2026-02-17T20:02:35.929 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-17T20:02:35.947 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T20:02:36.030 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/jcollin-2026-02-17_12:20:44-fs-wip-jcollin-testing-20260217.030412-squid-distro-default-trial/52816 branch: wip-jcollin-testing-20260217.030412-squid description: fs/upgrade/nofs/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} kernel no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn pg_health} tasks/{0-from/quincy 1-upgrade}} email: jcollin@redhat.com first_in_suite: false flavor: default job_id: '52816' kernel: sha1: distro last_in_suite: false machine_type: trial meta: - desc: 'install ceph/quincy latest ' name: jcollin-2026-02-17_12:20:44-fs-wip-jcollin-testing-20260217.030412-squid-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-jcollin-testing-20260217.030412-squid ceph: cluster-conf: mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: bluestore warn on legacy statfs: false bluestore warn on no per pool omap: false mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on osd down out interval zero: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - is offline because no MDS - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - MGR_MODULE_ERROR - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - pg .* is stuck inactive - pg .* is .*degraded - pg .* is stuck peering - scrub mismatch - ScrubResult - wrongly marked - \(POOL_APP_NOT_ENABLED\) - \(SLOW_OPS\) - overall HEALTH_ - \(MON_MSGR2_NOT_ENABLED\) - slow request sha1: 0a9403ad6667fb8ffa43f11d9a5d3062d3558d8e ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 0a9403ad6667fb8ffa43f11d9a5d3062d3558d8e selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-jcollin-testing-20260217.030412-squid sha1: 0a9403ad6667fb8ffa43f11d9a5d3062d3558d8e owner: scheduled_jcollin@soko04.front.sepia.ceph.com priority: 200 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 seed: 1479 sha1: 0a9403ad6667fb8ffa43f11d9a5d3062d3558d8e sleep_before_teardown: 0 subset: 316/2048 suite: fs suite_branch: wip-jcollin-testing-20260217.030412-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_0a9403ad6667fb8ffa43f11d9a5d3062d3558d8e/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 0a9403ad6667fb8ffa43f11d9a5d3062d3558d8e targets: trial123.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI0pWupezf+2JG5aiAB7PrpFQrZhs1T3enlrY/Z1rlFeAeobozJ0N/rbAR6WBUEEbrHBo+jrqNxXm3YDtZ910Ko= tasks: - install: branch: quincy exclude_packages: - librados3 - ceph-mgr-dashboard - ceph-mgr-diskprediction-local - ceph-mgr-rook - ceph-mgr-cephadm - cephadm - ceph-volume extra_packages: - librados2 - print: '**** done installing quincy' - ceph: conf: global: mon warn on pool no app: false ms bind msgr2: false log-ignorelist: - overall HEALTH_ - \(FS_ - \(MDS_ - \(OSD_ - \(MON_DOWN\) - \(CACHE_POOL_ - \(POOL_ - \(MGR_DOWN\) - \(PG_ - \(SMALLER_PGP_NUM\) - Monitor daemon marked osd - Behind on trimming - Manager daemon - exec: osd.0: - ceph osd set-require-min-compat-client quincy - print: '**** done ceph' - print: '*** upgrading, no cephfs present' - exec: mon.a: - ceph fs dump - install.upgrade: mon.a: null - print: '**** done install.upgrade' - ceph.restart: daemons: - mon.* - mgr.* mon-health-to-clog: false wait-for-healthy: false - ceph.healthy: null - ceph.restart: daemons: - osd.* wait-for-healthy: false wait-for-osds-up: true - exec: mon.a: - ceph versions - ceph osd dump -f json-pretty - ceph fs dump - ceph osd require-osd-release squid - for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done - ceph.healthy: null - print: '**** done ceph.restart' teuthology: fragments_dropped: [] meta: {} postmerge: - "local branch = yaml.kernel.branch\nif branch and not yaml.kernel.branch:find\ \ \"-all$\" then\n log.debug(\"removing default kernel specification: %s\", yaml.kernel)\n\ \ py_attrgetter(yaml.kernel).pop('branch', nil)\n py_attrgetter(yaml.kernel).pop('deb',\ \ nil)\n py_attrgetter(yaml.kernel).pop('flavor', nil)\n py_attrgetter(yaml.kernel).pop('kdb',\ \ nil)\n py_attrgetter(yaml.kernel).pop('koji', nil)\n py_attrgetter(yaml.kernel).pop('koji_task',\ \ nil)\n py_attrgetter(yaml.kernel).pop('rpm', nil)\n py_attrgetter(yaml.kernel).pop('sha1',\ \ nil)\n py_attrgetter(yaml.kernel).pop('tag', nil)\nend\n" teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-17_12:20:44 tube: trial user: jcollin verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682 2026-02-17T20:02:36.030 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_0a9403ad6667fb8ffa43f11d9a5d3062d3558d8e/qa; will attempt to use it 2026-02-17T20:02:36.031 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_0a9403ad6667fb8ffa43f11d9a5d3062d3558d8e/qa/tasks 2026-02-17T20:02:36.031 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-17T20:02:36.032 INFO:teuthology.task.internal:Checking packages... 2026-02-17T20:02:36.032 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '0a9403ad6667fb8ffa43f11d9a5d3062d3558d8e' 2026-02-17T20:02:36.032 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-17T20:02:36.032 INFO:teuthology.packaging:ref: None 2026-02-17T20:02:36.032 INFO:teuthology.packaging:tag: None 2026-02-17T20:02:36.032 INFO:teuthology.packaging:branch: wip-jcollin-testing-20260217.030412-squid 2026-02-17T20:02:36.032 INFO:teuthology.packaging:sha1: 0a9403ad6667fb8ffa43f11d9a5d3062d3558d8e 2026-02-17T20:02:36.032 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-jcollin-testing-20260217.030412-squid 2026-02-17T20:02:36.155 INFO:teuthology.task.internal:Found packages for ceph version 19.2.3-694.g0a9403ad 2026-02-17T20:02:36.156 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-17T20:02:36.166 INFO:teuthology.task.internal:no buildpackages task found 2026-02-17T20:02:36.166 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-17T20:02:36.179 INFO:teuthology.task.internal:Saving configuration 2026-02-17T20:02:36.187 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-17T20:02:36.197 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-17T20:02:36.252 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial123.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/jcollin-2026-02-17_12:20:44-fs-wip-jcollin-testing-20260217.030412-squid-distro-default-trial/52816', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 19:59:12.658470', 'locked_by': 'scheduled_jcollin@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI0pWupezf+2JG5aiAB7PrpFQrZhs1T3enlrY/Z1rlFeAeobozJ0N/rbAR6WBUEEbrHBo+jrqNxXm3YDtZ910Ko='} 2026-02-17T20:02:36.252 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-17T20:02:36.263 INFO:teuthology.task.internal:roles: ubuntu@trial123.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2026-02-17T20:02:36.263 INFO:teuthology.run_tasks:Running task console_log... 2026-02-17T20:02:36.334 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7a8f10e313a0>, signals=[15]) 2026-02-17T20:02:36.334 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-17T20:02:36.347 INFO:teuthology.task.internal:Opening connections... 2026-02-17T20:02:36.347 DEBUG:teuthology.task.internal:connecting to ubuntu@trial123.front.sepia.ceph.com 2026-02-17T20:02:36.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T20:02:36.408 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-17T20:02:36.419 DEBUG:teuthology.orchestra.run.trial123:> uname -m 2026-02-17T20:02:36.486 INFO:teuthology.orchestra.run.trial123.stdout:x86_64 2026-02-17T20:02:36.487 DEBUG:teuthology.orchestra.run.trial123:> cat /etc/os-release 2026-02-17T20:02:36.542 INFO:teuthology.orchestra.run.trial123.stdout:NAME="CentOS Stream" 2026-02-17T20:02:36.542 INFO:teuthology.orchestra.run.trial123.stdout:VERSION="9" 2026-02-17T20:02:36.542 INFO:teuthology.orchestra.run.trial123.stdout:ID="centos" 2026-02-17T20:02:36.542 INFO:teuthology.orchestra.run.trial123.stdout:ID_LIKE="rhel fedora" 2026-02-17T20:02:36.542 INFO:teuthology.orchestra.run.trial123.stdout:VERSION_ID="9" 2026-02-17T20:02:36.542 INFO:teuthology.orchestra.run.trial123.stdout:PLATFORM_ID="platform:el9" 2026-02-17T20:02:36.542 INFO:teuthology.orchestra.run.trial123.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T20:02:36.542 INFO:teuthology.orchestra.run.trial123.stdout:ANSI_COLOR="0;31" 2026-02-17T20:02:36.542 INFO:teuthology.orchestra.run.trial123.stdout:LOGO="fedora-logo-icon" 2026-02-17T20:02:36.542 INFO:teuthology.orchestra.run.trial123.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T20:02:36.542 INFO:teuthology.orchestra.run.trial123.stdout:HOME_URL="https://centos.org/" 2026-02-17T20:02:36.542 INFO:teuthology.orchestra.run.trial123.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T20:02:36.542 INFO:teuthology.orchestra.run.trial123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T20:02:36.542 INFO:teuthology.orchestra.run.trial123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T20:02:36.543 INFO:teuthology.lock.ops:Updating trial123.front.sepia.ceph.com on lock server 2026-02-17T20:02:36.600 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-17T20:02:36.612 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-17T20:02:36.623 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-17T20:02:36.623 DEBUG:teuthology.orchestra.run.trial123:> test '!' -e /home/ubuntu/cephtest 2026-02-17T20:02:36.637 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-17T20:02:36.648 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-17T20:02:36.648 DEBUG:teuthology.orchestra.run.trial123:> test -z $(ls -A /var/lib/ceph) 2026-02-17T20:02:36.694 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-17T20:02:36.760 INFO:teuthology.run_tasks:Running task kernel... 2026-02-17T20:02:36.779 INFO:teuthology.task.kernel:normalize config orig: {'sha1': 'distro'} 2026-02-17T20:02:36.779 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro'}}, timeout 300 2026-02-17T20:02:36.779 DEBUG:teuthology.orchestra.run.trial123:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T20:02:36.794 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T20:02:36.794 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-17T20:02:36.849 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-17T20:02:36.849 INFO:teuthology.task.kernel:Running kernel on trial123: 5.14.0-645.el9.x86_64 2026-02-17T20:02:36.849 DEBUG:teuthology.orchestra.run.trial123:> sudo yum install -y kernel 2026-02-17T20:02:38.254 INFO:teuthology.orchestra.run.trial123.stdout:CentOS Stream 9 - BaseOS 8.6 MB/s | 8.9 MB 00:01 2026-02-17T20:02:42.085 INFO:teuthology.orchestra.run.trial123.stdout:CentOS Stream 9 - AppStream 8.1 MB/s | 27 MB 00:03 2026-02-17T20:02:46.229 INFO:teuthology.orchestra.run.trial123.stdout:CentOS Stream 9 - CRB 4.4 MB/s | 7.8 MB 00:01 2026-02-17T20:02:47.176 INFO:teuthology.orchestra.run.trial123.stdout:CentOS Stream 9 - Extras packages 91 kB/s | 20 kB 00:00 2026-02-17T20:02:47.426 INFO:teuthology.orchestra.run.trial123.stdout:Extra Packages for Enterprise Linux 108 MB/s | 20 MB 00:00 2026-02-17T20:02:50.565 INFO:teuthology.orchestra.run.trial123.stdout:lab-extras 2.8 MB/s | 50 kB 00:00 2026-02-17T20:02:51.576 INFO:teuthology.orchestra.run.trial123.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-17T20:02:51.598 INFO:teuthology.orchestra.run.trial123.stdout:Dependencies resolved. 2026-02-17T20:02:51.599 INFO:teuthology.orchestra.run.trial123.stdout:================================================================================ 2026-02-17T20:02:51.599 INFO:teuthology.orchestra.run.trial123.stdout: Package Architecture Version Repository Size 2026-02-17T20:02:51.600 INFO:teuthology.orchestra.run.trial123.stdout:================================================================================ 2026-02-17T20:02:51.600 INFO:teuthology.orchestra.run.trial123.stdout:Installing: 2026-02-17T20:02:51.600 INFO:teuthology.orchestra.run.trial123.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-17T20:02:51.600 INFO:teuthology.orchestra.run.trial123.stdout:Installing dependencies: 2026-02-17T20:02:51.600 INFO:teuthology.orchestra.run.trial123.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-17T20:02:51.600 INFO:teuthology.orchestra.run.trial123.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-17T20:02:51.600 INFO:teuthology.orchestra.run.trial123.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-17T20:02:51.600 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:02:51.600 INFO:teuthology.orchestra.run.trial123.stdout:Transaction Summary 2026-02-17T20:02:51.600 INFO:teuthology.orchestra.run.trial123.stdout:================================================================================ 2026-02-17T20:02:51.601 INFO:teuthology.orchestra.run.trial123.stdout:Install 4 Packages 2026-02-17T20:02:51.601 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:02:51.601 INFO:teuthology.orchestra.run.trial123.stdout:Total download size: 88 M 2026-02-17T20:02:51.601 INFO:teuthology.orchestra.run.trial123.stdout:Installed size: 135 M 2026-02-17T20:02:51.601 INFO:teuthology.orchestra.run.trial123.stdout:Downloading Packages: 2026-02-17T20:02:53.400 INFO:teuthology.orchestra.run.trial123.stdout:(1/4): kernel-5.14.0-681.el9.x86_64.rpm 537 kB/s | 803 kB 00:01 2026-02-17T20:03:08.271 INFO:teuthology.orchestra.run.trial123.stdout:(2/4): kernel-modules-core-5.14.0-681.el9.x86_6 2.1 MB/s | 31 MB 00:14 2026-02-17T20:03:12.069 INFO:teuthology.orchestra.run.trial123.stdout:(3/4): kernel-core-5.14.0-681.el9.x86_64.rpm 868 kB/s | 17 MB 00:20 2026-02-17T20:03:38.171 INFO:teuthology.orchestra.run.trial123.stdout:(4/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 876 kB/s | 40 MB 00:46 2026-02-17T20:03:38.173 INFO:teuthology.orchestra.run.trial123.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:03:38.173 INFO:teuthology.orchestra.run.trial123.stdout:Total 1.9 MB/s | 88 MB 00:46 2026-02-17T20:03:38.363 INFO:teuthology.orchestra.run.trial123.stdout:Running transaction check 2026-02-17T20:03:38.567 INFO:teuthology.orchestra.run.trial123.stdout:Transaction check succeeded. 2026-02-17T20:03:38.567 INFO:teuthology.orchestra.run.trial123.stdout:Running transaction test 2026-02-17T20:03:38.913 INFO:teuthology.orchestra.run.trial123.stdout:Transaction test succeeded. 2026-02-17T20:03:38.913 INFO:teuthology.orchestra.run.trial123.stdout:Running transaction 2026-02-17T20:03:39.996 INFO:teuthology.orchestra.run.trial123.stdout: Preparing : 1/1 2026-02-17T20:03:40.278 INFO:teuthology.orchestra.run.trial123.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-17T20:03:40.297 INFO:teuthology.orchestra.run.trial123.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T20:03:42.084 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T20:03:42.112 INFO:teuthology.orchestra.run.trial123.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T20:03:45.137 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T20:03:45.143 INFO:teuthology.orchestra.run.trial123.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T20:03:48.176 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T20:04:18.515 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T20:04:18.536 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-17T20:04:18.599 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T20:04:18.600 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-17T20:04:18.600 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T20:04:18.600 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T20:04:18.653 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T20:04:18.653 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:04:18.653 INFO:teuthology.orchestra.run.trial123.stdout:Installed: 2026-02-17T20:04:18.653 INFO:teuthology.orchestra.run.trial123.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-17T20:04:18.653 INFO:teuthology.orchestra.run.trial123.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-17T20:04:18.653 INFO:teuthology.orchestra.run.trial123.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-17T20:04:18.653 INFO:teuthology.orchestra.run.trial123.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-17T20:04:18.653 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:04:18.653 INFO:teuthology.orchestra.run.trial123.stdout:Complete! 2026-02-17T20:04:18.711 DEBUG:teuthology.orchestra.run.trial123:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T20:04:18.736 INFO:teuthology.orchestra.run.trial123.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T20:04:18.736 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T20:04:18.737 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-17T20:04:18.737 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T20:04:18.737 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T20:04:18.737 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-17T20:04:18.737 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial123.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T20:04:18.737 DEBUG:teuthology.orchestra.run.trial123:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T20:04:18.800 INFO:teuthology.orchestra.run.trial123.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T20:04:18.800 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T20:04:18.801 DEBUG:teuthology.orchestra.run.trial123:> sudo rpm -qi grub2-tools 2026-02-17T20:04:18.870 INFO:teuthology.orchestra.run.trial123.stdout:Name : grub2-tools 2026-02-17T20:04:18.870 INFO:teuthology.orchestra.run.trial123.stdout:Epoch : 1 2026-02-17T20:04:18.870 INFO:teuthology.orchestra.run.trial123.stdout:Version : 2.06 2026-02-17T20:04:18.871 INFO:teuthology.orchestra.run.trial123.stdout:Release : 118.el9 2026-02-17T20:04:18.871 INFO:teuthology.orchestra.run.trial123.stdout:Architecture: x86_64 2026-02-17T20:04:18.871 INFO:teuthology.orchestra.run.trial123.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-17T20:04:18.871 INFO:teuthology.orchestra.run.trial123.stdout:Group : Unspecified 2026-02-17T20:04:18.871 INFO:teuthology.orchestra.run.trial123.stdout:Size : 8393909 2026-02-17T20:04:18.871 INFO:teuthology.orchestra.run.trial123.stdout:License : GPLv3+ 2026-02-17T20:04:18.871 INFO:teuthology.orchestra.run.trial123.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-17T20:04:18.871 INFO:teuthology.orchestra.run.trial123.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-17T20:04:18.871 INFO:teuthology.orchestra.run.trial123.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-17T20:04:18.871 INFO:teuthology.orchestra.run.trial123.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-17T20:04:18.872 INFO:teuthology.orchestra.run.trial123.stdout:Packager : builder@centos.org 2026-02-17T20:04:18.872 INFO:teuthology.orchestra.run.trial123.stdout:Vendor : CentOS 2026-02-17T20:04:18.872 INFO:teuthology.orchestra.run.trial123.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-17T20:04:18.872 INFO:teuthology.orchestra.run.trial123.stdout:Summary : Support tools for GRUB. 2026-02-17T20:04:18.872 INFO:teuthology.orchestra.run.trial123.stdout:Description : 2026-02-17T20:04:18.872 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:04:18.872 INFO:teuthology.orchestra.run.trial123.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-17T20:04:18.872 INFO:teuthology.orchestra.run.trial123.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-17T20:04:18.872 INFO:teuthology.orchestra.run.trial123.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-17T20:04:18.872 INFO:teuthology.orchestra.run.trial123.stdout:hardware devices. 2026-02-17T20:04:18.872 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:04:18.872 INFO:teuthology.orchestra.run.trial123.stdout:This subpackage provides tools for support of all platforms. 2026-02-17T20:04:18.874 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-17T20:04:18.874 INFO:teuthology.task.kernel:Updating grub on trial123 to boot 5.14.0-681.el9.x86_64 2026-02-17T20:04:18.874 DEBUG:teuthology.orchestra.run.trial123:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-17T20:04:18.937 INFO:teuthology.orchestra.run.trial123.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T20:04:18.938 DEBUG:teuthology.orchestra.run.trial123:> sudo command -v grubby && echo yes || echo no 2026-02-17T20:04:19.002 INFO:teuthology.orchestra.run.trial123.stdout:/sbin/grubby 2026-02-17T20:04:19.004 INFO:teuthology.orchestra.run.trial123.stdout:yes 2026-02-17T20:04:19.004 DEBUG:teuthology.orchestra.run.trial123:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-17T20:04:19.069 INFO:teuthology.orchestra.run.trial123.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T20:04:19.070 DEBUG:teuthology.orchestra.run.trial123:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-17T20:04:19.143 DEBUG:teuthology.orchestra.run.trial123:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-17T20:04:19.352 INFO:teuthology.orchestra.run.trial123.stderr:Generating grub configuration file ... 2026-02-17T20:04:19.414 INFO:teuthology.orchestra.run.trial123.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-17T20:04:19.421 INFO:teuthology.orchestra.run.trial123.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-17T20:04:19.671 INFO:teuthology.orchestra.run.trial123.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-17T20:04:19.677 INFO:teuthology.orchestra.run.trial123.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-17T20:04:19.709 INFO:teuthology.orchestra.run.trial123.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-17T20:04:19.716 INFO:teuthology.orchestra.run.trial123.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-17T20:04:19.740 INFO:teuthology.orchestra.run.trial123.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-17T20:04:19.746 INFO:teuthology.orchestra.run.trial123.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-17T20:04:19.828 INFO:teuthology.orchestra.run.trial123.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T20:04:19.836 INFO:teuthology.orchestra.run.trial123.stderr:done 2026-02-17T20:04:19.838 DEBUG:teuthology.orchestra.run.trial123:> test -d /sys/firmware/efi 2026-02-17T20:04:19.853 DEBUG:teuthology.orchestra.run.trial123:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-17T20:04:19.917 INFO:teuthology.orchestra.run.trial123.stdout:/boot/efi/EFI/BOOT 2026-02-17T20:04:19.917 INFO:teuthology.orchestra.run.trial123.stdout:/boot/efi/EFI/centos 2026-02-17T20:04:19.919 DEBUG:teuthology.orchestra.run.trial123:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-17T20:04:19.983 INFO:teuthology.orchestra.run.trial123.stdout:no 2026-02-17T20:04:19.983 DEBUG:teuthology.orchestra.run.trial123:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-17T20:04:20.047 INFO:teuthology.orchestra.run.trial123.stdout:yes 2026-02-17T20:04:20.048 DEBUG:teuthology.orchestra.run.trial123:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-17T20:04:20.113 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial123 2026-02-17T20:04:20.113 DEBUG:teuthology.orchestra.run.trial123:> sudo bash -c ' 2026-02-17T20:04:20.114 DEBUG:teuthology.orchestra.run.trial123:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-17T20:04:20.114 DEBUG:teuthology.orchestra.run.trial123:> ' 2026-02-17T20:04:50.156 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-17T20:04:50.157 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-17T20:04:50.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T20:05:50.220 DEBUG:teuthology.orchestra.remote:timed out 2026-02-17T20:05:59.229 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-17T20:05:59.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T20:05:59.361 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-17T20:05:59.507 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-17T20:05:59.508 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-681.el9.x86_64"... 2026-02-17T20:05:59.508 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-17T20:05:59.564 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-681.el9.x86_64 2026-02-17T20:05:59.564 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-17T20:05:59.564 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T20:05:59.564 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-17T20:06:00.565 DEBUG:teuthology.parallel:result is None 2026-02-17T20:06:00.565 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-17T20:06:00.576 INFO:teuthology.task.internal:Creating test directory... 2026-02-17T20:06:00.577 DEBUG:teuthology.orchestra.run.trial123:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T20:06:00.594 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-17T20:06:00.608 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-17T20:06:00.619 INFO:teuthology.task.internal:Creating archive directory... 2026-02-17T20:06:00.619 DEBUG:teuthology.orchestra.run.trial123:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T20:06:00.656 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-17T20:06:00.668 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-17T20:06:00.668 DEBUG:teuthology.orchestra.run.trial123:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T20:06:00.720 INFO:teuthology.orchestra.run.trial123.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T20:06:00.729 INFO:teuthology.orchestra.run.trial123.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T20:06:00.730 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-17T20:06:00.742 INFO:teuthology.task.internal:Configuring sudo... 2026-02-17T20:06:00.742 DEBUG:teuthology.orchestra.run.trial123:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T20:06:00.795 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-17T20:06:00.811 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-17T20:06:00.812 DEBUG:teuthology.orchestra.run.trial123:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T20:06:00.851 DEBUG:teuthology.orchestra.run.trial123:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T20:06:01.011 DEBUG:teuthology.orchestra.run.trial123:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T20:06:01.036 DEBUG:teuthology.orchestra.run.trial123:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T20:06:01.185 DEBUG:teuthology.orchestra.run.trial123:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T20:06:01.210 DEBUG:teuthology.orchestra.run.trial123:> set -ex 2026-02-17T20:06:01.210 DEBUG:teuthology.orchestra.run.trial123:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T20:06:01.274 DEBUG:teuthology.orchestra.run.trial123:> sudo service rsyslog restart 2026-02-17T20:06:01.343 INFO:teuthology.orchestra.run.trial123.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T20:06:01.680 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-17T20:06:01.693 INFO:teuthology.task.internal:Starting timer... 2026-02-17T20:06:01.693 INFO:teuthology.run_tasks:Running task pcp... 2026-02-17T20:06:01.714 INFO:teuthology.run_tasks:Running task selinux... 2026-02-17T20:06:01.731 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2026-02-17T20:06:01.732 DEBUG:teuthology.orchestra.run.trial123:> sudo service auditd rotate 2026-02-17T20:06:01.761 INFO:teuthology.orchestra.run.trial123.stdout:Rotating logs: 2026-02-17T20:06:01.763 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-17T20:06:01.763 DEBUG:teuthology.orchestra.run.trial123:> /usr/sbin/getenforce 2026-02-17T20:06:01.819 INFO:teuthology.orchestra.run.trial123.stdout:Permissive 2026-02-17T20:06:01.819 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial123.front.sepia.ceph.com': 'permissive'} 2026-02-17T20:06:01.819 DEBUG:teuthology.orchestra.run.trial123:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T20:06:01.882 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T20:06:01.883 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-17T20:06:01.883 DEBUG:teuthology.orchestra.run.trial123:> sudo /usr/sbin/setenforce permissive 2026-02-17T20:06:01.946 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-17T20:06:01.961 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2026-02-17T20:06:01.964 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2026-02-17T20:06:02.077 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-17T20:06:02.089 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-17T20:06:02.091 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial123.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-17T20:07:08.331 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial123.front.sepia.ceph.com')] 2026-02-17T20:07:08.333 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-17T20:07:08.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T20:07:08.441 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-17T20:07:08.516 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-17T20:07:08.517 INFO:teuthology.run_tasks:Running task clock... 2026-02-17T20:07:08.526 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-17T20:07:08.526 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T20:07:08.527 DEBUG:teuthology.orchestra.run.trial123:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T20:07:08.582 INFO:teuthology.orchestra.run.trial123.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-17T20:07:08.594 INFO:teuthology.orchestra.run.trial123.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-17T20:07:08.615 INFO:teuthology.orchestra.run.trial123.stderr:sudo: ntpd: command not found 2026-02-17T20:07:08.625 INFO:teuthology.orchestra.run.trial123.stdout:506 Cannot talk to daemon 2026-02-17T20:07:08.637 INFO:teuthology.orchestra.run.trial123.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-17T20:07:08.650 INFO:teuthology.orchestra.run.trial123.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-17T20:07:08.697 INFO:teuthology.orchestra.run.trial123.stderr:bash: line 1: ntpq: command not found 2026-02-17T20:07:08.740 INFO:teuthology.orchestra.run.trial123.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T20:07:08.740 INFO:teuthology.orchestra.run.trial123.stdout:=============================================================================== 2026-02-17T20:07:08.740 INFO:teuthology.orchestra.run.trial123.stdout:^? sensei.ruselabs.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T20:07:08.740 INFO:teuthology.orchestra.run.trial123.stdout:^? 198-12-95-197-host.coloc> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T20:07:08.740 INFO:teuthology.orchestra.run.trial123.stdout:^? triangle.kansas.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T20:07:08.740 INFO:teuthology.orchestra.run.trial123.stdout:^? 172-104-28-175.ip.linode> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T20:07:08.742 INFO:teuthology.run_tasks:Running task install... 2026-02-17T20:07:08.756 DEBUG:teuthology.task.install:project ceph 2026-02-17T20:07:08.756 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '0a9403ad6667fb8ffa43f11d9a5d3062d3558d8e'}} 2026-02-17T20:07:08.756 DEBUG:teuthology.task.install:config {'branch': 'quincy', 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-volume'], 'extra_packages': ['librados2'], 'flavor': 'default', 'sha1': '0a9403ad6667fb8ffa43f11d9a5d3062d3558d8e'} 2026-02-17T20:07:08.756 INFO:teuthology.task.install:Using flavor: default 2026-02-17T20:07:08.765 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-17T20:07:08.765 INFO:teuthology.task.install:extra packages: ['librados2'] 2026-02-17T20:07:08.766 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-volume'], 'extra_packages': ['librados2'], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0a9403ad6667fb8ffa43f11d9a5d3062d3558d8e', 'tag': None, 'wait_for_package': False} 2026-02-17T20:07:08.766 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-17T20:07:08.766 INFO:teuthology.packaging:ref: None 2026-02-17T20:07:08.767 INFO:teuthology.packaging:tag: None 2026-02-17T20:07:08.767 INFO:teuthology.packaging:branch: quincy 2026-02-17T20:07:08.767 INFO:teuthology.packaging:sha1: 0a9403ad6667fb8ffa43f11d9a5d3062d3558d8e 2026-02-17T20:07:08.767 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2026-02-17T20:07:08.940 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/quincy/69bf48f20731a4b0d742613f6c6335ccb54dd217/centos/9/flavors/default/ 2026-02-17T20:07:08.941 INFO:teuthology.task.install.rpm:Package version is 17.2.9-0 2026-02-17T20:07:09.092 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/quincy/69bf48f20731a4b0d742613f6c6335ccb54dd217/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/quincy/69bf48f20731a4b0d742613f6c6335ccb54dd217/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/quincy/69bf48f20731a4b0d742613f6c6335ccb54dd217/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-17T20:07:09.093 DEBUG:teuthology.orchestra.run.trial123:> set -ex 2026-02-17T20:07:09.093 DEBUG:teuthology.orchestra.run.trial123:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-17T20:07:09.119 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-immutable-object-cache, ceph-mgr, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, librados2 on remote rpm x86_64 2026-02-17T20:07:09.120 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-17T20:07:09.120 INFO:teuthology.packaging:ref: None 2026-02-17T20:07:09.120 INFO:teuthology.packaging:tag: None 2026-02-17T20:07:09.120 INFO:teuthology.packaging:branch: quincy 2026-02-17T20:07:09.120 INFO:teuthology.packaging:sha1: 0a9403ad6667fb8ffa43f11d9a5d3062d3558d8e 2026-02-17T20:07:09.120 DEBUG:teuthology.orchestra.run.trial123:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-17T20:07:09.183 DEBUG:teuthology.orchestra.run.trial123:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-17T20:07:09.256 DEBUG:teuthology.orchestra.run.trial123:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-17T20:07:09.320 INFO:teuthology.orchestra.run.trial123.stdout:check_obsoletes = 1 2026-02-17T20:07:09.321 DEBUG:teuthology.orchestra.run.trial123:> sudo yum clean all 2026-02-17T20:07:09.472 INFO:teuthology.orchestra.run.trial123.stdout:41 files removed 2026-02-17T20:07:09.488 DEBUG:teuthology.orchestra.run.trial123:> sudo yum -y install ceph-radosgw 2026-02-17T20:07:09.749 INFO:teuthology.orchestra.run.trial123.stdout:ceph packages for x86_64 662 kB/s | 77 kB 00:00 2026-02-17T20:07:09.857 INFO:teuthology.orchestra.run.trial123.stdout:ceph noarch packages 127 kB/s | 11 kB 00:00 2026-02-17T20:07:09.956 INFO:teuthology.orchestra.run.trial123.stdout:ceph source packages 27 kB/s | 2.1 kB 00:00 2026-02-17T20:07:10.765 INFO:teuthology.orchestra.run.trial123.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.9 MB 00:00 2026-02-17T20:07:16.896 INFO:teuthology.orchestra.run.trial123.stdout:CentOS Stream 9 - AppStream 4.8 MB/s | 27 MB 00:05 2026-02-17T20:07:23.714 INFO:teuthology.orchestra.run.trial123.stdout:CentOS Stream 9 - CRB 1.8 MB/s | 7.8 MB 00:04 2026-02-17T20:07:25.301 INFO:teuthology.orchestra.run.trial123.stdout:CentOS Stream 9 - Extras packages 23 kB/s | 20 kB 00:00 2026-02-17T20:07:26.136 INFO:teuthology.orchestra.run.trial123.stdout:Extra Packages for Enterprise Linux 26 MB/s | 20 MB 00:00 2026-02-17T20:07:29.332 INFO:teuthology.orchestra.run.trial123.stdout:lab-extras 2.4 MB/s | 50 kB 00:00 2026-02-17T20:07:30.555 INFO:teuthology.orchestra.run.trial123.stdout:Dependencies resolved. 2026-02-17T20:07:30.556 INFO:teuthology.orchestra.run.trial123.stdout:================================================================================ 2026-02-17T20:07:30.556 INFO:teuthology.orchestra.run.trial123.stdout: Package Arch Version Repository Size 2026-02-17T20:07:30.556 INFO:teuthology.orchestra.run.trial123.stdout:================================================================================ 2026-02-17T20:07:30.556 INFO:teuthology.orchestra.run.trial123.stdout:Installing: 2026-02-17T20:07:30.557 INFO:teuthology.orchestra.run.trial123.stdout: ceph-radosgw x86_64 2:17.2.9-0.el9 ceph 14 M 2026-02-17T20:07:30.557 INFO:teuthology.orchestra.run.trial123.stdout:Upgrading: 2026-02-17T20:07:30.557 INFO:teuthology.orchestra.run.trial123.stdout: librados2 x86_64 2:17.2.9-0.el9 ceph 3.1 M 2026-02-17T20:07:30.557 INFO:teuthology.orchestra.run.trial123.stdout: librbd1 x86_64 2:17.2.9-0.el9 ceph 2.9 M 2026-02-17T20:07:30.557 INFO:teuthology.orchestra.run.trial123.stdout:Installing dependencies: 2026-02-17T20:07:30.557 INFO:teuthology.orchestra.run.trial123.stdout: ceph-base x86_64 2:17.2.9-0.el9 ceph 5.0 M 2026-02-17T20:07:30.557 INFO:teuthology.orchestra.run.trial123.stdout: ceph-common x86_64 2:17.2.9-0.el9 ceph 22 M 2026-02-17T20:07:30.557 INFO:teuthology.orchestra.run.trial123.stdout: ceph-selinux x86_64 2:17.2.9-0.el9 ceph 25 k 2026-02-17T20:07:30.557 INFO:teuthology.orchestra.run.trial123.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-17T20:07:30.557 INFO:teuthology.orchestra.run.trial123.stdout: libcephfs2 x86_64 2:17.2.9-0.el9 ceph 637 k 2026-02-17T20:07:30.557 INFO:teuthology.orchestra.run.trial123.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-17T20:07:30.557 INFO:teuthology.orchestra.run.trial123.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-17T20:07:30.557 INFO:teuthology.orchestra.run.trial123.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-17T20:07:30.557 INFO:teuthology.orchestra.run.trial123.stdout: libradosstriper1 x86_64 2:17.2.9-0.el9 ceph 457 k 2026-02-17T20:07:30.557 INFO:teuthology.orchestra.run.trial123.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-17T20:07:30.557 INFO:teuthology.orchestra.run.trial123.stdout: librgw2 x86_64 2:17.2.9-0.el9 ceph 4.9 M 2026-02-17T20:07:30.557 INFO:teuthology.orchestra.run.trial123.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-17T20:07:30.557 INFO:teuthology.orchestra.run.trial123.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-17T20:07:30.557 INFO:teuthology.orchestra.run.trial123.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-17T20:07:30.557 INFO:teuthology.orchestra.run.trial123.stdout: python3-ceph-argparse x86_64 2:17.2.9-0.el9 ceph 45 k 2026-02-17T20:07:30.557 INFO:teuthology.orchestra.run.trial123.stdout: python3-ceph-common x86_64 2:17.2.9-0.el9 ceph 120 k 2026-02-17T20:07:30.557 INFO:teuthology.orchestra.run.trial123.stdout: python3-cephfs x86_64 2:17.2.9-0.el9 ceph 157 k 2026-02-17T20:07:30.558 INFO:teuthology.orchestra.run.trial123.stdout: python3-rados x86_64 2:17.2.9-0.el9 ceph 320 k 2026-02-17T20:07:30.558 INFO:teuthology.orchestra.run.trial123.stdout: python3-rbd x86_64 2:17.2.9-0.el9 ceph 296 k 2026-02-17T20:07:30.558 INFO:teuthology.orchestra.run.trial123.stdout: python3-rgw x86_64 2:17.2.9-0.el9 ceph 100 k 2026-02-17T20:07:30.558 INFO:teuthology.orchestra.run.trial123.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-17T20:07:30.558 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:07:30.558 INFO:teuthology.orchestra.run.trial123.stdout:Transaction Summary 2026-02-17T20:07:30.558 INFO:teuthology.orchestra.run.trial123.stdout:================================================================================ 2026-02-17T20:07:30.558 INFO:teuthology.orchestra.run.trial123.stdout:Install 22 Packages 2026-02-17T20:07:30.558 INFO:teuthology.orchestra.run.trial123.stdout:Upgrade 2 Packages 2026-02-17T20:07:30.558 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:07:30.559 INFO:teuthology.orchestra.run.trial123.stdout:Total download size: 58 M 2026-02-17T20:07:30.559 INFO:teuthology.orchestra.run.trial123.stdout:Downloading Packages: 2026-02-17T20:07:31.006 INFO:teuthology.orchestra.run.trial123.stdout:(1/24): ceph-base-17.2.9-0.el9.x86_64.rpm 37 MB/s | 5.0 MB 00:00 2026-02-17T20:07:31.015 INFO:teuthology.orchestra.run.trial123.stdout:(2/24): ceph-selinux-17.2.9-0.el9.x86_64.rpm 2.6 MB/s | 25 kB 00:00 2026-02-17T20:07:31.027 INFO:teuthology.orchestra.run.trial123.stdout:(3/24): libcephfs2-17.2.9-0.el9.x86_64.rpm 51 MB/s | 637 kB 00:00 2026-02-17T20:07:31.050 INFO:teuthology.orchestra.run.trial123.stdout:(4/24): ceph-radosgw-17.2.9-0.el9.x86_64.rpm 80 MB/s | 14 MB 00:00 2026-02-17T20:07:31.052 INFO:teuthology.orchestra.run.trial123.stdout:(5/24): libradosstriper1-17.2.9-0.el9.x86_64.rp 18 MB/s | 457 kB 00:00 2026-02-17T20:07:31.065 INFO:teuthology.orchestra.run.trial123.stdout:(6/24): python3-ceph-argparse-17.2.9-0.el9.x86_ 3.2 MB/s | 45 kB 00:00 2026-02-17T20:07:31.079 INFO:teuthology.orchestra.run.trial123.stdout:(7/24): librgw2-17.2.9-0.el9.x86_64.rpm 167 MB/s | 4.9 MB 00:00 2026-02-17T20:07:31.080 INFO:teuthology.orchestra.run.trial123.stdout:(8/24): python3-ceph-common-17.2.9-0.el9.x86_64 8.1 MB/s | 120 kB 00:00 2026-02-17T20:07:31.090 INFO:teuthology.orchestra.run.trial123.stdout:(9/24): python3-cephfs-17.2.9-0.el9.x86_64.rpm 15 MB/s | 157 kB 00:00 2026-02-17T20:07:31.091 INFO:teuthology.orchestra.run.trial123.stdout:(10/24): python3-rados-17.2.9-0.el9.x86_64.rpm 29 MB/s | 320 kB 00:00 2026-02-17T20:07:31.100 INFO:teuthology.orchestra.run.trial123.stdout:(11/24): python3-rbd-17.2.9-0.el9.x86_64.rpm 29 MB/s | 296 kB 00:00 2026-02-17T20:07:31.100 INFO:teuthology.orchestra.run.trial123.stdout:(12/24): python3-rgw-17.2.9-0.el9.x86_64.rpm 10 MB/s | 100 kB 00:00 2026-02-17T20:07:31.150 INFO:teuthology.orchestra.run.trial123.stdout:(13/24): ceph-common-17.2.9-0.el9.x86_64.rpm 81 MB/s | 22 MB 00:00 2026-02-17T20:07:31.154 INFO:teuthology.orchestra.run.trial123.stdout:(14/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.0 MB/s | 160 kB 00:00 2026-02-17T20:07:31.166 INFO:teuthology.orchestra.run.trial123.stdout:(15/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 2.7 MB/s | 45 kB 00:00 2026-02-17T20:07:31.176 INFO:teuthology.orchestra.run.trial123.stdout:(16/24): librdkafka-1.6.1-102.el9.x86_64.rpm 28 MB/s | 662 kB 00:00 2026-02-17T20:07:31.179 INFO:teuthology.orchestra.run.trial123.stdout:(17/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 22 MB/s | 292 kB 00:00 2026-02-17T20:07:31.192 INFO:teuthology.orchestra.run.trial123.stdout:(18/24): mailcap-2.1.49-5.el9.noarch.rpm 361 kB/s | 33 kB 00:00 2026-02-17T20:07:31.315 INFO:teuthology.orchestra.run.trial123.stdout:(19/24): liboath-2.6.12-1.el9.x86_64.rpm 361 kB/s | 49 kB 00:00 2026-02-17T20:07:31.328 INFO:teuthology.orchestra.run.trial123.stdout:(20/24): libunwind-1.6.2-1.el9.x86_64.rpm 495 kB/s | 67 kB 00:00 2026-02-17T20:07:31.354 INFO:teuthology.orchestra.run.trial123.stdout:(21/24): librados2-17.2.9-0.el9.x86_64.rpm 118 MB/s | 3.1 MB 00:00 2026-02-17T20:07:31.377 INFO:teuthology.orchestra.run.trial123.stdout:(22/24): librbd1-17.2.9-0.el9.x86_64.rpm 128 MB/s | 2.9 MB 00:00 2026-02-17T20:07:31.378 INFO:teuthology.orchestra.run.trial123.stdout:(23/24): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.5 MB/s | 308 kB 00:00 2026-02-17T20:07:31.440 INFO:teuthology.orchestra.run.trial123.stdout:(24/24): thrift-0.15.0-4.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2026-02-17T20:07:31.443 INFO:teuthology.orchestra.run.trial123.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:07:31.443 INFO:teuthology.orchestra.run.trial123.stdout:Total 66 MB/s | 58 MB 00:00 2026-02-17T20:07:31.486 INFO:teuthology.orchestra.run.trial123.stdout:Running transaction check 2026-02-17T20:07:31.501 INFO:teuthology.orchestra.run.trial123.stdout:Transaction check succeeded. 2026-02-17T20:07:31.501 INFO:teuthology.orchestra.run.trial123.stdout:Running transaction test 2026-02-17T20:07:31.731 INFO:teuthology.orchestra.run.trial123.stdout:Transaction test succeeded. 2026-02-17T20:07:31.731 INFO:teuthology.orchestra.run.trial123.stdout:Running transaction 2026-02-17T20:07:31.994 INFO:teuthology.orchestra.run.trial123.stdout: Preparing : 1/1 2026-02-17T20:07:32.130 INFO:teuthology.orchestra.run.trial123.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2026-02-17T20:07:32.133 INFO:teuthology.orchestra.run.trial123.stdout: Upgrading : librados2-2:17.2.9-0.el9.x86_64 2/26 2026-02-17T20:07:32.163 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: librados2-2:17.2.9-0.el9.x86_64 2/26 2026-02-17T20:07:32.190 INFO:teuthology.orchestra.run.trial123.stdout: Installing : python3-rados-2:17.2.9-0.el9.x86_64 3/26 2026-02-17T20:07:32.191 INFO:teuthology.orchestra.run.trial123.stdout: Installing : libcephfs2-2:17.2.9-0.el9.x86_64 4/26 2026-02-17T20:07:32.213 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: libcephfs2-2:17.2.9-0.el9.x86_64 4/26 2026-02-17T20:07:32.221 INFO:teuthology.orchestra.run.trial123.stdout: Installing : thrift-0.15.0-4.el9.x86_64 5/26 2026-02-17T20:07:32.223 INFO:teuthology.orchestra.run.trial123.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2026-02-17T20:07:32.431 INFO:teuthology.orchestra.run.trial123.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2026-02-17T20:07:32.432 INFO:teuthology.orchestra.run.trial123.stdout: Installing : librgw2-2:17.2.9-0.el9.x86_64 8/26 2026-02-17T20:07:32.443 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: librgw2-2:17.2.9-0.el9.x86_64 8/26 2026-02-17T20:07:32.447 INFO:teuthology.orchestra.run.trial123.stdout: Installing : liboath-2.6.12-1.el9.x86_64 9/26 2026-02-17T20:07:32.456 INFO:teuthology.orchestra.run.trial123.stdout: Installing : python3-ceph-argparse-2:17.2.9-0.el9.x86_64 10/26 2026-02-17T20:07:32.462 INFO:teuthology.orchestra.run.trial123.stdout: Installing : python3-cephfs-2:17.2.9-0.el9.x86_64 11/26 2026-02-17T20:07:32.482 INFO:teuthology.orchestra.run.trial123.stdout: Installing : python3-rgw-2:17.2.9-0.el9.x86_64 12/26 2026-02-17T20:07:32.483 INFO:teuthology.orchestra.run.trial123.stdout: Installing : libradosstriper1-2:17.2.9-0.el9.x86_64 13/26 2026-02-17T20:07:32.495 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: libradosstriper1-2:17.2.9-0.el9.x86_64 13/26 2026-02-17T20:07:32.501 INFO:teuthology.orchestra.run.trial123.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2026-02-17T20:07:32.505 INFO:teuthology.orchestra.run.trial123.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/26 2026-02-17T20:07:32.637 INFO:teuthology.orchestra.run.trial123.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 16/26 2026-02-17T20:07:32.638 INFO:teuthology.orchestra.run.trial123.stdout: Upgrading : librbd1-2:17.2.9-0.el9.x86_64 17/26 2026-02-17T20:07:32.661 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: librbd1-2:17.2.9-0.el9.x86_64 17/26 2026-02-17T20:07:32.664 INFO:teuthology.orchestra.run.trial123.stdout: Installing : python3-rbd-2:17.2.9-0.el9.x86_64 18/26 2026-02-17T20:07:32.686 INFO:teuthology.orchestra.run.trial123.stdout: Installing : mailcap-2.1.49-5.el9.noarch 19/26 2026-02-17T20:07:32.687 INFO:teuthology.orchestra.run.trial123.stdout: Installing : python3-ceph-common-2:17.2.9-0.el9.x86_64 20/26 2026-02-17T20:07:33.690 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: ceph-common-2:17.2.9-0.el9.x86_64 21/26 2026-02-17T20:07:33.692 INFO:teuthology.orchestra.run.trial123.stdout: Installing : ceph-common-2:17.2.9-0.el9.x86_64 21/26 2026-02-17T20:07:33.951 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: ceph-common-2:17.2.9-0.el9.x86_64 21/26 2026-02-17T20:07:33.954 INFO:teuthology.orchestra.run.trial123.stdout: Installing : ceph-base-2:17.2.9-0.el9.x86_64 22/26 2026-02-17T20:07:33.994 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: ceph-base-2:17.2.9-0.el9.x86_64 22/26 2026-02-17T20:07:33.994 INFO:teuthology.orchestra.run.trial123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-17T20:07:33.994 INFO:teuthology.orchestra.run.trial123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-17T20:07:33.994 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:07:33.997 INFO:teuthology.orchestra.run.trial123.stdout: Installing : ceph-selinux-2:17.2.9-0.el9.x86_64 23/26 2026-02-17T20:07:38.511 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: ceph-selinux-2:17.2.9-0.el9.x86_64 23/26 2026-02-17T20:07:38.511 INFO:teuthology.orchestra.run.trial123.stdout:skipping the directory /sys 2026-02-17T20:07:38.511 INFO:teuthology.orchestra.run.trial123.stdout:skipping the directory /proc 2026-02-17T20:07:38.511 INFO:teuthology.orchestra.run.trial123.stdout:skipping the directory /mnt 2026-02-17T20:07:38.511 INFO:teuthology.orchestra.run.trial123.stdout:skipping the directory /var/tmp 2026-02-17T20:07:38.511 INFO:teuthology.orchestra.run.trial123.stdout:skipping the directory /home 2026-02-17T20:07:38.512 INFO:teuthology.orchestra.run.trial123.stdout:skipping the directory /root 2026-02-17T20:07:38.512 INFO:teuthology.orchestra.run.trial123.stdout:skipping the directory /tmp 2026-02-17T20:07:38.512 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:07:39.116 INFO:teuthology.orchestra.run.trial123.stdout: Installing : ceph-radosgw-2:17.2.9-0.el9.x86_64 24/26 2026-02-17T20:07:39.146 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: ceph-radosgw-2:17.2.9-0.el9.x86_64 24/26 2026-02-17T20:07:39.146 INFO:teuthology.orchestra.run.trial123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:07:39.146 INFO:teuthology.orchestra.run.trial123.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-17T20:07:39.146 INFO:teuthology.orchestra.run.trial123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T20:07:39.146 INFO:teuthology.orchestra.run.trial123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T20:07:39.146 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:07:39.148 INFO:teuthology.orchestra.run.trial123.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2026-02-17T20:07:39.161 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2026-02-17T20:07:39.161 INFO:teuthology.orchestra.run.trial123.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2026-02-17T20:07:39.465 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2026-02-17T20:07:39.465 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : ceph-base-2:17.2.9-0.el9.x86_64 1/26 2026-02-17T20:07:39.465 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : ceph-common-2:17.2.9-0.el9.x86_64 2/26 2026-02-17T20:07:39.466 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : ceph-radosgw-2:17.2.9-0.el9.x86_64 3/26 2026-02-17T20:07:39.466 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : ceph-selinux-2:17.2.9-0.el9.x86_64 4/26 2026-02-17T20:07:39.466 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : libcephfs2-2:17.2.9-0.el9.x86_64 5/26 2026-02-17T20:07:39.466 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : libradosstriper1-2:17.2.9-0.el9.x86_64 6/26 2026-02-17T20:07:39.466 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : librgw2-2:17.2.9-0.el9.x86_64 7/26 2026-02-17T20:07:39.466 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : python3-ceph-argparse-2:17.2.9-0.el9.x86_64 8/26 2026-02-17T20:07:39.466 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : python3-ceph-common-2:17.2.9-0.el9.x86_64 9/26 2026-02-17T20:07:39.466 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : python3-cephfs-2:17.2.9-0.el9.x86_64 10/26 2026-02-17T20:07:39.466 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : python3-rados-2:17.2.9-0.el9.x86_64 11/26 2026-02-17T20:07:39.466 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : python3-rbd-2:17.2.9-0.el9.x86_64 12/26 2026-02-17T20:07:39.466 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : python3-rgw-2:17.2.9-0.el9.x86_64 13/26 2026-02-17T20:07:39.466 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/26 2026-02-17T20:07:39.466 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/26 2026-02-17T20:07:39.466 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/26 2026-02-17T20:07:39.466 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/26 2026-02-17T20:07:39.466 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/26 2026-02-17T20:07:39.466 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 19/26 2026-02-17T20:07:39.466 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 20/26 2026-02-17T20:07:39.466 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2026-02-17T20:07:39.466 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 22/26 2026-02-17T20:07:39.466 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : librados2-2:17.2.9-0.el9.x86_64 23/26 2026-02-17T20:07:39.466 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2026-02-17T20:07:39.466 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : librbd1-2:17.2.9-0.el9.x86_64 25/26 2026-02-17T20:07:39.523 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2026-02-17T20:07:39.523 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:07:39.524 INFO:teuthology.orchestra.run.trial123.stdout:Upgraded: 2026-02-17T20:07:39.524 INFO:teuthology.orchestra.run.trial123.stdout: librados2-2:17.2.9-0.el9.x86_64 librbd1-2:17.2.9-0.el9.x86_64 2026-02-17T20:07:39.524 INFO:teuthology.orchestra.run.trial123.stdout:Installed: 2026-02-17T20:07:39.524 INFO:teuthology.orchestra.run.trial123.stdout: ceph-base-2:17.2.9-0.el9.x86_64 2026-02-17T20:07:39.524 INFO:teuthology.orchestra.run.trial123.stdout: ceph-common-2:17.2.9-0.el9.x86_64 2026-02-17T20:07:39.524 INFO:teuthology.orchestra.run.trial123.stdout: ceph-radosgw-2:17.2.9-0.el9.x86_64 2026-02-17T20:07:39.524 INFO:teuthology.orchestra.run.trial123.stdout: ceph-selinux-2:17.2.9-0.el9.x86_64 2026-02-17T20:07:39.524 INFO:teuthology.orchestra.run.trial123.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-17T20:07:39.524 INFO:teuthology.orchestra.run.trial123.stdout: libcephfs2-2:17.2.9-0.el9.x86_64 2026-02-17T20:07:39.524 INFO:teuthology.orchestra.run.trial123.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-17T20:07:39.524 INFO:teuthology.orchestra.run.trial123.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-17T20:07:39.524 INFO:teuthology.orchestra.run.trial123.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-17T20:07:39.524 INFO:teuthology.orchestra.run.trial123.stdout: libradosstriper1-2:17.2.9-0.el9.x86_64 2026-02-17T20:07:39.524 INFO:teuthology.orchestra.run.trial123.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-17T20:07:39.524 INFO:teuthology.orchestra.run.trial123.stdout: librgw2-2:17.2.9-0.el9.x86_64 2026-02-17T20:07:39.524 INFO:teuthology.orchestra.run.trial123.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-17T20:07:39.524 INFO:teuthology.orchestra.run.trial123.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-17T20:07:39.524 INFO:teuthology.orchestra.run.trial123.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-17T20:07:39.524 INFO:teuthology.orchestra.run.trial123.stdout: python3-ceph-argparse-2:17.2.9-0.el9.x86_64 2026-02-17T20:07:39.524 INFO:teuthology.orchestra.run.trial123.stdout: python3-ceph-common-2:17.2.9-0.el9.x86_64 2026-02-17T20:07:39.524 INFO:teuthology.orchestra.run.trial123.stdout: python3-cephfs-2:17.2.9-0.el9.x86_64 2026-02-17T20:07:39.524 INFO:teuthology.orchestra.run.trial123.stdout: python3-rados-2:17.2.9-0.el9.x86_64 2026-02-17T20:07:39.524 INFO:teuthology.orchestra.run.trial123.stdout: python3-rbd-2:17.2.9-0.el9.x86_64 2026-02-17T20:07:39.524 INFO:teuthology.orchestra.run.trial123.stdout: python3-rgw-2:17.2.9-0.el9.x86_64 2026-02-17T20:07:39.524 INFO:teuthology.orchestra.run.trial123.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-17T20:07:39.524 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:07:39.524 INFO:teuthology.orchestra.run.trial123.stdout:Complete! 2026-02-17T20:07:39.563 DEBUG:teuthology.orchestra.run.trial123:> sudo yum -y install ceph-test 2026-02-17T20:07:39.868 INFO:teuthology.orchestra.run.trial123.stdout:Last metadata expiration check: 0:00:10 ago on Tue 17 Feb 2026 08:07:29 PM UTC. 2026-02-17T20:07:39.948 INFO:teuthology.orchestra.run.trial123.stdout:Dependencies resolved. 2026-02-17T20:07:39.948 INFO:teuthology.orchestra.run.trial123.stdout:================================================================================ 2026-02-17T20:07:39.948 INFO:teuthology.orchestra.run.trial123.stdout: Package Architecture Version Repository Size 2026-02-17T20:07:39.948 INFO:teuthology.orchestra.run.trial123.stdout:================================================================================ 2026-02-17T20:07:39.948 INFO:teuthology.orchestra.run.trial123.stdout:Installing: 2026-02-17T20:07:39.948 INFO:teuthology.orchestra.run.trial123.stdout: ceph-test x86_64 2:17.2.9-0.el9 ceph 48 M 2026-02-17T20:07:39.948 INFO:teuthology.orchestra.run.trial123.stdout:Installing dependencies: 2026-02-17T20:07:39.948 INFO:teuthology.orchestra.run.trial123.stdout: libcephsqlite x86_64 2:17.2.9-0.el9 ceph 163 k 2026-02-17T20:07:39.948 INFO:teuthology.orchestra.run.trial123.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-17T20:07:39.948 INFO:teuthology.orchestra.run.trial123.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-17T20:07:39.948 INFO:teuthology.orchestra.run.trial123.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-17T20:07:39.948 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:07:39.948 INFO:teuthology.orchestra.run.trial123.stdout:Transaction Summary 2026-02-17T20:07:39.948 INFO:teuthology.orchestra.run.trial123.stdout:================================================================================ 2026-02-17T20:07:39.948 INFO:teuthology.orchestra.run.trial123.stdout:Install 5 Packages 2026-02-17T20:07:39.948 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:07:39.949 INFO:teuthology.orchestra.run.trial123.stdout:Total download size: 49 M 2026-02-17T20:07:39.949 INFO:teuthology.orchestra.run.trial123.stdout:Installed size: 194 M 2026-02-17T20:07:39.949 INFO:teuthology.orchestra.run.trial123.stdout:Downloading Packages: 2026-02-17T20:07:40.140 INFO:teuthology.orchestra.run.trial123.stdout:(1/5): libcephsqlite-17.2.9-0.el9.x86_64.rpm 1.5 MB/s | 163 kB 00:00 2026-02-17T20:07:40.456 INFO:teuthology.orchestra.run.trial123.stdout:(2/5): ceph-test-17.2.9-0.el9.x86_64.rpm 114 MB/s | 48 MB 00:00 2026-02-17T20:07:40.798 INFO:teuthology.orchestra.run.trial123.stdout:(3/5): libxslt-1.1.34-12.el9.x86_64.rpm 306 kB/s | 233 kB 00:00 2026-02-17T20:07:40.951 INFO:teuthology.orchestra.run.trial123.stdout:(4/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 129 kB/s | 64 kB 00:00 2026-02-17T20:07:41.017 INFO:teuthology.orchestra.run.trial123.stdout:(5/5): socat-1.7.4.1-8.el9.x86_64.rpm 346 kB/s | 303 kB 00:00 2026-02-17T20:07:41.020 INFO:teuthology.orchestra.run.trial123.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:07:41.021 INFO:teuthology.orchestra.run.trial123.stdout:Total 45 MB/s | 49 MB 00:01 2026-02-17T20:07:41.043 INFO:teuthology.orchestra.run.trial123.stdout:Running transaction check 2026-02-17T20:07:41.052 INFO:teuthology.orchestra.run.trial123.stdout:Transaction check succeeded. 2026-02-17T20:07:41.052 INFO:teuthology.orchestra.run.trial123.stdout:Running transaction test 2026-02-17T20:07:41.228 INFO:teuthology.orchestra.run.trial123.stdout:Transaction test succeeded. 2026-02-17T20:07:41.229 INFO:teuthology.orchestra.run.trial123.stdout:Running transaction 2026-02-17T20:07:41.432 INFO:teuthology.orchestra.run.trial123.stdout: Preparing : 1/1 2026-02-17T20:07:41.437 INFO:teuthology.orchestra.run.trial123.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-17T20:07:41.441 INFO:teuthology.orchestra.run.trial123.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-17T20:07:41.449 INFO:teuthology.orchestra.run.trial123.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-17T20:07:41.450 INFO:teuthology.orchestra.run.trial123.stdout: Installing : libcephsqlite-2:17.2.9-0.el9.x86_64 4/5 2026-02-17T20:07:43.584 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: libcephsqlite-2:17.2.9-0.el9.x86_64 4/5 2026-02-17T20:07:43.602 INFO:teuthology.orchestra.run.trial123.stdout: Installing : ceph-test-2:17.2.9-0.el9.x86_64 5/5 2026-02-17T20:07:43.813 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: ceph-test-2:17.2.9-0.el9.x86_64 5/5 2026-02-17T20:07:43.813 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : ceph-test-2:17.2.9-0.el9.x86_64 1/5 2026-02-17T20:07:43.813 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : libcephsqlite-2:17.2.9-0.el9.x86_64 2/5 2026-02-17T20:07:43.813 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-17T20:07:43.813 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-17T20:07:43.867 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-17T20:07:43.867 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:07:43.867 INFO:teuthology.orchestra.run.trial123.stdout:Installed: 2026-02-17T20:07:43.868 INFO:teuthology.orchestra.run.trial123.stdout: ceph-test-2:17.2.9-0.el9.x86_64 libcephsqlite-2:17.2.9-0.el9.x86_64 2026-02-17T20:07:43.868 INFO:teuthology.orchestra.run.trial123.stdout: libxslt-1.1.34-12.el9.x86_64 socat-1.7.4.1-8.el9.x86_64 2026-02-17T20:07:43.868 INFO:teuthology.orchestra.run.trial123.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-17T20:07:43.868 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:07:43.868 INFO:teuthology.orchestra.run.trial123.stdout:Complete! 2026-02-17T20:07:43.901 DEBUG:teuthology.orchestra.run.trial123:> sudo yum -y install ceph 2026-02-17T20:07:44.203 INFO:teuthology.orchestra.run.trial123.stdout:Last metadata expiration check: 0:00:15 ago on Tue 17 Feb 2026 08:07:29 PM UTC. 2026-02-17T20:07:44.286 INFO:teuthology.orchestra.run.trial123.stdout:Dependencies resolved. 2026-02-17T20:07:44.287 INFO:teuthology.orchestra.run.trial123.stdout:================================================================================ 2026-02-17T20:07:44.287 INFO:teuthology.orchestra.run.trial123.stdout: Package Arch Version Repository Size 2026-02-17T20:07:44.287 INFO:teuthology.orchestra.run.trial123.stdout:================================================================================ 2026-02-17T20:07:44.287 INFO:teuthology.orchestra.run.trial123.stdout:Installing: 2026-02-17T20:07:44.287 INFO:teuthology.orchestra.run.trial123.stdout: ceph x86_64 2:17.2.9-0.el9 ceph 6.4 k 2026-02-17T20:07:44.287 INFO:teuthology.orchestra.run.trial123.stdout:Installing dependencies: 2026-02-17T20:07:44.287 INFO:teuthology.orchestra.run.trial123.stdout: ceph-mds x86_64 2:17.2.9-0.el9 ceph 2.1 M 2026-02-17T20:07:44.288 INFO:teuthology.orchestra.run.trial123.stdout: ceph-mgr x86_64 2:17.2.9-0.el9 ceph 1.4 M 2026-02-17T20:07:44.288 INFO:teuthology.orchestra.run.trial123.stdout: ceph-mgr-modules-core noarch 2:17.2.9-0.el9 ceph-noarch 240 k 2026-02-17T20:07:44.288 INFO:teuthology.orchestra.run.trial123.stdout: ceph-mon x86_64 2:17.2.9-0.el9 ceph 3.9 M 2026-02-17T20:07:44.288 INFO:teuthology.orchestra.run.trial123.stdout: ceph-osd x86_64 2:17.2.9-0.el9 ceph 15 M 2026-02-17T20:07:44.288 INFO:teuthology.orchestra.run.trial123.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-17T20:07:44.288 INFO:teuthology.orchestra.run.trial123.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-17T20:07:44.288 INFO:teuthology.orchestra.run.trial123.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-17T20:07:44.288 INFO:teuthology.orchestra.run.trial123.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-17T20:07:44.288 INFO:teuthology.orchestra.run.trial123.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-17T20:07:44.288 INFO:teuthology.orchestra.run.trial123.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-17T20:07:44.288 INFO:teuthology.orchestra.run.trial123.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-17T20:07:44.288 INFO:teuthology.orchestra.run.trial123.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-17T20:07:44.289 INFO:teuthology.orchestra.run.trial123.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-17T20:07:44.289 INFO:teuthology.orchestra.run.trial123.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-17T20:07:44.289 INFO:teuthology.orchestra.run.trial123.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-17T20:07:44.289 INFO:teuthology.orchestra.run.trial123.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-17T20:07:44.289 INFO:teuthology.orchestra.run.trial123.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-17T20:07:44.289 INFO:teuthology.orchestra.run.trial123.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-17T20:07:44.289 INFO:teuthology.orchestra.run.trial123.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-17T20:07:44.289 INFO:teuthology.orchestra.run.trial123.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-17T20:07:44.289 INFO:teuthology.orchestra.run.trial123.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-17T20:07:44.289 INFO:teuthology.orchestra.run.trial123.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-17T20:07:44.289 INFO:teuthology.orchestra.run.trial123.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-17T20:07:44.289 INFO:teuthology.orchestra.run.trial123.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-17T20:07:44.290 INFO:teuthology.orchestra.run.trial123.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-17T20:07:44.290 INFO:teuthology.orchestra.run.trial123.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-17T20:07:44.290 INFO:teuthology.orchestra.run.trial123.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-17T20:07:44.290 INFO:teuthology.orchestra.run.trial123.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-17T20:07:44.290 INFO:teuthology.orchestra.run.trial123.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-17T20:07:44.290 INFO:teuthology.orchestra.run.trial123.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-17T20:07:44.290 INFO:teuthology.orchestra.run.trial123.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-17T20:07:44.290 INFO:teuthology.orchestra.run.trial123.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-17T20:07:44.290 INFO:teuthology.orchestra.run.trial123.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-17T20:07:44.290 INFO:teuthology.orchestra.run.trial123.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-17T20:07:44.290 INFO:teuthology.orchestra.run.trial123.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-17T20:07:44.290 INFO:teuthology.orchestra.run.trial123.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-17T20:07:44.291 INFO:teuthology.orchestra.run.trial123.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-17T20:07:44.291 INFO:teuthology.orchestra.run.trial123.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-17T20:07:44.291 INFO:teuthology.orchestra.run.trial123.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-17T20:07:44.291 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:07:44.291 INFO:teuthology.orchestra.run.trial123.stdout:Transaction Summary 2026-02-17T20:07:44.291 INFO:teuthology.orchestra.run.trial123.stdout:================================================================================ 2026-02-17T20:07:44.291 INFO:teuthology.orchestra.run.trial123.stdout:Install 41 Packages 2026-02-17T20:07:44.291 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:07:44.292 INFO:teuthology.orchestra.run.trial123.stdout:Total download size: 28 M 2026-02-17T20:07:44.292 INFO:teuthology.orchestra.run.trial123.stdout:Installed size: 99 M 2026-02-17T20:07:44.292 INFO:teuthology.orchestra.run.trial123.stdout:Downloading Packages: 2026-02-17T20:07:44.581 INFO:teuthology.orchestra.run.trial123.stdout:(1/41): ceph-17.2.9-0.el9.x86_64.rpm 176 kB/s | 6.4 kB 00:00 2026-02-17T20:07:44.631 INFO:teuthology.orchestra.run.trial123.stdout:(2/41): ceph-mgr-17.2.9-0.el9.x86_64.rpm 16 MB/s | 1.4 MB 00:00 2026-02-17T20:07:44.646 INFO:teuthology.orchestra.run.trial123.stdout:(3/41): ceph-mds-17.2.9-0.el9.x86_64.rpm 20 MB/s | 2.1 MB 00:00 2026-02-17T20:07:44.657 INFO:teuthology.orchestra.run.trial123.stdout:(4/41): ceph-mgr-modules-core-17.2.9-0.el9.noar 24 MB/s | 240 kB 00:00 2026-02-17T20:07:44.663 INFO:teuthology.orchestra.run.trial123.stdout:(5/41): ceph-mon-17.2.9-0.el9.x86_64.rpm 48 MB/s | 3.9 MB 00:00 2026-02-17T20:07:44.729 INFO:teuthology.orchestra.run.trial123.stdout:(6/41): ceph-osd-17.2.9-0.el9.x86_64.rpm 157 MB/s | 15 MB 00:00 2026-02-17T20:07:45.215 INFO:teuthology.orchestra.run.trial123.stdout:(7/41): ledmon-libs-1.1.0-3.el9.x86_64.rpm 72 kB/s | 40 kB 00:00 2026-02-17T20:07:45.372 INFO:teuthology.orchestra.run.trial123.stdout:(8/41): libconfig-1.7.2-9.el9.x86_64.rpm 102 kB/s | 72 kB 00:00 2026-02-17T20:07:45.596 INFO:teuthology.orchestra.run.trial123.stdout:(9/41): python3-cffi-1.14.5-5.el9.x86_64.rpm 292 kB/s | 253 kB 00:00 2026-02-17T20:07:45.833 INFO:teuthology.orchestra.run.trial123.stdout:(10/41): python3-pycparser-2.20-6.el9.noarch.rp 570 kB/s | 135 kB 00:00 2026-02-17T20:07:45.919 INFO:teuthology.orchestra.run.trial123.stdout:(11/41): python3-ply-3.11-14.el9.noarch.rpm 195 kB/s | 106 kB 00:00 2026-02-17T20:07:46.148 INFO:teuthology.orchestra.run.trial123.stdout:(12/41): python3-pyparsing-2.4.7-9.el9.noarch.r 478 kB/s | 150 kB 00:00 2026-02-17T20:07:46.389 INFO:teuthology.orchestra.run.trial123.stdout:(13/41): python3-requests-2.25.1-10.el9.noarch. 269 kB/s | 126 kB 00:00 2026-02-17T20:07:46.541 INFO:teuthology.orchestra.run.trial123.stdout:(14/41): python3-urllib3-1.26.5-7.el9.noarch.rp 555 kB/s | 218 kB 00:00 2026-02-17T20:07:46.544 INFO:teuthology.orchestra.run.trial123.stdout:(15/41): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 1.6 MB/s | 246 kB 00:00 2026-02-17T20:07:46.581 INFO:teuthology.orchestra.run.trial123.stdout:(16/41): python3-mako-1.1.4-6.el9.noarch.rpm 4.6 MB/s | 172 kB 00:00 2026-02-17T20:07:46.607 INFO:teuthology.orchestra.run.trial123.stdout:(17/41): python3-markupsafe-1.1.1-12.el9.x86_64 1.3 MB/s | 35 kB 00:00 2026-02-17T20:07:46.637 INFO:teuthology.orchestra.run.trial123.stdout:(18/41): python3-packaging-20.9-5.el9.noarch.rp 2.5 MB/s | 77 kB 00:00 2026-02-17T20:07:46.664 INFO:teuthology.orchestra.run.trial123.stdout:(19/41): python3-toml-0.10.2-6.el9.noarch.rpm 1.5 MB/s | 42 kB 00:00 2026-02-17T20:07:46.684 INFO:teuthology.orchestra.run.trial123.stdout:(20/41): python3-libstoragemgmt-1.10.1-1.el9.x8 1.2 MB/s | 177 kB 00:00 2026-02-17T20:07:46.757 INFO:teuthology.orchestra.run.trial123.stdout:(21/41): python3-autocommand-2.2.2-8.el9.noarch 319 kB/s | 29 kB 00:00 2026-02-17T20:07:46.775 INFO:teuthology.orchestra.run.trial123.stdout:(22/41): python3-backports-tarfile-1.2.0-1.el9. 662 kB/s | 60 kB 00:00 2026-02-17T20:07:46.778 INFO:teuthology.orchestra.run.trial123.stdout:(23/41): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 2.0 MB/s | 43 kB 00:00 2026-02-17T20:07:46.784 INFO:teuthology.orchestra.run.trial123.stdout:(24/41): python3-cryptography-36.0.1-5.el9.x86_ 813 kB/s | 1.2 MB 00:01 2026-02-17T20:07:46.818 INFO:teuthology.orchestra.run.trial123.stdout:(25/41): python3-cheroot-10.0.1-4.el9.noarch.rp 4.0 MB/s | 173 kB 00:00 2026-02-17T20:07:46.824 INFO:teuthology.orchestra.run.trial123.stdout:(26/41): python3-jaraco-8.2.1-3.el9.noarch.rpm 267 kB/s | 11 kB 00:00 2026-02-17T20:07:46.839 INFO:teuthology.orchestra.run.trial123.stdout:(27/41): python3-jaraco-classes-3.2.1-5.el9.noa 843 kB/s | 18 kB 00:00 2026-02-17T20:07:46.840 INFO:teuthology.orchestra.run.trial123.stdout:(28/41): python3-cherrypy-18.6.1-2.el9.noarch.r 5.7 MB/s | 358 kB 00:00 2026-02-17T20:07:46.860 INFO:teuthology.orchestra.run.trial123.stdout:(29/41): python3-jaraco-context-6.0.1-3.el9.noa 941 kB/s | 20 kB 00:00 2026-02-17T20:07:46.861 INFO:teuthology.orchestra.run.trial123.stdout:(30/41): python3-jaraco-functools-3.5.0-2.el9.n 930 kB/s | 19 kB 00:00 2026-02-17T20:07:46.864 INFO:teuthology.orchestra.run.trial123.stdout:(31/41): python3-jaraco-collections-3.0.0-8.el9 584 kB/s | 23 kB 00:00 2026-02-17T20:07:46.882 INFO:teuthology.orchestra.run.trial123.stdout:(32/41): python3-jaraco-text-4.0.0-2.el9.noarch 1.2 MB/s | 26 kB 00:00 2026-02-17T20:07:46.883 INFO:teuthology.orchestra.run.trial123.stdout:(33/41): python3-logutils-0.3.5-21.el9.noarch.r 2.1 MB/s | 46 kB 00:00 2026-02-17T20:07:46.904 INFO:teuthology.orchestra.run.trial123.stdout:(34/41): python3-portend-3.1.0-2.el9.noarch.rpm 773 kB/s | 16 kB 00:00 2026-02-17T20:07:46.904 INFO:teuthology.orchestra.run.trial123.stdout:(35/41): python3-more-itertools-8.12.0-2.el9.no 1.9 MB/s | 79 kB 00:00 2026-02-17T20:07:46.905 INFO:teuthology.orchestra.run.trial123.stdout:(36/41): python3-pecan-1.4.2-3.el9.noarch.rpm 12 MB/s | 272 kB 00:00 2026-02-17T20:07:46.926 INFO:teuthology.orchestra.run.trial123.stdout:(37/41): python3-tempora-5.0.0-2.el9.noarch.rpm 1.6 MB/s | 36 kB 00:00 2026-02-17T20:07:46.928 INFO:teuthology.orchestra.run.trial123.stdout:(38/41): python3-pyOpenSSL-21.0.0-1.el9.noarch. 3.7 MB/s | 90 kB 00:00 2026-02-17T20:07:46.931 INFO:teuthology.orchestra.run.trial123.stdout:(39/41): python3-webob-1.8.8-2.el9.noarch.rpm 9.0 MB/s | 230 kB 00:00 2026-02-17T20:07:46.950 INFO:teuthology.orchestra.run.trial123.stdout:(40/41): python3-zc-lockfile-2.0-10.el9.noarch. 888 kB/s | 20 kB 00:00 2026-02-17T20:07:46.987 INFO:teuthology.orchestra.run.trial123.stdout:(41/41): python3-werkzeug-2.0.3-3.el9.1.noarch. 6.8 MB/s | 427 kB 00:00 2026-02-17T20:07:46.989 INFO:teuthology.orchestra.run.trial123.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:07:46.989 INFO:teuthology.orchestra.run.trial123.stdout:Total 10 MB/s | 28 MB 00:02 2026-02-17T20:07:47.114 INFO:teuthology.orchestra.run.trial123.stdout:Running transaction check 2026-02-17T20:07:47.132 INFO:teuthology.orchestra.run.trial123.stdout:Transaction check succeeded. 2026-02-17T20:07:47.132 INFO:teuthology.orchestra.run.trial123.stdout:Running transaction test 2026-02-17T20:07:47.269 INFO:teuthology.orchestra.run.trial123.stdout:Transaction test succeeded. 2026-02-17T20:07:47.270 INFO:teuthology.orchestra.run.trial123.stdout:Running transaction 2026-02-17T20:07:47.427 INFO:teuthology.orchestra.run.trial123.stdout: Preparing : 1/1 2026-02-17T20:07:47.429 INFO:teuthology.orchestra.run.trial123.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/41 2026-02-17T20:07:47.431 INFO:teuthology.orchestra.run.trial123.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/41 2026-02-17T20:07:47.436 INFO:teuthology.orchestra.run.trial123.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 3/41 2026-02-17T20:07:47.441 INFO:teuthology.orchestra.run.trial123.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 4/41 2026-02-17T20:07:47.471 INFO:teuthology.orchestra.run.trial123.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 5/41 2026-02-17T20:07:47.493 INFO:teuthology.orchestra.run.trial123.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 6/41 2026-02-17T20:07:47.502 INFO:teuthology.orchestra.run.trial123.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 7/41 2026-02-17T20:07:47.508 INFO:teuthology.orchestra.run.trial123.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 8/41 2026-02-17T20:07:47.512 INFO:teuthology.orchestra.run.trial123.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 9/41 2026-02-17T20:07:47.518 INFO:teuthology.orchestra.run.trial123.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 10/41 2026-02-17T20:07:47.523 INFO:teuthology.orchestra.run.trial123.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 11/41 2026-02-17T20:07:47.526 INFO:teuthology.orchestra.run.trial123.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 12/41 2026-02-17T20:07:47.532 INFO:teuthology.orchestra.run.trial123.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 13/41 2026-02-17T20:07:47.536 INFO:teuthology.orchestra.run.trial123.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 14/41 2026-02-17T20:07:47.542 INFO:teuthology.orchestra.run.trial123.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 15/41 2026-02-17T20:07:47.546 INFO:teuthology.orchestra.run.trial123.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/41 2026-02-17T20:07:47.551 INFO:teuthology.orchestra.run.trial123.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/41 2026-02-17T20:07:47.575 INFO:teuthology.orchestra.run.trial123.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/41 2026-02-17T20:07:47.630 INFO:teuthology.orchestra.run.trial123.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 19/41 2026-02-17T20:07:47.654 INFO:teuthology.orchestra.run.trial123.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 20/41 2026-02-17T20:07:47.666 INFO:teuthology.orchestra.run.trial123.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 21/41 2026-02-17T20:07:47.671 INFO:teuthology.orchestra.run.trial123.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 22/41 2026-02-17T20:07:47.681 INFO:teuthology.orchestra.run.trial123.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 23/41 2026-02-17T20:07:47.688 INFO:teuthology.orchestra.run.trial123.stdout: Installing : python3-packaging-20.9-5.el9.noarch 24/41 2026-02-17T20:07:47.701 INFO:teuthology.orchestra.run.trial123.stdout: Installing : python3-ply-3.11-14.el9.noarch 25/41 2026-02-17T20:07:47.716 INFO:teuthology.orchestra.run.trial123.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 26/41 2026-02-17T20:07:47.791 INFO:teuthology.orchestra.run.trial123.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 27/41 2026-02-17T20:07:47.799 INFO:teuthology.orchestra.run.trial123.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 28/41 2026-02-17T20:07:47.823 INFO:teuthology.orchestra.run.trial123.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/41 2026-02-17T20:07:47.852 INFO:teuthology.orchestra.run.trial123.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 30/41 2026-02-17T20:07:47.857 INFO:teuthology.orchestra.run.trial123.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 31/41 2026-02-17T20:07:47.901 INFO:teuthology.orchestra.run.trial123.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 32/41 2026-02-17T20:07:47.964 INFO:teuthology.orchestra.run.trial123.stdout: Installing : ceph-mgr-modules-core-2:17.2.9-0.el9.noarch 33/41 2026-02-17T20:07:47.965 INFO:teuthology.orchestra.run.trial123.stdout: Installing : ceph-mgr-2:17.2.9-0.el9.x86_64 34/41 2026-02-17T20:07:47.988 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: ceph-mgr-2:17.2.9-0.el9.x86_64 34/41 2026-02-17T20:07:47.988 INFO:teuthology.orchestra.run.trial123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:07:47.988 INFO:teuthology.orchestra.run.trial123.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-17T20:07:47.988 INFO:teuthology.orchestra.run.trial123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T20:07:47.988 INFO:teuthology.orchestra.run.trial123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T20:07:47.988 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:07:47.993 INFO:teuthology.orchestra.run.trial123.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 35/41 2026-02-17T20:07:48.011 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 36/41 2026-02-17T20:07:48.011 INFO:teuthology.orchestra.run.trial123.stdout:Creating group 'libstoragemgmt' with GID 992. 2026-02-17T20:07:48.011 INFO:teuthology.orchestra.run.trial123.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 992 and GID 992. 2026-02-17T20:07:48.011 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:07:48.019 INFO:teuthology.orchestra.run.trial123.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 36/41 2026-02-17T20:07:48.043 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 36/41 2026-02-17T20:07:48.043 INFO:teuthology.orchestra.run.trial123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-17T20:07:48.043 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:07:48.689 INFO:teuthology.orchestra.run.trial123.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 37/41 2026-02-17T20:07:48.690 INFO:teuthology.orchestra.run.trial123.stdout: Installing : ceph-osd-2:17.2.9-0.el9.x86_64 38/41 2026-02-17T20:07:48.715 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: ceph-osd-2:17.2.9-0.el9.x86_64 38/41 2026-02-17T20:07:48.716 INFO:teuthology.orchestra.run.trial123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:07:48.716 INFO:teuthology.orchestra.run.trial123.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-17T20:07:48.716 INFO:teuthology.orchestra.run.trial123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T20:07:48.716 INFO:teuthology.orchestra.run.trial123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T20:07:48.716 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:07:48.883 INFO:teuthology.orchestra.run.trial123.stdout: Installing : ceph-mon-2:17.2.9-0.el9.x86_64 39/41 2026-02-17T20:07:48.904 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: ceph-mon-2:17.2.9-0.el9.x86_64 39/41 2026-02-17T20:07:48.904 INFO:teuthology.orchestra.run.trial123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:07:48.904 INFO:teuthology.orchestra.run.trial123.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-17T20:07:48.904 INFO:teuthology.orchestra.run.trial123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T20:07:48.904 INFO:teuthology.orchestra.run.trial123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T20:07:48.904 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:07:48.991 INFO:teuthology.orchestra.run.trial123.stdout: Installing : ceph-mds-2:17.2.9-0.el9.x86_64 40/41 2026-02-17T20:07:49.012 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: ceph-mds-2:17.2.9-0.el9.x86_64 40/41 2026-02-17T20:07:49.012 INFO:teuthology.orchestra.run.trial123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:07:49.012 INFO:teuthology.orchestra.run.trial123.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-17T20:07:49.012 INFO:teuthology.orchestra.run.trial123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T20:07:49.012 INFO:teuthology.orchestra.run.trial123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T20:07:49.012 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:07:49.028 INFO:teuthology.orchestra.run.trial123.stdout: Installing : ceph-2:17.2.9-0.el9.x86_64 41/41 2026-02-17T20:07:49.357 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: ceph-2:17.2.9-0.el9.x86_64 41/41 2026-02-17T20:07:49.357 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : ceph-2:17.2.9-0.el9.x86_64 1/41 2026-02-17T20:07:49.357 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : ceph-mds-2:17.2.9-0.el9.x86_64 2/41 2026-02-17T20:07:49.357 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : ceph-mgr-2:17.2.9-0.el9.x86_64 3/41 2026-02-17T20:07:49.357 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : ceph-mon-2:17.2.9-0.el9.x86_64 4/41 2026-02-17T20:07:49.357 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : ceph-osd-2:17.2.9-0.el9.x86_64 5/41 2026-02-17T20:07:49.357 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : ceph-mgr-modules-core-2:17.2.9-0.el9.noarch 6/41 2026-02-17T20:07:49.357 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 7/41 2026-02-17T20:07:49.358 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 8/41 2026-02-17T20:07:49.358 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 9/41 2026-02-17T20:07:49.358 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 10/41 2026-02-17T20:07:49.358 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : python3-ply-3.11-14.el9.noarch 11/41 2026-02-17T20:07:49.358 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 12/41 2026-02-17T20:07:49.358 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 13/41 2026-02-17T20:07:49.358 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 14/41 2026-02-17T20:07:49.358 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 15/41 2026-02-17T20:07:49.358 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 16/41 2026-02-17T20:07:49.358 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 17/41 2026-02-17T20:07:49.358 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 18/41 2026-02-17T20:07:49.358 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 19/41 2026-02-17T20:07:49.359 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 20/41 2026-02-17T20:07:49.359 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 21/41 2026-02-17T20:07:49.359 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 22/41 2026-02-17T20:07:49.359 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 23/41 2026-02-17T20:07:49.359 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 24/41 2026-02-17T20:07:49.359 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 25/41 2026-02-17T20:07:49.359 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 26/41 2026-02-17T20:07:49.359 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 27/41 2026-02-17T20:07:49.359 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 28/41 2026-02-17T20:07:49.359 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 29/41 2026-02-17T20:07:49.359 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 30/41 2026-02-17T20:07:49.359 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 31/41 2026-02-17T20:07:49.359 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 32/41 2026-02-17T20:07:49.360 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 33/41 2026-02-17T20:07:49.360 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 34/41 2026-02-17T20:07:49.360 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 35/41 2026-02-17T20:07:49.360 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 36/41 2026-02-17T20:07:49.360 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 37/41 2026-02-17T20:07:49.360 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 38/41 2026-02-17T20:07:49.360 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 39/41 2026-02-17T20:07:49.360 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 40/41 2026-02-17T20:07:49.411 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 41/41 2026-02-17T20:07:49.412 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:07:49.412 INFO:teuthology.orchestra.run.trial123.stdout:Installed: 2026-02-17T20:07:49.412 INFO:teuthology.orchestra.run.trial123.stdout: ceph-2:17.2.9-0.el9.x86_64 2026-02-17T20:07:49.412 INFO:teuthology.orchestra.run.trial123.stdout: ceph-mds-2:17.2.9-0.el9.x86_64 2026-02-17T20:07:49.412 INFO:teuthology.orchestra.run.trial123.stdout: ceph-mgr-2:17.2.9-0.el9.x86_64 2026-02-17T20:07:49.412 INFO:teuthology.orchestra.run.trial123.stdout: ceph-mgr-modules-core-2:17.2.9-0.el9.noarch 2026-02-17T20:07:49.412 INFO:teuthology.orchestra.run.trial123.stdout: ceph-mon-2:17.2.9-0.el9.x86_64 2026-02-17T20:07:49.412 INFO:teuthology.orchestra.run.trial123.stdout: ceph-osd-2:17.2.9-0.el9.x86_64 2026-02-17T20:07:49.412 INFO:teuthology.orchestra.run.trial123.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-17T20:07:49.412 INFO:teuthology.orchestra.run.trial123.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-17T20:07:49.412 INFO:teuthology.orchestra.run.trial123.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T20:07:49.413 INFO:teuthology.orchestra.run.trial123.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-17T20:07:49.413 INFO:teuthology.orchestra.run.trial123.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-17T20:07:49.413 INFO:teuthology.orchestra.run.trial123.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-17T20:07:49.413 INFO:teuthology.orchestra.run.trial123.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-17T20:07:49.413 INFO:teuthology.orchestra.run.trial123.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-17T20:07:49.413 INFO:teuthology.orchestra.run.trial123.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-17T20:07:49.413 INFO:teuthology.orchestra.run.trial123.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-17T20:07:49.413 INFO:teuthology.orchestra.run.trial123.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-17T20:07:49.413 INFO:teuthology.orchestra.run.trial123.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-17T20:07:49.413 INFO:teuthology.orchestra.run.trial123.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-17T20:07:49.413 INFO:teuthology.orchestra.run.trial123.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-17T20:07:49.413 INFO:teuthology.orchestra.run.trial123.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-17T20:07:49.414 INFO:teuthology.orchestra.run.trial123.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-17T20:07:49.414 INFO:teuthology.orchestra.run.trial123.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T20:07:49.414 INFO:teuthology.orchestra.run.trial123.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-17T20:07:49.414 INFO:teuthology.orchestra.run.trial123.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-17T20:07:49.414 INFO:teuthology.orchestra.run.trial123.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-17T20:07:49.414 INFO:teuthology.orchestra.run.trial123.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-17T20:07:49.414 INFO:teuthology.orchestra.run.trial123.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-17T20:07:49.414 INFO:teuthology.orchestra.run.trial123.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-17T20:07:49.414 INFO:teuthology.orchestra.run.trial123.stdout: python3-ply-3.11-14.el9.noarch 2026-02-17T20:07:49.414 INFO:teuthology.orchestra.run.trial123.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-17T20:07:49.414 INFO:teuthology.orchestra.run.trial123.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-17T20:07:49.414 INFO:teuthology.orchestra.run.trial123.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-17T20:07:49.415 INFO:teuthology.orchestra.run.trial123.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-17T20:07:49.415 INFO:teuthology.orchestra.run.trial123.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-17T20:07:49.415 INFO:teuthology.orchestra.run.trial123.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-17T20:07:49.415 INFO:teuthology.orchestra.run.trial123.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-17T20:07:49.415 INFO:teuthology.orchestra.run.trial123.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-17T20:07:49.415 INFO:teuthology.orchestra.run.trial123.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-17T20:07:49.415 INFO:teuthology.orchestra.run.trial123.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-17T20:07:49.415 INFO:teuthology.orchestra.run.trial123.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-17T20:07:49.415 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:07:49.415 INFO:teuthology.orchestra.run.trial123.stdout:Complete! 2026-02-17T20:07:49.447 DEBUG:teuthology.orchestra.run.trial123:> sudo yum -y install ceph-base 2026-02-17T20:07:49.758 INFO:teuthology.orchestra.run.trial123.stdout:Last metadata expiration check: 0:00:20 ago on Tue 17 Feb 2026 08:07:29 PM UTC. 2026-02-17T20:07:49.821 INFO:teuthology.orchestra.run.trial123.stdout:Package ceph-base-2:17.2.9-0.el9.x86_64 is already installed. 2026-02-17T20:07:49.839 INFO:teuthology.orchestra.run.trial123.stdout:Dependencies resolved. 2026-02-17T20:07:49.839 INFO:teuthology.orchestra.run.trial123.stdout:Nothing to do. 2026-02-17T20:07:49.839 INFO:teuthology.orchestra.run.trial123.stdout:Complete! 2026-02-17T20:07:49.861 DEBUG:teuthology.orchestra.run.trial123:> sudo yum -y install ceph-immutable-object-cache 2026-02-17T20:07:50.163 INFO:teuthology.orchestra.run.trial123.stdout:Last metadata expiration check: 0:00:21 ago on Tue 17 Feb 2026 08:07:29 PM UTC. 2026-02-17T20:07:50.244 INFO:teuthology.orchestra.run.trial123.stdout:Dependencies resolved. 2026-02-17T20:07:50.245 INFO:teuthology.orchestra.run.trial123.stdout:================================================================================ 2026-02-17T20:07:50.245 INFO:teuthology.orchestra.run.trial123.stdout: Package Arch Version Repo Size 2026-02-17T20:07:50.245 INFO:teuthology.orchestra.run.trial123.stdout:================================================================================ 2026-02-17T20:07:50.245 INFO:teuthology.orchestra.run.trial123.stdout:Installing: 2026-02-17T20:07:50.245 INFO:teuthology.orchestra.run.trial123.stdout: ceph-immutable-object-cache x86_64 2:17.2.9-0.el9 ceph 137 k 2026-02-17T20:07:50.245 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:07:50.245 INFO:teuthology.orchestra.run.trial123.stdout:Transaction Summary 2026-02-17T20:07:50.245 INFO:teuthology.orchestra.run.trial123.stdout:================================================================================ 2026-02-17T20:07:50.245 INFO:teuthology.orchestra.run.trial123.stdout:Install 1 Package 2026-02-17T20:07:50.245 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:07:50.245 INFO:teuthology.orchestra.run.trial123.stdout:Total download size: 137 k 2026-02-17T20:07:50.245 INFO:teuthology.orchestra.run.trial123.stdout:Installed size: 379 k 2026-02-17T20:07:50.245 INFO:teuthology.orchestra.run.trial123.stdout:Downloading Packages: 2026-02-17T20:07:50.305 INFO:teuthology.orchestra.run.trial123.stdout:ceph-immutable-object-cache-17.2.9-0.el9.x86_64 2.3 MB/s | 137 kB 00:00 2026-02-17T20:07:50.306 INFO:teuthology.orchestra.run.trial123.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:07:50.306 INFO:teuthology.orchestra.run.trial123.stdout:Total 2.2 MB/s | 137 kB 00:00 2026-02-17T20:07:50.306 INFO:teuthology.orchestra.run.trial123.stdout:Running transaction check 2026-02-17T20:07:50.310 INFO:teuthology.orchestra.run.trial123.stdout:Transaction check succeeded. 2026-02-17T20:07:50.310 INFO:teuthology.orchestra.run.trial123.stdout:Running transaction test 2026-02-17T20:07:50.335 INFO:teuthology.orchestra.run.trial123.stdout:Transaction test succeeded. 2026-02-17T20:07:50.335 INFO:teuthology.orchestra.run.trial123.stdout:Running transaction 2026-02-17T20:07:50.383 INFO:teuthology.orchestra.run.trial123.stdout: Preparing : 1/1 2026-02-17T20:07:50.384 INFO:teuthology.orchestra.run.trial123.stdout: Installing : ceph-immutable-object-cache-2:17.2.9-0.el9.x86_64 1/1 2026-02-17T20:07:50.405 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.9-0.el9.x86_64 1/1 2026-02-17T20:07:50.406 INFO:teuthology.orchestra.run.trial123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:07:50.406 INFO:teuthology.orchestra.run.trial123.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-17T20:07:50.406 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:07:50.675 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : ceph-immutable-object-cache-2:17.2.9-0.el9.x86_64 1/1 2026-02-17T20:07:50.675 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:07:50.676 INFO:teuthology.orchestra.run.trial123.stdout:Installed: 2026-02-17T20:07:50.676 INFO:teuthology.orchestra.run.trial123.stdout: ceph-immutable-object-cache-2:17.2.9-0.el9.x86_64 2026-02-17T20:07:50.676 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:07:50.676 INFO:teuthology.orchestra.run.trial123.stdout:Complete! 2026-02-17T20:07:50.703 DEBUG:teuthology.orchestra.run.trial123:> sudo yum -y install ceph-mgr 2026-02-17T20:07:51.011 INFO:teuthology.orchestra.run.trial123.stdout:Last metadata expiration check: 0:00:22 ago on Tue 17 Feb 2026 08:07:29 PM UTC. 2026-02-17T20:07:51.075 INFO:teuthology.orchestra.run.trial123.stdout:Package ceph-mgr-2:17.2.9-0.el9.x86_64 is already installed. 2026-02-17T20:07:51.093 INFO:teuthology.orchestra.run.trial123.stdout:Dependencies resolved. 2026-02-17T20:07:51.094 INFO:teuthology.orchestra.run.trial123.stdout:Nothing to do. 2026-02-17T20:07:51.094 INFO:teuthology.orchestra.run.trial123.stdout:Complete! 2026-02-17T20:07:51.115 DEBUG:teuthology.orchestra.run.trial123:> sudo yum -y install ceph-fuse 2026-02-17T20:07:51.419 INFO:teuthology.orchestra.run.trial123.stdout:Last metadata expiration check: 0:00:22 ago on Tue 17 Feb 2026 08:07:29 PM UTC. 2026-02-17T20:07:51.501 INFO:teuthology.orchestra.run.trial123.stdout:Dependencies resolved. 2026-02-17T20:07:51.501 INFO:teuthology.orchestra.run.trial123.stdout:================================================================================ 2026-02-17T20:07:51.501 INFO:teuthology.orchestra.run.trial123.stdout: Package Architecture Version Repository Size 2026-02-17T20:07:51.502 INFO:teuthology.orchestra.run.trial123.stdout:================================================================================ 2026-02-17T20:07:51.502 INFO:teuthology.orchestra.run.trial123.stdout:Installing: 2026-02-17T20:07:51.502 INFO:teuthology.orchestra.run.trial123.stdout: ceph-fuse x86_64 2:17.2.9-0.el9 ceph 813 k 2026-02-17T20:07:51.502 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:07:51.502 INFO:teuthology.orchestra.run.trial123.stdout:Transaction Summary 2026-02-17T20:07:51.502 INFO:teuthology.orchestra.run.trial123.stdout:================================================================================ 2026-02-17T20:07:51.502 INFO:teuthology.orchestra.run.trial123.stdout:Install 1 Package 2026-02-17T20:07:51.502 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:07:51.502 INFO:teuthology.orchestra.run.trial123.stdout:Total download size: 813 k 2026-02-17T20:07:51.502 INFO:teuthology.orchestra.run.trial123.stdout:Installed size: 2.4 M 2026-02-17T20:07:51.503 INFO:teuthology.orchestra.run.trial123.stdout:Downloading Packages: 2026-02-17T20:07:51.584 INFO:teuthology.orchestra.run.trial123.stdout:ceph-fuse-17.2.9-0.el9.x86_64.rpm 9.7 MB/s | 813 kB 00:00 2026-02-17T20:07:51.584 INFO:teuthology.orchestra.run.trial123.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:07:51.585 INFO:teuthology.orchestra.run.trial123.stdout:Total 9.6 MB/s | 813 kB 00:00 2026-02-17T20:07:51.585 INFO:teuthology.orchestra.run.trial123.stdout:Running transaction check 2026-02-17T20:07:51.588 INFO:teuthology.orchestra.run.trial123.stdout:Transaction check succeeded. 2026-02-17T20:07:51.588 INFO:teuthology.orchestra.run.trial123.stdout:Running transaction test 2026-02-17T20:07:51.615 INFO:teuthology.orchestra.run.trial123.stdout:Transaction test succeeded. 2026-02-17T20:07:51.615 INFO:teuthology.orchestra.run.trial123.stdout:Running transaction 2026-02-17T20:07:51.693 INFO:teuthology.orchestra.run.trial123.stdout: Preparing : 1/1 2026-02-17T20:07:51.709 INFO:teuthology.orchestra.run.trial123.stdout: Installing : ceph-fuse-2:17.2.9-0.el9.x86_64 1/1 2026-02-17T20:07:51.943 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: ceph-fuse-2:17.2.9-0.el9.x86_64 1/1 2026-02-17T20:07:51.996 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : ceph-fuse-2:17.2.9-0.el9.x86_64 1/1 2026-02-17T20:07:51.997 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:07:51.997 INFO:teuthology.orchestra.run.trial123.stdout:Installed: 2026-02-17T20:07:51.997 INFO:teuthology.orchestra.run.trial123.stdout: ceph-fuse-2:17.2.9-0.el9.x86_64 2026-02-17T20:07:51.997 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:07:51.997 INFO:teuthology.orchestra.run.trial123.stdout:Complete! 2026-02-17T20:07:52.023 DEBUG:teuthology.orchestra.run.trial123:> sudo yum -y install librados-devel 2026-02-17T20:07:52.332 INFO:teuthology.orchestra.run.trial123.stdout:Last metadata expiration check: 0:00:23 ago on Tue 17 Feb 2026 08:07:29 PM UTC. 2026-02-17T20:07:52.414 INFO:teuthology.orchestra.run.trial123.stdout:Dependencies resolved. 2026-02-17T20:07:52.415 INFO:teuthology.orchestra.run.trial123.stdout:================================================================================ 2026-02-17T20:07:52.415 INFO:teuthology.orchestra.run.trial123.stdout: Package Architecture Version Repository Size 2026-02-17T20:07:52.416 INFO:teuthology.orchestra.run.trial123.stdout:================================================================================ 2026-02-17T20:07:52.416 INFO:teuthology.orchestra.run.trial123.stdout:Installing: 2026-02-17T20:07:52.416 INFO:teuthology.orchestra.run.trial123.stdout: librados-devel x86_64 2:17.2.9-0.el9 ceph 126 k 2026-02-17T20:07:52.416 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:07:52.416 INFO:teuthology.orchestra.run.trial123.stdout:Transaction Summary 2026-02-17T20:07:52.416 INFO:teuthology.orchestra.run.trial123.stdout:================================================================================ 2026-02-17T20:07:52.416 INFO:teuthology.orchestra.run.trial123.stdout:Install 1 Package 2026-02-17T20:07:52.416 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:07:52.417 INFO:teuthology.orchestra.run.trial123.stdout:Total download size: 126 k 2026-02-17T20:07:52.417 INFO:teuthology.orchestra.run.trial123.stdout:Installed size: 448 k 2026-02-17T20:07:52.417 INFO:teuthology.orchestra.run.trial123.stdout:Downloading Packages: 2026-02-17T20:07:52.480 INFO:teuthology.orchestra.run.trial123.stdout:librados-devel-17.2.9-0.el9.x86_64.rpm 1.9 MB/s | 126 kB 00:00 2026-02-17T20:07:52.480 INFO:teuthology.orchestra.run.trial123.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:07:52.480 INFO:teuthology.orchestra.run.trial123.stdout:Total 1.9 MB/s | 126 kB 00:00 2026-02-17T20:07:52.480 INFO:teuthology.orchestra.run.trial123.stdout:Running transaction check 2026-02-17T20:07:52.483 INFO:teuthology.orchestra.run.trial123.stdout:Transaction check succeeded. 2026-02-17T20:07:52.483 INFO:teuthology.orchestra.run.trial123.stdout:Running transaction test 2026-02-17T20:07:52.509 INFO:teuthology.orchestra.run.trial123.stdout:Transaction test succeeded. 2026-02-17T20:07:52.509 INFO:teuthology.orchestra.run.trial123.stdout:Running transaction 2026-02-17T20:07:52.557 INFO:teuthology.orchestra.run.trial123.stdout: Preparing : 1/1 2026-02-17T20:07:52.572 INFO:teuthology.orchestra.run.trial123.stdout: Installing : librados-devel-2:17.2.9-0.el9.x86_64 1/1 2026-02-17T20:07:52.648 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: librados-devel-2:17.2.9-0.el9.x86_64 1/1 2026-02-17T20:07:52.702 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : librados-devel-2:17.2.9-0.el9.x86_64 1/1 2026-02-17T20:07:52.702 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:07:52.703 INFO:teuthology.orchestra.run.trial123.stdout:Installed: 2026-02-17T20:07:52.703 INFO:teuthology.orchestra.run.trial123.stdout: librados-devel-2:17.2.9-0.el9.x86_64 2026-02-17T20:07:52.703 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:07:52.703 INFO:teuthology.orchestra.run.trial123.stdout:Complete! 2026-02-17T20:07:52.731 DEBUG:teuthology.orchestra.run.trial123:> sudo yum -y install libcephfs2 2026-02-17T20:07:53.040 INFO:teuthology.orchestra.run.trial123.stdout:Last metadata expiration check: 0:00:24 ago on Tue 17 Feb 2026 08:07:29 PM UTC. 2026-02-17T20:07:53.104 INFO:teuthology.orchestra.run.trial123.stdout:Package libcephfs2-2:17.2.9-0.el9.x86_64 is already installed. 2026-02-17T20:07:53.121 INFO:teuthology.orchestra.run.trial123.stdout:Dependencies resolved. 2026-02-17T20:07:53.122 INFO:teuthology.orchestra.run.trial123.stdout:Nothing to do. 2026-02-17T20:07:53.122 INFO:teuthology.orchestra.run.trial123.stdout:Complete! 2026-02-17T20:07:53.143 DEBUG:teuthology.orchestra.run.trial123:> sudo yum -y install libcephfs-devel 2026-02-17T20:07:53.454 INFO:teuthology.orchestra.run.trial123.stdout:Last metadata expiration check: 0:00:24 ago on Tue 17 Feb 2026 08:07:29 PM UTC. 2026-02-17T20:07:53.538 INFO:teuthology.orchestra.run.trial123.stdout:Dependencies resolved. 2026-02-17T20:07:53.538 INFO:teuthology.orchestra.run.trial123.stdout:================================================================================ 2026-02-17T20:07:53.538 INFO:teuthology.orchestra.run.trial123.stdout: Package Architecture Version Repository Size 2026-02-17T20:07:53.538 INFO:teuthology.orchestra.run.trial123.stdout:================================================================================ 2026-02-17T20:07:53.539 INFO:teuthology.orchestra.run.trial123.stdout:Installing: 2026-02-17T20:07:53.539 INFO:teuthology.orchestra.run.trial123.stdout: libcephfs-devel x86_64 2:17.2.9-0.el9 ceph 25 k 2026-02-17T20:07:53.539 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:07:53.539 INFO:teuthology.orchestra.run.trial123.stdout:Transaction Summary 2026-02-17T20:07:53.539 INFO:teuthology.orchestra.run.trial123.stdout:================================================================================ 2026-02-17T20:07:53.539 INFO:teuthology.orchestra.run.trial123.stdout:Install 1 Package 2026-02-17T20:07:53.539 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:07:53.539 INFO:teuthology.orchestra.run.trial123.stdout:Total download size: 25 k 2026-02-17T20:07:53.539 INFO:teuthology.orchestra.run.trial123.stdout:Installed size: 110 k 2026-02-17T20:07:53.540 INFO:teuthology.orchestra.run.trial123.stdout:Downloading Packages: 2026-02-17T20:07:53.583 INFO:teuthology.orchestra.run.trial123.stdout:libcephfs-devel-17.2.9-0.el9.x86_64.rpm 570 kB/s | 25 kB 00:00 2026-02-17T20:07:53.583 INFO:teuthology.orchestra.run.trial123.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:07:53.583 INFO:teuthology.orchestra.run.trial123.stdout:Total 557 kB/s | 25 kB 00:00 2026-02-17T20:07:53.584 INFO:teuthology.orchestra.run.trial123.stdout:Running transaction check 2026-02-17T20:07:53.585 INFO:teuthology.orchestra.run.trial123.stdout:Transaction check succeeded. 2026-02-17T20:07:53.585 INFO:teuthology.orchestra.run.trial123.stdout:Running transaction test 2026-02-17T20:07:53.586 INFO:teuthology.orchestra.run.trial123.stdout:Transaction test succeeded. 2026-02-17T20:07:53.586 INFO:teuthology.orchestra.run.trial123.stdout:Running transaction 2026-02-17T20:07:53.604 INFO:teuthology.orchestra.run.trial123.stdout: Preparing : 1/1 2026-02-17T20:07:53.619 INFO:teuthology.orchestra.run.trial123.stdout: Installing : libcephfs-devel-2:17.2.9-0.el9.x86_64 1/1 2026-02-17T20:07:53.670 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: libcephfs-devel-2:17.2.9-0.el9.x86_64 1/1 2026-02-17T20:07:53.722 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : libcephfs-devel-2:17.2.9-0.el9.x86_64 1/1 2026-02-17T20:07:53.722 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:07:53.723 INFO:teuthology.orchestra.run.trial123.stdout:Installed: 2026-02-17T20:07:53.723 INFO:teuthology.orchestra.run.trial123.stdout: libcephfs-devel-2:17.2.9-0.el9.x86_64 2026-02-17T20:07:53.723 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:07:53.723 INFO:teuthology.orchestra.run.trial123.stdout:Complete! 2026-02-17T20:07:53.750 DEBUG:teuthology.orchestra.run.trial123:> sudo yum -y install librados2 2026-02-17T20:07:54.051 INFO:teuthology.orchestra.run.trial123.stdout:Last metadata expiration check: 0:00:25 ago on Tue 17 Feb 2026 08:07:29 PM UTC. 2026-02-17T20:07:54.114 INFO:teuthology.orchestra.run.trial123.stdout:Package librados2-2:17.2.9-0.el9.x86_64 is already installed. 2026-02-17T20:07:54.132 INFO:teuthology.orchestra.run.trial123.stdout:Dependencies resolved. 2026-02-17T20:07:54.133 INFO:teuthology.orchestra.run.trial123.stdout:Nothing to do. 2026-02-17T20:07:54.133 INFO:teuthology.orchestra.run.trial123.stdout:Complete! 2026-02-17T20:07:54.154 DEBUG:teuthology.orchestra.run.trial123:> sudo yum -y install librbd1 2026-02-17T20:07:54.458 INFO:teuthology.orchestra.run.trial123.stdout:Last metadata expiration check: 0:00:25 ago on Tue 17 Feb 2026 08:07:29 PM UTC. 2026-02-17T20:07:54.521 INFO:teuthology.orchestra.run.trial123.stdout:Package librbd1-2:17.2.9-0.el9.x86_64 is already installed. 2026-02-17T20:07:54.539 INFO:teuthology.orchestra.run.trial123.stdout:Dependencies resolved. 2026-02-17T20:07:54.539 INFO:teuthology.orchestra.run.trial123.stdout:Nothing to do. 2026-02-17T20:07:54.540 INFO:teuthology.orchestra.run.trial123.stdout:Complete! 2026-02-17T20:07:54.560 DEBUG:teuthology.orchestra.run.trial123:> sudo yum -y install python3-rados 2026-02-17T20:07:54.863 INFO:teuthology.orchestra.run.trial123.stdout:Last metadata expiration check: 0:00:25 ago on Tue 17 Feb 2026 08:07:29 PM UTC. 2026-02-17T20:07:54.927 INFO:teuthology.orchestra.run.trial123.stdout:Package python3-rados-2:17.2.9-0.el9.x86_64 is already installed. 2026-02-17T20:07:54.945 INFO:teuthology.orchestra.run.trial123.stdout:Dependencies resolved. 2026-02-17T20:07:54.945 INFO:teuthology.orchestra.run.trial123.stdout:Nothing to do. 2026-02-17T20:07:54.946 INFO:teuthology.orchestra.run.trial123.stdout:Complete! 2026-02-17T20:07:54.966 DEBUG:teuthology.orchestra.run.trial123:> sudo yum -y install python3-rgw 2026-02-17T20:07:55.273 INFO:teuthology.orchestra.run.trial123.stdout:Last metadata expiration check: 0:00:26 ago on Tue 17 Feb 2026 08:07:29 PM UTC. 2026-02-17T20:07:55.339 INFO:teuthology.orchestra.run.trial123.stdout:Package python3-rgw-2:17.2.9-0.el9.x86_64 is already installed. 2026-02-17T20:07:55.356 INFO:teuthology.orchestra.run.trial123.stdout:Dependencies resolved. 2026-02-17T20:07:55.357 INFO:teuthology.orchestra.run.trial123.stdout:Nothing to do. 2026-02-17T20:07:55.357 INFO:teuthology.orchestra.run.trial123.stdout:Complete! 2026-02-17T20:07:55.378 DEBUG:teuthology.orchestra.run.trial123:> sudo yum -y install python3-cephfs 2026-02-17T20:07:55.681 INFO:teuthology.orchestra.run.trial123.stdout:Last metadata expiration check: 0:00:26 ago on Tue 17 Feb 2026 08:07:29 PM UTC. 2026-02-17T20:07:55.744 INFO:teuthology.orchestra.run.trial123.stdout:Package python3-cephfs-2:17.2.9-0.el9.x86_64 is already installed. 2026-02-17T20:07:55.761 INFO:teuthology.orchestra.run.trial123.stdout:Dependencies resolved. 2026-02-17T20:07:55.762 INFO:teuthology.orchestra.run.trial123.stdout:Nothing to do. 2026-02-17T20:07:55.762 INFO:teuthology.orchestra.run.trial123.stdout:Complete! 2026-02-17T20:07:55.784 DEBUG:teuthology.orchestra.run.trial123:> sudo yum -y install python3-rbd 2026-02-17T20:07:56.091 INFO:teuthology.orchestra.run.trial123.stdout:Last metadata expiration check: 0:00:27 ago on Tue 17 Feb 2026 08:07:29 PM UTC. 2026-02-17T20:07:56.155 INFO:teuthology.orchestra.run.trial123.stdout:Package python3-rbd-2:17.2.9-0.el9.x86_64 is already installed. 2026-02-17T20:07:56.173 INFO:teuthology.orchestra.run.trial123.stdout:Dependencies resolved. 2026-02-17T20:07:56.174 INFO:teuthology.orchestra.run.trial123.stdout:Nothing to do. 2026-02-17T20:07:56.174 INFO:teuthology.orchestra.run.trial123.stdout:Complete! 2026-02-17T20:07:56.194 DEBUG:teuthology.orchestra.run.trial123:> sudo yum -y install rbd-fuse 2026-02-17T20:07:56.498 INFO:teuthology.orchestra.run.trial123.stdout:Last metadata expiration check: 0:00:27 ago on Tue 17 Feb 2026 08:07:29 PM UTC. 2026-02-17T20:07:56.580 INFO:teuthology.orchestra.run.trial123.stdout:Dependencies resolved. 2026-02-17T20:07:56.580 INFO:teuthology.orchestra.run.trial123.stdout:================================================================================ 2026-02-17T20:07:56.581 INFO:teuthology.orchestra.run.trial123.stdout: Package Architecture Version Repository Size 2026-02-17T20:07:56.581 INFO:teuthology.orchestra.run.trial123.stdout:================================================================================ 2026-02-17T20:07:56.581 INFO:teuthology.orchestra.run.trial123.stdout:Installing: 2026-02-17T20:07:56.581 INFO:teuthology.orchestra.run.trial123.stdout: rbd-fuse x86_64 2:17.2.9-0.el9 ceph 82 k 2026-02-17T20:07:56.581 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:07:56.581 INFO:teuthology.orchestra.run.trial123.stdout:Transaction Summary 2026-02-17T20:07:56.581 INFO:teuthology.orchestra.run.trial123.stdout:================================================================================ 2026-02-17T20:07:56.581 INFO:teuthology.orchestra.run.trial123.stdout:Install 1 Package 2026-02-17T20:07:56.582 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:07:56.582 INFO:teuthology.orchestra.run.trial123.stdout:Total download size: 82 k 2026-02-17T20:07:56.582 INFO:teuthology.orchestra.run.trial123.stdout:Installed size: 222 k 2026-02-17T20:07:56.583 INFO:teuthology.orchestra.run.trial123.stdout:Downloading Packages: 2026-02-17T20:07:56.631 INFO:teuthology.orchestra.run.trial123.stdout:rbd-fuse-17.2.9-0.el9.x86_64.rpm 1.6 MB/s | 82 kB 00:00 2026-02-17T20:07:56.632 INFO:teuthology.orchestra.run.trial123.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:07:56.632 INFO:teuthology.orchestra.run.trial123.stdout:Total 1.6 MB/s | 82 kB 00:00 2026-02-17T20:07:56.632 INFO:teuthology.orchestra.run.trial123.stdout:Running transaction check 2026-02-17T20:07:56.635 INFO:teuthology.orchestra.run.trial123.stdout:Transaction check succeeded. 2026-02-17T20:07:56.635 INFO:teuthology.orchestra.run.trial123.stdout:Running transaction test 2026-02-17T20:07:56.661 INFO:teuthology.orchestra.run.trial123.stdout:Transaction test succeeded. 2026-02-17T20:07:56.661 INFO:teuthology.orchestra.run.trial123.stdout:Running transaction 2026-02-17T20:07:56.705 INFO:teuthology.orchestra.run.trial123.stdout: Preparing : 1/1 2026-02-17T20:07:56.720 INFO:teuthology.orchestra.run.trial123.stdout: Installing : rbd-fuse-2:17.2.9-0.el9.x86_64 1/1 2026-02-17T20:07:56.796 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: rbd-fuse-2:17.2.9-0.el9.x86_64 1/1 2026-02-17T20:07:56.850 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : rbd-fuse-2:17.2.9-0.el9.x86_64 1/1 2026-02-17T20:07:56.851 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:07:56.851 INFO:teuthology.orchestra.run.trial123.stdout:Installed: 2026-02-17T20:07:56.851 INFO:teuthology.orchestra.run.trial123.stdout: rbd-fuse-2:17.2.9-0.el9.x86_64 2026-02-17T20:07:56.851 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:07:56.851 INFO:teuthology.orchestra.run.trial123.stdout:Complete! 2026-02-17T20:07:56.879 DEBUG:teuthology.orchestra.run.trial123:> sudo yum -y install rbd-mirror 2026-02-17T20:07:57.186 INFO:teuthology.orchestra.run.trial123.stdout:Last metadata expiration check: 0:00:28 ago on Tue 17 Feb 2026 08:07:29 PM UTC. 2026-02-17T20:07:57.269 INFO:teuthology.orchestra.run.trial123.stdout:Dependencies resolved. 2026-02-17T20:07:57.269 INFO:teuthology.orchestra.run.trial123.stdout:================================================================================ 2026-02-17T20:07:57.269 INFO:teuthology.orchestra.run.trial123.stdout: Package Architecture Version Repository Size 2026-02-17T20:07:57.270 INFO:teuthology.orchestra.run.trial123.stdout:================================================================================ 2026-02-17T20:07:57.270 INFO:teuthology.orchestra.run.trial123.stdout:Installing: 2026-02-17T20:07:57.270 INFO:teuthology.orchestra.run.trial123.stdout: rbd-mirror x86_64 2:17.2.9-0.el9 ceph 2.9 M 2026-02-17T20:07:57.270 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:07:57.270 INFO:teuthology.orchestra.run.trial123.stdout:Transaction Summary 2026-02-17T20:07:57.270 INFO:teuthology.orchestra.run.trial123.stdout:================================================================================ 2026-02-17T20:07:57.270 INFO:teuthology.orchestra.run.trial123.stdout:Install 1 Package 2026-02-17T20:07:57.270 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:07:57.270 INFO:teuthology.orchestra.run.trial123.stdout:Total download size: 2.9 M 2026-02-17T20:07:57.270 INFO:teuthology.orchestra.run.trial123.stdout:Installed size: 12 M 2026-02-17T20:07:57.271 INFO:teuthology.orchestra.run.trial123.stdout:Downloading Packages: 2026-02-17T20:07:57.371 INFO:teuthology.orchestra.run.trial123.stdout:rbd-mirror-17.2.9-0.el9.x86_64.rpm 29 MB/s | 2.9 MB 00:00 2026-02-17T20:07:57.372 INFO:teuthology.orchestra.run.trial123.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:07:57.372 INFO:teuthology.orchestra.run.trial123.stdout:Total 29 MB/s | 2.9 MB 00:00 2026-02-17T20:07:57.372 INFO:teuthology.orchestra.run.trial123.stdout:Running transaction check 2026-02-17T20:07:57.376 INFO:teuthology.orchestra.run.trial123.stdout:Transaction check succeeded. 2026-02-17T20:07:57.376 INFO:teuthology.orchestra.run.trial123.stdout:Running transaction test 2026-02-17T20:07:57.409 INFO:teuthology.orchestra.run.trial123.stdout:Transaction test succeeded. 2026-02-17T20:07:57.409 INFO:teuthology.orchestra.run.trial123.stdout:Running transaction 2026-02-17T20:07:57.589 INFO:teuthology.orchestra.run.trial123.stdout: Preparing : 1/1 2026-02-17T20:07:57.590 INFO:teuthology.orchestra.run.trial123.stdout: Installing : rbd-mirror-2:17.2.9-0.el9.x86_64 1/1 2026-02-17T20:07:57.612 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: rbd-mirror-2:17.2.9-0.el9.x86_64 1/1 2026-02-17T20:07:57.613 INFO:teuthology.orchestra.run.trial123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:07:57.613 INFO:teuthology.orchestra.run.trial123.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-17T20:07:57.613 INFO:teuthology.orchestra.run.trial123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T20:07:57.613 INFO:teuthology.orchestra.run.trial123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T20:07:57.613 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:07:57.916 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : rbd-mirror-2:17.2.9-0.el9.x86_64 1/1 2026-02-17T20:07:57.916 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:07:57.916 INFO:teuthology.orchestra.run.trial123.stdout:Installed: 2026-02-17T20:07:57.916 INFO:teuthology.orchestra.run.trial123.stdout: rbd-mirror-2:17.2.9-0.el9.x86_64 2026-02-17T20:07:57.916 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:07:57.916 INFO:teuthology.orchestra.run.trial123.stdout:Complete! 2026-02-17T20:07:57.943 DEBUG:teuthology.orchestra.run.trial123:> sudo yum -y install rbd-nbd 2026-02-17T20:07:58.257 INFO:teuthology.orchestra.run.trial123.stdout:Last metadata expiration check: 0:00:29 ago on Tue 17 Feb 2026 08:07:29 PM UTC. 2026-02-17T20:07:58.339 INFO:teuthology.orchestra.run.trial123.stdout:Dependencies resolved. 2026-02-17T20:07:58.339 INFO:teuthology.orchestra.run.trial123.stdout:================================================================================ 2026-02-17T20:07:58.339 INFO:teuthology.orchestra.run.trial123.stdout: Package Architecture Version Repository Size 2026-02-17T20:07:58.339 INFO:teuthology.orchestra.run.trial123.stdout:================================================================================ 2026-02-17T20:07:58.339 INFO:teuthology.orchestra.run.trial123.stdout:Installing: 2026-02-17T20:07:58.340 INFO:teuthology.orchestra.run.trial123.stdout: rbd-nbd x86_64 2:17.2.9-0.el9 ceph 165 k 2026-02-17T20:07:58.340 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:07:58.340 INFO:teuthology.orchestra.run.trial123.stdout:Transaction Summary 2026-02-17T20:07:58.340 INFO:teuthology.orchestra.run.trial123.stdout:================================================================================ 2026-02-17T20:07:58.340 INFO:teuthology.orchestra.run.trial123.stdout:Install 1 Package 2026-02-17T20:07:58.340 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:07:58.340 INFO:teuthology.orchestra.run.trial123.stdout:Total download size: 165 k 2026-02-17T20:07:58.340 INFO:teuthology.orchestra.run.trial123.stdout:Installed size: 477 k 2026-02-17T20:07:58.340 INFO:teuthology.orchestra.run.trial123.stdout:Downloading Packages: 2026-02-17T20:07:58.402 INFO:teuthology.orchestra.run.trial123.stdout:rbd-nbd-17.2.9-0.el9.x86_64.rpm 2.6 MB/s | 165 kB 00:00 2026-02-17T20:07:58.402 INFO:teuthology.orchestra.run.trial123.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:07:58.402 INFO:teuthology.orchestra.run.trial123.stdout:Total 2.6 MB/s | 165 kB 00:00 2026-02-17T20:07:58.402 INFO:teuthology.orchestra.run.trial123.stdout:Running transaction check 2026-02-17T20:07:58.405 INFO:teuthology.orchestra.run.trial123.stdout:Transaction check succeeded. 2026-02-17T20:07:58.405 INFO:teuthology.orchestra.run.trial123.stdout:Running transaction test 2026-02-17T20:07:58.431 INFO:teuthology.orchestra.run.trial123.stdout:Transaction test succeeded. 2026-02-17T20:07:58.431 INFO:teuthology.orchestra.run.trial123.stdout:Running transaction 2026-02-17T20:07:58.479 INFO:teuthology.orchestra.run.trial123.stdout: Preparing : 1/1 2026-02-17T20:07:58.495 INFO:teuthology.orchestra.run.trial123.stdout: Installing : rbd-nbd-2:17.2.9-0.el9.x86_64 1/1 2026-02-17T20:07:58.580 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: rbd-nbd-2:17.2.9-0.el9.x86_64 1/1 2026-02-17T20:07:58.633 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : rbd-nbd-2:17.2.9-0.el9.x86_64 1/1 2026-02-17T20:07:58.633 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:07:58.633 INFO:teuthology.orchestra.run.trial123.stdout:Installed: 2026-02-17T20:07:58.634 INFO:teuthology.orchestra.run.trial123.stdout: rbd-nbd-2:17.2.9-0.el9.x86_64 2026-02-17T20:07:58.634 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:07:58.634 INFO:teuthology.orchestra.run.trial123.stdout:Complete! 2026-02-17T20:07:58.663 DEBUG:teuthology.orchestra.run.trial123:> sudo yum -y install librados2 2026-02-17T20:07:58.983 INFO:teuthology.orchestra.run.trial123.stdout:Last metadata expiration check: 0:00:29 ago on Tue 17 Feb 2026 08:07:29 PM UTC. 2026-02-17T20:07:59.048 INFO:teuthology.orchestra.run.trial123.stdout:Package librados2-2:17.2.9-0.el9.x86_64 is already installed. 2026-02-17T20:07:59.066 INFO:teuthology.orchestra.run.trial123.stdout:Dependencies resolved. 2026-02-17T20:07:59.067 INFO:teuthology.orchestra.run.trial123.stdout:Nothing to do. 2026-02-17T20:07:59.067 INFO:teuthology.orchestra.run.trial123.stdout:Complete! 2026-02-17T20:07:59.091 DEBUG:teuthology.parallel:result is None 2026-02-17T20:07:59.092 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-17T20:07:59.092 INFO:teuthology.packaging:ref: None 2026-02-17T20:07:59.092 INFO:teuthology.packaging:tag: None 2026-02-17T20:07:59.092 INFO:teuthology.packaging:branch: quincy 2026-02-17T20:07:59.092 INFO:teuthology.packaging:sha1: 0a9403ad6667fb8ffa43f11d9a5d3062d3558d8e 2026-02-17T20:07:59.093 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2026-02-17T20:07:59.279 DEBUG:teuthology.orchestra.run.trial123:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-17T20:07:59.300 INFO:teuthology.orchestra.run.trial123.stdout:17.2.9-0.el9 2026-02-17T20:07:59.301 INFO:teuthology.packaging:The installed version of ceph is 17.2.9-0.el9 2026-02-17T20:07:59.301 INFO:teuthology.task.install:The correct ceph version 17.2.9-0 is installed. 2026-02-17T20:07:59.304 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-17T20:07:59.304 DEBUG:teuthology.orchestra.run.trial123:> set -ex 2026-02-17T20:07:59.304 DEBUG:teuthology.orchestra.run.trial123:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T20:07:59.365 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-17T20:07:59.365 DEBUG:teuthology.orchestra.run.trial123:> set -ex 2026-02-17T20:07:59.366 DEBUG:teuthology.orchestra.run.trial123:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T20:07:59.429 DEBUG:teuthology.orchestra.run.trial123:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T20:07:59.494 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-17T20:07:59.495 DEBUG:teuthology.orchestra.run.trial123:> set -ex 2026-02-17T20:07:59.495 DEBUG:teuthology.orchestra.run.trial123:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T20:07:59.558 DEBUG:teuthology.orchestra.run.trial123:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T20:07:59.621 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-17T20:07:59.621 DEBUG:teuthology.orchestra.run.trial123:> set -ex 2026-02-17T20:07:59.621 DEBUG:teuthology.orchestra.run.trial123:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T20:07:59.684 DEBUG:teuthology.orchestra.run.trial123:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T20:07:59.748 INFO:teuthology.run_tasks:Running task print... 2026-02-17T20:07:59.762 INFO:teuthology.task.print:**** done installing quincy 2026-02-17T20:07:59.762 INFO:teuthology.run_tasks:Running task ceph... 2026-02-17T20:07:59.873 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-17T20:07:59.873 DEBUG:teuthology.orchestra.run.trial123:> sudo chmod 777 /var/log/ceph 2026-02-17T20:07:59.897 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-17T20:07:59.897 DEBUG:teuthology.orchestra.run.trial123:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-17T20:07:59.961 INFO:tasks.ceph:Creating extra log directories... 2026-02-17T20:07:59.961 DEBUG:teuthology.orchestra.run.trial123:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-17T20:08:00.034 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-17T20:08:00.034 INFO:tasks.ceph:config {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'is offline because no MDS', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'MGR_MODULE_ERROR', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'pg .* is stuck inactive', 'pg .* is .*degraded', 'pg .* is stuck peering', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-17T20:08:00.034 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/jcollin-2026-02-17_12:20:44-fs-wip-jcollin-testing-20260217.030412-squid-distro-default-trial/52816', 'branch': 'wip-jcollin-testing-20260217.030412-squid', 'description': 'fs/upgrade/nofs/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} kernel no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn pg_health} tasks/{0-from/quincy 1-upgrade}}', 'email': 'jcollin@redhat.com', 'first_in_suite': False, 'flavor': 'default', 'job_id': '52816', 'kernel': {'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'meta': [{'desc': 'install ceph/quincy latest\n'}], 'name': 'jcollin-2026-02-17_12:20:44-fs-wip-jcollin-testing-20260217.030412-squid-distro-default-trial', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-jcollin-testing-20260217.030412-squid'}, 'ceph': {'cluster-conf': {'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'is offline because no MDS', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'MGR_MODULE_ERROR', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'pg .* is stuck inactive', 'pg .* is .*degraded', 'pg .* is stuck peering', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request'], 'sha1': '0a9403ad6667fb8ffa43f11d9a5d3062d3558d8e'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '0a9403ad6667fb8ffa43f11d9a5d3062d3558d8e'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-jcollin-testing-20260217.030412-squid', 'sha1': '0a9403ad6667fb8ffa43f11d9a5d3062d3558d8e'}}, 'owner': 'scheduled_jcollin@soko04.front.sepia.ceph.com', 'priority': 200, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 1479, 'sha1': '0a9403ad6667fb8ffa43f11d9a5d3062d3558d8e', 'sleep_before_teardown': 0, 'subset': '316/2048', 'suite': 'fs', 'suite_branch': 'wip-jcollin-testing-20260217.030412-squid', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_0a9403ad6667fb8ffa43f11d9a5d3062d3558d8e/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '0a9403ad6667fb8ffa43f11d9a5d3062d3558d8e', 'targets': {'trial123.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI0pWupezf+2JG5aiAB7PrpFQrZhs1T3enlrY/Z1rlFeAeobozJ0N/rbAR6WBUEEbrHBo+jrqNxXm3YDtZ910Ko='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'branch': 'quincy', 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-volume'], 'extra_packages': ['librados2'], 'flavor': 'default', 'sha1': '0a9403ad6667fb8ffa43f11d9a5d3062d3558d8e'}}, {'print': '**** done installing quincy'}, {'ceph': {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'log-ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'is offline because no MDS', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'MGR_MODULE_ERROR', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'pg .* is stuck inactive', 'pg .* is .*degraded', 'pg .* is stuck peering', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request'], 'cluster-conf': {'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}}, 'flavor': 'default', 'fs': 'xfs', 'sha1': '0a9403ad6667fb8ffa43f11d9a5d3062d3558d8e', 'cluster': 'ceph'}}, {'exec': {'osd.0': ['ceph osd set-require-min-compat-client quincy']}}, {'print': '**** done ceph'}, {'print': '*** upgrading, no cephfs present'}, {'exec': {'mon.a': ['ceph fs dump']}}, {'install.upgrade': {'mon.a': None}}, {'print': '**** done install.upgrade'}, {'ceph.restart': {'daemons': ['mon.*', 'mgr.*'], 'mon-health-to-clog': False, 'wait-for-healthy': False}}, {'ceph.healthy': None}, {'ceph.restart': {'daemons': ['osd.*'], 'wait-for-healthy': False, 'wait-for-osds-up': True}}, {'exec': {'mon.a': ['ceph versions', 'ceph osd dump -f json-pretty', 'ceph fs dump', 'ceph osd require-osd-release squid', 'for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done']}}, {'ceph.healthy': None}, {'print': '**** done ceph.restart'}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local branch = yaml.kernel.branch\nif branch and not yaml.kernel.branch:find "-all$" then\n log.debug("removing default kernel specification: %s", yaml.kernel)\n py_attrgetter(yaml.kernel).pop(\'branch\', nil)\n py_attrgetter(yaml.kernel).pop(\'deb\', nil)\n py_attrgetter(yaml.kernel).pop(\'flavor\', nil)\n py_attrgetter(yaml.kernel).pop(\'kdb\', nil)\n py_attrgetter(yaml.kernel).pop(\'koji\', nil)\n py_attrgetter(yaml.kernel).pop(\'koji_task\', nil)\n py_attrgetter(yaml.kernel).pop(\'rpm\', nil)\n py_attrgetter(yaml.kernel).pop(\'sha1\', nil)\n py_attrgetter(yaml.kernel).pop(\'tag\', nil)\nend\n']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'fa17720d0088c3ac28e473468bfc79eeaff5cd38', 'timestamp': '2026-02-17_12:20:44', 'tube': 'trial', 'user': 'jcollin', 'verbose': True, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682'} 2026-02-17T20:08:00.035 DEBUG:teuthology.orchestra.run.trial123:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-17T20:08:00.080 DEBUG:teuthology.orchestra.run.trial123:> sudo install -d -m0777 -- /var/run/ceph 2026-02-17T20:08:00.146 DEBUG:teuthology.orchestra.run.trial123:> set -ex 2026-02-17T20:08:00.147 DEBUG:teuthology.orchestra.run.trial123:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T20:08:00.203 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-17T20:08:00.204 DEBUG:teuthology.orchestra.run.trial123:> stat /dev/vg_nvme/lv_1 2026-02-17T20:08:00.260 INFO:teuthology.orchestra.run.trial123.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-17T20:08:00.260 INFO:teuthology.orchestra.run.trial123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T20:08:00.260 INFO:teuthology.orchestra.run.trial123.stdout:Device: 6h/6d Inode: 914 Links: 1 2026-02-17T20:08:00.260 INFO:teuthology.orchestra.run.trial123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T20:08:00.260 INFO:teuthology.orchestra.run.trial123.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T20:08:00.260 INFO:teuthology.orchestra.run.trial123.stdout:Access: 2026-02-17 20:07:57.747536892 +0000 2026-02-17T20:08:00.260 INFO:teuthology.orchestra.run.trial123.stdout:Modify: 2026-02-17 20:06:57.216388982 +0000 2026-02-17T20:08:00.260 INFO:teuthology.orchestra.run.trial123.stdout:Change: 2026-02-17 20:06:57.216388982 +0000 2026-02-17T20:08:00.261 INFO:teuthology.orchestra.run.trial123.stdout: Birth: 2026-02-17 20:06:57.216388982 +0000 2026-02-17T20:08:00.261 DEBUG:teuthology.orchestra.run.trial123:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-17T20:08:00.324 INFO:teuthology.orchestra.run.trial123.stderr:1+0 records in 2026-02-17T20:08:00.324 INFO:teuthology.orchestra.run.trial123.stderr:1+0 records out 2026-02-17T20:08:00.324 INFO:teuthology.orchestra.run.trial123.stderr:512 bytes copied, 0.000157021 s, 3.3 MB/s 2026-02-17T20:08:00.325 DEBUG:teuthology.orchestra.run.trial123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-17T20:08:00.383 DEBUG:teuthology.orchestra.run.trial123:> stat /dev/vg_nvme/lv_2 2026-02-17T20:08:00.439 INFO:teuthology.orchestra.run.trial123.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-17T20:08:00.439 INFO:teuthology.orchestra.run.trial123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T20:08:00.439 INFO:teuthology.orchestra.run.trial123.stdout:Device: 6h/6d Inode: 942 Links: 1 2026-02-17T20:08:00.439 INFO:teuthology.orchestra.run.trial123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T20:08:00.439 INFO:teuthology.orchestra.run.trial123.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T20:08:00.439 INFO:teuthology.orchestra.run.trial123.stdout:Access: 2026-02-17 20:07:57.747536892 +0000 2026-02-17T20:08:00.439 INFO:teuthology.orchestra.run.trial123.stdout:Modify: 2026-02-17 20:06:57.444383241 +0000 2026-02-17T20:08:00.439 INFO:teuthology.orchestra.run.trial123.stdout:Change: 2026-02-17 20:06:57.444383241 +0000 2026-02-17T20:08:00.439 INFO:teuthology.orchestra.run.trial123.stdout: Birth: 2026-02-17 20:06:57.444383241 +0000 2026-02-17T20:08:00.440 DEBUG:teuthology.orchestra.run.trial123:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-17T20:08:00.500 INFO:teuthology.orchestra.run.trial123.stderr:1+0 records in 2026-02-17T20:08:00.501 INFO:teuthology.orchestra.run.trial123.stderr:1+0 records out 2026-02-17T20:08:00.501 INFO:teuthology.orchestra.run.trial123.stderr:512 bytes copied, 0.000141122 s, 3.6 MB/s 2026-02-17T20:08:00.502 DEBUG:teuthology.orchestra.run.trial123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-17T20:08:00.559 DEBUG:teuthology.orchestra.run.trial123:> stat /dev/vg_nvme/lv_3 2026-02-17T20:08:00.615 INFO:teuthology.orchestra.run.trial123.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-17T20:08:00.615 INFO:teuthology.orchestra.run.trial123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T20:08:00.615 INFO:teuthology.orchestra.run.trial123.stdout:Device: 6h/6d Inode: 966 Links: 1 2026-02-17T20:08:00.615 INFO:teuthology.orchestra.run.trial123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T20:08:00.616 INFO:teuthology.orchestra.run.trial123.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T20:08:00.616 INFO:teuthology.orchestra.run.trial123.stdout:Access: 2026-02-17 20:07:57.747536892 +0000 2026-02-17T20:08:00.616 INFO:teuthology.orchestra.run.trial123.stdout:Modify: 2026-02-17 20:06:57.702376745 +0000 2026-02-17T20:08:00.616 INFO:teuthology.orchestra.run.trial123.stdout:Change: 2026-02-17 20:06:57.702376745 +0000 2026-02-17T20:08:00.616 INFO:teuthology.orchestra.run.trial123.stdout: Birth: 2026-02-17 20:06:57.702376745 +0000 2026-02-17T20:08:00.616 DEBUG:teuthology.orchestra.run.trial123:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-17T20:08:00.678 INFO:teuthology.orchestra.run.trial123.stderr:1+0 records in 2026-02-17T20:08:00.679 INFO:teuthology.orchestra.run.trial123.stderr:1+0 records out 2026-02-17T20:08:00.679 INFO:teuthology.orchestra.run.trial123.stderr:512 bytes copied, 0.000150519 s, 3.4 MB/s 2026-02-17T20:08:00.680 DEBUG:teuthology.orchestra.run.trial123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-17T20:08:00.739 DEBUG:teuthology.orchestra.run.trial123:> stat /dev/vg_nvme/lv_4 2026-02-17T20:08:00.795 INFO:teuthology.orchestra.run.trial123.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-17T20:08:00.796 INFO:teuthology.orchestra.run.trial123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T20:08:00.796 INFO:teuthology.orchestra.run.trial123.stdout:Device: 6h/6d Inode: 995 Links: 1 2026-02-17T20:08:00.796 INFO:teuthology.orchestra.run.trial123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T20:08:00.796 INFO:teuthology.orchestra.run.trial123.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T20:08:00.796 INFO:teuthology.orchestra.run.trial123.stdout:Access: 2026-02-17 20:07:57.748536867 +0000 2026-02-17T20:08:00.796 INFO:teuthology.orchestra.run.trial123.stdout:Modify: 2026-02-17 20:06:57.969370022 +0000 2026-02-17T20:08:00.796 INFO:teuthology.orchestra.run.trial123.stdout:Change: 2026-02-17 20:06:57.969370022 +0000 2026-02-17T20:08:00.796 INFO:teuthology.orchestra.run.trial123.stdout: Birth: 2026-02-17 20:06:57.969370022 +0000 2026-02-17T20:08:00.797 DEBUG:teuthology.orchestra.run.trial123:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-17T20:08:00.858 INFO:teuthology.orchestra.run.trial123.stderr:1+0 records in 2026-02-17T20:08:00.858 INFO:teuthology.orchestra.run.trial123.stderr:1+0 records out 2026-02-17T20:08:00.858 INFO:teuthology.orchestra.run.trial123.stderr:512 bytes copied, 0.000130924 s, 3.9 MB/s 2026-02-17T20:08:00.859 DEBUG:teuthology.orchestra.run.trial123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-17T20:08:00.916 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-17T20:08:00.916 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial123.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2026-02-17T20:08:00.916 INFO:tasks.ceph:Generating config... 2026-02-17T20:08:00.919 INFO:tasks.ceph:[global] mon warn on pool no app = False 2026-02-17T20:08:00.919 INFO:tasks.ceph:[global] ms bind msgr2 = False 2026-02-17T20:08:00.919 INFO:tasks.ceph:[global] bluestore warn on legacy statfs = False 2026-02-17T20:08:00.920 INFO:tasks.ceph:[global] bluestore warn on no per pool omap = False 2026-02-17T20:08:00.920 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2026-02-17T20:08:00.920 INFO:tasks.ceph:[client] client mount timeout = 600 2026-02-17T20:08:00.920 INFO:tasks.ceph:[client] debug client = 20 2026-02-17T20:08:00.920 INFO:tasks.ceph:[client] debug ms = 1 2026-02-17T20:08:00.920 INFO:tasks.ceph:[client] rados mon op timeout = 900 2026-02-17T20:08:00.920 INFO:tasks.ceph:[client] rados osd op timeout = 900 2026-02-17T20:08:00.920 INFO:tasks.ceph:[mds] debug mds = 20 2026-02-17T20:08:00.920 INFO:tasks.ceph:[mds] debug mds balancer = 20 2026-02-17T20:08:00.920 INFO:tasks.ceph:[mds] debug ms = 1 2026-02-17T20:08:00.920 INFO:tasks.ceph:[mds] mds debug frag = True 2026-02-17T20:08:00.921 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2026-02-17T20:08:00.921 INFO:tasks.ceph:[mds] mds op complaint time = 180 2026-02-17T20:08:00.921 INFO:tasks.ceph:[mds] mds verify scatter = True 2026-02-17T20:08:00.921 INFO:tasks.ceph:[mds] osd op complaint time = 180 2026-02-17T20:08:00.921 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2026-02-17T20:08:00.921 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2026-02-17T20:08:00.921 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-17T20:08:00.921 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-17T20:08:00.921 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-17T20:08:00.921 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-17T20:08:00.922 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-17T20:08:00.922 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2026-02-17T20:08:00.922 INFO:tasks.ceph:[mon] mon op complaint time = 120 2026-02-17T20:08:00.922 INFO:tasks.ceph:[mon] mon warn on osd down out interval zero = False 2026-02-17T20:08:00.922 INFO:tasks.ceph:[osd] bdev async discard = True 2026-02-17T20:08:00.922 INFO:tasks.ceph:[osd] bdev enable discard = True 2026-02-17T20:08:00.922 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2026-02-17T20:08:00.922 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2026-02-17T20:08:00.922 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2026-02-17T20:08:00.922 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2026-02-17T20:08:00.922 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2026-02-17T20:08:00.923 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-17T20:08:00.923 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-17T20:08:00.923 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2026-02-17T20:08:00.923 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2026-02-17T20:08:00.923 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2026-02-17T20:08:00.923 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2026-02-17T20:08:00.923 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2026-02-17T20:08:00.923 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2026-02-17T20:08:00.923 INFO:tasks.ceph:[osd] osd op complaint time = 180 2026-02-17T20:08:00.924 INFO:tasks.ceph:Setting up mon.a... 2026-02-17T20:08:00.924 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-17T20:08:00.989 INFO:teuthology.orchestra.run.trial123.stdout:creating /etc/ceph/ceph.keyring 2026-02-17T20:08:00.992 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-17T20:08:01.066 DEBUG:teuthology.orchestra.run.trial123:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T20:08:01.130 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.123'), ('mon.b', '[v2:10.20.193.123:3301,v1:10.20.193.123:6790]'), ('mon.c', '[v2:10.20.193.123:3302,v1:10.20.193.123:6791]')] 2026-02-17T20:08:01.130 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.123,[v2:10.20.193.123:3301,v1:10.20.193.123:6790],[v2:10.20.193.123:3302,v1:10.20.193.123:6791]', 'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2026-02-17T20:08:01.132 DEBUG:teuthology.orchestra.run.trial123:> set -ex 2026-02-17T20:08:01.132 DEBUG:teuthology.orchestra.run.trial123:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-17T20:08:01.185 DEBUG:teuthology.orchestra.run.trial123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.123 --addv b '[v2:10.20.193.123:3301,v1:10.20.193.123:6790]' --addv c '[v2:10.20.193.123:3302,v1:10.20.193.123:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2026-02-17T20:08:01.256 INFO:teuthology.orchestra.run.trial123.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-17T20:08:01.256 INFO:teuthology.orchestra.run.trial123.stdout:monmaptool: generated fsid ddf342a7-b912-46f2-b373-84d7f3b75be2 2026-02-17T20:08:01.256 INFO:teuthology.orchestra.run.trial123.stdout:setting min_mon_release = octopus 2026-02-17T20:08:01.256 INFO:teuthology.orchestra.run.trial123.stdout:epoch 0 2026-02-17T20:08:01.256 INFO:teuthology.orchestra.run.trial123.stdout:fsid ddf342a7-b912-46f2-b373-84d7f3b75be2 2026-02-17T20:08:01.257 INFO:teuthology.orchestra.run.trial123.stdout:last_changed 2026-02-17T20:08:01.258489+0000 2026-02-17T20:08:01.257 INFO:teuthology.orchestra.run.trial123.stdout:created 2026-02-17T20:08:01.258489+0000 2026-02-17T20:08:01.257 INFO:teuthology.orchestra.run.trial123.stdout:min_mon_release 15 (octopus) 2026-02-17T20:08:01.257 INFO:teuthology.orchestra.run.trial123.stdout:election_strategy: 1 2026-02-17T20:08:01.257 INFO:teuthology.orchestra.run.trial123.stdout:0: [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] mon.a 2026-02-17T20:08:01.257 INFO:teuthology.orchestra.run.trial123.stdout:1: [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] mon.b 2026-02-17T20:08:01.257 INFO:teuthology.orchestra.run.trial123.stdout:2: [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] mon.c 2026-02-17T20:08:01.257 INFO:teuthology.orchestra.run.trial123.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2026-02-17T20:08:01.259 DEBUG:teuthology.orchestra.run.trial123:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-17T20:08:01.316 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID ddf342a7-b912-46f2-b373-84d7f3b75be2... 2026-02-17T20:08:01.317 DEBUG:teuthology.orchestra.run.trial123:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-17T20:08:01.398 INFO:teuthology.orchestra.run.trial123.stdout:[global] 2026-02-17T20:08:01.398 INFO:teuthology.orchestra.run.trial123.stdout: chdir = "" 2026-02-17T20:08:01.398 INFO:teuthology.orchestra.run.trial123.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-17T20:08:01.398 INFO:teuthology.orchestra.run.trial123.stdout: auth supported = cephx 2026-02-17T20:08:01.399 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:08:01.399 INFO:teuthology.orchestra.run.trial123.stdout: filestore xattr use omap = true 2026-02-17T20:08:01.399 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:08:01.399 INFO:teuthology.orchestra.run.trial123.stdout: mon clock drift allowed = 1.000 2026-02-17T20:08:01.399 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:08:01.399 INFO:teuthology.orchestra.run.trial123.stdout: osd crush chooseleaf type = 0 2026-02-17T20:08:01.399 INFO:teuthology.orchestra.run.trial123.stdout: auth debug = true 2026-02-17T20:08:01.399 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:08:01.399 INFO:teuthology.orchestra.run.trial123.stdout: ms die on old message = true 2026-02-17T20:08:01.399 INFO:teuthology.orchestra.run.trial123.stdout: ms die on bug = true 2026-02-17T20:08:01.399 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:08:01.399 INFO:teuthology.orchestra.run.trial123.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-17T20:08:01.400 INFO:teuthology.orchestra.run.trial123.stdout: mon pg warn max object skew = 0 2026-02-17T20:08:01.400 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:08:01.400 INFO:teuthology.orchestra.run.trial123.stdout: # disable pg_autoscaler by default for new pools 2026-02-17T20:08:01.400 INFO:teuthology.orchestra.run.trial123.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-17T20:08:01.400 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:08:01.400 INFO:teuthology.orchestra.run.trial123.stdout: osd pool default size = 2 2026-02-17T20:08:01.400 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:08:01.400 INFO:teuthology.orchestra.run.trial123.stdout: mon osd allow primary affinity = true 2026-02-17T20:08:01.400 INFO:teuthology.orchestra.run.trial123.stdout: mon osd allow pg remap = true 2026-02-17T20:08:01.400 INFO:teuthology.orchestra.run.trial123.stdout: mon warn on legacy crush tunables = false 2026-02-17T20:08:01.400 INFO:teuthology.orchestra.run.trial123.stdout: mon warn on crush straw calc version zero = false 2026-02-17T20:08:01.401 INFO:teuthology.orchestra.run.trial123.stdout: mon warn on no sortbitwise = false 2026-02-17T20:08:01.401 INFO:teuthology.orchestra.run.trial123.stdout: mon warn on osd down out interval zero = false 2026-02-17T20:08:01.401 INFO:teuthology.orchestra.run.trial123.stdout: mon warn on too few osds = false 2026-02-17T20:08:01.401 INFO:teuthology.orchestra.run.trial123.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-17T20:08:01.401 INFO:teuthology.orchestra.run.trial123.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-17T20:08:01.401 INFO:teuthology.orchestra.run.trial123.stdout: mon_allow_pool_size_one = true 2026-02-17T20:08:01.401 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:08:01.401 INFO:teuthology.orchestra.run.trial123.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-17T20:08:01.401 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:08:01.401 INFO:teuthology.orchestra.run.trial123.stdout: osd default data pool replay window = 5 2026-02-17T20:08:01.401 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:08:01.401 INFO:teuthology.orchestra.run.trial123.stdout: mon allow pool delete = true 2026-02-17T20:08:01.402 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:08:01.402 INFO:teuthology.orchestra.run.trial123.stdout: mon cluster log file level = debug 2026-02-17T20:08:01.402 INFO:teuthology.orchestra.run.trial123.stdout: debug asserts on shutdown = true 2026-02-17T20:08:01.402 INFO:teuthology.orchestra.run.trial123.stdout: mon health detail to clog = false 2026-02-17T20:08:01.402 INFO:teuthology.orchestra.run.trial123.stdout: mon host = "10.20.193.123,[v2:10.20.193.123:3301,v1:10.20.193.123:6790],[v2:10.20.193.123:3302,v1:10.20.193.123:6791]" 2026-02-17T20:08:01.402 INFO:teuthology.orchestra.run.trial123.stdout: mon warn on pool no app = False 2026-02-17T20:08:01.402 INFO:teuthology.orchestra.run.trial123.stdout: ms bind msgr2 = False 2026-02-17T20:08:01.402 INFO:teuthology.orchestra.run.trial123.stdout: bluestore warn on legacy statfs = False 2026-02-17T20:08:01.402 INFO:teuthology.orchestra.run.trial123.stdout: bluestore warn on no per pool omap = False 2026-02-17T20:08:01.402 INFO:teuthology.orchestra.run.trial123.stdout: mon pg warn min per osd = 0 2026-02-17T20:08:01.402 INFO:teuthology.orchestra.run.trial123.stdout: fsid = ddf342a7-b912-46f2-b373-84d7f3b75be2 2026-02-17T20:08:01.402 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:08:01.402 INFO:teuthology.orchestra.run.trial123.stdout:[osd] 2026-02-17T20:08:01.403 INFO:teuthology.orchestra.run.trial123.stdout: osd journal size = 100 2026-02-17T20:08:01.403 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:08:01.403 INFO:teuthology.orchestra.run.trial123.stdout: osd scrub load threshold = 5.0 2026-02-17T20:08:01.403 INFO:teuthology.orchestra.run.trial123.stdout: osd scrub max interval = 600 2026-02-17T20:08:01.403 INFO:teuthology.orchestra.run.trial123.stdout: osd mclock profile = high_recovery_ops 2026-02-17T20:08:01.403 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:08:01.403 INFO:teuthology.orchestra.run.trial123.stdout: osd recover clone overlap = true 2026-02-17T20:08:01.403 INFO:teuthology.orchestra.run.trial123.stdout: osd recovery max chunk = 1048576 2026-02-17T20:08:01.403 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:08:01.403 INFO:teuthology.orchestra.run.trial123.stdout: osd debug shutdown = true 2026-02-17T20:08:01.403 INFO:teuthology.orchestra.run.trial123.stdout: osd debug op order = true 2026-02-17T20:08:01.403 INFO:teuthology.orchestra.run.trial123.stdout: osd debug verify stray on activate = true 2026-02-17T20:08:01.404 INFO:teuthology.orchestra.run.trial123.stdout: osd debug trim objects = true 2026-02-17T20:08:01.404 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:08:01.404 INFO:teuthology.orchestra.run.trial123.stdout: osd open classes on start = true 2026-02-17T20:08:01.404 INFO:teuthology.orchestra.run.trial123.stdout: osd debug pg log writeout = true 2026-02-17T20:08:01.404 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:08:01.404 INFO:teuthology.orchestra.run.trial123.stdout: osd deep scrub update digest min age = 30 2026-02-17T20:08:01.404 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:08:01.404 INFO:teuthology.orchestra.run.trial123.stdout: osd map max advance = 10 2026-02-17T20:08:01.404 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:08:01.404 INFO:teuthology.orchestra.run.trial123.stdout: journal zero on create = true 2026-02-17T20:08:01.404 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:08:01.404 INFO:teuthology.orchestra.run.trial123.stdout: filestore ondisk finisher threads = 3 2026-02-17T20:08:01.404 INFO:teuthology.orchestra.run.trial123.stdout: filestore apply finisher threads = 3 2026-02-17T20:08:01.405 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:08:01.405 INFO:teuthology.orchestra.run.trial123.stdout: bdev debug aio = true 2026-02-17T20:08:01.405 INFO:teuthology.orchestra.run.trial123.stdout: osd debug misdirected ops = true 2026-02-17T20:08:01.405 INFO:teuthology.orchestra.run.trial123.stdout: bdev async discard = True 2026-02-17T20:08:01.405 INFO:teuthology.orchestra.run.trial123.stdout: bdev enable discard = True 2026-02-17T20:08:01.405 INFO:teuthology.orchestra.run.trial123.stdout: bluestore allocator = bitmap 2026-02-17T20:08:01.405 INFO:teuthology.orchestra.run.trial123.stdout: bluestore block size = 96636764160 2026-02-17T20:08:01.405 INFO:teuthology.orchestra.run.trial123.stdout: bluestore fsck on mount = True 2026-02-17T20:08:01.405 INFO:teuthology.orchestra.run.trial123.stdout: debug bluefs = 1/20 2026-02-17T20:08:01.405 INFO:teuthology.orchestra.run.trial123.stdout: debug bluestore = 1/20 2026-02-17T20:08:01.405 INFO:teuthology.orchestra.run.trial123.stdout: debug ms = 1 2026-02-17T20:08:01.405 INFO:teuthology.orchestra.run.trial123.stdout: debug osd = 20 2026-02-17T20:08:01.405 INFO:teuthology.orchestra.run.trial123.stdout: debug rocksdb = 4/10 2026-02-17T20:08:01.406 INFO:teuthology.orchestra.run.trial123.stdout: mon osd backfillfull_ratio = 0.85 2026-02-17T20:08:01.406 INFO:teuthology.orchestra.run.trial123.stdout: mon osd full ratio = 0.9 2026-02-17T20:08:01.406 INFO:teuthology.orchestra.run.trial123.stdout: mon osd nearfull ratio = 0.8 2026-02-17T20:08:01.406 INFO:teuthology.orchestra.run.trial123.stdout: osd failsafe full ratio = 0.95 2026-02-17T20:08:01.406 INFO:teuthology.orchestra.run.trial123.stdout: osd objectstore = bluestore 2026-02-17T20:08:01.406 INFO:teuthology.orchestra.run.trial123.stdout: osd op complaint time = 180 2026-02-17T20:08:01.406 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:08:01.406 INFO:teuthology.orchestra.run.trial123.stdout:[mgr] 2026-02-17T20:08:01.406 INFO:teuthology.orchestra.run.trial123.stdout: debug ms = 1 2026-02-17T20:08:01.406 INFO:teuthology.orchestra.run.trial123.stdout: debug mgr = 20 2026-02-17T20:08:01.406 INFO:teuthology.orchestra.run.trial123.stdout: debug mon = 20 2026-02-17T20:08:01.406 INFO:teuthology.orchestra.run.trial123.stdout: debug auth = 20 2026-02-17T20:08:01.406 INFO:teuthology.orchestra.run.trial123.stdout: mon reweight min pgs per osd = 4 2026-02-17T20:08:01.407 INFO:teuthology.orchestra.run.trial123.stdout: mon reweight min bytes per osd = 10 2026-02-17T20:08:01.407 INFO:teuthology.orchestra.run.trial123.stdout: mgr/telemetry/nag = false 2026-02-17T20:08:01.407 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:08:01.407 INFO:teuthology.orchestra.run.trial123.stdout:[mon] 2026-02-17T20:08:01.407 INFO:teuthology.orchestra.run.trial123.stdout: debug ms = 1 2026-02-17T20:08:01.407 INFO:teuthology.orchestra.run.trial123.stdout: debug mon = 20 2026-02-17T20:08:01.407 INFO:teuthology.orchestra.run.trial123.stdout: debug paxos = 20 2026-02-17T20:08:01.407 INFO:teuthology.orchestra.run.trial123.stdout: debug auth = 20 2026-02-17T20:08:01.407 INFO:teuthology.orchestra.run.trial123.stdout: mon data avail warn = 5 2026-02-17T20:08:01.407 INFO:teuthology.orchestra.run.trial123.stdout: mon mgr mkfs grace = 240 2026-02-17T20:08:01.407 INFO:teuthology.orchestra.run.trial123.stdout: mon reweight min pgs per osd = 4 2026-02-17T20:08:01.407 INFO:teuthology.orchestra.run.trial123.stdout: mon osd reporter subtree level = osd 2026-02-17T20:08:01.407 INFO:teuthology.orchestra.run.trial123.stdout: mon osd prime pg temp = true 2026-02-17T20:08:01.408 INFO:teuthology.orchestra.run.trial123.stdout: mon reweight min bytes per osd = 10 2026-02-17T20:08:01.408 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:08:01.408 INFO:teuthology.orchestra.run.trial123.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-17T20:08:01.408 INFO:teuthology.orchestra.run.trial123.stdout: auth mon ticket ttl = 660 # 11m 2026-02-17T20:08:01.408 INFO:teuthology.orchestra.run.trial123.stdout: auth service ticket ttl = 240 # 4m 2026-02-17T20:08:01.408 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:08:01.408 INFO:teuthology.orchestra.run.trial123.stdout: # don't complain about insecure global_id in the test suite 2026-02-17T20:08:01.408 INFO:teuthology.orchestra.run.trial123.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-17T20:08:01.408 INFO:teuthology.orchestra.run.trial123.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-17T20:08:01.408 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:08:01.408 INFO:teuthology.orchestra.run.trial123.stdout: # 1m isn't quite enough 2026-02-17T20:08:01.408 INFO:teuthology.orchestra.run.trial123.stdout: mon_down_mkfs_grace = 2m 2026-02-17T20:08:01.409 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:08:01.409 INFO:teuthology.orchestra.run.trial123.stdout: mon_warn_on_filestore_osds = false 2026-02-17T20:08:01.409 INFO:teuthology.orchestra.run.trial123.stdout: mon down mkfs grace = 300 2026-02-17T20:08:01.409 INFO:teuthology.orchestra.run.trial123.stdout: mon op complaint time = 120 2026-02-17T20:08:01.409 INFO:teuthology.orchestra.run.trial123.stdout: mon warn on osd down out interval zero = False 2026-02-17T20:08:01.409 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:08:01.409 INFO:teuthology.orchestra.run.trial123.stdout:[client] 2026-02-17T20:08:01.409 INFO:teuthology.orchestra.run.trial123.stdout: rgw cache enabled = true 2026-02-17T20:08:01.409 INFO:teuthology.orchestra.run.trial123.stdout: rgw enable ops log = true 2026-02-17T20:08:01.409 INFO:teuthology.orchestra.run.trial123.stdout: rgw enable usage log = true 2026-02-17T20:08:01.409 INFO:teuthology.orchestra.run.trial123.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-17T20:08:01.409 INFO:teuthology.orchestra.run.trial123.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-17T20:08:01.409 INFO:teuthology.orchestra.run.trial123.stdout: client mount timeout = 600 2026-02-17T20:08:01.410 INFO:teuthology.orchestra.run.trial123.stdout: debug client = 20 2026-02-17T20:08:01.410 INFO:teuthology.orchestra.run.trial123.stdout: debug ms = 1 2026-02-17T20:08:01.410 INFO:teuthology.orchestra.run.trial123.stdout: rados mon op timeout = 900 2026-02-17T20:08:01.410 INFO:teuthology.orchestra.run.trial123.stdout: rados osd op timeout = 900 2026-02-17T20:08:01.410 INFO:teuthology.orchestra.run.trial123.stdout:[mon.a] 2026-02-17T20:08:01.410 INFO:teuthology.orchestra.run.trial123.stdout:[mon.b] 2026-02-17T20:08:01.410 INFO:teuthology.orchestra.run.trial123.stdout:[mon.c] 2026-02-17T20:08:01.410 INFO:teuthology.orchestra.run.trial123.stdout:[mds] 2026-02-17T20:08:01.410 INFO:teuthology.orchestra.run.trial123.stdout: debug mds = 20 2026-02-17T20:08:01.410 INFO:teuthology.orchestra.run.trial123.stdout: debug mds balancer = 20 2026-02-17T20:08:01.410 INFO:teuthology.orchestra.run.trial123.stdout: debug ms = 1 2026-02-17T20:08:01.410 INFO:teuthology.orchestra.run.trial123.stdout: mds debug frag = True 2026-02-17T20:08:01.410 INFO:teuthology.orchestra.run.trial123.stdout: mds debug scatterstat = True 2026-02-17T20:08:01.411 INFO:teuthology.orchestra.run.trial123.stdout: mds op complaint time = 180 2026-02-17T20:08:01.411 INFO:teuthology.orchestra.run.trial123.stdout: mds verify scatter = True 2026-02-17T20:08:01.411 INFO:teuthology.orchestra.run.trial123.stdout: osd op complaint time = 180 2026-02-17T20:08:01.411 INFO:teuthology.orchestra.run.trial123.stdout: rados mon op timeout = 900 2026-02-17T20:08:01.411 INFO:teuthology.orchestra.run.trial123.stdout: rados osd op timeout = 900 2026-02-17T20:08:01.412 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-17T20:08:01.412 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-17T20:08:01.491 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-17T20:08:01.491 DEBUG:teuthology.orchestra.run.trial123:> set -ex 2026-02-17T20:08:01.492 DEBUG:teuthology.orchestra.run.trial123:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-17T20:08:01.547 DEBUG:teuthology.orchestra.run.trial123:> set -ex 2026-02-17T20:08:01.548 DEBUG:teuthology.orchestra.run.trial123:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-17T20:08:01.605 INFO:tasks.ceph:Sending monmap to node ubuntu@trial123.front.sepia.ceph.com 2026-02-17T20:08:01.605 DEBUG:teuthology.orchestra.run.trial123:> set -ex 2026-02-17T20:08:01.605 DEBUG:teuthology.orchestra.run.trial123:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-17T20:08:01.606 DEBUG:teuthology.orchestra.run.trial123:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T20:08:01.682 DEBUG:teuthology.orchestra.run.trial123:> set -ex 2026-02-17T20:08:01.682 DEBUG:teuthology.orchestra.run.trial123:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-17T20:08:01.740 INFO:tasks.ceph:Setting up mon nodes... 2026-02-17T20:08:01.740 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-17T20:08:01.741 DEBUG:teuthology.orchestra.run.trial123:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-17T20:08:01.822 INFO:teuthology.orchestra.run.trial123.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-17T20:08:01.824 DEBUG:teuthology.orchestra.run.trial123:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2026-02-17T20:08:01.905 INFO:teuthology.orchestra.run.trial123.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2026-02-17T20:08:01.908 INFO:tasks.ceph:Setting up mds nodes... 2026-02-17T20:08:01.908 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-17T20:08:01.908 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-17T20:08:01.908 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial123.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2026-02-17T20:08:01.908 DEBUG:teuthology.orchestra.run.trial123:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-17T20:08:01.971 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-17T20:08:01.971 INFO:tasks.ceph:role: osd.0 2026-02-17T20:08:01.971 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial123.front.sepia.ceph.com 2026-02-17T20:08:01.972 DEBUG:teuthology.orchestra.run.trial123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-17T20:08:02.036 INFO:teuthology.orchestra.run.trial123.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T20:08:02.036 INFO:teuthology.orchestra.run.trial123.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T20:08:02.036 INFO:teuthology.orchestra.run.trial123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T20:08:02.037 INFO:teuthology.orchestra.run.trial123.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T20:08:02.037 INFO:teuthology.orchestra.run.trial123.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T20:08:02.037 INFO:teuthology.orchestra.run.trial123.stdout: = sunit=0 swidth=0 blks 2026-02-17T20:08:02.037 INFO:teuthology.orchestra.run.trial123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T20:08:02.037 INFO:teuthology.orchestra.run.trial123.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T20:08:02.037 INFO:teuthology.orchestra.run.trial123.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T20:08:02.037 INFO:teuthology.orchestra.run.trial123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T20:08:02.624 INFO:teuthology.orchestra.run.trial123.stdout:Discarding blocks...Done. 2026-02-17T20:08:02.626 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial123.front.sepia.ceph.com -o noatime 2026-02-17T20:08:02.626 DEBUG:teuthology.orchestra.run.trial123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-17T20:08:02.696 DEBUG:teuthology.orchestra.run.trial123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-17T20:08:02.762 DEBUG:teuthology.orchestra.run.trial123:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-17T20:08:02.828 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-17T20:08:02.828 INFO:tasks.ceph:role: osd.1 2026-02-17T20:08:02.828 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial123.front.sepia.ceph.com 2026-02-17T20:08:02.829 DEBUG:teuthology.orchestra.run.trial123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-17T20:08:02.893 INFO:teuthology.orchestra.run.trial123.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T20:08:02.893 INFO:teuthology.orchestra.run.trial123.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T20:08:02.893 INFO:teuthology.orchestra.run.trial123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T20:08:02.893 INFO:teuthology.orchestra.run.trial123.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T20:08:02.893 INFO:teuthology.orchestra.run.trial123.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T20:08:02.893 INFO:teuthology.orchestra.run.trial123.stdout: = sunit=0 swidth=0 blks 2026-02-17T20:08:02.893 INFO:teuthology.orchestra.run.trial123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T20:08:02.894 INFO:teuthology.orchestra.run.trial123.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T20:08:02.894 INFO:teuthology.orchestra.run.trial123.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T20:08:02.894 INFO:teuthology.orchestra.run.trial123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T20:08:03.452 INFO:teuthology.orchestra.run.trial123.stdout:Discarding blocks...Done. 2026-02-17T20:08:03.454 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial123.front.sepia.ceph.com -o noatime 2026-02-17T20:08:03.455 DEBUG:teuthology.orchestra.run.trial123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-17T20:08:03.523 DEBUG:teuthology.orchestra.run.trial123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-17T20:08:03.591 DEBUG:teuthology.orchestra.run.trial123:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-17T20:08:03.656 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-17T20:08:03.656 INFO:tasks.ceph:role: osd.2 2026-02-17T20:08:03.656 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial123.front.sepia.ceph.com 2026-02-17T20:08:03.656 DEBUG:teuthology.orchestra.run.trial123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-17T20:08:03.720 INFO:teuthology.orchestra.run.trial123.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T20:08:03.721 INFO:teuthology.orchestra.run.trial123.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T20:08:03.721 INFO:teuthology.orchestra.run.trial123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T20:08:03.721 INFO:teuthology.orchestra.run.trial123.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T20:08:03.721 INFO:teuthology.orchestra.run.trial123.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T20:08:03.721 INFO:teuthology.orchestra.run.trial123.stdout: = sunit=0 swidth=0 blks 2026-02-17T20:08:03.721 INFO:teuthology.orchestra.run.trial123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T20:08:03.721 INFO:teuthology.orchestra.run.trial123.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T20:08:03.721 INFO:teuthology.orchestra.run.trial123.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T20:08:03.721 INFO:teuthology.orchestra.run.trial123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T20:08:04.300 INFO:teuthology.orchestra.run.trial123.stdout:Discarding blocks...Done. 2026-02-17T20:08:04.302 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial123.front.sepia.ceph.com -o noatime 2026-02-17T20:08:04.303 DEBUG:teuthology.orchestra.run.trial123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2026-02-17T20:08:04.370 DEBUG:teuthology.orchestra.run.trial123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-17T20:08:04.436 DEBUG:teuthology.orchestra.run.trial123:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2026-02-17T20:08:04.502 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-17T20:08:04.502 INFO:tasks.ceph:role: osd.3 2026-02-17T20:08:04.502 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial123.front.sepia.ceph.com 2026-02-17T20:08:04.502 DEBUG:teuthology.orchestra.run.trial123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-17T20:08:04.569 INFO:teuthology.orchestra.run.trial123.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T20:08:04.569 INFO:teuthology.orchestra.run.trial123.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T20:08:04.570 INFO:teuthology.orchestra.run.trial123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T20:08:04.570 INFO:teuthology.orchestra.run.trial123.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T20:08:04.570 INFO:teuthology.orchestra.run.trial123.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T20:08:04.570 INFO:teuthology.orchestra.run.trial123.stdout: = sunit=0 swidth=0 blks 2026-02-17T20:08:04.570 INFO:teuthology.orchestra.run.trial123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T20:08:04.570 INFO:teuthology.orchestra.run.trial123.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T20:08:04.570 INFO:teuthology.orchestra.run.trial123.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T20:08:04.570 INFO:teuthology.orchestra.run.trial123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T20:08:05.127 INFO:teuthology.orchestra.run.trial123.stdout:Discarding blocks...Done. 2026-02-17T20:08:05.129 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial123.front.sepia.ceph.com -o noatime 2026-02-17T20:08:05.130 DEBUG:teuthology.orchestra.run.trial123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2026-02-17T20:08:05.201 DEBUG:teuthology.orchestra.run.trial123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2026-02-17T20:08:05.268 DEBUG:teuthology.orchestra.run.trial123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T20:08:05.343 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:05.345+0000 7f9eb1dd6440 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-17T20:08:05.344 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:05.345+0000 7f9eb1dd6440 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-17T20:08:05.344 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:05.345+0000 7f9eb1dd6440 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2026-02-17T20:08:05.344 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:05.345+0000 7f9eb1dd6440 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2026-02-17T20:08:05.344 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:05.345+0000 7f9eb1dd6440 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2026-02-17T20:08:05.344 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:05.346+0000 7f9eb1dd6440 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-17T20:08:05.864 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:05.866+0000 7f9eb1dd6440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2026-02-17T20:08:06.631 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:06.632+0000 7f9eb1dd6440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2026-02-17T20:08:07.393 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:07.394+0000 7f9eb1dd6440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2026-02-17T20:08:08.186 DEBUG:teuthology.orchestra.run.trial123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-17T20:08:08.252 DEBUG:teuthology.orchestra.run.trial123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T20:08:08.328 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:08.330+0000 7f672ac08440 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-17T20:08:08.329 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:08.330+0000 7f672ac08440 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-17T20:08:08.329 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:08.330+0000 7f672ac08440 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2026-02-17T20:08:08.329 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:08.330+0000 7f672ac08440 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2026-02-17T20:08:08.329 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:08.330+0000 7f672ac08440 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2026-02-17T20:08:08.330 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:08.331+0000 7f672ac08440 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-17T20:08:08.850 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:08.851+0000 7f672ac08440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2026-02-17T20:08:09.612 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:09.613+0000 7f672ac08440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2026-02-17T20:08:10.374 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:10.376+0000 7f672ac08440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2026-02-17T20:08:11.170 DEBUG:teuthology.orchestra.run.trial123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-17T20:08:11.234 DEBUG:teuthology.orchestra.run.trial123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T20:08:11.310 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:11.311+0000 7f26b5a06440 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2026-02-17T20:08:11.310 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:11.311+0000 7f26b5a06440 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2026-02-17T20:08:11.310 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:11.311+0000 7f26b5a06440 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2026-02-17T20:08:11.310 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:11.311+0000 7f26b5a06440 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2026-02-17T20:08:11.310 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:11.311+0000 7f26b5a06440 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2026-02-17T20:08:11.311 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:11.312+0000 7f26b5a06440 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2026-02-17T20:08:11.830 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:11.832+0000 7f26b5a06440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2026-02-17T20:08:12.593 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:12.595+0000 7f26b5a06440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2026-02-17T20:08:13.356 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:13.357+0000 7f26b5a06440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2026-02-17T20:08:14.149 DEBUG:teuthology.orchestra.run.trial123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-17T20:08:14.215 DEBUG:teuthology.orchestra.run.trial123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T20:08:14.290 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:14.291+0000 7f1bf8dd6440 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2026-02-17T20:08:14.290 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:14.291+0000 7f1bf8dd6440 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2026-02-17T20:08:14.290 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:14.291+0000 7f1bf8dd6440 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2026-02-17T20:08:14.290 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:14.291+0000 7f1bf8dd6440 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2026-02-17T20:08:14.290 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:14.291+0000 7f1bf8dd6440 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2026-02-17T20:08:14.291 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:14.292+0000 7f1bf8dd6440 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2026-02-17T20:08:14.811 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:14.812+0000 7f1bf8dd6440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2026-02-17T20:08:15.573 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:15.574+0000 7f1bf8dd6440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2026-02-17T20:08:16.336 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:16.337+0000 7f1bf8dd6440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2026-02-17T20:08:17.133 DEBUG:teuthology.orchestra.run.trial123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2026-02-17T20:08:17.198 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-17T20:08:17.199 DEBUG:teuthology.orchestra.run.trial123:> set -ex 2026-02-17T20:08:17.199 DEBUG:teuthology.orchestra.run.trial123:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-17T20:08:17.262 DEBUG:teuthology.orchestra.run.trial123:> set -ex 2026-02-17T20:08:17.262 DEBUG:teuthology.orchestra.run.trial123:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2026-02-17T20:08:17.326 DEBUG:teuthology.orchestra.run.trial123:> set -ex 2026-02-17T20:08:17.326 DEBUG:teuthology.orchestra.run.trial123:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-17T20:08:17.391 DEBUG:teuthology.orchestra.run.trial123:> set -ex 2026-02-17T20:08:17.391 DEBUG:teuthology.orchestra.run.trial123:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-17T20:08:17.453 DEBUG:teuthology.orchestra.run.trial123:> set -ex 2026-02-17T20:08:17.453 DEBUG:teuthology.orchestra.run.trial123:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-17T20:08:17.516 DEBUG:teuthology.orchestra.run.trial123:> set -ex 2026-02-17T20:08:17.516 DEBUG:teuthology.orchestra.run.trial123:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2026-02-17T20:08:17.580 INFO:tasks.ceph:Adding keys to all mons... 2026-02-17T20:08:17.581 DEBUG:teuthology.orchestra.run.trial123:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-17T20:08:17.643 INFO:teuthology.orchestra.run.trial123.stdout:[mgr.x] 2026-02-17T20:08:17.643 INFO:teuthology.orchestra.run.trial123.stdout: key = AQChypRp2Q8rMRAAiZvnAZL5dFNygqznu1zs8w== 2026-02-17T20:08:17.643 INFO:teuthology.orchestra.run.trial123.stdout:[mgr.y] 2026-02-17T20:08:17.643 INFO:teuthology.orchestra.run.trial123.stdout: key = AQChypRpNVkiNhAABJm/Oc3tA16cX6tNLQVqJA== 2026-02-17T20:08:17.643 INFO:teuthology.orchestra.run.trial123.stdout:[osd.0] 2026-02-17T20:08:17.643 INFO:teuthology.orchestra.run.trial123.stdout: key = AQClypRpNGqgFBAApgYvHEeSqzwVIW7wwqNuXw== 2026-02-17T20:08:17.643 INFO:teuthology.orchestra.run.trial123.stdout:[osd.1] 2026-02-17T20:08:17.643 INFO:teuthology.orchestra.run.trial123.stdout: key = AQCoypRpnbO6ExAAdnXr3QEpqrf6YMRYExIjKA== 2026-02-17T20:08:17.644 INFO:teuthology.orchestra.run.trial123.stdout:[osd.2] 2026-02-17T20:08:17.644 INFO:teuthology.orchestra.run.trial123.stdout: key = AQCrypRpUIGbEhAA9UvqTn6dnCw+4IrMWbRnbQ== 2026-02-17T20:08:17.644 INFO:teuthology.orchestra.run.trial123.stdout:[osd.3] 2026-02-17T20:08:17.644 INFO:teuthology.orchestra.run.trial123.stdout: key = AQCuypRp/B1sERAA9rqN0gZVsUcBLFDRSdWo/A== 2026-02-17T20:08:17.645 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-17T20:08:17.721 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-17T20:08:17.799 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T20:08:17.876 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T20:08:17.954 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T20:08:18.028 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T20:08:18.103 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-17T20:08:18.103 DEBUG:teuthology.orchestra.run.trial123:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-17T20:08:18.166 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-17T20:08:18.245 DEBUG:teuthology.orchestra.run.trial123:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-17T20:08:18.309 DEBUG:teuthology.orchestra.run.trial123:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2026-02-17T20:08:18.373 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-17T20:08:18.453 DEBUG:teuthology.orchestra.run.trial123:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2026-02-17T20:08:18.517 DEBUG:teuthology.orchestra.run.trial123:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2026-02-17T20:08:18.581 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-17T20:08:18.660 DEBUG:teuthology.orchestra.run.trial123:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2026-02-17T20:08:18.723 DEBUG:teuthology.orchestra.run.trial123:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-17T20:08:18.779 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-17T20:08:18.780 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-17T20:08:18.780 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-17T20:08:18.821 INFO:tasks.ceph.mon.a:Started 2026-02-17T20:08:18.821 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-17T20:08:18.822 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-17T20:08:18.824 INFO:tasks.ceph.mon.b:Started 2026-02-17T20:08:18.824 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-17T20:08:18.824 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-17T20:08:18.825 INFO:tasks.ceph.mon.c:Started 2026-02-17T20:08:18.825 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-17T20:08:18.825 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-17T20:08:18.825 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-17T20:08:18.827 INFO:tasks.ceph.mgr.x:Started 2026-02-17T20:08:18.827 INFO:tasks.ceph.mgr.y:Restarting daemon 2026-02-17T20:08:18.827 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2026-02-17T20:08:18.830 INFO:tasks.ceph.mgr.y:Started 2026-02-17T20:08:18.830 INFO:tasks.ceph:Setting crush tunables to default 2026-02-17T20:08:18.830 DEBUG:teuthology.orchestra.run.trial123:> sudo ceph --cluster ceph osd crush tunables default 2026-02-17T20:08:18.894 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:18.895+0000 7f3dd339c640 1 Processor -- start 2026-02-17T20:08:18.894 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:18.895+0000 7f3dd339c640 1 -- start start 2026-02-17T20:08:18.894 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:18.895+0000 7f3dd339c640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3dcc096da0 0x7f3dcc0684f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:18.894 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:18.895+0000 7f3dd339c640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f3dcc068e00 0x7f3dcc12ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:18.894 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:18.895+0000 7f3dd339c640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dcc097b20 con 0x7f3dcc068a30 2026-02-17T20:08:18.894 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:18.895+0000 7f3dd339c640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dcc06a050 con 0x7f3dcc068e00 2026-02-17T20:08:18.894 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:18.895+0000 7f3dd339c640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3dcc0923a0 con 0x7f3dcc096da0 2026-02-17T20:08:18.894 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:18.895+0000 7f3dd1939640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f3dcc068e00 0x7f3dcc12ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:18.894 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:18.895+0000 7f3dd1138640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3dcc096da0 0x7f3dcc0684f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:18.894 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:18.895+0000 7f3dd1939640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f3dcc068e00 0x7f3dcc12ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:53312/0 (socket says 10.20.193.123:53312) 2026-02-17T20:08:18.894 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:18.895+0000 7f3dd1939640 1 -- 10.20.193.123:0/1056910463 learned_addr learned my addr 10.20.193.123:0/1056910463 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:18.894 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:18.895+0000 7f3dd0937640 1 --1- 10.20.193.123:0/1056910463 >> v1:10.20.193.123:6789/0 conn(0x7f3dcc068a30 0x7f3dcc12a510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:58972/0 (socket says 10.20.193.123:58972) 2026-02-17T20:08:18.894 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:18.895+0000 7f3dd1939640 1 -- 10.20.193.123:0/1056910463 >> v2:10.20.193.123:3300/0 conn(0x7f3dcc068e00 msgr2=0x7f3dcc12ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T20:08:18.894 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:18.895+0000 7f3dd1939640 1 -- 10.20.193.123:0/1056910463 >> v2:10.20.193.123:3300/0 conn(0x7f3dcc068e00 msgr2=0x7f3dcc12ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T20:08:18.894 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:18.895+0000 7f3dd1939640 1 --2- 10.20.193.123:0/1056910463 >> v2:10.20.193.123:3300/0 conn(0x7f3dcc068e00 0x7f3dcc12ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2026-02-17T20:08:18.894 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:18.895+0000 7f3dd1138640 1 -- 10.20.193.123:0/1056910463 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3dcc096da0 msgr2=0x7f3dcc0684f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T20:08:18.894 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:18.895+0000 7f3dd1138640 1 -- 10.20.193.123:0/1056910463 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3dcc096da0 msgr2=0x7f3dcc0684f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T20:08:18.894 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:18.895+0000 7f3dd1138640 1 --2- 10.20.193.123:0/1056910463 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3dcc096da0 0x7f3dcc0684f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2026-02-17T20:08:18.894 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:18.895+0000 7f3dd1939640 1 --2- 10.20.193.123:0/1056910463 >> v2:10.20.193.123:3300/0 conn(0x7f3dcc068e00 0x7f3dcc12ac20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T20:08:18.894 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:18.895+0000 7f3dd1138640 1 --2- 10.20.193.123:0/1056910463 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3dcc096da0 0x7f3dcc0684f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T20:08:19.098 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.094+0000 7f3dc3fff640 1 -- 10.20.193.123:0/1056910463 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3819373900 0 0) 0x7f3dcc097b20 con 0x7f3dcc068a30 2026-02-17T20:08:19.099 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.094+0000 7f3dc3fff640 1 -- 10.20.193.123:0/1056910463 --> v1:10.20.193.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3db80034e0 con 0x7f3dcc068a30 2026-02-17T20:08:19.099 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.094+0000 7f3dc3fff640 1 -- 10.20.193.123:0/1056910463 <== mon.0 v1:10.20.193.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 950076917 0 0) 0x7f3db80034e0 con 0x7f3dcc068a30 2026-02-17T20:08:19.099 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.094+0000 7f3dc3fff640 1 -- 10.20.193.123:0/1056910463 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3dcc096da0 msgr2=0x7f3dcc0684f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T20:08:19.099 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.094+0000 7f3dc3fff640 1 --2- 10.20.193.123:0/1056910463 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3dcc096da0 0x7f3dcc0684f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.099 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.094+0000 7f3dc3fff640 1 -- 10.20.193.123:0/1056910463 >> v2:10.20.193.123:3300/0 conn(0x7f3dcc068e00 msgr2=0x7f3dcc12ac20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T20:08:19.099 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.094+0000 7f3dc3fff640 1 --2- 10.20.193.123:0/1056910463 >> v2:10.20.193.123:3300/0 conn(0x7f3dcc068e00 0x7f3dcc12ac20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.099 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.094+0000 7f3dc3fff640 1 -- 10.20.193.123:0/1056910463 --> v1:10.20.193.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dcc069bc0 con 0x7f3dcc068a30 2026-02-17T20:08:19.100 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.094+0000 7f3dc3fff640 1 -- 10.20.193.123:0/1056910463 <== mon.0 v1:10.20.193.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3148607444 0 0) 0x7f3dbc0014f0 con 0x7f3dcc068a30 2026-02-17T20:08:19.100 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.094+0000 7f3dc3fff640 1 -- 10.20.193.123:0/1056910463 >> v1:10.20.193.123:6789/0 conn(0x7f3dcc068a30 legacy=0x7f3dcc12a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:19.100 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.094+0000 7f3dc3fff640 1 --2- 10.20.193.123:0/1056910463 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f3db80039d0 0x7f3db8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:19.100 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.094+0000 7f3dc3fff640 1 --2- 10.20.193.123:0/1056910463 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3dcc096da0 0x7f3db8004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:19.100 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.095+0000 7f3dc3fff640 1 --2- 10.20.193.123:0/1056910463 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f3db8004cc0 0x7f3db8005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:19.100 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.095+0000 7f3dc3fff640 1 -- 10.20.193.123:0/1056910463 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dcc06a050 con 0x7f3db80039d0 2026-02-17T20:08:19.100 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.095+0000 7f3dc3fff640 1 -- 10.20.193.123:0/1056910463 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3db800bbe0 con 0x7f3db8004cc0 2026-02-17T20:08:19.100 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.095+0000 7f3dc3fff640 1 -- 10.20.193.123:0/1056910463 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3db800bda0 con 0x7f3dcc096da0 2026-02-17T20:08:19.100 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.095+0000 7f3dd1939640 1 --2- 10.20.193.123:0/1056910463 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f3db8004cc0 0x7f3db8005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:19.100 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.095+0000 7f3dd0937640 1 --2- 10.20.193.123:0/1056910463 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3dcc096da0 0x7f3db8004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:19.101 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.095+0000 7f3dd1138640 1 --2- 10.20.193.123:0/1056910463 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f3db80039d0 0x7f3db8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:19.101 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.095+0000 7f3dd0937640 1 -- 10.20.193.123:0/1056910463 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f3db8004cc0 msgr2=0x7f3db8005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:08:19.101 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.095+0000 7f3dd0937640 1 --2- 10.20.193.123:0/1056910463 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f3db8004cc0 0x7f3db8005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.101 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.095+0000 7f3dd0937640 1 -- 10.20.193.123:0/1056910463 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f3db80039d0 msgr2=0x7f3db8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:08:19.101 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.095+0000 7f3dd0937640 1 --2- 10.20.193.123:0/1056910463 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f3db80039d0 0x7f3db8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.101 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.095+0000 7f3dd0937640 1 -- 10.20.193.123:0/1056910463 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db80034e0 con 0x7f3dcc096da0 2026-02-17T20:08:19.101 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.095+0000 7f3dd1138640 1 --2- 10.20.193.123:0/1056910463 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f3db80039d0 0x7f3db8003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:08:19.101 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.095+0000 7f3dd0937640 1 --2- 10.20.193.123:0/1056910463 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3dcc096da0 0x7f3db8004780 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc007fd0 tx=0x7f3dbc02f4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6606939cdba8527 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:19.101 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.095+0000 7f3dc3fff640 1 -- 10.20.193.123:0/1056910463 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc0070f0 con 0x7f3dcc096da0 2026-02-17T20:08:19.101 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.095+0000 7f3dc3fff640 1 -- 10.20.193.123:0/1056910463 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dbc032070 con 0x7f3dcc096da0 2026-02-17T20:08:19.102 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.095+0000 7f3dc3fff640 1 -- 10.20.193.123:0/1056910463 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc0072d0 con 0x7f3dcc096da0 2026-02-17T20:08:19.102 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.096+0000 7f3dd339c640 1 -- 10.20.193.123:0/1056910463 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3dcc096da0 msgr2=0x7f3db8004780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:19.102 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.096+0000 7f3dd339c640 1 --2- 10.20.193.123:0/1056910463 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3dcc096da0 0x7f3db8004780 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc007fd0 tx=0x7f3dbc02f4d0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.102 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.096+0000 7f3dd1939640 1 -- 10.20.193.123:0/1056910463 reap_dead start 2026-02-17T20:08:19.102 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.096+0000 7f3dd339c640 1 -- 10.20.193.123:0/1056910463 shutdown_connections 2026-02-17T20:08:19.102 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.096+0000 7f3dd339c640 1 -- 10.20.193.123:0/1056910463 >> 10.20.193.123:0/1056910463 conn(0x7f3dcc097e90 msgr2=0x7f3dcc098290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:19.102 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.096+0000 7f3dd339c640 1 -- 10.20.193.123:0/1056910463 shutdown_connections 2026-02-17T20:08:19.102 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.096+0000 7f3dd339c640 1 -- 10.20.193.123:0/1056910463 wait complete. 2026-02-17T20:08:19.102 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.096+0000 7f3dd339c640 1 Processor -- start 2026-02-17T20:08:19.102 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.097+0000 7f3dd339c640 1 -- start start 2026-02-17T20:08:19.102 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.097+0000 7f3dd339c640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f3dcc096da0 0x7f3dcc1a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:19.103 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.097+0000 7f3dd339c640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3dcc1a56c0 0x7f3dcc1a5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:19.103 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.097+0000 7f3dd339c640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f3dcc1be190 0x7f3dcc1be630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:19.103 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.097+0000 7f3dd339c640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dcc06f780 con 0x7f3dcc096da0 2026-02-17T20:08:19.103 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.097+0000 7f3dd339c640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dcc1a7760 con 0x7f3dcc1be190 2026-02-17T20:08:19.103 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.097+0000 7f3dd339c640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3dcc06f4b0 con 0x7f3dcc1a56c0 2026-02-17T20:08:19.103 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.097+0000 7f3dd0937640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3dcc1a56c0 0x7f3dcc1a5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:19.103 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.097+0000 7f3dd1138640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f3dcc096da0 0x7f3dcc1a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:19.103 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.097+0000 7f3dd0937640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3dcc1a56c0 0x7f3dcc1a5b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:45152/0 (socket says 10.20.193.123:45152) 2026-02-17T20:08:19.103 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.097+0000 7f3dd0937640 1 -- 10.20.193.123:0/1793483928 learned_addr learned my addr 10.20.193.123:0/1793483928 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:19.103 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.097+0000 7f3dd1939640 1 --2- 10.20.193.123:0/1793483928 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f3dcc1be190 0x7f3dcc1be630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:19.104 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.097+0000 7f3dd1138640 1 -- 10.20.193.123:0/1793483928 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3dcc1a56c0 msgr2=0x7f3dcc1a5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:19.104 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.097+0000 7f3dd1138640 1 --2- 10.20.193.123:0/1793483928 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3dcc1a56c0 0x7f3dcc1a5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.104 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.097+0000 7f3dd1138640 1 -- 10.20.193.123:0/1793483928 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f3dcc1be190 msgr2=0x7f3dcc1be630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:19.104 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.097+0000 7f3dd1138640 1 --2- 10.20.193.123:0/1793483928 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f3dcc1be190 0x7f3dcc1be630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.104 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.097+0000 7f3dd1138640 1 -- 10.20.193.123:0/1793483928 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dcc1a7390 con 0x7f3dcc096da0 2026-02-17T20:08:19.104 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.097+0000 7f3dd1939640 1 --2- 10.20.193.123:0/1793483928 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f3dcc1be190 0x7f3dcc1be630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:08:19.104 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.097+0000 7f3dd1138640 1 --2- 10.20.193.123:0/1793483928 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f3dcc096da0 0x7f3dcc1a5180 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8006fd0 tx=0x7f3dc8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:19.104 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.097+0000 7f3dc1ffb640 1 -- 10.20.193.123:0/1793483928 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8010e70 con 0x7f3dcc096da0 2026-02-17T20:08:19.104 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.097+0000 7f3dc1ffb640 1 -- 10.20.193.123:0/1793483928 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc800ee30 con 0x7f3dcc096da0 2026-02-17T20:08:19.104 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.097+0000 7f3dc1ffb640 1 -- 10.20.193.123:0/1793483928 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc80166d0 con 0x7f3dcc096da0 2026-02-17T20:08:19.104 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.097+0000 7f3dd339c640 1 -- 10.20.193.123:0/1793483928 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dcc06ec50 con 0x7f3dcc096da0 2026-02-17T20:08:19.105 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.097+0000 7f3dd339c640 1 -- 10.20.193.123:0/1793483928 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dcc1beb70 con 0x7f3dcc096da0 2026-02-17T20:08:19.105 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.097+0000 7f3dc1ffb640 1 -- 10.20.193.123:0/1793483928 <== mon.0 v2:10.20.193.123:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f3dc8016cd0 con 0x7f3dcc096da0 2026-02-17T20:08:19.105 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.097+0000 7f3dc1ffb640 1 -- 10.20.193.123:0/1793483928 <== mon.0 v2:10.20.193.123:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f3dc8014a70 con 0x7f3dcc096da0 2026-02-17T20:08:19.105 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.098+0000 7f3dd339c640 1 -- 10.20.193.123:0/1793483928 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dcc05f010 con 0x7f3dcc096da0 2026-02-17T20:08:19.105 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.099+0000 7f3dc1ffb640 1 -- 10.20.193.123:0/1793483928 <== mon.0 v2:10.20.193.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72049 (secure 0 0 0) 0x7f3dc803e990 con 0x7f3dcc096da0 2026-02-17T20:08:19.127 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.128+0000 7f3dd339c640 1 -- 10.20.193.123:0/1793483928 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f3dcc0646a0 con 0x7f3dcc096da0 2026-02-17T20:08:19.128 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.130+0000 7f3dc1ffb640 1 -- 10.20.193.123:0/1793483928 <== mon.0 v2:10.20.193.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f3dc802d020 con 0x7f3dcc096da0 2026-02-17T20:08:19.128 INFO:teuthology.orchestra.run.trial123.stderr:adjusted tunables profile to default 2026-02-17T20:08:19.130 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.131+0000 7f3dd339c640 1 -- 10.20.193.123:0/1793483928 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f3dcc096da0 msgr2=0x7f3dcc1a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:19.130 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.131+0000 7f3dd339c640 1 --2- 10.20.193.123:0/1793483928 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f3dcc096da0 0x7f3dcc1a5180 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8006fd0 tx=0x7f3dc8008040 comp rx=0 tx=0).stop 2026-02-17T20:08:19.130 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.131+0000 7f3dd339c640 1 -- 10.20.193.123:0/1793483928 shutdown_connections 2026-02-17T20:08:19.130 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.131+0000 7f3dd339c640 1 --2- 10.20.193.123:0/1793483928 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f3dcc1be190 0x7f3dcc1be630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.130 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.131+0000 7f3dd339c640 1 --2- 10.20.193.123:0/1793483928 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3dcc1a56c0 0x7f3dcc1a5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.130 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.131+0000 7f3dd339c640 1 --2- 10.20.193.123:0/1793483928 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f3dcc096da0 0x7f3dcc1a5180 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.130 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.131+0000 7f3dd339c640 1 -- 10.20.193.123:0/1793483928 >> 10.20.193.123:0/1793483928 conn(0x7f3dcc097e90 msgr2=0x7f3dcc09a030 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:19.130 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.131+0000 7f3dd339c640 1 -- 10.20.193.123:0/1793483928 shutdown_connections 2026-02-17T20:08:19.130 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.131+0000 7f3dd339c640 1 -- 10.20.193.123:0/1793483928 wait complete. 2026-02-17T20:08:19.136 INFO:tasks.ceph:check_enable_crimson: False 2026-02-17T20:08:19.136 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-17T20:08:19.137 DEBUG:teuthology.orchestra.run.trial123:> set -ex 2026-02-17T20:08:19.137 DEBUG:teuthology.orchestra.run.trial123:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-17T20:08:19.162 DEBUG:teuthology.orchestra.run.trial123:> set -ex 2026-02-17T20:08:19.163 DEBUG:teuthology.orchestra.run.trial123:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-17T20:08:19.198 INFO:tasks.ceph.mgr.y.trial123.stderr:2026-02-17T20:08:19.199+0000 7fbb31615ec0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-17T20:08:19.222 DEBUG:teuthology.orchestra.run.trial123:> set -ex 2026-02-17T20:08:19.222 DEBUG:teuthology.orchestra.run.trial123:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-17T20:08:19.287 DEBUG:teuthology.orchestra.run.trial123:> set -ex 2026-02-17T20:08:19.287 DEBUG:teuthology.orchestra.run.trial123:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2026-02-17T20:08:19.307 INFO:tasks.ceph.mgr.y.trial123.stderr:2026-02-17T20:08:19.309+0000 7fbb31615ec0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-17T20:08:19.331 DEBUG:teuthology.orchestra.run.trial123:> sudo ceph --cluster ceph osd new 5cfdb97e-5584-42e3-8c32-a9b4ace549f6 0 2026-02-17T20:08:19.333 INFO:tasks.ceph.mgr.y.trial123.stderr:2026-02-17T20:08:19.335+0000 7fbb31615ec0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-17T20:08:19.366 INFO:tasks.ceph.mgr.y.trial123.stderr:2026-02-17T20:08:19.368+0000 7fbb31615ec0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-17T20:08:19.388 INFO:tasks.ceph.mgr.y.trial123.stderr:2026-02-17T20:08:19.390+0000 7fbb31615ec0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-17T20:08:19.396 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.398+0000 7f9a9529b640 1 Processor -- start 2026-02-17T20:08:19.396 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.398+0000 7f9a9529b640 1 -- start start 2026-02-17T20:08:19.398 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.398+0000 7f9a9529b640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f9a90096a60 0x7f9a90096e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:19.398 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.398+0000 7f9a9529b640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f9a90097370 0x7f9a90129e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:19.398 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.398+0000 7f9a9529b640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f9a9012a390 0x7f9a9012a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:19.398 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.398+0000 7f9a9529b640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a9012ad50 con 0x7f9a9012a390 2026-02-17T20:08:19.398 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.398+0000 7f9a9529b640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a90099a70 con 0x7f9a90096a60 2026-02-17T20:08:19.398 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.398+0000 7f9a9529b640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a900992e0 con 0x7f9a90097370 2026-02-17T20:08:19.398 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.398+0000 7f9a8f7fe640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f9a9012a390 0x7f9a9012a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:19.398 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.398+0000 7f9a8effd640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f9a90096a60 0x7f9a90096e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:19.398 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.398+0000 7f9a8f7fe640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f9a9012a390 0x7f9a9012a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:53386/0 (socket says 10.20.193.123:53386) 2026-02-17T20:08:19.398 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.399+0000 7f9a8f7fe640 1 -- 10.20.193.123:0/2353100841 learned_addr learned my addr 10.20.193.123:0/2353100841 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:19.398 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.398+0000 7f9a87fff640 1 --2- 10.20.193.123:0/2353100841 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f9a90097370 0x7f9a90129e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:19.398 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.399+0000 7f9a8f7fe640 1 -- 10.20.193.123:0/2353100841 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f9a90097370 msgr2=0x7f9a90129e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:08:19.398 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.399+0000 7f9a8f7fe640 1 --2- 10.20.193.123:0/2353100841 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f9a90097370 0x7f9a90129e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.398 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.399+0000 7f9a8f7fe640 1 -- 10.20.193.123:0/2353100841 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f9a90096a60 msgr2=0x7f9a90096e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:08:19.398 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.399+0000 7f9a8f7fe640 1 --2- 10.20.193.123:0/2353100841 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f9a90096a60 0x7f9a90096e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.399 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.399+0000 7f9a8f7fe640 1 -- 10.20.193.123:0/2353100841 --> v2:10.20.193.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a9009a2d0 con 0x7f9a9012a390 2026-02-17T20:08:19.399 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.399+0000 7f9a8effd640 1 --2- 10.20.193.123:0/2353100841 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f9a90096a60 0x7f9a90096e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:08:19.399 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.399+0000 7f9a8f7fe640 1 --2- 10.20.193.123:0/2353100841 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f9a9012a390 0x7f9a9012a810 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9a88009f20 tx=0x7f9a8802f310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e375c32702fd4ed server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:19.399 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.399+0000 7f9a8e7fc640 1 -- 10.20.193.123:0/2353100841 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8802fc10 con 0x7f9a9012a390 2026-02-17T20:08:19.399 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.399+0000 7f9a8e7fc640 1 -- 10.20.193.123:0/2353100841 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a8802fd70 con 0x7f9a9012a390 2026-02-17T20:08:19.399 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.399+0000 7f9a8e7fc640 1 -- 10.20.193.123:0/2353100841 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a88007630 con 0x7f9a9012a390 2026-02-17T20:08:19.399 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.399+0000 7f9a9529b640 1 -- 10.20.193.123:0/2353100841 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f9a9012a390 msgr2=0x7f9a9012a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:19.399 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.399+0000 7f9a9529b640 1 --2- 10.20.193.123:0/2353100841 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f9a9012a390 0x7f9a9012a810 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9a88009f20 tx=0x7f9a8802f310 comp rx=0 tx=0).stop 2026-02-17T20:08:19.399 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.400+0000 7f9a9529b640 1 -- 10.20.193.123:0/2353100841 shutdown_connections 2026-02-17T20:08:19.399 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.400+0000 7f9a9529b640 1 --2- 10.20.193.123:0/2353100841 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f9a9012a390 0x7f9a9012a810 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.399 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.400+0000 7f9a9529b640 1 --2- 10.20.193.123:0/2353100841 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f9a90097370 0x7f9a90129e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.399 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.400+0000 7f9a9529b640 1 --2- 10.20.193.123:0/2353100841 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f9a90096a60 0x7f9a90096e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.399 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.400+0000 7f9a9529b640 1 -- 10.20.193.123:0/2353100841 >> 10.20.193.123:0/2353100841 conn(0x7f9a9009d750 msgr2=0x7f9a9009db50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:19.399 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.400+0000 7f9a9529b640 1 -- 10.20.193.123:0/2353100841 shutdown_connections 2026-02-17T20:08:19.399 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.400+0000 7f9a9529b640 1 -- 10.20.193.123:0/2353100841 wait complete. 2026-02-17T20:08:19.401 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.400+0000 7f9a9529b640 1 Processor -- start 2026-02-17T20:08:19.401 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.400+0000 7f9a9529b640 1 -- start start 2026-02-17T20:08:19.401 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.401+0000 7f9a9529b640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f9a90096a60 0x7f9a901bdea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:19.401 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.401+0000 7f9a9529b640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f9a90097370 0x7f9a901be3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:19.401 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.401+0000 7f9a9529b640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f9a9012a390 0x7f9a901be920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:19.401 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.401+0000 7f9a9529b640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9011eb50 con 0x7f9a90096a60 2026-02-17T20:08:19.401 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.401+0000 7f9a9529b640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a90120c40 con 0x7f9a9012a390 2026-02-17T20:08:19.401 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.401+0000 7f9a9529b640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a90120db0 con 0x7f9a90097370 2026-02-17T20:08:19.401 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.401+0000 7f9a8effd640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f9a90096a60 0x7f9a901bdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:19.401 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.401+0000 7f9a87fff640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f9a90097370 0x7f9a901be3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:19.401 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.401+0000 7f9a8f7fe640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f9a9012a390 0x7f9a901be920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:19.401 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.401+0000 7f9a8effd640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f9a90096a60 0x7f9a901bdea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:53392/0 (socket says 10.20.193.123:53392) 2026-02-17T20:08:19.401 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.401+0000 7f9a8effd640 1 -- 10.20.193.123:0/3457444406 learned_addr learned my addr 10.20.193.123:0/3457444406 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:19.401 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.401+0000 7f9a8f7fe640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f9a9012a390 0x7f9a901be920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:32986/0 (socket says 10.20.193.123:32986) 2026-02-17T20:08:19.401 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.401+0000 7f9a8effd640 1 -- 10.20.193.123:0/3457444406 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f9a90097370 msgr2=0x7f9a901be3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:19.401 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.401+0000 7f9a8effd640 1 --2- 10.20.193.123:0/3457444406 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f9a90097370 0x7f9a901be3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.401 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.401+0000 7f9a8effd640 1 -- 10.20.193.123:0/3457444406 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f9a9012a390 msgr2=0x7f9a901be920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:19.401 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.401+0000 7f9a8effd640 1 --2- 10.20.193.123:0/3457444406 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f9a9012a390 0x7f9a901be920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.401 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.401+0000 7f9a8effd640 1 -- 10.20.193.123:0/3457444406 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a80009390 con 0x7f9a90096a60 2026-02-17T20:08:19.401 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.401+0000 7f9a87fff640 1 --2- 10.20.193.123:0/3457444406 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f9a90097370 0x7f9a901be3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:08:19.402 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.401+0000 7f9a8effd640 1 --2- 10.20.193.123:0/3457444406 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f9a90096a60 0x7f9a901bdea0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9a8000ea70 tx=0x7f9a800090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:19.402 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.401+0000 7f9a877fe640 1 -- 10.20.193.123:0/3457444406 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8000cae0 con 0x7f9a90096a60 2026-02-17T20:08:19.402 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.401+0000 7f9a877fe640 1 -- 10.20.193.123:0/3457444406 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a8000cc40 con 0x7f9a90096a60 2026-02-17T20:08:19.402 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.401+0000 7f9a9529b640 1 -- 10.20.193.123:0/3457444406 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a88009ae0 con 0x7f9a90096a60 2026-02-17T20:08:19.402 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.401+0000 7f9a877fe640 1 -- 10.20.193.123:0/3457444406 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a80013470 con 0x7f9a90096a60 2026-02-17T20:08:19.402 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.401+0000 7f9a9529b640 1 -- 10.20.193.123:0/3457444406 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a9011d850 con 0x7f9a90096a60 2026-02-17T20:08:19.402 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.401+0000 7f9a877fe640 1 -- 10.20.193.123:0/3457444406 <== mon.0 v2:10.20.193.123:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f9a80005970 con 0x7f9a90096a60 2026-02-17T20:08:19.402 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.401+0000 7f9a877fe640 1 -- 10.20.193.123:0/3457444406 <== mon.0 v2:10.20.193.123:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f9a80006020 con 0x7f9a90096a60 2026-02-17T20:08:19.402 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.402+0000 7f9a9529b640 1 -- 10.20.193.123:0/3457444406 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a9005f010 con 0x7f9a90096a60 2026-02-17T20:08:19.402 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.403+0000 7f9a877fe640 1 -- 10.20.193.123:0/3457444406 <== mon.0 v2:10.20.193.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72049 (secure 0 0 0) 0x7f9a80021060 con 0x7f9a90096a60 2026-02-17T20:08:19.415 INFO:tasks.ceph.mgr.y.trial123.stderr:2026-02-17T20:08:19.417+0000 7fbb31615ec0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-17T20:08:19.433 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.435+0000 7f9a9529b640 1 -- 10.20.193.123:0/3457444406 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5cfdb97e-5584-42e3-8c32-a9b4ace549f6", "id": 0} v 0) v1 -- 0x7f9a90064720 con 0x7f9a90096a60 2026-02-17T20:08:19.435 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.437+0000 7f9a877fe640 1 -- 10.20.193.123:0/3457444406 <== mon.0 v2:10.20.193.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5cfdb97e-5584-42e3-8c32-a9b4ace549f6", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9a80029020 con 0x7f9a90096a60 2026-02-17T20:08:19.436 INFO:teuthology.orchestra.run.trial123.stdout:0 2026-02-17T20:08:19.436 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.438+0000 7f9a9529b640 1 -- 10.20.193.123:0/3457444406 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f9a90096a60 msgr2=0x7f9a901bdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:19.436 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.438+0000 7f9a9529b640 1 --2- 10.20.193.123:0/3457444406 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f9a90096a60 0x7f9a901bdea0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9a8000ea70 tx=0x7f9a800090f0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.436 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.438+0000 7f9a9529b640 1 -- 10.20.193.123:0/3457444406 shutdown_connections 2026-02-17T20:08:19.436 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.438+0000 7f9a9529b640 1 --2- 10.20.193.123:0/3457444406 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f9a9012a390 0x7f9a901be920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.436 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.438+0000 7f9a9529b640 1 --2- 10.20.193.123:0/3457444406 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f9a90097370 0x7f9a901be3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.436 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.438+0000 7f9a9529b640 1 --2- 10.20.193.123:0/3457444406 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f9a90096a60 0x7f9a901bdea0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.436 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.438+0000 7f9a9529b640 1 -- 10.20.193.123:0/3457444406 >> 10.20.193.123:0/3457444406 conn(0x7f9a9009d750 msgr2=0x7f9a90116660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:19.436 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.438+0000 7f9a9529b640 1 -- 10.20.193.123:0/3457444406 shutdown_connections 2026-02-17T20:08:19.436 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.438+0000 7f9a9529b640 1 -- 10.20.193.123:0/3457444406 wait complete. 2026-02-17T20:08:19.444 DEBUG:teuthology.orchestra.run.trial123:> sudo ceph --cluster ceph osd new 9b7f5906-8ae8-4a34-8e71-1ba7cf3eeda1 1 2026-02-17T20:08:19.480 INFO:tasks.ceph.mgr.y.trial123.stderr:2026-02-17T20:08:19.481+0000 7fbb31615ec0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-17T20:08:19.506 INFO:tasks.ceph.mgr.y.trial123.stderr:2026-02-17T20:08:19.507+0000 7fbb31615ec0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-17T20:08:19.545 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.545+0000 7fac2e292640 1 Processor -- start 2026-02-17T20:08:19.545 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.545+0000 7fac2e292640 1 -- start start 2026-02-17T20:08:19.545 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.545+0000 7fac2e292640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fac28096a60 0x7fac28096e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:19.545 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.545+0000 7fac2e292640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fac2812a570 0x7fac281321d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:19.545 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.545+0000 7fac2e292640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac2809a430 con 0x7fac28097370 2026-02-17T20:08:19.545 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.545+0000 7fac2e292640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac28097e40 con 0x7fac2812a570 2026-02-17T20:08:19.545 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.545+0000 7fac2e292640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac2809a680 con 0x7fac28096a60 2026-02-17T20:08:19.545 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.545+0000 7fac27fff640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fac28096a60 0x7fac28096e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:19.545 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.545+0000 7fac27fff640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fac28096a60 0x7fac28096e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:45202/0 (socket says 10.20.193.123:45202) 2026-02-17T20:08:19.545 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.545+0000 7fac27fff640 1 -- 10.20.193.123:0/3073212508 learned_addr learned my addr 10.20.193.123:0/3073212508 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:19.545 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.545+0000 7fac2c82f640 1 --2- 10.20.193.123:0/3073212508 >> v2:10.20.193.123:3300/0 conn(0x7fac2812a570 0x7fac281321d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:19.545 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.545+0000 7fac27fff640 1 -- 10.20.193.123:0/3073212508 >> v2:10.20.193.123:3300/0 conn(0x7fac2812a570 msgr2=0x7fac281321d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:08:19.545 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.545+0000 7fac27fff640 1 --2- 10.20.193.123:0/3073212508 >> v2:10.20.193.123:3300/0 conn(0x7fac2812a570 0x7fac281321d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.545 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.545+0000 7fac27fff640 1 -- 10.20.193.123:0/3073212508 >> v1:10.20.193.123:6789/0 conn(0x7fac28097370 legacy=0x7fac28129e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:19.545 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.545+0000 7fac27fff640 1 -- 10.20.193.123:0/3073212508 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac28099440 con 0x7fac28096a60 2026-02-17T20:08:19.546 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.546+0000 7fac27fff640 1 --2- 10.20.193.123:0/3073212508 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fac28096a60 0x7fac28096e30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fac18009910 tx=0x7fac1802ee10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4eaac832a1d10d63 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:19.546 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.546+0000 7fac277fe640 1 -- 10.20.193.123:0/3073212508 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1802f970 con 0x7fac28096a60 2026-02-17T20:08:19.546 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.546+0000 7fac277fe640 1 -- 10.20.193.123:0/3073212508 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac1802fad0 con 0x7fac28096a60 2026-02-17T20:08:19.546 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.546+0000 7fac277fe640 1 -- 10.20.193.123:0/3073212508 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac18037440 con 0x7fac28096a60 2026-02-17T20:08:19.546 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.546+0000 7fac2e292640 1 -- 10.20.193.123:0/3073212508 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fac28096a60 msgr2=0x7fac28096e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:19.546 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.546+0000 7fac2e292640 1 --2- 10.20.193.123:0/3073212508 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fac28096a60 0x7fac28096e30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fac18009910 tx=0x7fac1802ee10 comp rx=0 tx=0).stop 2026-02-17T20:08:19.546 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.546+0000 7fac2e292640 1 -- 10.20.193.123:0/3073212508 shutdown_connections 2026-02-17T20:08:19.546 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.546+0000 7fac2e292640 1 --2- 10.20.193.123:0/3073212508 >> v2:10.20.193.123:3300/0 conn(0x7fac2812a570 0x7fac281321d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.546 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.546+0000 7fac2e292640 1 --2- 10.20.193.123:0/3073212508 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fac28096a60 0x7fac28096e30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.546 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.546+0000 7fac2e292640 1 -- 10.20.193.123:0/3073212508 >> 10.20.193.123:0/3073212508 conn(0x7fac2809d8d0 msgr2=0x7fac2809dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:19.546 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.546+0000 7fac2e292640 1 -- 10.20.193.123:0/3073212508 shutdown_connections 2026-02-17T20:08:19.546 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.546+0000 7fac2e292640 1 -- 10.20.193.123:0/3073212508 wait complete. 2026-02-17T20:08:19.547 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.547+0000 7fac2e292640 1 Processor -- start 2026-02-17T20:08:19.548 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.547+0000 7fac2e292640 1 -- start start 2026-02-17T20:08:19.548 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.547+0000 7fac2e292640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fac28096a60 0x7fac2811a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:19.548 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.547+0000 7fac2e292640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fac28097370 0x7fac2811a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:19.548 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.547+0000 7fac2e292640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fac2812a570 0x7fac2811ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:19.548 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.547+0000 7fac2e292640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2811c010 con 0x7fac2812a570 2026-02-17T20:08:19.548 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.547+0000 7fac2e292640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac2811dca0 con 0x7fac28096a60 2026-02-17T20:08:19.548 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.547+0000 7fac2e292640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac2811d080 con 0x7fac28097370 2026-02-17T20:08:19.548 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.547+0000 7fac2c82f640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fac2812a570 0x7fac2811ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:19.548 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.547+0000 7fac1ffff640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fac28097370 0x7fac2811a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:19.548 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.547+0000 7fac2c82f640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fac2812a570 0x7fac2811ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:53430/0 (socket says 10.20.193.123:53430) 2026-02-17T20:08:19.548 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.547+0000 7fac2c82f640 1 -- 10.20.193.123:0/3704608816 learned_addr learned my addr 10.20.193.123:0/3704608816 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:19.548 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.547+0000 7fac27fff640 1 --2- 10.20.193.123:0/3704608816 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fac28096a60 0x7fac2811a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:19.548 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.547+0000 7fac2c82f640 1 -- 10.20.193.123:0/3704608816 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fac28097370 msgr2=0x7fac2811a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:19.548 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.547+0000 7fac2c82f640 1 --2- 10.20.193.123:0/3704608816 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fac28097370 0x7fac2811a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.548 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.547+0000 7fac2c82f640 1 -- 10.20.193.123:0/3704608816 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fac28096a60 msgr2=0x7fac2811a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:19.548 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.547+0000 7fac2c82f640 1 --2- 10.20.193.123:0/3704608816 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fac28096a60 0x7fac2811a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.548 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.547+0000 7fac2c82f640 1 -- 10.20.193.123:0/3704608816 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac18009450 con 0x7fac2812a570 2026-02-17T20:08:19.548 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.548+0000 7fac2c82f640 1 --2- 10.20.193.123:0/3704608816 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fac2812a570 0x7fac2811ae80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fac20009ec0 tx=0x7fac2000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:19.548 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.548+0000 7fac257fa640 1 -- 10.20.193.123:0/3704608816 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2000ce80 con 0x7fac2812a570 2026-02-17T20:08:19.548 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.548+0000 7fac257fa640 1 -- 10.20.193.123:0/3704608816 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac2000f040 con 0x7fac2812a570 2026-02-17T20:08:19.548 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.548+0000 7fac2e292640 1 -- 10.20.193.123:0/3704608816 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac2811b4b0 con 0x7fac2812a570 2026-02-17T20:08:19.548 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.548+0000 7fac257fa640 1 -- 10.20.193.123:0/3704608816 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac200146d0 con 0x7fac2812a570 2026-02-17T20:08:19.548 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.548+0000 7fac2e292640 1 -- 10.20.193.123:0/3704608816 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac281be460 con 0x7fac2812a570 2026-02-17T20:08:19.548 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.548+0000 7fac257fa640 1 -- 10.20.193.123:0/3704608816 <== mon.0 v2:10.20.193.123:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fac20014cd0 con 0x7fac2812a570 2026-02-17T20:08:19.548 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.548+0000 7fac257fa640 1 -- 10.20.193.123:0/3704608816 <== mon.0 v2:10.20.193.123:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7fac200133e0 con 0x7fac2812a570 2026-02-17T20:08:19.548 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.548+0000 7fac2e292640 1 -- 10.20.193.123:0/3704608816 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac2805f010 con 0x7fac2812a570 2026-02-17T20:08:19.549 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.549+0000 7fac257fa640 1 -- 10.20.193.123:0/3704608816 <== mon.0 v2:10.20.193.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72049 (secure 0 0 0) 0x7fac20018020 con 0x7fac2812a570 2026-02-17T20:08:19.556 INFO:tasks.ceph.mgr.y.trial123.stderr:2026-02-17T20:08:19.557+0000 7fbb31615ec0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-17T20:08:19.565 INFO:tasks.ceph.mgr.x.trial123.stderr:2026-02-17T20:08:19.566+0000 7fa1a400fec0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-17T20:08:19.582 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.582+0000 7fac2e292640 1 -- 10.20.193.123:0/3704608816 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9b7f5906-8ae8-4a34-8e71-1ba7cf3eeda1", "id": 1} v 0) v1 -- 0x7fac280646d0 con 0x7fac2812a570 2026-02-17T20:08:19.584 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.585+0000 7fac257fa640 1 -- 10.20.193.123:0/3704608816 <== mon.0 v2:10.20.193.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9b7f5906-8ae8-4a34-8e71-1ba7cf3eeda1", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fac2001d500 con 0x7fac2812a570 2026-02-17T20:08:19.585 INFO:teuthology.orchestra.run.trial123.stdout:1 2026-02-17T20:08:19.586 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.585+0000 7fac2e292640 1 -- 10.20.193.123:0/3704608816 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fac2812a570 msgr2=0x7fac2811ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:19.586 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.585+0000 7fac2e292640 1 --2- 10.20.193.123:0/3704608816 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fac2812a570 0x7fac2811ae80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fac20009ec0 tx=0x7fac2000b040 comp rx=0 tx=0).stop 2026-02-17T20:08:19.586 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.586+0000 7fac2e292640 1 -- 10.20.193.123:0/3704608816 shutdown_connections 2026-02-17T20:08:19.586 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.586+0000 7fac2e292640 1 --2- 10.20.193.123:0/3704608816 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fac2812a570 0x7fac2811ae80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.587 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.586+0000 7fac2e292640 1 --2- 10.20.193.123:0/3704608816 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fac28097370 0x7fac2811a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.587 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.586+0000 7fac2e292640 1 --2- 10.20.193.123:0/3704608816 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fac28096a60 0x7fac2811a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.587 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.586+0000 7fac2e292640 1 -- 10.20.193.123:0/3704608816 >> 10.20.193.123:0/3704608816 conn(0x7fac2809d8d0 msgr2=0x7fac2809c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:19.587 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.586+0000 7fac2e292640 1 -- 10.20.193.123:0/3704608816 shutdown_connections 2026-02-17T20:08:19.587 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.586+0000 7fac2e292640 1 -- 10.20.193.123:0/3704608816 wait complete. 2026-02-17T20:08:19.594 DEBUG:teuthology.orchestra.run.trial123:> sudo ceph --cluster ceph osd new db6be5e2-fdd2-460f-bf35-269d92577824 2 2026-02-17T20:08:19.599 INFO:tasks.ceph.mgr.y.trial123.stderr:2026-02-17T20:08:19.600+0000 7fbb31615ec0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-17T20:08:19.626 INFO:tasks.ceph.mgr.y.trial123.stderr:2026-02-17T20:08:19.626+0000 7fbb31615ec0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-17T20:08:19.650 INFO:tasks.ceph.mgr.y.trial123.stderr:2026-02-17T20:08:19.651+0000 7fbb31615ec0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-17T20:08:19.667 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.662+0000 7fadf02db640 1 Processor -- start 2026-02-17T20:08:19.667 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.663+0000 7fadf02db640 1 -- start start 2026-02-17T20:08:19.667 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.663+0000 7fadf02db640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fade80690f0 0x7fade812f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:19.667 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.663+0000 7fadf02db640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fade812f7d0 0x7fade8131bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:19.667 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.663+0000 7fadf02db640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fade8069dc0 con 0x7fade8068610 2026-02-17T20:08:19.668 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.663+0000 7fadf02db640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fade80694c0 con 0x7fade812f7d0 2026-02-17T20:08:19.668 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.663+0000 7fadf02db640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fade806be70 con 0x7fade80690f0 2026-02-17T20:08:19.668 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.663+0000 7fadee077640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7fade8068610 0x7fade80689e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:58996/0 (socket says 10.20.193.123:58996) 2026-02-17T20:08:19.668 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.663+0000 7fadee077640 1 -- 10.20.193.123:0/64627673 learned_addr learned my addr 10.20.193.123:0/64627673 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:08:19.668 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.663+0000 7fadee878640 1 --2- 10.20.193.123:0/64627673 >> v2:10.20.193.123:3300/0 conn(0x7fade812f7d0 0x7fade8131bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:19.668 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.663+0000 7faded876640 1 --2- 10.20.193.123:0/64627673 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fade80690f0 0x7fade812f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:19.668 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.663+0000 7faded075640 1 -- 10.20.193.123:0/64627673 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3052195592 0 0) 0x7fade8069dc0 con 0x7fade8068610 2026-02-17T20:08:19.668 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.663+0000 7faded075640 1 -- 10.20.193.123:0/64627673 --> v1:10.20.193.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadd40034e0 con 0x7fade8068610 2026-02-17T20:08:19.668 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.663+0000 7faded876640 1 -- 10.20.193.123:0/64627673 >> v2:10.20.193.123:3300/0 conn(0x7fade812f7d0 msgr2=0x7fade8131bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:08:19.668 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.663+0000 7faded876640 1 --2- 10.20.193.123:0/64627673 >> v2:10.20.193.123:3300/0 conn(0x7fade812f7d0 0x7fade8131bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.668 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.663+0000 7faded876640 1 -- 10.20.193.123:0/64627673 >> v1:10.20.193.123:6789/0 conn(0x7fade8068610 legacy=0x7fade80689e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:19.669 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.663+0000 7faded876640 1 -- 10.20.193.123:0/64627673 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade8097f40 con 0x7fade80690f0 2026-02-17T20:08:19.669 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.663+0000 7fadee878640 1 --2- 10.20.193.123:0/64627673 >> v2:10.20.193.123:3300/0 conn(0x7fade812f7d0 0x7fade8131bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:08:19.669 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.664+0000 7faded876640 1 --2- 10.20.193.123:0/64627673 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fade80690f0 0x7fade812f290 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fadd8009850 tx=0x7fadd802ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eee838b8e42ad7ac server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:19.669 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.664+0000 7faded075640 1 -- 10.20.193.123:0/64627673 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd802f8b0 con 0x7fade80690f0 2026-02-17T20:08:19.669 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.664+0000 7faded075640 1 -- 10.20.193.123:0/64627673 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd802fa10 con 0x7fade80690f0 2026-02-17T20:08:19.669 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.664+0000 7faded075640 1 -- 10.20.193.123:0/64627673 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd802fdb0 con 0x7fade80690f0 2026-02-17T20:08:19.669 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.664+0000 7fadf02db640 1 -- 10.20.193.123:0/64627673 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fade80690f0 msgr2=0x7fade812f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:19.669 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.664+0000 7fadf02db640 1 --2- 10.20.193.123:0/64627673 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fade80690f0 0x7fade812f290 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fadd8009850 tx=0x7fadd802ed50 comp rx=0 tx=0).stop 2026-02-17T20:08:19.669 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.664+0000 7fadf02db640 1 -- 10.20.193.123:0/64627673 shutdown_connections 2026-02-17T20:08:19.669 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.664+0000 7fadf02db640 1 --2- 10.20.193.123:0/64627673 >> v2:10.20.193.123:3300/0 conn(0x7fade812f7d0 0x7fade8131bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.670 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.664+0000 7fadf02db640 1 --2- 10.20.193.123:0/64627673 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fade80690f0 0x7fade812f290 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.670 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.664+0000 7fadf02db640 1 -- 10.20.193.123:0/64627673 >> 10.20.193.123:0/64627673 conn(0x7fade809b640 msgr2=0x7fade809ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:19.670 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.664+0000 7fadf02db640 1 -- 10.20.193.123:0/64627673 shutdown_connections 2026-02-17T20:08:19.670 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.664+0000 7fadf02db640 1 -- 10.20.193.123:0/64627673 wait complete. 2026-02-17T20:08:19.670 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.665+0000 7fadf02db640 1 Processor -- start 2026-02-17T20:08:19.670 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.665+0000 7fadf02db640 1 -- start start 2026-02-17T20:08:19.670 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.665+0000 7fadf02db640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fade8068610 0x7fade811c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:19.670 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.665+0000 7fadf02db640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fade80690f0 0x7fade811cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:19.670 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.665+0000 7fadf02db640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fade812f7d0 0x7fade811d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:19.670 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.665+0000 7fadf02db640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade811e590 con 0x7fade80690f0 2026-02-17T20:08:19.671 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.665+0000 7fadf02db640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fade811da90 con 0x7fade8068610 2026-02-17T20:08:19.671 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.665+0000 7fadf02db640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fade811fda0 con 0x7fade812f7d0 2026-02-17T20:08:19.671 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.665+0000 7faded876640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fade80690f0 0x7fade811cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:19.671 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.665+0000 7faded876640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fade80690f0 0x7fade811cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:53448/0 (socket says 10.20.193.123:53448) 2026-02-17T20:08:19.671 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.665+0000 7fadee878640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fade812f7d0 0x7fade811d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:19.671 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.665+0000 7faded876640 1 -- 10.20.193.123:0/4084199592 learned_addr learned my addr 10.20.193.123:0/4084199592 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:19.671 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.665+0000 7fadee077640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fade8068610 0x7fade811c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:19.671 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.665+0000 7fadee878640 1 -- 10.20.193.123:0/4084199592 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fade8068610 msgr2=0x7fade811c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:19.671 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.665+0000 7fadee878640 1 --2- 10.20.193.123:0/4084199592 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fade8068610 0x7fade811c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.671 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.665+0000 7fadee878640 1 -- 10.20.193.123:0/4084199592 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fade80690f0 msgr2=0x7fade811cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:19.672 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.665+0000 7fadee878640 1 --2- 10.20.193.123:0/4084199592 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fade80690f0 0x7fade811cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.672 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.665+0000 7fadee878640 1 -- 10.20.193.123:0/4084199592 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade0009a20 con 0x7fade812f7d0 2026-02-17T20:08:19.672 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.665+0000 7faded876640 1 --2- 10.20.193.123:0/4084199592 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fade80690f0 0x7fade811cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:08:19.672 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.665+0000 7fadee878640 1 --2- 10.20.193.123:0/4084199592 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fade812f7d0 0x7fade811d460 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fade0009f10 tx=0x7fade000b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:19.672 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.665+0000 7faddeffd640 1 -- 10.20.193.123:0/4084199592 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade0014480 con 0x7fade812f7d0 2026-02-17T20:08:19.672 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.665+0000 7faddeffd640 1 -- 10.20.193.123:0/4084199592 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade000f040 con 0x7fade812f7d0 2026-02-17T20:08:19.672 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.665+0000 7fadf02db640 1 -- 10.20.193.123:0/4084199592 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadd8009390 con 0x7fade812f7d0 2026-02-17T20:08:19.672 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.665+0000 7faddeffd640 1 -- 10.20.193.123:0/4084199592 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade0014850 con 0x7fade812f7d0 2026-02-17T20:08:19.672 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.665+0000 7fadf02db640 1 -- 10.20.193.123:0/4084199592 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fade811f880 con 0x7fade812f7d0 2026-02-17T20:08:19.672 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.665+0000 7faddeffd640 1 -- 10.20.193.123:0/4084199592 <== mon.2 v2:10.20.193.123:3302/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fade0003020 con 0x7fade812f7d0 2026-02-17T20:08:19.672 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.666+0000 7faddeffd640 1 -- 10.20.193.123:0/4084199592 <== mon.2 v2:10.20.193.123:3302/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7fade001d410 con 0x7fade812f7d0 2026-02-17T20:08:19.672 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.666+0000 7fadf02db640 1 -- 10.20.193.123:0/4084199592 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fade805f010 con 0x7fade812f7d0 2026-02-17T20:08:19.673 INFO:tasks.ceph.mgr.x.trial123.stderr:2026-02-17T20:08:19.666+0000 7fa1a400fec0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-17T20:08:19.673 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.667+0000 7faddeffd640 1 -- 10.20.193.123:0/4084199592 <== mon.2 v2:10.20.193.123:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72049 (secure 0 0 0) 0x7fade0018030 con 0x7fade812f7d0 2026-02-17T20:08:19.677 INFO:tasks.ceph.mgr.y.trial123.stderr:2026-02-17T20:08:19.678+0000 7fbb31615ec0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-17T20:08:19.686 INFO:tasks.ceph.mgr.x.trial123.stderr:2026-02-17T20:08:19.687+0000 7fa1a400fec0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-17T20:08:19.698 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.699+0000 7fadf02db640 1 -- 10.20.193.123:0/4084199592 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_command({"prefix": "osd new", "uuid": "db6be5e2-fdd2-460f-bf35-269d92577824", "id": 2} v 0) v1 -- 0x7fade8064730 con 0x7fade812f7d0 2026-02-17T20:08:19.699 INFO:tasks.ceph.mgr.y.trial123.stderr:2026-02-17T20:08:19.700+0000 7fbb31615ec0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-17T20:08:19.701 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.702+0000 7faddeffd640 1 -- 10.20.193.123:0/4084199592 <== mon.2 v2:10.20.193.123:3302/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "db6be5e2-fdd2-460f-bf35-269d92577824", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fade001d910 con 0x7fade812f7d0 2026-02-17T20:08:19.701 INFO:teuthology.orchestra.run.trial123.stdout:2 2026-02-17T20:08:19.702 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.703+0000 7fadf02db640 1 -- 10.20.193.123:0/4084199592 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fade812f7d0 msgr2=0x7fade811d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:19.702 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.703+0000 7fadf02db640 1 --2- 10.20.193.123:0/4084199592 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fade812f7d0 0x7fade811d460 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fade0009f10 tx=0x7fade000b040 comp rx=0 tx=0).stop 2026-02-17T20:08:19.702 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.703+0000 7fadf02db640 1 -- 10.20.193.123:0/4084199592 shutdown_connections 2026-02-17T20:08:19.702 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.703+0000 7fadf02db640 1 --2- 10.20.193.123:0/4084199592 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fade812f7d0 0x7fade811d460 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.702 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.703+0000 7fadf02db640 1 --2- 10.20.193.123:0/4084199592 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fade80690f0 0x7fade811cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.702 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.703+0000 7fadf02db640 1 --2- 10.20.193.123:0/4084199592 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fade8068610 0x7fade811c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.702 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.703+0000 7fadf02db640 1 -- 10.20.193.123:0/4084199592 >> 10.20.193.123:0/4084199592 conn(0x7fade809b640 msgr2=0x7fade8131410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:19.702 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.703+0000 7fadf02db640 1 -- 10.20.193.123:0/4084199592 shutdown_connections 2026-02-17T20:08:19.702 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.703+0000 7fadf02db640 1 -- 10.20.193.123:0/4084199592 wait complete. 2026-02-17T20:08:19.709 DEBUG:teuthology.orchestra.run.trial123:> sudo ceph --cluster ceph osd new 23275d01-0d57-497c-a600-d9aeef747af2 3 2026-02-17T20:08:19.712 INFO:tasks.ceph.mgr.x.trial123.stderr:2026-02-17T20:08:19.713+0000 7fa1a400fec0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-17T20:08:19.732 INFO:tasks.ceph.mgr.x.trial123.stderr:2026-02-17T20:08:19.733+0000 7fa1a400fec0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-17T20:08:19.745 INFO:tasks.ceph.mgr.y.trial123.stderr:2026-02-17T20:08:19.746+0000 7fbb31615ec0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-17T20:08:19.757 INFO:tasks.ceph.mgr.x.trial123.stderr:2026-02-17T20:08:19.758+0000 7fa1a400fec0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-17T20:08:19.768 INFO:tasks.ceph.mgr.y.trial123.stderr:2026-02-17T20:08:19.769+0000 7fbb31615ec0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-17T20:08:19.772 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.772+0000 7f42a1da7640 1 Processor -- start 2026-02-17T20:08:19.772 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.772+0000 7f42a1da7640 1 -- start start 2026-02-17T20:08:19.777 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.773+0000 7f42a1da7640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f429c096a60 0x7f429c096e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:19.777 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.773+0000 7f42a1da7640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f429c097370 0x7f429c129e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:19.777 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.773+0000 7f42a1da7640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f429c09a430 con 0x7f429c12a3a0 2026-02-17T20:08:19.777 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.773+0000 7f42a1da7640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f429c097e40 con 0x7f429c096a60 2026-02-17T20:08:19.777 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.773+0000 7f42a1da7640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f429c09a680 con 0x7f429c097370 2026-02-17T20:08:19.777 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.773+0000 7f429b7fe640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f429c096a60 0x7f429c096e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:19.777 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.773+0000 7f4293fff640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f429c097370 0x7f429c129e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:19.777 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.773+0000 7f429bfff640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7f429c12a3a0 0x7f429c1311c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:59008/0 (socket says 10.20.193.123:59008) 2026-02-17T20:08:19.777 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.773+0000 7f429bfff640 1 -- 10.20.193.123:0/2787867131 learned_addr learned my addr 10.20.193.123:0/2787867131 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:08:19.777 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.773+0000 7f429b7fe640 1 -- 10.20.193.123:0/2787867131 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f429c097370 msgr2=0x7f429c129e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:08:19.778 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.773+0000 7f429b7fe640 1 --2- 10.20.193.123:0/2787867131 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f429c097370 0x7f429c129e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.778 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.773+0000 7f429b7fe640 1 -- 10.20.193.123:0/2787867131 >> v1:10.20.193.123:6789/0 conn(0x7f429c12a3a0 legacy=0x7f429c1311c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:19.778 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.773+0000 7f429b7fe640 1 -- 10.20.193.123:0/2787867131 --> v2:10.20.193.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f429c099440 con 0x7f429c096a60 2026-02-17T20:08:19.778 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.773+0000 7f429affd640 1 -- 10.20.193.123:0/2787867131 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2441746346 0 0) 0x7f429c09a430 con 0x7f429c12a3a0 2026-02-17T20:08:19.778 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.773+0000 7f4293fff640 1 --2- 10.20.193.123:0/2787867131 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f429c097370 0x7f429c129e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:08:19.778 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.774+0000 7f429b7fe640 1 --2- 10.20.193.123:0/2787867131 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f429c096a60 0x7f429c096e30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f428c009850 tx=0x7f428c02ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94891f911accb6d1 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:19.778 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.774+0000 7f429affd640 1 -- 10.20.193.123:0/2787867131 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c02f8b0 con 0x7f429c096a60 2026-02-17T20:08:19.778 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.774+0000 7f429affd640 1 -- 10.20.193.123:0/2787867131 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f428c02fa10 con 0x7f429c096a60 2026-02-17T20:08:19.778 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.774+0000 7f429affd640 1 -- 10.20.193.123:0/2787867131 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c02fdb0 con 0x7f429c096a60 2026-02-17T20:08:19.778 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.774+0000 7f42a1da7640 1 -- 10.20.193.123:0/2787867131 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f429c096a60 msgr2=0x7f429c096e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:19.778 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.774+0000 7f42a1da7640 1 --2- 10.20.193.123:0/2787867131 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f429c096a60 0x7f429c096e30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f428c009850 tx=0x7f428c02ed50 comp rx=0 tx=0).stop 2026-02-17T20:08:19.778 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.774+0000 7f42a1da7640 1 -- 10.20.193.123:0/2787867131 shutdown_connections 2026-02-17T20:08:19.779 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.774+0000 7f42a1da7640 1 --2- 10.20.193.123:0/2787867131 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f429c097370 0x7f429c129e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.779 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.774+0000 7f42a1da7640 1 --2- 10.20.193.123:0/2787867131 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f429c096a60 0x7f429c096e30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.779 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.774+0000 7f42a1da7640 1 -- 10.20.193.123:0/2787867131 >> 10.20.193.123:0/2787867131 conn(0x7f429c09d8d0 msgr2=0x7f429c09dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:19.779 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.774+0000 7f42a1da7640 1 -- 10.20.193.123:0/2787867131 shutdown_connections 2026-02-17T20:08:19.779 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.774+0000 7f42a1da7640 1 -- 10.20.193.123:0/2787867131 wait complete. 2026-02-17T20:08:19.779 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.775+0000 7f42a1da7640 1 Processor -- start 2026-02-17T20:08:19.779 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.775+0000 7f42a1da7640 1 -- start start 2026-02-17T20:08:19.779 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.775+0000 7f42a1da7640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f429c096a60 0x7f429c11c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:19.779 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.775+0000 7f42a1da7640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f429c097370 0x7f429c11c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:19.779 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.775+0000 7f42a1da7640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f429c12a3a0 0x7f429c11ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:19.779 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.775+0000 7f42a1da7640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429c129dc0 con 0x7f429c096a60 2026-02-17T20:08:19.779 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.775+0000 7f42a1da7640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f429c11dd40 con 0x7f429c12a3a0 2026-02-17T20:08:19.780 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.775+0000 7f42a1da7640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f429c11f670 con 0x7f429c097370 2026-02-17T20:08:19.780 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.775+0000 7f429b7fe640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f429c096a60 0x7f429c11c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:19.780 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.775+0000 7f429bfff640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f429c12a3a0 0x7f429c11ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:19.780 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.775+0000 7f429b7fe640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f429c096a60 0x7f429c11c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:53464/0 (socket says 10.20.193.123:53464) 2026-02-17T20:08:19.780 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.775+0000 7f429b7fe640 1 -- 10.20.193.123:0/703059723 learned_addr learned my addr 10.20.193.123:0/703059723 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:19.780 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.775+0000 7f4293fff640 1 --2- 10.20.193.123:0/703059723 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f429c097370 0x7f429c11c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:19.780 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.776+0000 7f429bfff640 1 -- 10.20.193.123:0/703059723 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f429c097370 msgr2=0x7f429c11c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:19.780 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.776+0000 7f429bfff640 1 --2- 10.20.193.123:0/703059723 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f429c097370 0x7f429c11c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.780 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.776+0000 7f429bfff640 1 -- 10.20.193.123:0/703059723 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f429c096a60 msgr2=0x7f429c11c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:19.780 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.776+0000 7f429bfff640 1 --2- 10.20.193.123:0/703059723 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f429c096a60 0x7f429c11c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.780 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.776+0000 7f429bfff640 1 -- 10.20.193.123:0/703059723 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4284009390 con 0x7f429c12a3a0 2026-02-17T20:08:19.780 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.776+0000 7f429b7fe640 1 --2- 10.20.193.123:0/703059723 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f429c096a60 0x7f429c11c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:08:19.781 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.776+0000 7f429bfff640 1 --2- 10.20.193.123:0/703059723 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f429c12a3a0 0x7f429c11ce60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f429400cb90 tx=0x7f42940019a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:19.781 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.776+0000 7f4298ff9640 1 -- 10.20.193.123:0/703059723 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429400ce90 con 0x7f429c12a3a0 2026-02-17T20:08:19.781 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.776+0000 7f4298ff9640 1 -- 10.20.193.123:0/703059723 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f429400a850 con 0x7f429c12a3a0 2026-02-17T20:08:19.781 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.776+0000 7f42a1da7640 1 -- 10.20.193.123:0/703059723 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f428c009390 con 0x7f429c12a3a0 2026-02-17T20:08:19.781 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.776+0000 7f4298ff9640 1 -- 10.20.193.123:0/703059723 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429400ac50 con 0x7f429c12a3a0 2026-02-17T20:08:19.781 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.776+0000 7f42a1da7640 1 -- 10.20.193.123:0/703059723 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f429c129ad0 con 0x7f429c12a3a0 2026-02-17T20:08:19.781 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.776+0000 7f4298ff9640 1 -- 10.20.193.123:0/703059723 <== mon.1 v2:10.20.193.123:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f4294007300 con 0x7f429c12a3a0 2026-02-17T20:08:19.781 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.776+0000 7f4298ff9640 1 -- 10.20.193.123:0/703059723 <== mon.1 v2:10.20.193.123:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f4294007a50 con 0x7f429c12a3a0 2026-02-17T20:08:19.781 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.776+0000 7f42a1da7640 1 -- 10.20.193.123:0/703059723 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f429c11edf0 con 0x7f429c12a3a0 2026-02-17T20:08:19.782 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.778+0000 7f4298ff9640 1 -- 10.20.193.123:0/703059723 <== mon.1 v2:10.20.193.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72049 (secure 0 0 0) 0x7f42940075b0 con 0x7f429c12a3a0 2026-02-17T20:08:19.792 INFO:tasks.ceph.mgr.y.trial123.stderr:2026-02-17T20:08:19.792+0000 7fbb31615ec0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-17T20:08:19.807 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.808+0000 7f42a1da7640 1 -- 10.20.193.123:0/703059723 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command({"prefix": "osd new", "uuid": "23275d01-0d57-497c-a600-d9aeef747af2", "id": 3} v 0) v1 -- 0x7f429c11e670 con 0x7f429c12a3a0 2026-02-17T20:08:19.809 INFO:tasks.ceph.mgr.x.trial123.stderr:2026-02-17T20:08:19.810+0000 7fa1a400fec0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-17T20:08:19.810 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.810+0000 7f4298ff9640 1 -- 10.20.193.123:0/703059723 <== mon.1 v2:10.20.193.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "23275d01-0d57-497c-a600-d9aeef747af2", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f42940077d0 con 0x7f429c12a3a0 2026-02-17T20:08:19.810 INFO:teuthology.orchestra.run.trial123.stdout:3 2026-02-17T20:08:19.811 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.811+0000 7f42a1da7640 1 -- 10.20.193.123:0/703059723 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f429c12a3a0 msgr2=0x7f429c11ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:19.811 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.811+0000 7f42a1da7640 1 --2- 10.20.193.123:0/703059723 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f429c12a3a0 0x7f429c11ce60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f429400cb90 tx=0x7f42940019a0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.811 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.811+0000 7f42a1da7640 1 -- 10.20.193.123:0/703059723 shutdown_connections 2026-02-17T20:08:19.811 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.811+0000 7f42a1da7640 1 --2- 10.20.193.123:0/703059723 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f429c12a3a0 0x7f429c11ce60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.811 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.811+0000 7f42a1da7640 1 --2- 10.20.193.123:0/703059723 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f429c097370 0x7f429c11c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.812 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.811+0000 7f42a1da7640 1 --2- 10.20.193.123:0/703059723 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f429c096a60 0x7f429c11c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.812 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.811+0000 7f42a1da7640 1 -- 10.20.193.123:0/703059723 >> 10.20.193.123:0/703059723 conn(0x7f429c09d8d0 msgr2=0x7f429c114e20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:19.812 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.811+0000 7f42a1da7640 1 -- 10.20.193.123:0/703059723 shutdown_connections 2026-02-17T20:08:19.812 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.811+0000 7f42a1da7640 1 -- 10.20.193.123:0/703059723 wait complete. 2026-02-17T20:08:19.818 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-17T20:08:19.818 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2026-02-17T20:08:19.832 INFO:tasks.ceph.mgr.y.trial123.stderr:2026-02-17T20:08:19.832+0000 7fbb31615ec0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-17T20:08:19.834 INFO:tasks.ceph.osd.0:Started 2026-02-17T20:08:19.834 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-17T20:08:19.834 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2026-02-17T20:08:19.835 INFO:tasks.ceph.mgr.x.trial123.stderr:2026-02-17T20:08:19.834+0000 7fa1a400fec0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-17T20:08:19.836 INFO:tasks.ceph.osd.1:Started 2026-02-17T20:08:19.837 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-17T20:08:19.837 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2026-02-17T20:08:19.839 INFO:tasks.ceph.osd.2:Started 2026-02-17T20:08:19.839 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-17T20:08:19.839 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2026-02-17T20:08:19.842 INFO:tasks.ceph.osd.3:Started 2026-02-17T20:08:19.842 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T20:08:19.853 INFO:tasks.ceph.mgr.y.trial123.stderr:2026-02-17T20:08:19.854+0000 7fbb31615ec0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-17T20:08:19.874 INFO:tasks.ceph.mgr.x.trial123.stderr:2026-02-17T20:08:19.874+0000 7fa1a400fec0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-17T20:08:19.894 INFO:tasks.ceph.mgr.y.trial123.stderr:2026-02-17T20:08:19.894+0000 7fbb31615ec0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-17T20:08:19.911 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.907+0000 7f85cfd6e640 1 Processor -- start 2026-02-17T20:08:19.911 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.907+0000 7f85cfd6e640 1 -- start start 2026-02-17T20:08:19.911 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.907+0000 7f85cfd6e640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f85c8097540 0x7f85c812f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:19.911 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.907+0000 7f85cfd6e640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f85c812f6f0 0x7f85c8131ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:19.911 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.907+0000 7f85cfd6e640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85c809a430 con 0x7f85c8096a60 2026-02-17T20:08:19.911 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.907+0000 7f85cfd6e640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85c8097e40 con 0x7f85c8097540 2026-02-17T20:08:19.912 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.907+0000 7f85cfd6e640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85c809a680 con 0x7f85c812f6f0 2026-02-17T20:08:19.912 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.907+0000 7f85cd309640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f85c8097540 0x7f85c812f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:19.912 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.907+0000 7f85ce30b640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f85c812f6f0 0x7f85c8131ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:19.912 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.908+0000 7f85cdb0a640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7f85c8096a60 0x7f85c8096e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:59028/0 (socket says 10.20.193.123:59028) 2026-02-17T20:08:19.912 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.908+0000 7f85cdb0a640 1 -- 10.20.193.123:0/4288682943 learned_addr learned my addr 10.20.193.123:0/4288682943 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:08:19.912 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.908+0000 7f85cd309640 1 --2- 10.20.193.123:0/4288682943 >> v2:10.20.193.123:3300/0 conn(0x7f85c8097540 0x7f85c812f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:53500/0 (socket says 10.20.193.123:53500) 2026-02-17T20:08:19.912 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.908+0000 7f85cd309640 1 -- 10.20.193.123:0/4288682943 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f85c812f6f0 msgr2=0x7f85c8131ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:08:19.912 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.908+0000 7f85cd309640 1 --2- 10.20.193.123:0/4288682943 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f85c812f6f0 0x7f85c8131ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.912 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.908+0000 7f85cd309640 1 -- 10.20.193.123:0/4288682943 >> v1:10.20.193.123:6789/0 conn(0x7f85c8096a60 legacy=0x7f85c8096e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:19.912 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.908+0000 7f85cd309640 1 -- 10.20.193.123:0/4288682943 --> v2:10.20.193.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c8099440 con 0x7f85c8097540 2026-02-17T20:08:19.912 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.908+0000 7f85ccb08640 1 -- 10.20.193.123:0/4288682943 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1805846461 0 0) 0x7f85c809a430 con 0x7f85c8096a60 2026-02-17T20:08:19.913 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.908+0000 7f85cd309640 1 --2- 10.20.193.123:0/4288682943 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f85c8097540 0x7f85c812f1b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f85b8009850 tx=0x7f85b802ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7f8ee256fd4c0d4 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:19.913 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.908+0000 7f85ccb08640 1 -- 10.20.193.123:0/4288682943 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b802f8b0 con 0x7f85c8097540 2026-02-17T20:08:19.913 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.908+0000 7f85ccb08640 1 -- 10.20.193.123:0/4288682943 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b802fa10 con 0x7f85c8097540 2026-02-17T20:08:19.913 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.908+0000 7f85ccb08640 1 -- 10.20.193.123:0/4288682943 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b802fdb0 con 0x7f85c8097540 2026-02-17T20:08:19.913 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.909+0000 7f85cfd6e640 1 -- 10.20.193.123:0/4288682943 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f85c8097540 msgr2=0x7f85c812f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:19.913 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.909+0000 7f85cfd6e640 1 --2- 10.20.193.123:0/4288682943 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f85c8097540 0x7f85c812f1b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f85b8009850 tx=0x7f85b802ed50 comp rx=0 tx=0).stop 2026-02-17T20:08:19.913 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.909+0000 7f85cfd6e640 1 -- 10.20.193.123:0/4288682943 shutdown_connections 2026-02-17T20:08:19.913 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.909+0000 7f85cfd6e640 1 --2- 10.20.193.123:0/4288682943 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f85c812f6f0 0x7f85c8131ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.913 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.909+0000 7f85cfd6e640 1 --2- 10.20.193.123:0/4288682943 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f85c8097540 0x7f85c812f1b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.913 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.909+0000 7f85cfd6e640 1 -- 10.20.193.123:0/4288682943 >> 10.20.193.123:0/4288682943 conn(0x7f85c809d8d0 msgr2=0x7f85c809dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:19.913 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.909+0000 7f85cfd6e640 1 -- 10.20.193.123:0/4288682943 shutdown_connections 2026-02-17T20:08:19.913 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.909+0000 7f85cfd6e640 1 -- 10.20.193.123:0/4288682943 wait complete. 2026-02-17T20:08:19.914 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.909+0000 7f85cfd6e640 1 Processor -- start 2026-02-17T20:08:19.914 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.909+0000 7f85cfd6e640 1 -- start start 2026-02-17T20:08:19.914 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.909+0000 7f85cfd6e640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f85c8096a60 0x7f85c81140e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:19.914 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.909+0000 7f85cfd6e640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f85c8097540 0x7f85c8114620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:19.914 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.909+0000 7f85cfd6e640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f85c812f6f0 0x7f85c8114b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:19.914 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.909+0000 7f85cfd6e640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c81174a0 con 0x7f85c812f6f0 2026-02-17T20:08:19.914 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.909+0000 7f85cfd6e640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c8116cc0 con 0x7f85c8097540 2026-02-17T20:08:19.914 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.909+0000 7f85cfd6e640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85c8116380 con 0x7f85c8096a60 2026-02-17T20:08:19.914 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.909+0000 7f85cdb0a640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f85c8096a60 0x7f85c81140e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:19.914 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.909+0000 7f85ce30b640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f85c812f6f0 0x7f85c8114b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:19.914 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.909+0000 7f85cd309640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f85c8097540 0x7f85c8114620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:19.914 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.909+0000 7f85cdb0a640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f85c8096a60 0x7f85c81140e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:45274/0 (socket says 10.20.193.123:45274) 2026-02-17T20:08:19.915 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.909+0000 7f85cdb0a640 1 -- 10.20.193.123:0/1869587360 learned_addr learned my addr 10.20.193.123:0/1869587360 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:19.915 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.910+0000 7f85ce30b640 1 -- 10.20.193.123:0/1869587360 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f85c8096a60 msgr2=0x7f85c81140e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:19.915 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.910+0000 7f85ce30b640 1 --2- 10.20.193.123:0/1869587360 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f85c8096a60 0x7f85c81140e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.915 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.910+0000 7f85ce30b640 1 -- 10.20.193.123:0/1869587360 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f85c8097540 msgr2=0x7f85c8114620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:19.915 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.910+0000 7f85ce30b640 1 --2- 10.20.193.123:0/1869587360 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f85c8097540 0x7f85c8114620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.915 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.910+0000 7f85ce30b640 1 -- 10.20.193.123:0/1869587360 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b8009390 con 0x7f85c812f6f0 2026-02-17T20:08:19.915 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.910+0000 7f85ce30b640 1 --2- 10.20.193.123:0/1869587360 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f85c812f6f0 0x7f85c8114b60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f85c0009e20 tx=0x7f85c000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:19.915 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.910+0000 7f85be7fc640 1 -- 10.20.193.123:0/1869587360 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c000ce20 con 0x7f85c812f6f0 2026-02-17T20:08:19.915 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.910+0000 7f85be7fc640 1 -- 10.20.193.123:0/1869587360 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c000f040 con 0x7f85c812f6f0 2026-02-17T20:08:19.915 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.910+0000 7f85cfd6e640 1 -- 10.20.193.123:0/1869587360 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85c81267b0 con 0x7f85c812f6f0 2026-02-17T20:08:19.915 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.910+0000 7f85be7fc640 1 -- 10.20.193.123:0/1869587360 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c00146d0 con 0x7f85c812f6f0 2026-02-17T20:08:19.915 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.910+0000 7f85cfd6e640 1 -- 10.20.193.123:0/1869587360 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85c81152c0 con 0x7f85c812f6f0 2026-02-17T20:08:19.916 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.910+0000 7f85be7fc640 1 -- 10.20.193.123:0/1869587360 <== mon.0 v2:10.20.193.123:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f85c0014cd0 con 0x7f85c812f6f0 2026-02-17T20:08:19.916 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.910+0000 7f85be7fc640 1 -- 10.20.193.123:0/1869587360 <== mon.0 v2:10.20.193.123:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f85c001d400 con 0x7f85c812f6f0 2026-02-17T20:08:19.916 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.910+0000 7f85cfd6e640 1 -- 10.20.193.123:0/1869587360 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85c8115510 con 0x7f85c812f6f0 2026-02-17T20:08:19.916 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.912+0000 7f85be7fc640 1 -- 10.20.193.123:0/1869587360 <== mon.0 v2:10.20.193.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72049 (secure 0 0 0) 0x7f85c003b990 con 0x7f85c812f6f0 2026-02-17T20:08:19.917 INFO:tasks.ceph.mgr.x.trial123.stderr:2026-02-17T20:08:19.917+0000 7fa1a400fec0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-17T20:08:19.937 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.938+0000 7f85cfd6e640 1 -- 10.20.193.123:0/1869587360 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85c8116e80 con 0x7f85c812f6f0 2026-02-17T20:08:19.938 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.939+0000 7f85be7fc640 1 -- 10.20.193.123:0/1869587360 <== mon.0 v2:10.20.193.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4108 (secure 0 0 0) 0x7f85c002a070 con 0x7f85c812f6f0 2026-02-17T20:08:19.938 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:08:19.939 INFO:teuthology.orchestra.run.trial123.stdout:{"epoch":6,"fsid":"ddf342a7-b912-46f2-b373-84d7f3b75be2","created":"2026-02-17T20:08:19.090665+0000","modified":"2026-02-17T20:08:19.810884+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T20:08:19.810884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"5cfdb97e-5584-42e3-8c32-a9b4ace549f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9b7f5906-8ae8-4a34-8e71-1ba7cf3eeda1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"db6be5e2-fdd2-460f-bf35-269d92577824","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"23275d01-0d57-497c-a600-d9aeef747af2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T20:08:19.939 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.939+0000 7f85cfd6e640 1 -- 10.20.193.123:0/1869587360 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f85c812f6f0 msgr2=0x7f85c8114b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:19.940 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.939+0000 7f85cfd6e640 1 --2- 10.20.193.123:0/1869587360 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f85c812f6f0 0x7f85c8114b60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f85c0009e20 tx=0x7f85c000b040 comp rx=0 tx=0).stop 2026-02-17T20:08:19.940 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.939+0000 7f85cfd6e640 1 -- 10.20.193.123:0/1869587360 shutdown_connections 2026-02-17T20:08:19.940 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.939+0000 7f85cfd6e640 1 --2- 10.20.193.123:0/1869587360 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f85c812f6f0 0x7f85c8114b60 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.940 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.939+0000 7f85cfd6e640 1 --2- 10.20.193.123:0/1869587360 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f85c8097540 0x7f85c8114620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.940 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.939+0000 7f85cfd6e640 1 --2- 10.20.193.123:0/1869587360 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f85c8096a60 0x7f85c81140e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:19.940 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.939+0000 7f85cfd6e640 1 -- 10.20.193.123:0/1869587360 >> 10.20.193.123:0/1869587360 conn(0x7f85c809d8d0 msgr2=0x7f85c809c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:19.940 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.939+0000 7f85cfd6e640 1 -- 10.20.193.123:0/1869587360 shutdown_connections 2026-02-17T20:08:19.940 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:19.939+0000 7f85cfd6e640 1 -- 10.20.193.123:0/1869587360 wait complete. 2026-02-17T20:08:19.941 INFO:tasks.ceph.mgr.x.trial123.stderr:2026-02-17T20:08:19.941+0000 7fa1a400fec0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-17T20:08:19.947 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-17T20:08:19.947 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-17T20:08:19.956 INFO:tasks.ceph.mgr.y.trial123.stderr:2026-02-17T20:08:19.957+0000 7fbb31615ec0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-17T20:08:19.965 INFO:tasks.ceph.mgr.x.trial123.stderr:2026-02-17T20:08:19.965+0000 7fa1a400fec0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-17T20:08:19.978 INFO:tasks.ceph.mgr.y.trial123.stderr:2026-02-17T20:08:19.979+0000 7fbb31615ec0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-17T20:08:19.989 INFO:tasks.ceph.mgr.x.trial123.stderr:2026-02-17T20:08:19.989+0000 7fa1a400fec0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-17T20:08:20.009 INFO:tasks.ceph.mgr.x.trial123.stderr:2026-02-17T20:08:20.009+0000 7fa1a400fec0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-17T20:08:20.049 INFO:tasks.ceph.mgr.x.trial123.stderr:2026-02-17T20:08:20.049+0000 7fa1a400fec0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-17T20:08:20.069 INFO:tasks.ceph.mgr.x.trial123.stderr:2026-02-17T20:08:20.070+0000 7fa1a400fec0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-17T20:08:20.090 INFO:tasks.ceph.mgr.x.trial123.stderr:2026-02-17T20:08:20.091+0000 7fa1a400fec0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-17T20:08:20.129 INFO:tasks.ceph.mgr.x.trial123.stderr:2026-02-17T20:08:20.129+0000 7fa1a400fec0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-17T20:08:20.139 INFO:tasks.ceph.mgr.y.trial123.stderr:2026-02-17T20:08:20.139+0000 7fbb31615ec0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-17T20:08:20.149 INFO:tasks.ceph.mgr.x.trial123.stderr:2026-02-17T20:08:20.150+0000 7fa1a400fec0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-17T20:08:20.187 INFO:tasks.ceph.mgr.x.trial123.stderr:2026-02-17T20:08:20.188+0000 7fa1a400fec0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-17T20:08:20.229 INFO:tasks.ceph.mgr.x.trial123.stderr:2026-02-17T20:08:20.230+0000 7fa1a400fec0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-17T20:08:20.249 INFO:tasks.ceph.mgr.x.trial123.stderr:2026-02-17T20:08:20.250+0000 7fa1a400fec0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-17T20:08:20.350 DEBUG:teuthology.orchestra.run.trial123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T20:08:20.399 INFO:tasks.ceph.mgr.x.trial123.stderr:2026-02-17T20:08:20.400+0000 7fa1a400fec0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-17T20:08:20.413 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.408+0000 7fb053fff640 1 Processor -- start 2026-02-17T20:08:20.413 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.409+0000 7fb053fff640 1 -- start start 2026-02-17T20:08:20.413 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.409+0000 7fb053fff640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fb0540684e0 0x7fb0540688b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:20.413 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.409+0000 7fb053fff640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fb054068df0 0x7fb05412e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:20.413 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.409+0000 7fb053fff640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb054094760 con 0x7fb05412e930 2026-02-17T20:08:20.413 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.409+0000 7fb053fff640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb054097680 con 0x7fb0540684e0 2026-02-17T20:08:20.413 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.409+0000 7fb053fff640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0540996c0 con 0x7fb054068df0 2026-02-17T20:08:20.414 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.409+0000 7fb0527fc640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fb054068df0 0x7fb05412e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:20.414 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.409+0000 7fb052ffd640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fb0540684e0 0x7fb0540688b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:20.414 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.409+0000 7fb0537fe640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7fb05412e930 0x7fb054130d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:59032/0 (socket says 10.20.193.123:59032) 2026-02-17T20:08:20.414 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.409+0000 7fb0537fe640 1 -- 10.20.193.123:0/398998714 learned_addr learned my addr 10.20.193.123:0/398998714 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:08:20.414 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.409+0000 7fb051ffb640 1 -- 10.20.193.123:0/398998714 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2119311376 0 0) 0x7fb054094760 con 0x7fb05412e930 2026-02-17T20:08:20.414 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.409+0000 7fb051ffb640 1 -- 10.20.193.123:0/398998714 --> v1:10.20.193.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb03c0034e0 con 0x7fb05412e930 2026-02-17T20:08:20.414 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.409+0000 7fb0527fc640 1 -- 10.20.193.123:0/398998714 >> v2:10.20.193.123:3300/0 conn(0x7fb0540684e0 msgr2=0x7fb0540688b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:08:20.414 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.409+0000 7fb0527fc640 1 --2- 10.20.193.123:0/398998714 >> v2:10.20.193.123:3300/0 conn(0x7fb0540684e0 0x7fb0540688b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:20.414 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.409+0000 7fb0527fc640 1 -- 10.20.193.123:0/398998714 >> v1:10.20.193.123:6789/0 conn(0x7fb05412e930 legacy=0x7fb054130d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:20.414 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.409+0000 7fb0527fc640 1 -- 10.20.193.123:0/398998714 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb05406a290 con 0x7fb054068df0 2026-02-17T20:08:20.414 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.409+0000 7fb0527fc640 1 --2- 10.20.193.123:0/398998714 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fb054068df0 0x7fb05412e3f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb048009850 tx=0x7fb04802ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14d5b812e2f94584 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:20.415 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.410+0000 7fb051ffb640 1 -- 10.20.193.123:0/398998714 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04802f8b0 con 0x7fb054068df0 2026-02-17T20:08:20.415 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.410+0000 7fb051ffb640 1 -- 10.20.193.123:0/398998714 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04802fa10 con 0x7fb054068df0 2026-02-17T20:08:20.415 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.410+0000 7fb051ffb640 1 -- 10.20.193.123:0/398998714 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04802fdb0 con 0x7fb054068df0 2026-02-17T20:08:20.415 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.410+0000 7fb053fff640 1 -- 10.20.193.123:0/398998714 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fb054068df0 msgr2=0x7fb05412e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:20.415 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.410+0000 7fb053fff640 1 --2- 10.20.193.123:0/398998714 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fb054068df0 0x7fb05412e3f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb048009850 tx=0x7fb04802ed50 comp rx=0 tx=0).stop 2026-02-17T20:08:20.415 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.410+0000 7fb053fff640 1 -- 10.20.193.123:0/398998714 shutdown_connections 2026-02-17T20:08:20.415 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.410+0000 7fb053fff640 1 --2- 10.20.193.123:0/398998714 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fb054068df0 0x7fb05412e3f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:20.415 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.410+0000 7fb053fff640 1 --2- 10.20.193.123:0/398998714 >> v2:10.20.193.123:3300/0 conn(0x7fb0540684e0 0x7fb0540688b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:20.415 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.410+0000 7fb053fff640 1 -- 10.20.193.123:0/398998714 >> 10.20.193.123:0/398998714 conn(0x7fb05409de70 msgr2=0x7fb054099d70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:20.415 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.410+0000 7fb053fff640 1 -- 10.20.193.123:0/398998714 shutdown_connections 2026-02-17T20:08:20.415 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.410+0000 7fb053fff640 1 -- 10.20.193.123:0/398998714 wait complete. 2026-02-17T20:08:20.415 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.410+0000 7fb053fff640 1 Processor -- start 2026-02-17T20:08:20.416 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.410+0000 7fb053fff640 1 -- start start 2026-02-17T20:08:20.416 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.411+0000 7fb053fff640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fb0540684e0 0x7fb05408ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:20.416 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.411+0000 7fb053fff640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fb054068df0 0x7fb0540904a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:20.416 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.411+0000 7fb053fff640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fb05412e930 0x7fb0540909e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:20.416 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.411+0000 7fb053fff640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb054092910 con 0x7fb0540684e0 2026-02-17T20:08:20.416 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.411+0000 7fb053fff640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb054092640 con 0x7fb05412e930 2026-02-17T20:08:20.416 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.411+0000 7fb053fff640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb054122350 con 0x7fb054068df0 2026-02-17T20:08:20.416 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.411+0000 7fb052ffd640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fb0540684e0 0x7fb05408ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:20.416 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.411+0000 7fb0527fc640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fb054068df0 0x7fb0540904a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:20.416 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.411+0000 7fb052ffd640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fb0540684e0 0x7fb05408ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:53594/0 (socket says 10.20.193.123:53594) 2026-02-17T20:08:20.416 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.411+0000 7fb052ffd640 1 -- 10.20.193.123:0/148922206 learned_addr learned my addr 10.20.193.123:0/148922206 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:20.416 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.411+0000 7fb0537fe640 1 --2- 10.20.193.123:0/148922206 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fb05412e930 0x7fb0540909e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:20.417 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.411+0000 7fb052ffd640 1 -- 10.20.193.123:0/148922206 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fb054068df0 msgr2=0x7fb0540904a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:20.417 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.411+0000 7fb052ffd640 1 --2- 10.20.193.123:0/148922206 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fb054068df0 0x7fb0540904a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:20.417 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.411+0000 7fb052ffd640 1 -- 10.20.193.123:0/148922206 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fb05412e930 msgr2=0x7fb0540909e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:20.417 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.411+0000 7fb052ffd640 1 --2- 10.20.193.123:0/148922206 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fb05412e930 0x7fb0540909e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:20.417 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.411+0000 7fb052ffd640 1 -- 10.20.193.123:0/148922206 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb048009390 con 0x7fb0540684e0 2026-02-17T20:08:20.417 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.411+0000 7fb052ffd640 1 --2- 10.20.193.123:0/148922206 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fb0540684e0 0x7fb05408ff60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb04400ea20 tx=0x7fb0440090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:20.417 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.411+0000 7fb03b7fe640 1 -- 10.20.193.123:0/148922206 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04400ca70 con 0x7fb0540684e0 2026-02-17T20:08:20.417 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.411+0000 7fb03b7fe640 1 -- 10.20.193.123:0/148922206 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04400cbd0 con 0x7fb0540684e0 2026-02-17T20:08:20.417 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.411+0000 7fb053fff640 1 -- 10.20.193.123:0/148922206 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0540920c0 con 0x7fb0540684e0 2026-02-17T20:08:20.417 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.411+0000 7fb03b7fe640 1 -- 10.20.193.123:0/148922206 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb044013470 con 0x7fb0540684e0 2026-02-17T20:08:20.417 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.411+0000 7fb053fff640 1 -- 10.20.193.123:0/148922206 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0541c4af0 con 0x7fb0540684e0 2026-02-17T20:08:20.417 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.411+0000 7fb03b7fe640 1 -- 10.20.193.123:0/148922206 <== mon.0 v2:10.20.193.123:3300/0 4 ==== mgrmap(e 2) v1 ==== 29536+0+0 (secure 0 0 0) 0x7fb044013860 con 0x7fb0540684e0 2026-02-17T20:08:20.418 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.412+0000 7fb053fff640 1 -- 10.20.193.123:0/148922206 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb05405f010 con 0x7fb0540684e0 2026-02-17T20:08:20.418 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.412+0000 7fb03b7fe640 1 -- 10.20.193.123:0/148922206 <== mon.0 v2:10.20.193.123:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7fb044036fb0 con 0x7fb0540684e0 2026-02-17T20:08:20.418 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.413+0000 7fb03b7fe640 1 -- 10.20.193.123:0/148922206 <== mon.0 v2:10.20.193.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72049 (secure 0 0 0) 0x7fb0440236b0 con 0x7fb0540684e0 2026-02-17T20:08:20.418 INFO:tasks.ceph.osd.0.trial123.stderr:2026-02-17T20:08:20.413+0000 7fd53a3ce440 -1 Falling back to public interface 2026-02-17T20:08:20.418 INFO:tasks.ceph.osd.1.trial123.stderr:2026-02-17T20:08:20.416+0000 7f63069de440 -1 Falling back to public interface 2026-02-17T20:08:20.419 INFO:tasks.ceph.osd.2.trial123.stderr:2026-02-17T20:08:20.417+0000 7fc80a5fc440 -1 Falling back to public interface 2026-02-17T20:08:20.424 INFO:tasks.ceph.osd.3.trial123.stderr:2026-02-17T20:08:20.425+0000 7f0ddce15440 -1 Falling back to public interface 2026-02-17T20:08:20.438 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.439+0000 7fb053fff640 1 -- 10.20.193.123:0/148922206 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb054071020 con 0x7fb0540684e0 2026-02-17T20:08:20.438 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.439+0000 7fb03b7fe640 1 -- 10.20.193.123:0/148922206 <== mon.0 v2:10.20.193.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4108 (secure 0 0 0) 0x7fb054071020 con 0x7fb0540684e0 2026-02-17T20:08:20.439 INFO:teuthology.misc.health.trial123.stdout: 2026-02-17T20:08:20.439 INFO:teuthology.misc.health.trial123.stdout:{"epoch":6,"fsid":"ddf342a7-b912-46f2-b373-84d7f3b75be2","created":"2026-02-17T20:08:19.090665+0000","modified":"2026-02-17T20:08:19.810884+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T20:08:19.810884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"5cfdb97e-5584-42e3-8c32-a9b4ace549f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9b7f5906-8ae8-4a34-8e71-1ba7cf3eeda1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"db6be5e2-fdd2-460f-bf35-269d92577824","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"23275d01-0d57-497c-a600-d9aeef747af2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T20:08:20.440 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.439+0000 7fb053fff640 1 -- 10.20.193.123:0/148922206 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fb0540684e0 msgr2=0x7fb05408ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:20.440 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.439+0000 7fb053fff640 1 --2- 10.20.193.123:0/148922206 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fb0540684e0 0x7fb05408ff60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb04400ea20 tx=0x7fb0440090f0 comp rx=0 tx=0).stop 2026-02-17T20:08:20.440 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.439+0000 7fb053fff640 1 -- 10.20.193.123:0/148922206 shutdown_connections 2026-02-17T20:08:20.440 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.439+0000 7fb053fff640 1 --2- 10.20.193.123:0/148922206 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fb05412e930 0x7fb0540909e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:20.440 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.439+0000 7fb053fff640 1 --2- 10.20.193.123:0/148922206 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fb054068df0 0x7fb0540904a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:20.440 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.439+0000 7fb053fff640 1 --2- 10.20.193.123:0/148922206 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fb0540684e0 0x7fb05408ff60 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:20.440 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.439+0000 7fb053fff640 1 -- 10.20.193.123:0/148922206 >> 10.20.193.123:0/148922206 conn(0x7fb05409de70 msgr2=0x7fb054093640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:20.440 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.439+0000 7fb053fff640 1 -- 10.20.193.123:0/148922206 shutdown_connections 2026-02-17T20:08:20.441 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:20.439+0000 7fb053fff640 1 -- 10.20.193.123:0/148922206 wait complete. 2026-02-17T20:08:20.445 DEBUG:teuthology.misc:0 of 4 OSDs are up 2026-02-17T20:08:21.146 INFO:tasks.ceph.mgr.y.trial123.stderr:2026-02-17T20:08:21.147+0000 7fbb1a8b6640 -1 mgr.server handle_report got status from non-daemon mon.c 2026-02-17T20:08:21.146 INFO:tasks.ceph.mgr.y.trial123.stderr:2026-02-17T20:08:21.147+0000 7fbb1a8b6640 -1 mgr.server handle_report got status from non-daemon mon.b 2026-02-17T20:08:23.867 INFO:tasks.ceph.osd.0.trial123.stderr:2026-02-17T20:08:23.869+0000 7fd53a3ce440 -1 osd.0 0 log_to_monitors true 2026-02-17T20:08:23.898 INFO:tasks.ceph.osd.1.trial123.stderr:2026-02-17T20:08:23.900+0000 7f63069de440 -1 osd.1 0 log_to_monitors true 2026-02-17T20:08:23.904 INFO:tasks.ceph.osd.2.trial123.stderr:2026-02-17T20:08:23.906+0000 7fc80a5fc440 -1 osd.2 0 log_to_monitors true 2026-02-17T20:08:23.931 INFO:tasks.ceph.osd.3.trial123.stderr:2026-02-17T20:08:23.933+0000 7f0ddce15440 -1 osd.3 0 log_to_monitors true 2026-02-17T20:08:25.672 INFO:tasks.ceph.osd.0.trial123.stderr:2026-02-17T20:08:25.674+0000 7fd534df6640 -1 osd.0 0 waiting for initial osdmap 2026-02-17T20:08:25.674 INFO:tasks.ceph.osd.0.trial123.stderr:2026-02-17T20:08:25.676+0000 7fd52dc85640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T20:08:25.677 INFO:tasks.ceph.osd.2.trial123.stderr:2026-02-17T20:08:25.679+0000 7fc8059f6640 -1 osd.2 0 waiting for initial osdmap 2026-02-17T20:08:25.678 INFO:tasks.ceph.osd.3.trial123.stderr:2026-02-17T20:08:25.680+0000 7f0dd75f6640 -1 osd.3 0 waiting for initial osdmap 2026-02-17T20:08:25.679 INFO:tasks.ceph.osd.2.trial123.stderr:2026-02-17T20:08:25.681+0000 7fc7fe885640 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T20:08:25.681 INFO:tasks.ceph.osd.3.trial123.stderr:2026-02-17T20:08:25.683+0000 7f0dd05e8640 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T20:08:25.719 INFO:tasks.ceph.osd.1.trial123.stderr:2026-02-17T20:08:25.721+0000 7f63013f6640 -1 osd.1 0 waiting for initial osdmap 2026-02-17T20:08:25.721 INFO:tasks.ceph.osd.1.trial123.stderr:2026-02-17T20:08:25.723+0000 7f62fa3e8640 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T20:08:26.848 DEBUG:teuthology.orchestra.run.trial123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T20:08:26.909 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.908+0000 7fcdf2d93640 1 Processor -- start 2026-02-17T20:08:26.910 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.908+0000 7fcdf2d93640 1 -- start start 2026-02-17T20:08:26.910 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.908+0000 7fcdf2d93640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fcdec097500 0x7fcdec12f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:26.910 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.908+0000 7fcdf2d93640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fcdec12f7b0 0x7fcdec131b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:26.910 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.908+0000 7fcdf2d93640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdec09a1f0 con 0x7fcdec096a20 2026-02-17T20:08:26.910 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.908+0000 7fcdf2d93640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdec098ca0 con 0x7fcdec12f7b0 2026-02-17T20:08:26.910 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.908+0000 7fcdf2d93640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdec097920 con 0x7fcdec097500 2026-02-17T20:08:26.910 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.908+0000 7fcdebfff640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fcdec097500 0x7fcdec12f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:26.910 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.908+0000 7fcdf0b2f640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7fcdec096a20 0x7fcdec096df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:59064/0 (socket says 10.20.193.123:59064) 2026-02-17T20:08:26.911 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.908+0000 7fcdf0b2f640 1 -- 10.20.193.123:0/3541734709 learned_addr learned my addr 10.20.193.123:0/3541734709 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:08:26.911 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.908+0000 7fcdf1330640 1 --2- 10.20.193.123:0/3541734709 >> v2:10.20.193.123:3300/0 conn(0x7fcdec12f7b0 0x7fcdec131b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:26.911 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.908+0000 7fcdebfff640 1 -- 10.20.193.123:0/3541734709 >> v2:10.20.193.123:3300/0 conn(0x7fcdec12f7b0 msgr2=0x7fcdec131b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:08:26.911 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.908+0000 7fcdebfff640 1 --2- 10.20.193.123:0/3541734709 >> v2:10.20.193.123:3300/0 conn(0x7fcdec12f7b0 0x7fcdec131b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:26.911 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.908+0000 7fcdebfff640 1 -- 10.20.193.123:0/3541734709 >> v1:10.20.193.123:6789/0 conn(0x7fcdec096a20 legacy=0x7fcdec096df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:26.911 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.908+0000 7fcdebfff640 1 -- 10.20.193.123:0/3541734709 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdec099890 con 0x7fcdec097500 2026-02-17T20:08:26.911 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.908+0000 7fcdeb7fe640 1 -- 10.20.193.123:0/3541734709 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2167318671 0 0) 0x7fcdec09a1f0 con 0x7fcdec096a20 2026-02-17T20:08:26.911 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.908+0000 7fcdebfff640 1 --2- 10.20.193.123:0/3541734709 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fcdec097500 0x7fcdec12f270 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8009880 tx=0x7fcdd802ee10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c108db9d550ed45 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:26.911 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.909+0000 7fcdeb7fe640 1 -- 10.20.193.123:0/3541734709 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd802f930 con 0x7fcdec097500 2026-02-17T20:08:26.911 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.909+0000 7fcdeb7fe640 1 -- 10.20.193.123:0/3541734709 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdd802fa90 con 0x7fcdec097500 2026-02-17T20:08:26.911 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.909+0000 7fcdeb7fe640 1 -- 10.20.193.123:0/3541734709 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd802fe30 con 0x7fcdec097500 2026-02-17T20:08:26.912 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.909+0000 7fcdf2d93640 1 -- 10.20.193.123:0/3541734709 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fcdec097500 msgr2=0x7fcdec12f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:26.912 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.909+0000 7fcdf2d93640 1 --2- 10.20.193.123:0/3541734709 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fcdec097500 0x7fcdec12f270 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8009880 tx=0x7fcdd802ee10 comp rx=0 tx=0).stop 2026-02-17T20:08:26.912 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.909+0000 7fcdf2d93640 1 -- 10.20.193.123:0/3541734709 shutdown_connections 2026-02-17T20:08:26.912 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.909+0000 7fcdf2d93640 1 --2- 10.20.193.123:0/3541734709 >> v2:10.20.193.123:3300/0 conn(0x7fcdec12f7b0 0x7fcdec131b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:26.912 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.909+0000 7fcdf2d93640 1 --2- 10.20.193.123:0/3541734709 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fcdec097500 0x7fcdec12f270 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:26.912 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.909+0000 7fcdf2d93640 1 -- 10.20.193.123:0/3541734709 >> 10.20.193.123:0/3541734709 conn(0x7fcdec09d8a0 msgr2=0x7fcdec09dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:26.912 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.909+0000 7fcdf2d93640 1 -- 10.20.193.123:0/3541734709 shutdown_connections 2026-02-17T20:08:26.912 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.909+0000 7fcdf2d93640 1 -- 10.20.193.123:0/3541734709 wait complete. 2026-02-17T20:08:26.912 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.909+0000 7fcdf2d93640 1 Processor -- start 2026-02-17T20:08:26.912 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.909+0000 7fcdf2d93640 1 -- start start 2026-02-17T20:08:26.912 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.910+0000 7fcdf2d93640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fcdec096a20 0x7fcdec123400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:26.913 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.910+0000 7fcdf2d93640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fcdec097500 0x7fcdec12c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:26.913 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.910+0000 7fcdf2d93640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fcdec12f7b0 0x7fcdec12c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:26.913 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.910+0000 7fcdf2d93640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdec1143e0 con 0x7fcdec12f7b0 2026-02-17T20:08:26.913 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.910+0000 7fcdf2d93640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdec1147b0 con 0x7fcdec097500 2026-02-17T20:08:26.913 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.910+0000 7fcdf2d93640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcdec12df70 con 0x7fcdec096a20 2026-02-17T20:08:26.913 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.910+0000 7fcdebfff640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fcdec097500 0x7fcdec12c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:26.913 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.910+0000 7fcdf0b2f640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fcdec096a20 0x7fcdec123400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:26.913 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.910+0000 7fcdebfff640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fcdec097500 0x7fcdec12c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:33194/0 (socket says 10.20.193.123:33194) 2026-02-17T20:08:26.913 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.910+0000 7fcdebfff640 1 -- 10.20.193.123:0/4082057099 learned_addr learned my addr 10.20.193.123:0/4082057099 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:26.913 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.910+0000 7fcdf1330640 1 --2- 10.20.193.123:0/4082057099 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fcdec12f7b0 0x7fcdec12c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:26.913 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.910+0000 7fcdebfff640 1 -- 10.20.193.123:0/4082057099 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fcdec096a20 msgr2=0x7fcdec123400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:26.913 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.910+0000 7fcdebfff640 1 --2- 10.20.193.123:0/4082057099 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fcdec096a20 0x7fcdec123400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:26.914 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.910+0000 7fcdebfff640 1 -- 10.20.193.123:0/4082057099 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fcdec12f7b0 msgr2=0x7fcdec12c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:26.914 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.910+0000 7fcdebfff640 1 --2- 10.20.193.123:0/4082057099 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fcdec12f7b0 0x7fcdec12c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:26.914 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.910+0000 7fcdebfff640 1 -- 10.20.193.123:0/4082057099 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd8009390 con 0x7fcdec097500 2026-02-17T20:08:26.914 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.910+0000 7fcdebfff640 1 --2- 10.20.193.123:0/4082057099 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fcdec097500 0x7fcdec12c440 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcdd80097d0 tx=0x7fcdd8037000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:26.914 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.910+0000 7fcde97fa640 1 -- 10.20.193.123:0/4082057099 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd80366b0 con 0x7fcdec097500 2026-02-17T20:08:26.914 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.910+0000 7fcde97fa640 1 -- 10.20.193.123:0/4082057099 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdd8036830 con 0x7fcdec097500 2026-02-17T20:08:26.914 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.910+0000 7fcdf2d93640 1 -- 10.20.193.123:0/4082057099 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdec12cec0 con 0x7fcdec097500 2026-02-17T20:08:26.914 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.910+0000 7fcde97fa640 1 -- 10.20.193.123:0/4082057099 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd8036bf0 con 0x7fcdec097500 2026-02-17T20:08:26.914 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.910+0000 7fcdf2d93640 1 -- 10.20.193.123:0/4082057099 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdec12d350 con 0x7fcdec097500 2026-02-17T20:08:26.914 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.910+0000 7fcdf2d93640 1 -- 10.20.193.123:0/4082057099 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdec113b60 con 0x7fcdec097500 2026-02-17T20:08:26.914 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.911+0000 7fcde97fa640 1 -- 10.20.193.123:0/4082057099 <== mon.1 v2:10.20.193.123:3301/0 4 ==== mgrmap(e 4) v1 ==== 59153+0+0 (secure 0 0 0) 0x7fcdd803e040 con 0x7fcdec097500 2026-02-17T20:08:26.914 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.911+0000 7fcde97fa640 1 -- 10.20.193.123:0/4082057099 <== mon.1 v2:10.20.193.123:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 2067+0+0 (secure 0 0 0) 0x7fcdd8087ef0 con 0x7fcdec097500 2026-02-17T20:08:26.915 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.913+0000 7fcde97fa640 1 -- 10.20.193.123:0/4082057099 <== mon.1 v2:10.20.193.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7fcdd8063210 con 0x7fcdec097500 2026-02-17T20:08:26.974 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.975+0000 7fcdf2d93640 1 -- 10.20.193.123:0/4082057099 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcdec05f010 con 0x7fcdec097500 2026-02-17T20:08:26.974 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.976+0000 7fcde97fa640 1 -- 10.20.193.123:0/4082057099 <== mon.1 v2:10.20.193.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v9) v1 ==== 74+0+4935 (secure 0 0 0) 0x7fcdd8047020 con 0x7fcdec097500 2026-02-17T20:08:26.974 INFO:teuthology.misc.health.trial123.stdout: 2026-02-17T20:08:26.975 INFO:teuthology.misc.health.trial123.stdout:{"epoch":9,"fsid":"ddf342a7-b912-46f2-b373-84d7f3b75be2","created":"2026-02-17T20:08:19.090665+0000","modified":"2026-02-17T20:08:26.676482+0000","last_up_change":"2026-02-17T20:08:26.676482+0000","last_in_change":"2026-02-17T20:08:19.810884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"5cfdb97e-5584-42e3-8c32-a9b4ace549f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6801","nonce":24324}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6802","nonce":24324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6804","nonce":24324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6803","nonce":24324}]},"public_addr":"10.20.193.123:6801/24324","cluster_addr":"10.20.193.123:6802/24324","heartbeat_back_addr":"10.20.193.123:6804/24324","heartbeat_front_addr":"10.20.193.123:6803/24324","state":["exists","up"]},{"osd":1,"uuid":"9b7f5906-8ae8-4a34-8e71-1ba7cf3eeda1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6805","nonce":24325}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6806","nonce":24325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6808","nonce":24325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6807","nonce":24325}]},"public_addr":"10.20.193.123:6805/24325","cluster_addr":"10.20.193.123:6806/24325","heartbeat_back_addr":"10.20.193.123:6808/24325","heartbeat_front_addr":"10.20.193.123:6807/24325","state":["exists","up"]},{"osd":2,"uuid":"db6be5e2-fdd2-460f-bf35-269d92577824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6809","nonce":24326}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6810","nonce":24326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6812","nonce":24326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6811","nonce":24326}]},"public_addr":"10.20.193.123:6809/24326","cluster_addr":"10.20.193.123:6810/24326","heartbeat_back_addr":"10.20.193.123:6812/24326","heartbeat_front_addr":"10.20.193.123:6811/24326","state":["exists","up"]},{"osd":3,"uuid":"23275d01-0d57-497c-a600-d9aeef747af2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6813","nonce":24327}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6814","nonce":24327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6816","nonce":24327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6815","nonce":24327}]},"public_addr":"10.20.193.123:6813/24327","cluster_addr":"10.20.193.123:6814/24327","heartbeat_back_addr":"10.20.193.123:6816/24327","heartbeat_front_addr":"10.20.193.123:6815/24327","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T20:08:26.976 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.976+0000 7fcdf2d93640 1 -- 10.20.193.123:0/4082057099 >> v1:10.20.193.123:6800/23720 conn(0x7fcdd004d070 legacy=0x7fcdd004f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:26.976 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.976+0000 7fcdf2d93640 1 -- 10.20.193.123:0/4082057099 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fcdec097500 msgr2=0x7fcdec12c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:26.976 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.976+0000 7fcdf2d93640 1 --2- 10.20.193.123:0/4082057099 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fcdec097500 0x7fcdec12c440 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcdd80097d0 tx=0x7fcdd8037000 comp rx=0 tx=0).stop 2026-02-17T20:08:26.976 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.976+0000 7fcdf2d93640 1 -- 10.20.193.123:0/4082057099 shutdown_connections 2026-02-17T20:08:26.976 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.976+0000 7fcdf2d93640 1 --2- 10.20.193.123:0/4082057099 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fcdec12f7b0 0x7fcdec12c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:26.976 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.976+0000 7fcdf2d93640 1 --2- 10.20.193.123:0/4082057099 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fcdec097500 0x7fcdec12c440 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:26.976 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.976+0000 7fcdf2d93640 1 --2- 10.20.193.123:0/4082057099 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fcdec096a20 0x7fcdec123400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:26.977 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.976+0000 7fcdf2d93640 1 -- 10.20.193.123:0/4082057099 >> 10.20.193.123:0/4082057099 conn(0x7fcdec09d8a0 msgr2=0x7fcdec09c300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:26.977 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.976+0000 7fcdf2d93640 1 -- 10.20.193.123:0/4082057099 shutdown_connections 2026-02-17T20:08:26.977 INFO:teuthology.misc.health.trial123.stderr:2026-02-17T20:08:26.976+0000 7fcdf2d93640 1 -- 10.20.193.123:0/4082057099 wait complete. 2026-02-17T20:08:26.980 DEBUG:teuthology.misc:4 of 4 OSDs are up 2026-02-17T20:08:26.981 INFO:tasks.ceph:Creating RBD pool 2026-02-17T20:08:26.981 DEBUG:teuthology.orchestra.run.trial123:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-17T20:08:27.048 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.046+0000 7faff901d640 1 Processor -- start 2026-02-17T20:08:27.048 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.046+0000 7faff901d640 1 -- start start 2026-02-17T20:08:27.048 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.046+0000 7faff901d640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7faff4097540 0x7faff412f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:27.049 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.046+0000 7faff901d640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7faff412f6e0 0x7faff4131ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:27.049 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.046+0000 7faff901d640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faff4098990 con 0x7faff4096a60 2026-02-17T20:08:27.049 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.046+0000 7faff901d640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faff4098b90 con 0x7faff412f6e0 2026-02-17T20:08:27.049 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.046+0000 7faff901d640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faff409a380 con 0x7faff4097540 2026-02-17T20:08:27.049 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.046+0000 7fafebfff640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7faff4097540 0x7faff412f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:27.049 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.046+0000 7faff359e640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7faff412f6e0 0x7faff4131ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:27.049 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.046+0000 7fafebfff640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7faff4097540 0x7faff412f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:45380/0 (socket says 10.20.193.123:45380) 2026-02-17T20:08:27.049 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.046+0000 7fafebfff640 1 -- 10.20.193.123:0/3164026753 learned_addr learned my addr 10.20.193.123:0/3164026753 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:27.049 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.046+0000 7faff2d9d640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7faff4096a60 0x7faff4096e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:59066/0 (socket says 10.20.193.123:59066) 2026-02-17T20:08:27.049 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.046+0000 7fafebfff640 1 -- 10.20.193.123:0/3164026753 >> v2:10.20.193.123:3300/0 conn(0x7faff412f6e0 msgr2=0x7faff4131ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:08:27.050 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.046+0000 7fafebfff640 1 --2- 10.20.193.123:0/3164026753 >> v2:10.20.193.123:3300/0 conn(0x7faff412f6e0 0x7faff4131ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:27.050 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.046+0000 7fafebfff640 1 -- 10.20.193.123:0/3164026753 >> v1:10.20.193.123:6789/0 conn(0x7faff4096a60 legacy=0x7faff4096e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:27.050 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.046+0000 7fafebfff640 1 -- 10.20.193.123:0/3164026753 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff409a070 con 0x7faff4097540 2026-02-17T20:08:27.050 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.046+0000 7faff359e640 1 --2- 10.20.193.123:0/3164026753 >> v2:10.20.193.123:3300/0 conn(0x7faff412f6e0 0x7faff4131ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:08:27.050 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.047+0000 7fafebfff640 1 --2- 10.20.193.123:0/3164026753 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7faff4097540 0x7faff412f1a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fafdc009910 tx=0x7fafdc02ee10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=592be2b8bbb5968b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:27.050 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.047+0000 7faff259c640 1 -- 10.20.193.123:0/3164026753 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafdc02f970 con 0x7faff4097540 2026-02-17T20:08:27.050 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.047+0000 7faff259c640 1 -- 10.20.193.123:0/3164026753 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafdc02fad0 con 0x7faff4097540 2026-02-17T20:08:27.050 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.047+0000 7faff259c640 1 -- 10.20.193.123:0/3164026753 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafdc037440 con 0x7faff4097540 2026-02-17T20:08:27.050 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.047+0000 7faff901d640 1 -- 10.20.193.123:0/3164026753 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7faff4097540 msgr2=0x7faff412f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:27.050 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.047+0000 7faff901d640 1 --2- 10.20.193.123:0/3164026753 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7faff4097540 0x7faff412f1a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fafdc009910 tx=0x7fafdc02ee10 comp rx=0 tx=0).stop 2026-02-17T20:08:27.051 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.047+0000 7faff901d640 1 -- 10.20.193.123:0/3164026753 shutdown_connections 2026-02-17T20:08:27.051 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.047+0000 7faff901d640 1 --2- 10.20.193.123:0/3164026753 >> v2:10.20.193.123:3300/0 conn(0x7faff412f6e0 0x7faff4131ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:27.051 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.047+0000 7faff901d640 1 --2- 10.20.193.123:0/3164026753 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7faff4097540 0x7faff412f1a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:27.051 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.047+0000 7faff901d640 1 -- 10.20.193.123:0/3164026753 >> 10.20.193.123:0/3164026753 conn(0x7faff409db90 msgr2=0x7faff409df90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:27.051 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.047+0000 7faff901d640 1 -- 10.20.193.123:0/3164026753 shutdown_connections 2026-02-17T20:08:27.051 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.047+0000 7faff901d640 1 -- 10.20.193.123:0/3164026753 wait complete. 2026-02-17T20:08:27.051 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.048+0000 7faff901d640 1 Processor -- start 2026-02-17T20:08:27.051 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.048+0000 7faff901d640 1 -- start start 2026-02-17T20:08:27.051 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.048+0000 7faff901d640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7faff4096a60 0x7faff4126540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:27.051 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.048+0000 7faff901d640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7faff4097540 0x7faff41140a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:27.051 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.048+0000 7faff901d640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7faff412f6e0 0x7faff41145e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:27.051 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.048+0000 7faff901d640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff4117830 con 0x7faff412f6e0 2026-02-17T20:08:27.052 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.048+0000 7faff901d640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faff4117460 con 0x7faff4096a60 2026-02-17T20:08:27.052 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.048+0000 7faff901d640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faff4116c80 con 0x7faff4097540 2026-02-17T20:08:27.052 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.048+0000 7fafebfff640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7faff4097540 0x7faff41140a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:27.052 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.048+0000 7faff359e640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7faff412f6e0 0x7faff41145e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:27.052 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.048+0000 7faff2d9d640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7faff4096a60 0x7faff4126540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:27.052 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.048+0000 7fafebfff640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7faff4097540 0x7faff41140a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:45390/0 (socket says 10.20.193.123:45390) 2026-02-17T20:08:27.052 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.048+0000 7fafebfff640 1 -- 10.20.193.123:0/2797091743 learned_addr learned my addr 10.20.193.123:0/2797091743 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:27.052 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.048+0000 7faff359e640 1 -- 10.20.193.123:0/2797091743 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7faff4097540 msgr2=0x7faff41140a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:27.052 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.048+0000 7faff359e640 1 --2- 10.20.193.123:0/2797091743 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7faff4097540 0x7faff41140a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:27.052 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.048+0000 7faff359e640 1 -- 10.20.193.123:0/2797091743 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7faff4096a60 msgr2=0x7faff4126540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:27.053 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.048+0000 7faff359e640 1 --2- 10.20.193.123:0/2797091743 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7faff4096a60 0x7faff4126540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:27.053 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.048+0000 7faff359e640 1 -- 10.20.193.123:0/2797091743 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafec009a20 con 0x7faff412f6e0 2026-02-17T20:08:27.053 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.048+0000 7fafebfff640 1 --2- 10.20.193.123:0/2797091743 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7faff4097540 0x7faff41140a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:08:27.053 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.048+0000 7faff359e640 1 --2- 10.20.193.123:0/2797091743 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7faff412f6e0 0x7faff41145e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fafec009ee0 tx=0x7fafec00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:27.053 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.048+0000 7fafeb7fe640 1 -- 10.20.193.123:0/2797091743 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafec00ce80 con 0x7faff412f6e0 2026-02-17T20:08:27.053 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.048+0000 7faff901d640 1 -- 10.20.193.123:0/2797091743 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafdc009450 con 0x7faff412f6e0 2026-02-17T20:08:27.053 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.048+0000 7fafeb7fe640 1 -- 10.20.193.123:0/2797091743 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafec00f040 con 0x7faff412f6e0 2026-02-17T20:08:27.053 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.048+0000 7fafeb7fe640 1 -- 10.20.193.123:0/2797091743 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafec0146d0 con 0x7faff412f6e0 2026-02-17T20:08:27.053 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.048+0000 7faff901d640 1 -- 10.20.193.123:0/2797091743 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faff4114b20 con 0x7faff412f6e0 2026-02-17T20:08:27.053 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.049+0000 7faff901d640 1 -- 10.20.193.123:0/2797091743 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faff405f010 con 0x7faff412f6e0 2026-02-17T20:08:27.053 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.049+0000 7fafeb7fe640 1 -- 10.20.193.123:0/2797091743 <== mon.0 v2:10.20.193.123:3300/0 4 ==== mgrmap(e 4) v1 ==== 59153+0+0 (secure 0 0 0) 0x7fafec014a40 con 0x7faff412f6e0 2026-02-17T20:08:27.053 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.049+0000 7fafeb7fe640 1 -- 10.20.193.123:0/2797091743 <== mon.0 v2:10.20.193.123:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 2067+0+0 (secure 0 0 0) 0x7fafec064410 con 0x7faff412f6e0 2026-02-17T20:08:27.054 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.052+0000 7fafeb7fe640 1 -- 10.20.193.123:0/2797091743 <== mon.0 v2:10.20.193.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7fafec03f620 con 0x7faff412f6e0 2026-02-17T20:08:27.113 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.115+0000 7faff901d640 1 -- 10.20.193.123:0/2797091743 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7faff4064720 con 0x7faff412f6e0 2026-02-17T20:08:27.676 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.678+0000 7fafeb7fe640 1 -- 10.20.193.123:0/2797091743 <== mon.0 v2:10.20.193.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v10) v1 ==== 109+0+0 (secure 0 0 0) 0x7fafec018020 con 0x7faff412f6e0 2026-02-17T20:08:27.676 INFO:teuthology.orchestra.run.trial123.stderr:pool 'rbd' created 2026-02-17T20:08:27.679 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.680+0000 7faff901d640 1 -- 10.20.193.123:0/2797091743 >> v1:10.20.193.123:6800/23720 conn(0x7fafd404d040 legacy=0x7fafd404f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:27.679 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.680+0000 7faff901d640 1 -- 10.20.193.123:0/2797091743 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7faff412f6e0 msgr2=0x7faff41145e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:27.679 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.680+0000 7faff901d640 1 --2- 10.20.193.123:0/2797091743 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7faff412f6e0 0x7faff41145e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fafec009ee0 tx=0x7fafec00b040 comp rx=0 tx=0).stop 2026-02-17T20:08:27.679 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.680+0000 7faff901d640 1 -- 10.20.193.123:0/2797091743 shutdown_connections 2026-02-17T20:08:27.679 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.680+0000 7faff901d640 1 --2- 10.20.193.123:0/2797091743 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7faff412f6e0 0x7faff41145e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:27.680 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.680+0000 7faff901d640 1 --2- 10.20.193.123:0/2797091743 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7faff4097540 0x7faff41140a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:27.680 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.680+0000 7faff901d640 1 --2- 10.20.193.123:0/2797091743 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7faff4096a60 0x7faff4126540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:27.680 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.680+0000 7faff901d640 1 -- 10.20.193.123:0/2797091743 >> 10.20.193.123:0/2797091743 conn(0x7faff409db90 msgr2=0x7faff409c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:27.680 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.681+0000 7faff901d640 1 -- 10.20.193.123:0/2797091743 shutdown_connections 2026-02-17T20:08:27.680 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.681+0000 7faff901d640 1 -- 10.20.193.123:0/2797091743 wait complete. 2026-02-17T20:08:27.688 DEBUG:teuthology.orchestra.run.trial123:> rbd --cluster ceph pool init rbd 2026-02-17T20:08:27.719 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.716+0000 7fed1e01fb80 1 Processor -- start 2026-02-17T20:08:27.719 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.716+0000 7fed1e01fb80 1 -- start start 2026-02-17T20:08:27.719 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.716+0000 7fed1e01fb80 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x55de18ee8d60 0x55de18ee9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:27.719 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.716+0000 7fed1e01fb80 1 --2- >> v2:10.20.193.123:3300/0 conn(0x55de18ee9670 0x55de18ee3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:27.719 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.716+0000 7fed1e01fb80 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55de18d8c4d0 con 0x55de18ee3d70 2026-02-17T20:08:27.720 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.716+0000 7fed1e01fb80 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x55de18dc7b30 con 0x55de18ee9670 2026-02-17T20:08:27.720 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.716+0000 7fed1e01fb80 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x55de18dc5100 con 0x55de18ee8d60 2026-02-17T20:08:27.720 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.716+0000 7fed1c2af640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x55de18ee8d60 0x55de18ee9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:27.720 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.716+0000 7fed1baae640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x55de18ee9670 0x55de18ee3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:27.720 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.716+0000 7fed1d511640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x55de18ee3d70 0x55de18f839e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:59082/0 (socket says 10.20.193.123:59082) 2026-02-17T20:08:27.720 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.716+0000 7fed1c2af640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x55de18ee8d60 0x55de18ee9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:33208/0 (socket says 10.20.193.123:33208) 2026-02-17T20:08:27.720 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.716+0000 7fed1baae640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x55de18ee9670 0x55de18ee3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:53624/0 (socket says 10.20.193.123:53624) 2026-02-17T20:08:27.720 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.716+0000 7fed1c2af640 1 -- 10.20.193.123:0/1023460106 learned_addr learned my addr 10.20.193.123:0/1023460106 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:27.720 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.716+0000 7fed1c2af640 1 -- 10.20.193.123:0/1023460106 >> v2:10.20.193.123:3300/0 conn(0x55de18ee9670 msgr2=0x55de18ee3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:08:27.720 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.716+0000 7fed1c2af640 1 --2- 10.20.193.123:0/1023460106 >> v2:10.20.193.123:3300/0 conn(0x55de18ee9670 0x55de18ee3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:27.721 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.717+0000 7fed1c2af640 1 -- 10.20.193.123:0/1023460106 >> v1:10.20.193.123:6789/0 conn(0x55de18ee3d70 legacy=0x55de18f839e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:27.721 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.717+0000 7fed1c2af640 1 -- 10.20.193.123:0/1023460106 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de18d64c50 con 0x55de18ee8d60 2026-02-17T20:08:27.721 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.718+0000 7fed1c2af640 1 --2- 10.20.193.123:0/1023460106 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x55de18ee8d60 0x55de18ee9130 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fed0c00a6d0 tx=0x7fed0c058a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79c8051c8e70d4e6 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:27.721 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.718+0000 7fed1b2ad640 1 -- 10.20.193.123:0/1023460106 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0c068400 con 0x55de18ee8d60 2026-02-17T20:08:27.721 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.718+0000 7fed1b2ad640 1 -- 10.20.193.123:0/1023460106 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed0c064050 con 0x55de18ee8d60 2026-02-17T20:08:27.721 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.718+0000 7fed1b2ad640 1 -- 10.20.193.123:0/1023460106 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0c0685a0 con 0x55de18ee8d60 2026-02-17T20:08:27.721 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.718+0000 7fed1e01fb80 1 -- 10.20.193.123:0/1023460106 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x55de18ee8d60 msgr2=0x55de18ee9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:27.721 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.718+0000 7fed1e01fb80 1 --2- 10.20.193.123:0/1023460106 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x55de18ee8d60 0x55de18ee9130 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fed0c00a6d0 tx=0x7fed0c058a90 comp rx=0 tx=0).stop 2026-02-17T20:08:27.721 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.718+0000 7fed1e01fb80 1 -- 10.20.193.123:0/1023460106 shutdown_connections 2026-02-17T20:08:27.721 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.718+0000 7fed1e01fb80 1 --2- 10.20.193.123:0/1023460106 >> v2:10.20.193.123:3300/0 conn(0x55de18ee9670 0x55de18ee3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:27.722 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.718+0000 7fed1e01fb80 1 --2- 10.20.193.123:0/1023460106 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x55de18ee8d60 0x55de18ee9130 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:27.722 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.718+0000 7fed1e01fb80 1 -- 10.20.193.123:0/1023460106 >> 10.20.193.123:0/1023460106 conn(0x55de18eec2e0 msgr2=0x55de18eec6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:27.722 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.718+0000 7fed1e01fb80 1 -- 10.20.193.123:0/1023460106 shutdown_connections 2026-02-17T20:08:27.722 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.718+0000 7fed1e01fb80 1 -- 10.20.193.123:0/1023460106 wait complete. 2026-02-17T20:08:27.722 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.718+0000 7fed1e01fb80 1 Processor -- start 2026-02-17T20:08:27.722 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.719+0000 7fed1e01fb80 1 -- start start 2026-02-17T20:08:27.722 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.719+0000 7fed1e01fb80 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x55de18ee3d70 0x55de18edf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:27.722 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.719+0000 7fed1e01fb80 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x55de18ee8d60 0x55de18edfef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:27.722 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.719+0000 7fed1e01fb80 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x55de18ee9670 0x55de18ee0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:27.722 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.719+0000 7fed1e01fb80 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de18dc0de0 con 0x55de18ee8d60 2026-02-17T20:08:27.723 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.719+0000 7fed1e01fb80 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x55de18d66120 con 0x55de18ee3d70 2026-02-17T20:08:27.723 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.719+0000 7fed1e01fb80 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x55de18d65dc0 con 0x55de18ee9670 2026-02-17T20:08:27.723 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.719+0000 7fed1c2af640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x55de18ee3d70 0x55de18edf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:27.723 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.719+0000 7fed1baae640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x55de18ee8d60 0x55de18edfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:27.723 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.719+0000 7fed1c2af640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x55de18ee3d70 0x55de18edf9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:33214/0 (socket says 10.20.193.123:33214) 2026-02-17T20:08:27.723 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.719+0000 7fed1c2af640 1 -- 10.20.193.123:0/1319115300 learned_addr learned my addr 10.20.193.123:0/1319115300 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:27.723 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.719+0000 7fed1d511640 1 --2- 10.20.193.123:0/1319115300 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x55de18ee9670 0x55de18ee0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:27.723 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.719+0000 7fed1c2af640 1 -- 10.20.193.123:0/1319115300 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x55de18ee9670 msgr2=0x55de18ee0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:27.723 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.719+0000 7fed1c2af640 1 --2- 10.20.193.123:0/1319115300 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x55de18ee9670 0x55de18ee0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:27.723 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.719+0000 7fed1c2af640 1 -- 10.20.193.123:0/1319115300 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x55de18ee8d60 msgr2=0x55de18edfef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:27.723 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.719+0000 7fed1c2af640 1 --2- 10.20.193.123:0/1319115300 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x55de18ee8d60 0x55de18edfef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:27.723 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.719+0000 7fed1c2af640 1 -- 10.20.193.123:0/1319115300 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed0c005db0 con 0x55de18ee3d70 2026-02-17T20:08:27.724 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.719+0000 7fed1baae640 1 --2- 10.20.193.123:0/1319115300 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x55de18ee8d60 0x55de18edfef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:08:27.724 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.719+0000 7fed1c2af640 1 --2- 10.20.193.123:0/1319115300 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x55de18ee3d70 0x55de18edf9b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fed0c058670 tx=0x7fed0c06e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:27.724 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.719+0000 7fed18aa8640 1 -- 10.20.193.123:0/1319115300 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0c07c460 con 0x55de18ee3d70 2026-02-17T20:08:27.724 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.719+0000 7fed18aa8640 1 -- 10.20.193.123:0/1319115300 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed0c07c5c0 con 0x55de18ee3d70 2026-02-17T20:08:27.724 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.719+0000 7fed1e01fb80 1 -- 10.20.193.123:0/1319115300 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55de18d71af0 con 0x55de18ee3d70 2026-02-17T20:08:27.724 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.719+0000 7fed18aa8640 1 -- 10.20.193.123:0/1319115300 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0c07c960 con 0x55de18ee3d70 2026-02-17T20:08:27.724 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.719+0000 7fed1e01fb80 1 -- 10.20.193.123:0/1319115300 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55de18d64fe0 con 0x55de18ee3d70 2026-02-17T20:08:27.724 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.720+0000 7fed18aa8640 1 -- 10.20.193.123:0/1319115300 <== mon.1 v2:10.20.193.123:3301/0 4 ==== mgrmap(e 4) v1 ==== 59153+0+0 (secure 0 0 0) 0x7fed0c07ccd0 con 0x55de18ee3d70 2026-02-17T20:08:27.724 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.720+0000 7fed18aa8640 1 -- 10.20.193.123:0/1319115300 <== mon.1 v2:10.20.193.123:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 2409+0+0 (secure 0 0 0) 0x7fed0c0ba840 con 0x55de18ee3d70 2026-02-17T20:08:27.724 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:27.720+0000 7fed1e01fb80 1 -- 10.20.193.123:0/1319115300 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) v1 -- 0x55de18d64a40 con 0x55de18ee3d70 2026-02-17T20:08:28.682 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:28.683+0000 7fed18aa8640 1 -- 10.20.193.123:0/1319115300 <== mon.1 v2:10.20.193.123:3301/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v11) v1 ==== 141+0+0 (secure 0 0 0) 0x7fed0c077030 con 0x55de18ee3d70 2026-02-17T20:08:28.682 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:28.683+0000 7fed1e01fb80 1 -- 10.20.193.123:0/1319115300 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x55de18d939c0 con 0x55de18ee3d70 2026-02-17T20:08:28.682 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:28.683+0000 7fed18aa8640 1 -- 10.20.193.123:0/1319115300 <== mon.1 v2:10.20.193.123:3301/0 7 ==== mon_get_version_reply(handle=1 version=11) v2 ==== 24+0+0 (secure 0 0 0) 0x7fed0c0b9be0 con 0x55de18ee3d70 2026-02-17T20:08:28.682 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:28.683+0000 7fed1aaac640 1 -- 10.20.193.123:0/1319115300 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({osdmap=11}) v3 -- 0x7fecf8002a10 con 0x55de18ee3d70 2026-02-17T20:08:28.682 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:28.683+0000 7fed18aa8640 1 -- 10.20.193.123:0/1319115300 <== mon.1 v2:10.20.193.123:3301/0 8 ==== osd_map(11..11 src has 1..11) v4 ==== 1025+0+0 (secure 0 0 0) 0x7fed0c09d020 con 0x55de18ee3d70 2026-02-17T20:08:28.682 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:28.683+0000 7fed1e01fb80 1 -- 10.20.193.123:0/1319115300 --> v1:10.20.193.123:6805/24325 -- osd_op(unknown.0.0:1 1.3 1:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11) v8 -- 0x55de18f95bb0 con 0x55de18f920b0 2026-02-17T20:08:28.684 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:28.686+0000 7fed1d511640 1 -- 10.20.193.123:0/1319115300 <== osd.1 v1:10.20.193.123:6805/24325 1 ==== osd_op_reply(1 rbd_trash [create] v11'1 uv1 ondisk = 0) v8 ==== 153+0+0 (unknown 2473213795 0 0) 0x7fed140014a0 con 0x55de18f920b0 2026-02-17T20:08:28.686 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:28.687+0000 7fed1e01fb80 1 -- 10.20.193.123:0/1319115300 --> v1:10.20.193.123:6801/24324 -- osd_op(unknown.0.0:2 1.2 1:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e11) v8 -- 0x55de18fe77d0 con 0x55de18fe3be0 2026-02-17T20:08:28.686 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:28.687+0000 7fed1c2af640 1 -- 10.20.193.123:0/1319115300 <== osd.0 v1:10.20.193.123:6801/24324 1 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (unknown 3067770393 0 0) 0x7fed0c07dd00 con 0x55de18fe3be0 2026-02-17T20:08:28.686 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:28.687+0000 7fed1e01fb80 1 -- 10.20.193.123:0/1319115300 --> v1:10.20.193.123:6801/24324 -- osd_op(unknown.0.0:3 1.2 1:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e11) v8 -- 0x55de18fe2650 con 0x55de18fe3be0 2026-02-17T20:08:28.686 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:28.687+0000 7fed1c2af640 1 -- 10.20.193.123:0/1319115300 <== osd.0 v1:10.20.193.123:6801/24324 2 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (unknown 3079310357 0 0) 0x7fed0c07dd00 con 0x55de18fe3be0 2026-02-17T20:08:28.686 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:28.687+0000 7fed1aaac640 1 -- 10.20.193.123:0/1319115300 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- pool_op(create unmanaged snap pool 1 tid 4 name v0) v4 -- 0x7fecf8003db0 con 0x55de18ee3d70 2026-02-17T20:08:29.680 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:29.683+0000 7fed18aa8640 1 -- 10.20.193.123:0/1319115300 <== mon.1 v2:10.20.193.123:3301/0 9 ==== pool_op_reply(tid 4 (0) Success v12) v1 ==== 55+0+0 (secure 0 0 0) 0x7fed0c0998e0 con 0x55de18ee3d70 2026-02-17T20:08:29.681 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:29.683+0000 7fed18aa8640 1 -- 10.20.193.123:0/1319115300 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({osdmap=12}) v3 -- 0x7fed00052590 con 0x55de18ee3d70 2026-02-17T20:08:29.681 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:29.683+0000 7fed18aa8640 1 -- 10.20.193.123:0/1319115300 <== mon.1 v2:10.20.193.123:3301/0 10 ==== osd_map(12..12 src has 1..12) v4 ==== 996+0+0 (secure 0 0 0) 0x7fed0c07edb0 con 0x55de18ee3d70 2026-02-17T20:08:29.681 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:29.683+0000 7fed1aaac640 1 -- 10.20.193.123:0/1319115300 --> v1:10.20.193.123:6801/24324 -- osd_op(unknown.0.0:5 1.2 1:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12) v8 -- 0x7fecf80056d0 con 0x55de18fe3be0 2026-02-17T20:08:29.683 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:29.685+0000 7fed1c2af640 1 -- 10.20.193.123:0/1319115300 <== osd.0 v1:10.20.193.123:6801/24324 3 ==== osd_op_reply(5 rbd_info [create,write 0~8] v12'1 uv1 ondisk = 0) v8 ==== 194+0+0 (unknown 265107415 0 0) 0x7fed0c07dd00 con 0x55de18fe3be0 2026-02-17T20:08:29.684 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:29.685+0000 7fed1aaac640 1 -- 10.20.193.123:0/1319115300 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- pool_op(delete unmanaged snap pool 1 tid 6 name v12) v4 -- 0x7fecf8005290 con 0x55de18ee3d70 2026-02-17T20:08:30.687 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.688+0000 7fed18aa8640 1 -- 10.20.193.123:0/1319115300 <== mon.1 v2:10.20.193.123:3301/0 11 ==== pool_op_reply(tid 6 (0) Success v13) v1 ==== 43+0+0 (secure 0 0 0) 0x7fed0c077030 con 0x55de18ee3d70 2026-02-17T20:08:30.687 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.688+0000 7fed18aa8640 1 -- 10.20.193.123:0/1319115300 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({osdmap=13}) v3 -- 0x7fed00052720 con 0x55de18ee3d70 2026-02-17T20:08:30.687 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.688+0000 7fed18aa8640 1 -- 10.20.193.123:0/1319115300 <== mon.1 v2:10.20.193.123:3301/0 12 ==== osd_map(13..13 src has 1..13) v4 ==== 1016+0+0 (secure 0 0 0) 0x7fed0c099500 con 0x55de18ee3d70 2026-02-17T20:08:30.687 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.689+0000 7fed1aaac640 1 -- 10.20.193.123:0/1319115300 --> v1:10.20.193.123:6801/24324 -- osd_op(unknown.0.0:7 1.2 1:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13) v8 -- 0x7fecf8005f70 con 0x55de18fe3be0 2026-02-17T20:08:30.690 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.691+0000 7fed1c2af640 1 -- 10.20.193.123:0/1319115300 <== osd.0 v1:10.20.193.123:6801/24324 4 ==== osd_op_reply(7 rbd_info [write 0~19] v13'2 uv2 ondisk = 0) v8 ==== 152+0+0 (unknown 3677271976 0 0) 0x7fed0c07dd00 con 0x55de18fe3be0 2026-02-17T20:08:30.690 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.691+0000 7fed1e01fb80 1 -- 10.20.193.123:0/1319115300 >> v1:10.20.193.123:6801/24324 conn(0x55de18fe3be0 legacy=0x55de18fe6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:30.690 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.691+0000 7fed1e01fb80 1 -- 10.20.193.123:0/1319115300 >> v1:10.20.193.123:6805/24325 conn(0x55de18f920b0 legacy=0x55de18f94490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:30.690 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.691+0000 7fed1e01fb80 1 -- 10.20.193.123:0/1319115300 >> v1:10.20.193.123:6800/23720 conn(0x7fed0004b970 legacy=0x7fed0004de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:30.690 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.691+0000 7fed1e01fb80 1 -- 10.20.193.123:0/1319115300 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x55de18ee3d70 msgr2=0x55de18edf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:30.690 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.691+0000 7fed1e01fb80 1 --2- 10.20.193.123:0/1319115300 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x55de18ee3d70 0x55de18edf9b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fed0c058670 tx=0x7fed0c06e000 comp rx=0 tx=0).stop 2026-02-17T20:08:30.690 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.691+0000 7fed1d511640 1 -- 10.20.193.123:0/1319115300 reap_dead start 2026-02-17T20:08:30.691 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.691+0000 7fed1d511640 1 -- 10.20.193.123:0/1319115300 reap_dead start 2026-02-17T20:08:30.691 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.691+0000 7fed1e01fb80 1 -- 10.20.193.123:0/1319115300 shutdown_connections 2026-02-17T20:08:30.691 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.691+0000 7fed1e01fb80 1 -- 10.20.193.123:0/1319115300 >> 10.20.193.123:0/1319115300 conn(0x55de18eec2e0 msgr2=0x55de18eea1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:30.691 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.691+0000 7fed1e01fb80 1 -- 10.20.193.123:0/1319115300 shutdown_connections 2026-02-17T20:08:30.691 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.691+0000 7fed1e01fb80 1 -- 10.20.193.123:0/1319115300 wait complete. 2026-02-17T20:08:30.692 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-17T20:08:30.693 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-17T20:08:30.693 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-17T20:08:30.693 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-17T20:08:30.694 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-17T20:08:30.802 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.800+0000 7f591196e640 1 Processor -- start 2026-02-17T20:08:30.802 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.800+0000 7f591196e640 1 -- start start 2026-02-17T20:08:30.802 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.800+0000 7f591196e640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f590c096a60 0x7f590c096e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:30.802 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.800+0000 7f591196e640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f590c097370 0x7f590c129e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:30.803 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.800+0000 7f591196e640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f590c09a430 con 0x7f590c12a3a0 2026-02-17T20:08:30.803 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.800+0000 7f591196e640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f590c097e40 con 0x7f590c096a60 2026-02-17T20:08:30.803 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.800+0000 7f591196e640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f590c09a680 con 0x7f590c097370 2026-02-17T20:08:30.803 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.800+0000 7f590affd640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f590c096a60 0x7f590c096e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:30.803 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.800+0000 7f590affd640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f590c096a60 0x7f590c096e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:56918/0 (socket says 10.20.193.123:56918) 2026-02-17T20:08:30.803 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.800+0000 7f590affd640 1 -- 10.20.193.123:0/2795161530 learned_addr learned my addr 10.20.193.123:0/2795161530 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:30.803 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.800+0000 7f590b7fe640 1 --1- 10.20.193.123:0/2795161530 >> v1:10.20.193.123:6789/0 conn(0x7f590c12a3a0 0x7f590c1311c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:37260/0 (socket says 10.20.193.123:37260) 2026-02-17T20:08:30.803 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.800+0000 7f590a7fc640 1 --2- 10.20.193.123:0/2795161530 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f590c097370 0x7f590c129e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:30.803 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.801+0000 7f590affd640 1 -- 10.20.193.123:0/2795161530 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f590c097370 msgr2=0x7f590c129e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:08:30.803 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.801+0000 7f590affd640 1 --2- 10.20.193.123:0/2795161530 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f590c097370 0x7f590c129e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:30.803 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.801+0000 7f590affd640 1 -- 10.20.193.123:0/2795161530 >> v1:10.20.193.123:6789/0 conn(0x7f590c12a3a0 legacy=0x7f590c1311c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:30.804 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.801+0000 7f590affd640 1 -- 10.20.193.123:0/2795161530 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f590c099440 con 0x7f590c096a60 2026-02-17T20:08:30.804 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.801+0000 7f590affd640 1 --2- 10.20.193.123:0/2795161530 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f590c096a60 0x7f590c096e30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f58fc009970 tx=0x7f58fc02eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=126cf9b19746565c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:30.804 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.801+0000 7f5909ffb640 1 -- 10.20.193.123:0/2795161530 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58fc02f980 con 0x7f590c096a60 2026-02-17T20:08:30.804 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.801+0000 7f5909ffb640 1 -- 10.20.193.123:0/2795161530 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58fc02fae0 con 0x7f590c096a60 2026-02-17T20:08:30.804 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.801+0000 7f5909ffb640 1 -- 10.20.193.123:0/2795161530 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58fc02fe80 con 0x7f590c096a60 2026-02-17T20:08:30.804 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.801+0000 7f591196e640 1 -- 10.20.193.123:0/2795161530 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f590c096a60 msgr2=0x7f590c096e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:30.804 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.801+0000 7f591196e640 1 --2- 10.20.193.123:0/2795161530 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f590c096a60 0x7f590c096e30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f58fc009970 tx=0x7f58fc02eeb0 comp rx=0 tx=0).stop 2026-02-17T20:08:30.804 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.801+0000 7f591196e640 1 -- 10.20.193.123:0/2795161530 shutdown_connections 2026-02-17T20:08:30.804 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.801+0000 7f591196e640 1 --2- 10.20.193.123:0/2795161530 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f590c097370 0x7f590c129e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:30.804 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.801+0000 7f591196e640 1 --2- 10.20.193.123:0/2795161530 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f590c096a60 0x7f590c096e30 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:30.804 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.801+0000 7f591196e640 1 -- 10.20.193.123:0/2795161530 >> 10.20.193.123:0/2795161530 conn(0x7f590c09d8d0 msgr2=0x7f590c09dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:30.804 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.801+0000 7f591196e640 1 -- 10.20.193.123:0/2795161530 shutdown_connections 2026-02-17T20:08:30.805 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.801+0000 7f591196e640 1 -- 10.20.193.123:0/2795161530 wait complete. 2026-02-17T20:08:30.805 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.802+0000 7f591196e640 1 Processor -- start 2026-02-17T20:08:30.805 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.802+0000 7f591196e640 1 -- start start 2026-02-17T20:08:30.805 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.802+0000 7f591196e640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f590c096a60 0x7f590c11a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:30.805 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.802+0000 7f591196e640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f590c097370 0x7f590c11aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:30.805 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.802+0000 7f591196e640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f590c12a3a0 0x7f590c11b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:30.805 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.802+0000 7f591196e640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590c11c0c0 con 0x7f590c096a60 2026-02-17T20:08:30.805 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.802+0000 7f591196e640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f590c11d130 con 0x7f590c12a3a0 2026-02-17T20:08:30.805 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.802+0000 7f591196e640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f590c11dd50 con 0x7f590c097370 2026-02-17T20:08:30.805 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.802+0000 7f590affd640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f590c096a60 0x7f590c11a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:30.805 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.802+0000 7f590affd640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f590c096a60 0x7f590c11a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:41878/0 (socket says 10.20.193.123:41878) 2026-02-17T20:08:30.805 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.802+0000 7f590affd640 1 -- 10.20.193.123:0/3093215577 learned_addr learned my addr 10.20.193.123:0/3093215577 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:30.805 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.802+0000 7f590b7fe640 1 --2- 10.20.193.123:0/3093215577 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f590c12a3a0 0x7f590c11b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:30.806 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.802+0000 7f590a7fc640 1 --2- 10.20.193.123:0/3093215577 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f590c097370 0x7f590c11aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:30.806 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.802+0000 7f590affd640 1 -- 10.20.193.123:0/3093215577 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f590c097370 msgr2=0x7f590c11aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:30.806 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.802+0000 7f590affd640 1 --2- 10.20.193.123:0/3093215577 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f590c097370 0x7f590c11aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:30.806 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.802+0000 7f590affd640 1 -- 10.20.193.123:0/3093215577 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f590c12a3a0 msgr2=0x7f590c11b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:30.806 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.802+0000 7f590affd640 1 --2- 10.20.193.123:0/3093215577 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f590c12a3a0 0x7f590c11b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:30.806 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.802+0000 7f590affd640 1 -- 10.20.193.123:0/3093215577 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58fc009450 con 0x7f590c096a60 2026-02-17T20:08:30.806 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.802+0000 7f590b7fe640 1 --2- 10.20.193.123:0/3093215577 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f590c12a3a0 0x7f590c11b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:08:30.806 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.802+0000 7f590affd640 1 --2- 10.20.193.123:0/3093215577 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f590c096a60 0x7f590c11a5a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f58fc03a040 tx=0x7f58fc037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:30.806 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.802+0000 7f58f3fff640 1 -- 10.20.193.123:0/3093215577 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58fc042630 con 0x7f590c096a60 2026-02-17T20:08:30.806 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.803+0000 7f58f3fff640 1 -- 10.20.193.123:0/3093215577 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58fc0427d0 con 0x7f590c096a60 2026-02-17T20:08:30.806 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.803+0000 7f591196e640 1 -- 10.20.193.123:0/3093215577 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f590c11b650 con 0x7f590c096a60 2026-02-17T20:08:30.806 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.803+0000 7f58f3fff640 1 -- 10.20.193.123:0/3093215577 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58fc042b90 con 0x7f590c096a60 2026-02-17T20:08:30.807 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.803+0000 7f591196e640 1 -- 10.20.193.123:0/3093215577 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f590c1be540 con 0x7f590c096a60 2026-02-17T20:08:30.807 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.803+0000 7f591196e640 1 -- 10.20.193.123:0/3093215577 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f590c05f010 con 0x7f590c096a60 2026-02-17T20:08:30.807 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.803+0000 7f58f3fff640 1 -- 10.20.193.123:0/3093215577 <== mon.0 v2:10.20.193.123:3300/0 4 ==== mgrmap(e 4) v1 ==== 59153+0+0 (secure 0 0 0) 0x7f58fc03e040 con 0x7f590c096a60 2026-02-17T20:08:30.807 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.803+0000 7f58f3fff640 1 -- 10.20.193.123:0/3093215577 <== mon.0 v2:10.20.193.123:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2862+0+0 (secure 0 0 0) 0x7f58fc088190 con 0x7f590c096a60 2026-02-17T20:08:30.807 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.805+0000 7f58f3fff640 1 -- 10.20.193.123:0/3093215577 <== mon.0 v2:10.20.193.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7f58fc0631a0 con 0x7f590c096a60 2026-02-17T20:08:30.876 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.878+0000 7f591196e640 1 -- 10.20.193.123:0/3093215577 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f590c0646d0 con 0x7f590c096a60 2026-02-17T20:08:30.877 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.879+0000 7f58f3fff640 1 -- 10.20.193.123:0/3093215577 <== mon.0 v2:10.20.193.123:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+116968 (secure 0 0 0) 0x7f58fc047090 con 0x7f590c096a60 2026-02-17T20:08:30.878 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:08:30.878 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.880+0000 7f591196e640 1 -- 10.20.193.123:0/3093215577 >> v1:10.20.193.123:6800/23720 conn(0x7f58f804d040 legacy=0x7f58f804f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:30.879 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.880+0000 7f591196e640 1 -- 10.20.193.123:0/3093215577 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f590c096a60 msgr2=0x7f590c11a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:30.879 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.880+0000 7f591196e640 1 --2- 10.20.193.123:0/3093215577 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f590c096a60 0x7f590c11a5a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f58fc03a040 tx=0x7f58fc037000 comp rx=0 tx=0).stop 2026-02-17T20:08:30.879 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.880+0000 7f591196e640 1 -- 10.20.193.123:0/3093215577 shutdown_connections 2026-02-17T20:08:30.879 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.880+0000 7f591196e640 1 --2- 10.20.193.123:0/3093215577 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f590c12a3a0 0x7f590c11b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:30.879 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.880+0000 7f591196e640 1 --2- 10.20.193.123:0/3093215577 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f590c097370 0x7f590c11aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:30.879 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.880+0000 7f591196e640 1 --2- 10.20.193.123:0/3093215577 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f590c096a60 0x7f590c11a5a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:30.879 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.880+0000 7f591196e640 1 -- 10.20.193.123:0/3093215577 >> 10.20.193.123:0/3093215577 conn(0x7f590c09d8d0 msgr2=0x7f590c09c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:30.879 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.880+0000 7f591196e640 1 -- 10.20.193.123:0/3093215577 shutdown_connections 2026-02-17T20:08:30.879 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.880+0000 7f591196e640 1 -- 10.20.193.123:0/3093215577 wait complete. 2026-02-17T20:08:30.885 INFO:teuthology.orchestra.run.trial123.stdout:{"epoch":4,"flags":0,"active_gid":4103,"active_name":"y","active_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6800","nonce":23720}]},"active_addr":"10.20.193.123:6800/23720","active_change":"2026-02-17T20:08:20.142493+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4119,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.123:0","nonce":2996849897}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.123:0","nonce":1995254470}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.123:0","nonce":3994607579}]}]} 2026-02-17T20:08:30.887 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-17T20:08:30.888 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-17T20:08:30.888 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T20:08:30.956 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.954+0000 7fea27e87640 1 Processor -- start 2026-02-17T20:08:30.956 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.954+0000 7fea27e87640 1 -- start start 2026-02-17T20:08:30.956 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.954+0000 7fea27e87640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fea20094c00 0x7fea20094fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:30.956 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.954+0000 7fea27e87640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fea20095510 0x7fea2012c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:30.956 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.954+0000 7fea27e87640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fea2012c8d0 0x7fea2012ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:30.957 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.954+0000 7fea27e87640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea20092b80 con 0x7fea20094c00 2026-02-17T20:08:30.957 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.954+0000 7fea27e87640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea2008dfd0 con 0x7fea20095510 2026-02-17T20:08:30.957 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.954+0000 7fea27e87640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea20093010 con 0x7fea2012c8d0 2026-02-17T20:08:30.957 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.954+0000 7fea25422640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fea20095510 0x7fea2012c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:30.957 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.954+0000 7fea25c23640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fea20094c00 0x7fea20094fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:30.957 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.954+0000 7fea26424640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fea2012c8d0 0x7fea2012ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:30.957 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.954+0000 7fea25422640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fea20095510 0x7fea2012c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:56930/0 (socket says 10.20.193.123:56930) 2026-02-17T20:08:30.957 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.954+0000 7fea26424640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fea2012c8d0 0x7fea2012ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:45310/0 (socket says 10.20.193.123:45310) 2026-02-17T20:08:30.957 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.954+0000 7fea25422640 1 -- 10.20.193.123:0/4265378974 learned_addr learned my addr 10.20.193.123:0/4265378974 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:30.957 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.954+0000 7fea25422640 1 -- 10.20.193.123:0/4265378974 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fea2012c8d0 msgr2=0x7fea2012ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:08:30.957 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.954+0000 7fea25422640 1 --2- 10.20.193.123:0/4265378974 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fea2012c8d0 0x7fea2012ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:30.958 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.954+0000 7fea25422640 1 -- 10.20.193.123:0/4265378974 >> v2:10.20.193.123:3300/0 conn(0x7fea20094c00 msgr2=0x7fea20094fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:08:30.958 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.954+0000 7fea25422640 1 --2- 10.20.193.123:0/4265378974 >> v2:10.20.193.123:3300/0 conn(0x7fea20094c00 0x7fea20094fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:30.958 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.954+0000 7fea25422640 1 -- 10.20.193.123:0/4265378974 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea2008dc00 con 0x7fea20095510 2026-02-17T20:08:30.958 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.955+0000 7fea25422640 1 --2- 10.20.193.123:0/4265378974 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fea20095510 0x7fea2012c390 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fea10009910 tx=0x7fea1002ee10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=749bd63a73ad9c44 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:30.958 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.955+0000 7fea24c21640 1 -- 10.20.193.123:0/4265378974 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1002f920 con 0x7fea20095510 2026-02-17T20:08:30.958 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.955+0000 7fea24c21640 1 -- 10.20.193.123:0/4265378974 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1002fa80 con 0x7fea20095510 2026-02-17T20:08:30.958 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.955+0000 7fea24c21640 1 -- 10.20.193.123:0/4265378974 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1002fe60 con 0x7fea20095510 2026-02-17T20:08:30.958 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.955+0000 7fea27e87640 1 -- 10.20.193.123:0/4265378974 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fea20095510 msgr2=0x7fea2012c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:30.958 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.955+0000 7fea27e87640 1 --2- 10.20.193.123:0/4265378974 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fea20095510 0x7fea2012c390 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fea10009910 tx=0x7fea1002ee10 comp rx=0 tx=0).stop 2026-02-17T20:08:30.958 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.955+0000 7fea27e87640 1 -- 10.20.193.123:0/4265378974 shutdown_connections 2026-02-17T20:08:30.958 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.955+0000 7fea27e87640 1 --2- 10.20.193.123:0/4265378974 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fea2012c8d0 0x7fea2012ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:30.958 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.955+0000 7fea27e87640 1 --2- 10.20.193.123:0/4265378974 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fea20095510 0x7fea2012c390 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:30.959 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.955+0000 7fea27e87640 1 --2- 10.20.193.123:0/4265378974 >> v2:10.20.193.123:3300/0 conn(0x7fea20094c00 0x7fea20094fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:30.959 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.955+0000 7fea27e87640 1 -- 10.20.193.123:0/4265378974 >> 10.20.193.123:0/4265378974 conn(0x7fea20099df0 msgr2=0x7fea20095cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:30.959 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.955+0000 7fea27e87640 1 -- 10.20.193.123:0/4265378974 shutdown_connections 2026-02-17T20:08:30.959 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.955+0000 7fea27e87640 1 -- 10.20.193.123:0/4265378974 wait complete. 2026-02-17T20:08:30.959 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.956+0000 7fea27e87640 1 Processor -- start 2026-02-17T20:08:30.959 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.956+0000 7fea27e87640 1 -- start start 2026-02-17T20:08:30.959 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.956+0000 7fea27e87640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fea20094c00 0x7fea2011e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:30.959 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.956+0000 7fea27e87640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fea20095510 0x7fea2011e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:30.959 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.956+0000 7fea27e87640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fea2012c8d0 0x7fea2011ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:30.959 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.956+0000 7fea27e87640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea20120440 con 0x7fea20095510 2026-02-17T20:08:30.959 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.956+0000 7fea27e87640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea201206e0 con 0x7fea20094c00 2026-02-17T20:08:30.959 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.956+0000 7fea27e87640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea2006efc0 con 0x7fea2012c8d0 2026-02-17T20:08:30.960 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.956+0000 7fea25c23640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fea20094c00 0x7fea2011e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:30.960 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.956+0000 7fea25422640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fea20095510 0x7fea2011e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:30.960 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.956+0000 7fea25c23640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fea20094c00 0x7fea2011e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:56946/0 (socket says 10.20.193.123:56946) 2026-02-17T20:08:30.960 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.956+0000 7fea25c23640 1 -- 10.20.193.123:0/1811413413 learned_addr learned my addr 10.20.193.123:0/1811413413 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:30.960 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.956+0000 7fea26424640 1 --2- 10.20.193.123:0/1811413413 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fea2012c8d0 0x7fea2011ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:30.960 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.956+0000 7fea25c23640 1 -- 10.20.193.123:0/1811413413 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fea2012c8d0 msgr2=0x7fea2011ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:30.960 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.956+0000 7fea25c23640 1 --2- 10.20.193.123:0/1811413413 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fea2012c8d0 0x7fea2011ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:30.960 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.956+0000 7fea25c23640 1 -- 10.20.193.123:0/1811413413 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fea20095510 msgr2=0x7fea2011e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:30.960 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.956+0000 7fea25c23640 1 --2- 10.20.193.123:0/1811413413 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fea20095510 0x7fea2011e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:30.960 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.956+0000 7fea25c23640 1 -- 10.20.193.123:0/1811413413 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea10009450 con 0x7fea20094c00 2026-02-17T20:08:30.960 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.956+0000 7fea25422640 1 --2- 10.20.193.123:0/1811413413 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fea20095510 0x7fea2011e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:08:30.960 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.956+0000 7fea25c23640 1 --2- 10.20.193.123:0/1811413413 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fea20094c00 0x7fea2011e2d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fea1c00ea20 tx=0x7fea1c0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:30.961 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.956+0000 7fea167fc640 1 -- 10.20.193.123:0/1811413413 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1c00ca70 con 0x7fea20094c00 2026-02-17T20:08:30.961 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.957+0000 7fea167fc640 1 -- 10.20.193.123:0/1811413413 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1c00cbd0 con 0x7fea20094c00 2026-02-17T20:08:30.961 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.957+0000 7fea27e87640 1 -- 10.20.193.123:0/1811413413 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea2006e540 con 0x7fea20094c00 2026-02-17T20:08:30.961 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.957+0000 7fea167fc640 1 -- 10.20.193.123:0/1811413413 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1c013470 con 0x7fea20094c00 2026-02-17T20:08:30.961 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.957+0000 7fea27e87640 1 -- 10.20.193.123:0/1811413413 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea201bcc00 con 0x7fea20094c00 2026-02-17T20:08:30.961 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.957+0000 7fea27e87640 1 -- 10.20.193.123:0/1811413413 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea2011f350 con 0x7fea20094c00 2026-02-17T20:08:30.961 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.957+0000 7fea167fc640 1 -- 10.20.193.123:0/1811413413 <== mon.1 v2:10.20.193.123:3301/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7fea1c013860 con 0x7fea20094c00 2026-02-17T20:08:30.961 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.957+0000 7fea167fc640 1 -- 10.20.193.123:0/1811413413 <== mon.1 v2:10.20.193.123:3301/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2862+0+0 (secure 0 0 0) 0x7fea1c063cb0 con 0x7fea20094c00 2026-02-17T20:08:30.962 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:30.959+0000 7fea167fc640 1 -- 10.20.193.123:0/1811413413 <== mon.1 v2:10.20.193.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7fea1c03eaa0 con 0x7fea20094c00 2026-02-17T20:08:31.021 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.023+0000 7fea27e87640 1 -- 10.20.193.123:0/1811413413 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fea2005f010 con 0x7fea20094c00 2026-02-17T20:08:31.022 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.024+0000 7fea167fc640 1 -- 10.20.193.123:0/1811413413 <== mon.1 v2:10.20.193.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+8110 (secure 0 0 0) 0x7fea1c0422b0 con 0x7fea20094c00 2026-02-17T20:08:31.022 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:08:31.022 INFO:teuthology.orchestra.run.trial123.stdout:{"epoch":13,"fsid":"ddf342a7-b912-46f2-b373-84d7f3b75be2","created":"2026-02-17T20:08:19.090665+0000","modified":"2026-02-17T20:08:30.684505+0000","last_up_change":"2026-02-17T20:08:26.676482+0000","last_in_change":"2026-02-17T20:08:19.810884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-17T20:08:27.136671+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":13,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2026-02-17T20:08:28.174323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"5cfdb97e-5584-42e3-8c32-a9b4ace549f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6801","nonce":24324}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6802","nonce":24324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6804","nonce":24324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6803","nonce":24324}]},"public_addr":"10.20.193.123:6801/24324","cluster_addr":"10.20.193.123:6802/24324","heartbeat_back_addr":"10.20.193.123:6804/24324","heartbeat_front_addr":"10.20.193.123:6803/24324","state":["exists","up"]},{"osd":1,"uuid":"9b7f5906-8ae8-4a34-8e71-1ba7cf3eeda1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6805","nonce":24325}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6806","nonce":24325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6808","nonce":24325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6807","nonce":24325}]},"public_addr":"10.20.193.123:6805/24325","cluster_addr":"10.20.193.123:6806/24325","heartbeat_back_addr":"10.20.193.123:6808/24325","heartbeat_front_addr":"10.20.193.123:6807/24325","state":["exists","up"]},{"osd":2,"uuid":"db6be5e2-fdd2-460f-bf35-269d92577824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6809","nonce":24326}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6810","nonce":24326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6812","nonce":24326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6811","nonce":24326}]},"public_addr":"10.20.193.123:6809/24326","cluster_addr":"10.20.193.123:6810/24326","heartbeat_back_addr":"10.20.193.123:6812/24326","heartbeat_front_addr":"10.20.193.123:6811/24326","state":["exists","up"]},{"osd":3,"uuid":"23275d01-0d57-497c-a600-d9aeef747af2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6813","nonce":24327}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6814","nonce":24327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6816","nonce":24327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6815","nonce":24327}]},"public_addr":"10.20.193.123:6813/24327","cluster_addr":"10.20.193.123:6814/24327","heartbeat_back_addr":"10.20.193.123:6816/24327","heartbeat_front_addr":"10.20.193.123:6815/24327","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T20:08:31.023 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.024+0000 7fea27e87640 1 -- 10.20.193.123:0/1811413413 >> v1:10.20.193.123:6800/23720 conn(0x7fea0404d0d0 legacy=0x7fea0404f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.024 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.024+0000 7fea27e87640 1 -- 10.20.193.123:0/1811413413 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fea20094c00 msgr2=0x7fea2011e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.024 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.024+0000 7fea27e87640 1 --2- 10.20.193.123:0/1811413413 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fea20094c00 0x7fea2011e2d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fea1c00ea20 tx=0x7fea1c0090f0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.024 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.024+0000 7fea27e87640 1 -- 10.20.193.123:0/1811413413 shutdown_connections 2026-02-17T20:08:31.024 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.024+0000 7fea27e87640 1 --2- 10.20.193.123:0/1811413413 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fea2012c8d0 0x7fea2011ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.024 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.024+0000 7fea27e87640 1 --2- 10.20.193.123:0/1811413413 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fea20095510 0x7fea2011e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.024 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.024+0000 7fea27e87640 1 --2- 10.20.193.123:0/1811413413 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fea20094c00 0x7fea2011e2d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.024 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.024+0000 7fea27e87640 1 -- 10.20.193.123:0/1811413413 >> 10.20.193.123:0/1811413413 conn(0x7fea20099df0 msgr2=0x7fea2008a750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:31.024 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.025+0000 7fea27e87640 1 -- 10.20.193.123:0/1811413413 shutdown_connections 2026-02-17T20:08:31.024 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.025+0000 7fea27e87640 1 -- 10.20.193.123:0/1811413413 wait complete. 2026-02-17T20:08:31.030 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-17T20:08:31.030 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T20:08:31.098 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.096+0000 7eff70bd4640 1 Processor -- start 2026-02-17T20:08:31.099 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.096+0000 7eff70bd4640 1 -- start start 2026-02-17T20:08:31.099 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.097+0000 7eff70bd4640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7eff6c097540 0x7eff6c12f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:31.099 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.097+0000 7eff70bd4640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7eff6c12f6f0 0x7eff6c131ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:31.099 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.097+0000 7eff70bd4640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff6c09a430 con 0x7eff6c096a60 2026-02-17T20:08:31.099 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.097+0000 7eff70bd4640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff6c097e40 con 0x7eff6c097540 2026-02-17T20:08:31.099 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.097+0000 7eff70bd4640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c09a680 con 0x7eff6c12f6f0 2026-02-17T20:08:31.099 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.097+0000 7eff6a59c640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7eff6c096a60 0x7eff6c096e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:37266/0 (socket says 10.20.193.123:37266) 2026-02-17T20:08:31.099 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.097+0000 7eff6a59c640 1 -- 10.20.193.123:0/1148250560 learned_addr learned my addr 10.20.193.123:0/1148250560 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:08:31.099 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.097+0000 7eff6ad9d640 1 --2- 10.20.193.123:0/1148250560 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7eff6c12f6f0 0x7eff6c131ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:31.099 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.097+0000 7eff69d9b640 1 --2- 10.20.193.123:0/1148250560 >> v2:10.20.193.123:3300/0 conn(0x7eff6c097540 0x7eff6c12f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:31.100 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.097+0000 7eff6959a640 1 -- 10.20.193.123:0/1148250560 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1021867186 0 0) 0x7eff6c09a430 con 0x7eff6c096a60 2026-02-17T20:08:31.100 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.097+0000 7eff6959a640 1 -- 10.20.193.123:0/1148250560 --> v1:10.20.193.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff540034e0 con 0x7eff6c096a60 2026-02-17T20:08:31.100 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.097+0000 7eff6ad9d640 1 -- 10.20.193.123:0/1148250560 >> v2:10.20.193.123:3300/0 conn(0x7eff6c097540 msgr2=0x7eff6c12f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:08:31.100 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.097+0000 7eff6ad9d640 1 --2- 10.20.193.123:0/1148250560 >> v2:10.20.193.123:3300/0 conn(0x7eff6c097540 0x7eff6c12f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.100 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.097+0000 7eff6ad9d640 1 -- 10.20.193.123:0/1148250560 >> v1:10.20.193.123:6789/0 conn(0x7eff6c096a60 legacy=0x7eff6c096e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.100 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.097+0000 7eff6ad9d640 1 -- 10.20.193.123:0/1148250560 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff6c099440 con 0x7eff6c12f6f0 2026-02-17T20:08:31.100 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.097+0000 7eff6ad9d640 1 --2- 10.20.193.123:0/1148250560 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7eff6c12f6f0 0x7eff6c131ad0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7eff64009e60 tx=0x7eff6402f280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3647dd07f6e1b74a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:31.100 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.097+0000 7eff6959a640 1 -- 10.20.193.123:0/1148250560 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6402fda0 con 0x7eff6c12f6f0 2026-02-17T20:08:31.100 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.098+0000 7eff6959a640 1 -- 10.20.193.123:0/1148250560 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff64037440 con 0x7eff6c12f6f0 2026-02-17T20:08:31.100 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.098+0000 7eff6959a640 1 -- 10.20.193.123:0/1148250560 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff640377c0 con 0x7eff6c12f6f0 2026-02-17T20:08:31.100 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.098+0000 7eff70bd4640 1 -- 10.20.193.123:0/1148250560 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7eff6c12f6f0 msgr2=0x7eff6c131ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.100 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.098+0000 7eff70bd4640 1 --2- 10.20.193.123:0/1148250560 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7eff6c12f6f0 0x7eff6c131ad0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7eff64009e60 tx=0x7eff6402f280 comp rx=0 tx=0).stop 2026-02-17T20:08:31.101 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.098+0000 7eff70bd4640 1 -- 10.20.193.123:0/1148250560 shutdown_connections 2026-02-17T20:08:31.101 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.098+0000 7eff70bd4640 1 --2- 10.20.193.123:0/1148250560 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7eff6c12f6f0 0x7eff6c131ad0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.101 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.098+0000 7eff70bd4640 1 --2- 10.20.193.123:0/1148250560 >> v2:10.20.193.123:3300/0 conn(0x7eff6c097540 0x7eff6c12f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.101 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.098+0000 7eff70bd4640 1 -- 10.20.193.123:0/1148250560 >> 10.20.193.123:0/1148250560 conn(0x7eff6c09d8d0 msgr2=0x7eff6c09dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:31.101 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.098+0000 7eff70bd4640 1 -- 10.20.193.123:0/1148250560 shutdown_connections 2026-02-17T20:08:31.101 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.098+0000 7eff70bd4640 1 -- 10.20.193.123:0/1148250560 wait complete. 2026-02-17T20:08:31.101 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.098+0000 7eff70bd4640 1 Processor -- start 2026-02-17T20:08:31.101 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.098+0000 7eff70bd4640 1 -- start start 2026-02-17T20:08:31.101 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.099+0000 7eff70bd4640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7eff6c096a60 0x7eff6c129a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:31.101 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.099+0000 7eff70bd4640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7eff6c097540 0x7eff6c129fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:31.101 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.099+0000 7eff70bd4640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7eff6c12f6f0 0x7eff6c117d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:31.101 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.099+0000 7eff70bd4640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c12a890 con 0x7eff6c097540 2026-02-17T20:08:31.102 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.099+0000 7eff70bd4640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c11b4a0 con 0x7eff6c12f6f0 2026-02-17T20:08:31.102 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.099+0000 7eff70bd4640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c11a080 con 0x7eff6c096a60 2026-02-17T20:08:31.102 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.099+0000 7eff6a59c640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7eff6c096a60 0x7eff6c129a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:31.102 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.099+0000 7eff69d9b640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7eff6c097540 0x7eff6c129fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:31.102 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.099+0000 7eff6a59c640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7eff6c096a60 0x7eff6c129a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:45330/0 (socket says 10.20.193.123:45330) 2026-02-17T20:08:31.102 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.099+0000 7eff69d9b640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7eff6c097540 0x7eff6c129fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:41900/0 (socket says 10.20.193.123:41900) 2026-02-17T20:08:31.102 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.099+0000 7eff6a59c640 1 -- 10.20.193.123:0/3947540284 learned_addr learned my addr 10.20.193.123:0/3947540284 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:31.102 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.099+0000 7eff6ad9d640 1 --2- 10.20.193.123:0/3947540284 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7eff6c12f6f0 0x7eff6c117d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:31.102 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.099+0000 7eff6a59c640 1 -- 10.20.193.123:0/3947540284 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7eff6c12f6f0 msgr2=0x7eff6c117d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.102 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.099+0000 7eff6a59c640 1 --2- 10.20.193.123:0/3947540284 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7eff6c12f6f0 0x7eff6c117d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.102 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.099+0000 7eff6a59c640 1 -- 10.20.193.123:0/3947540284 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7eff6c097540 msgr2=0x7eff6c129fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.103 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.099+0000 7eff6a59c640 1 --2- 10.20.193.123:0/3947540284 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7eff6c097540 0x7eff6c129fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.103 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.099+0000 7eff6a59c640 1 -- 10.20.193.123:0/3947540284 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff64009a20 con 0x7eff6c096a60 2026-02-17T20:08:31.103 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.099+0000 7eff69d9b640 1 --2- 10.20.193.123:0/3947540284 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7eff6c097540 0x7eff6c129fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:08:31.103 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.099+0000 7eff6a59c640 1 --2- 10.20.193.123:0/3947540284 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7eff6c096a60 0x7eff6c129a90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7eff5c00c7c0 tx=0x7eff5c007d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:31.103 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.099+0000 7eff5affd640 1 -- 10.20.193.123:0/3947540284 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c005870 con 0x7eff6c096a60 2026-02-17T20:08:31.103 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.099+0000 7eff5affd640 1 -- 10.20.193.123:0/3947540284 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5c0059d0 con 0x7eff6c096a60 2026-02-17T20:08:31.103 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.099+0000 7eff70bd4640 1 -- 10.20.193.123:0/3947540284 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff6c11b190 con 0x7eff6c096a60 2026-02-17T20:08:31.103 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.099+0000 7eff5affd640 1 -- 10.20.193.123:0/3947540284 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c005d90 con 0x7eff6c096a60 2026-02-17T20:08:31.103 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.099+0000 7eff70bd4640 1 -- 10.20.193.123:0/3947540284 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff6c12a6b0 con 0x7eff6c096a60 2026-02-17T20:08:31.103 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.100+0000 7eff70bd4640 1 -- 10.20.193.123:0/3947540284 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff6c05f010 con 0x7eff6c096a60 2026-02-17T20:08:31.103 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.100+0000 7eff5affd640 1 -- 10.20.193.123:0/3947540284 <== mon.2 v2:10.20.193.123:3302/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7eff5c007300 con 0x7eff6c096a60 2026-02-17T20:08:31.103 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.100+0000 7eff5affd640 1 -- 10.20.193.123:0/3947540284 <== mon.2 v2:10.20.193.123:3302/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2862+0+0 (secure 0 0 0) 0x7eff5c062e30 con 0x7eff6c096a60 2026-02-17T20:08:31.104 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.102+0000 7eff5affd640 1 -- 10.20.193.123:0/3947540284 <== mon.2 v2:10.20.193.123:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7eff5c03dc40 con 0x7eff6c096a60 2026-02-17T20:08:31.161 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.163+0000 7eff70bd4640 1 -- 10.20.193.123:0/3947540284 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff6c0646d0 con 0x7eff6c096a60 2026-02-17T20:08:31.162 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.164+0000 7eff5affd640 1 -- 10.20.193.123:0/3947540284 <== mon.2 v2:10.20.193.123:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+8110 (secure 0 0 0) 0x7eff5c017030 con 0x7eff6c096a60 2026-02-17T20:08:31.162 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:08:31.162 INFO:teuthology.orchestra.run.trial123.stdout:{"epoch":13,"fsid":"ddf342a7-b912-46f2-b373-84d7f3b75be2","created":"2026-02-17T20:08:19.090665+0000","modified":"2026-02-17T20:08:30.684505+0000","last_up_change":"2026-02-17T20:08:26.676482+0000","last_in_change":"2026-02-17T20:08:19.810884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-17T20:08:27.136671+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":13,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2026-02-17T20:08:28.174323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"5cfdb97e-5584-42e3-8c32-a9b4ace549f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6801","nonce":24324}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6802","nonce":24324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6804","nonce":24324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6803","nonce":24324}]},"public_addr":"10.20.193.123:6801/24324","cluster_addr":"10.20.193.123:6802/24324","heartbeat_back_addr":"10.20.193.123:6804/24324","heartbeat_front_addr":"10.20.193.123:6803/24324","state":["exists","up"]},{"osd":1,"uuid":"9b7f5906-8ae8-4a34-8e71-1ba7cf3eeda1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6805","nonce":24325}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6806","nonce":24325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6808","nonce":24325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6807","nonce":24325}]},"public_addr":"10.20.193.123:6805/24325","cluster_addr":"10.20.193.123:6806/24325","heartbeat_back_addr":"10.20.193.123:6808/24325","heartbeat_front_addr":"10.20.193.123:6807/24325","state":["exists","up"]},{"osd":2,"uuid":"db6be5e2-fdd2-460f-bf35-269d92577824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6809","nonce":24326}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6810","nonce":24326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6812","nonce":24326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6811","nonce":24326}]},"public_addr":"10.20.193.123:6809/24326","cluster_addr":"10.20.193.123:6810/24326","heartbeat_back_addr":"10.20.193.123:6812/24326","heartbeat_front_addr":"10.20.193.123:6811/24326","state":["exists","up"]},{"osd":3,"uuid":"23275d01-0d57-497c-a600-d9aeef747af2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6813","nonce":24327}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6814","nonce":24327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6816","nonce":24327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6815","nonce":24327}]},"public_addr":"10.20.193.123:6813/24327","cluster_addr":"10.20.193.123:6814/24327","heartbeat_back_addr":"10.20.193.123:6816/24327","heartbeat_front_addr":"10.20.193.123:6815/24327","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T20:08:31.163 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.164+0000 7eff70bd4640 1 -- 10.20.193.123:0/3947540284 >> v1:10.20.193.123:6800/23720 conn(0x7eff4c04d0d0 legacy=0x7eff4c04f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.164 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.164+0000 7eff70bd4640 1 -- 10.20.193.123:0/3947540284 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7eff6c096a60 msgr2=0x7eff6c129a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.164 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.164+0000 7eff70bd4640 1 --2- 10.20.193.123:0/3947540284 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7eff6c096a60 0x7eff6c129a90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7eff5c00c7c0 tx=0x7eff5c007d60 comp rx=0 tx=0).stop 2026-02-17T20:08:31.164 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.164+0000 7eff70bd4640 1 -- 10.20.193.123:0/3947540284 shutdown_connections 2026-02-17T20:08:31.164 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.164+0000 7eff70bd4640 1 --2- 10.20.193.123:0/3947540284 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7eff6c12f6f0 0x7eff6c117d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.164 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.164+0000 7eff70bd4640 1 --2- 10.20.193.123:0/3947540284 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7eff6c097540 0x7eff6c129fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.164 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.164+0000 7eff70bd4640 1 --2- 10.20.193.123:0/3947540284 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7eff6c096a60 0x7eff6c129a90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.164 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.164+0000 7eff70bd4640 1 -- 10.20.193.123:0/3947540284 >> 10.20.193.123:0/3947540284 conn(0x7eff6c09d8d0 msgr2=0x7eff6c130f30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:31.164 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.164+0000 7eff70bd4640 1 -- 10.20.193.123:0/3947540284 shutdown_connections 2026-02-17T20:08:31.164 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.164+0000 7eff70bd4640 1 -- 10.20.193.123:0/3947540284 wait complete. 2026-02-17T20:08:31.170 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T20:08:31.171 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T20:08:31.171 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T20:08:31.172 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T20:08:31.237 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.239+0000 7fac030db640 1 Processor -- start 2026-02-17T20:08:31.238 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.239+0000 7fac030db640 1 -- start start 2026-02-17T20:08:31.238 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.239+0000 7fac030db640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fabfc094b00 0x7fabfc094ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:31.238 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.239+0000 7fac030db640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fabfc092a20 0x7fabfc095410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:31.238 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.239+0000 7fac030db640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabfc095950 con 0x7fabfc12c290 2026-02-17T20:08:31.238 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.239+0000 7fac030db640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabfc08ff10 con 0x7fabfc092a20 2026-02-17T20:08:31.238 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.239+0000 7fac030db640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc092f40 con 0x7fabfc094b00 2026-02-17T20:08:31.238 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.239+0000 7fac00e77640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fabfc094b00 0x7fabfc094ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:31.238 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.239+0000 7fabfbfff640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fabfc092a20 0x7fabfc095410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:31.238 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.239+0000 7fac00e77640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fabfc094b00 0x7fabfc094ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:45338/0 (socket says 10.20.193.123:45338) 2026-02-17T20:08:31.239 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.239+0000 7fac01678640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7fabfc12c290 0x7fabfc12e670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:37282/0 (socket says 10.20.193.123:37282) 2026-02-17T20:08:31.239 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.239+0000 7fac00e77640 1 -- 10.20.193.123:0/2893800994 learned_addr learned my addr 10.20.193.123:0/2893800994 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:31.239 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.239+0000 7f7e19d88640 1 Processor -- start 2026-02-17T20:08:31.239 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.239+0000 7fc09c292640 1 Processor -- start 2026-02-17T20:08:31.240 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.239+0000 7f7e19d88640 1 -- start start 2026-02-17T20:08:31.240 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.239+0000 7fc09c292640 1 -- start start 2026-02-17T20:08:31.241 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.239+0000 7fabfb7fe640 1 -- 10.20.193.123:0/2893800994 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2535316808 0 0) 0x7fabfc095950 con 0x7fabfc12c290 2026-02-17T20:08:31.241 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.239+0000 7fabfb7fe640 1 -- 10.20.193.123:0/2893800994 --> v1:10.20.193.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabec0034e0 con 0x7fabfc12c290 2026-02-17T20:08:31.241 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.239+0000 7fac00e77640 1 -- 10.20.193.123:0/2893800994 >> v2:10.20.193.123:3300/0 conn(0x7fabfc092a20 msgr2=0x7fabfc095410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:08:31.241 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.239+0000 7fac00e77640 1 --2- 10.20.193.123:0/2893800994 >> v2:10.20.193.123:3300/0 conn(0x7fabfc092a20 0x7fabfc095410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.241 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.239+0000 7fac00e77640 1 -- 10.20.193.123:0/2893800994 >> v1:10.20.193.123:6789/0 conn(0x7fabfc12c290 legacy=0x7fabfc12e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.241 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.239+0000 7fac00e77640 1 -- 10.20.193.123:0/2893800994 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabfc08deb0 con 0x7fabfc094b00 2026-02-17T20:08:31.241 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.239+0000 7fabfbfff640 1 --2- 10.20.193.123:0/2893800994 >> v2:10.20.193.123:3300/0 conn(0x7fabfc092a20 0x7fabfc095410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:08:31.242 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.240+0000 7f7e19d88640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f7e14094b00 0x7f7e14094ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:31.242 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.240+0000 7f7e19d88640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f7e14092a20 0x7f7e14095410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:31.242 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.240+0000 7f7e19d88640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e14095950 con 0x7f7e1412c290 2026-02-17T20:08:31.242 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.240+0000 7f7e19d88640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1408ff10 con 0x7f7e14094b00 2026-02-17T20:08:31.242 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.240+0000 7f7e19d88640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e14092f40 con 0x7f7e14092a20 2026-02-17T20:08:31.243 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.240+0000 7f7e12ffd640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f7e14092a20 0x7f7e14095410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:31.243 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.240+0000 7f7e13fff640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7f7e1412c290 0x7f7e1412e670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:37284/0 (socket says 10.20.193.123:37284) 2026-02-17T20:08:31.243 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.240+0000 7f7e13fff640 1 -- 10.20.193.123:0/3340764493 learned_addr learned my addr 10.20.193.123:0/3340764493 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:08:31.243 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.240+0000 7fc09c292640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc094096a60 0x7fc094096e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:31.243 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.240+0000 7f7e137fe640 1 --2- 10.20.193.123:0/3340764493 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f7e14094b00 0x7f7e14094ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:31.244 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.240+0000 7fc09c292640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fc09412a560 0x7fc0941321a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:31.244 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.240+0000 7fc09c292640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc09409a5c0 con 0x7fc094097370 2026-02-17T20:08:31.244 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.240+0000 7fc09c292640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc094099ac0 con 0x7fc094096a60 2026-02-17T20:08:31.244 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.240+0000 7fc09c292640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc094099310 con 0x7fc09412a560 2026-02-17T20:08:31.244 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.240+0000 7f7e127fc640 1 -- 10.20.193.123:0/3340764493 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4161376031 0 0) 0x7f7e14095950 con 0x7f7e1412c290 2026-02-17T20:08:31.245 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.240+0000 7fc09982d640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7fc094097370 0x7fc094129e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:37286/0 (socket says 10.20.193.123:37286) 2026-02-17T20:08:31.245 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.240+0000 7fc09982d640 1 -- 10.20.193.123:0/2728198952 learned_addr learned my addr 10.20.193.123:0/2728198952 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:08:31.245 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.240+0000 7fc09a02e640 1 --2- 10.20.193.123:0/2728198952 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc094096a60 0x7fc094096e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:31.245 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.240+0000 7f7e127fc640 1 -- 10.20.193.123:0/3340764493 --> v1:10.20.193.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e000034e0 con 0x7f7e1412c290 2026-02-17T20:08:31.246 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.240+0000 7fc09a82f640 1 --2- 10.20.193.123:0/2728198952 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fc09412a560 0x7fc0941321a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:31.246 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.240+0000 7f7e12ffd640 1 -- 10.20.193.123:0/3340764493 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f7e14094b00 msgr2=0x7f7e14094ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:08:31.246 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.240+0000 7f7e12ffd640 1 --2- 10.20.193.123:0/3340764493 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f7e14094b00 0x7f7e14094ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.246 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.240+0000 7f7e12ffd640 1 -- 10.20.193.123:0/3340764493 >> v1:10.20.193.123:6789/0 conn(0x7f7e1412c290 legacy=0x7f7e1412e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.246 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.240+0000 7f7e12ffd640 1 -- 10.20.193.123:0/3340764493 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e1408deb0 con 0x7f7e14092a20 2026-02-17T20:08:31.247 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.240+0000 7fac00e77640 1 --2- 10.20.193.123:0/2893800994 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fabfc094b00 0x7fabfc094ed0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fabf0009910 tx=0x7fabf002ee10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b70514e6812cc70d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:31.247 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.240+0000 7fc09902c640 1 -- 10.20.193.123:0/2728198952 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3755720283 0 0) 0x7fc09409a5c0 con 0x7fc094097370 2026-02-17T20:08:31.248 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.240+0000 7fc09902c640 1 -- 10.20.193.123:0/2728198952 --> v1:10.20.193.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0800034e0 con 0x7fc094097370 2026-02-17T20:08:31.248 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.240+0000 7fc09a82f640 1 -- 10.20.193.123:0/2728198952 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc094096a60 msgr2=0x7fc094096e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:08:31.248 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.240+0000 7fc09a82f640 1 --2- 10.20.193.123:0/2728198952 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc094096a60 0x7fc094096e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.248 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.240+0000 7fc09a82f640 1 -- 10.20.193.123:0/2728198952 >> v1:10.20.193.123:6789/0 conn(0x7fc094097370 legacy=0x7fc094129e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.248 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.240+0000 7fc09a82f640 1 -- 10.20.193.123:0/2728198952 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc09409a300 con 0x7fc09412a560 2026-02-17T20:08:31.248 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.240+0000 7fabfb7fe640 1 -- 10.20.193.123:0/2893800994 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf002f970 con 0x7fabfc094b00 2026-02-17T20:08:31.249 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.240+0000 7fabfb7fe640 1 -- 10.20.193.123:0/2893800994 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf002fad0 con 0x7fabfc094b00 2026-02-17T20:08:31.249 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.240+0000 7fabfb7fe640 1 -- 10.20.193.123:0/2893800994 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf002fe70 con 0x7fabfc094b00 2026-02-17T20:08:31.249 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.240+0000 7faa5f6db640 1 Processor -- start 2026-02-17T20:08:31.249 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.240+0000 7faa5f6db640 1 -- start start 2026-02-17T20:08:31.250 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.240+0000 7f7e12ffd640 1 --2- 10.20.193.123:0/3340764493 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f7e14092a20 0x7f7e14095410 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc009880 tx=0x7f7dfc02ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be9d2b0e8679f00d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:31.250 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.240+0000 7fac030db640 1 -- 10.20.193.123:0/2893800994 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fabfc094b00 msgr2=0x7fabfc094ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.250 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.240+0000 7fac030db640 1 --2- 10.20.193.123:0/2893800994 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fabfc094b00 0x7fabfc094ed0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fabf0009910 tx=0x7fabf002ee10 comp rx=0 tx=0).stop 2026-02-17T20:08:31.251 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.240+0000 7fac030db640 1 -- 10.20.193.123:0/2893800994 shutdown_connections 2026-02-17T20:08:31.251 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.240+0000 7fac030db640 1 --2- 10.20.193.123:0/2893800994 >> v2:10.20.193.123:3300/0 conn(0x7fabfc092a20 0x7fabfc095410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.251 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.240+0000 7fac030db640 1 --2- 10.20.193.123:0/2893800994 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fabfc094b00 0x7fabfc094ed0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.251 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.240+0000 7fac030db640 1 -- 10.20.193.123:0/2893800994 >> 10.20.193.123:0/2893800994 conn(0x7fabfc099cf0 msgr2=0x7fabfc095bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:31.251 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.240+0000 7fac030db640 1 -- 10.20.193.123:0/2893800994 shutdown_connections 2026-02-17T20:08:31.251 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.240+0000 7f7e127fc640 1 -- 10.20.193.123:0/3340764493 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc02f890 con 0x7f7e14092a20 2026-02-17T20:08:31.252 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.240+0000 7fc09a82f640 1 --2- 10.20.193.123:0/2728198952 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fc09412a560 0x7fc0941321a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc08c009e90 tx=0x7fc08c02f2b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd0f38df7084a4d1 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:31.252 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.240+0000 7fac030db640 1 -- 10.20.193.123:0/2893800994 wait complete. 2026-02-17T20:08:31.252 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.240+0000 7f7e127fc640 1 -- 10.20.193.123:0/3340764493 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dfc02f9f0 con 0x7f7e14092a20 2026-02-17T20:08:31.252 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.240+0000 7f7e127fc640 1 -- 10.20.193.123:0/3340764493 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc02fd90 con 0x7f7e14092a20 2026-02-17T20:08:31.253 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.240+0000 7faa5f6db640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7faa58090570 0x7faa58095c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:31.253 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.240+0000 7faa5f6db640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7faa58096180 0x7faa580965f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:31.253 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7fc09902c640 1 -- 10.20.193.123:0/2728198952 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c02fd80 con 0x7fc09412a560 2026-02-17T20:08:31.254 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7faa5f6db640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7faa5812c3c0 0x7faa5812e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:31.254 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7faa5f6db640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa580675e0 con 0x7faa5812c3c0 2026-02-17T20:08:31.254 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7faa5f6db640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa580911f0 con 0x7faa58090570 2026-02-17T20:08:31.254 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7faa5f6db640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa580678b0 con 0x7faa58096180 2026-02-17T20:08:31.254 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7fc09902c640 1 -- 10.20.193.123:0/2728198952 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08c037440 con 0x7fc09412a560 2026-02-17T20:08:31.255 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7fc09902c640 1 -- 10.20.193.123:0/2728198952 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c0377e0 con 0x7fc09412a560 2026-02-17T20:08:31.255 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7faa5d477640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7faa58090570 0x7faa58095c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:31.255 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7faa5d477640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7faa58090570 0x7faa58095c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:56958/0 (socket says 10.20.193.123:56958) 2026-02-17T20:08:31.255 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7faa5d477640 1 -- 10.20.193.123:0/2076857350 learned_addr learned my addr 10.20.193.123:0/2076857350 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:31.255 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7faa5cc76640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7faa58096180 0x7faa580965f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:31.256 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7faa5dc78640 1 --2- 10.20.193.123:0/2076857350 >> v2:10.20.193.123:3300/0 conn(0x7faa5812c3c0 0x7faa5812e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:31.256 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7f7e19d88640 1 -- 10.20.193.123:0/3340764493 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f7e14092a20 msgr2=0x7f7e14095410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.256 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7f7e19d88640 1 --2- 10.20.193.123:0/3340764493 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f7e14092a20 0x7f7e14095410 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc009880 tx=0x7f7dfc02ed80 comp rx=0 tx=0).stop 2026-02-17T20:08:31.256 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7f7e19d88640 1 -- 10.20.193.123:0/3340764493 shutdown_connections 2026-02-17T20:08:31.256 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7f7e19d88640 1 --2- 10.20.193.123:0/3340764493 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f7e14092a20 0x7f7e14095410 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.257 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7f7e19d88640 1 --2- 10.20.193.123:0/3340764493 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f7e14094b00 0x7f7e14094ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.257 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7f7e19d88640 1 -- 10.20.193.123:0/3340764493 >> 10.20.193.123:0/3340764493 conn(0x7f7e14099cf0 msgr2=0x7f7e14095bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:31.257 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7faa5d477640 1 -- 10.20.193.123:0/2076857350 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7faa58096180 msgr2=0x7faa580965f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:08:31.257 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7faa5d477640 1 --2- 10.20.193.123:0/2076857350 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7faa58096180 0x7faa580965f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.257 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7faa5d477640 1 -- 10.20.193.123:0/2076857350 >> v2:10.20.193.123:3300/0 conn(0x7faa5812c3c0 msgr2=0x7faa5812e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:08:31.258 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7faa5d477640 1 --2- 10.20.193.123:0/2076857350 >> v2:10.20.193.123:3300/0 conn(0x7faa5812c3c0 0x7faa5812e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.258 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7faa5d477640 1 -- 10.20.193.123:0/2076857350 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa58094510 con 0x7faa58090570 2026-02-17T20:08:31.258 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7f7e19d88640 1 -- 10.20.193.123:0/3340764493 shutdown_connections 2026-02-17T20:08:31.258 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7f7e19d88640 1 -- 10.20.193.123:0/3340764493 wait complete. 2026-02-17T20:08:31.259 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7fc09c292640 1 -- 10.20.193.123:0/2728198952 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fc09412a560 msgr2=0x7fc0941321a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.259 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7fc09c292640 1 --2- 10.20.193.123:0/2728198952 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fc09412a560 0x7fc0941321a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc08c009e90 tx=0x7fc08c02f2b0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.259 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7fc09c292640 1 -- 10.20.193.123:0/2728198952 shutdown_connections 2026-02-17T20:08:31.259 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7fc09c292640 1 --2- 10.20.193.123:0/2728198952 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fc09412a560 0x7fc0941321a0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.259 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7fc09c292640 1 --2- 10.20.193.123:0/2728198952 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc094096a60 0x7fc094096e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.259 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7fc09c292640 1 -- 10.20.193.123:0/2728198952 >> 10.20.193.123:0/2728198952 conn(0x7fc09409d950 msgr2=0x7fc09409dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:31.260 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7fac030db640 1 Processor -- start 2026-02-17T20:08:31.260 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7fc09c292640 1 -- 10.20.193.123:0/2728198952 shutdown_connections 2026-02-17T20:08:31.260 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7fc09c292640 1 -- 10.20.193.123:0/2728198952 wait complete. 2026-02-17T20:08:31.260 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7fac030db640 1 -- start start 2026-02-17T20:08:31.261 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7faa5d477640 1 --2- 10.20.193.123:0/2076857350 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7faa58090570 0x7faa58095c40 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7faa54009940 tx=0x7faa5402ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=555447becb14d856 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:31.261 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7f7e19d88640 1 Processor -- start 2026-02-17T20:08:31.261 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7faa4ffff640 1 -- 10.20.193.123:0/2076857350 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5402f950 con 0x7faa58090570 2026-02-17T20:08:31.262 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7faa4ffff640 1 -- 10.20.193.123:0/2076857350 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa5402fab0 con 0x7faa58090570 2026-02-17T20:08:31.262 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7faa4ffff640 1 -- 10.20.193.123:0/2076857350 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5402fe50 con 0x7faa58090570 2026-02-17T20:08:31.262 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7f7e19d88640 1 -- start start 2026-02-17T20:08:31.263 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7fac030db640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fabfc092a20 0x7fabfc06dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:31.263 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7fac030db640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fabfc094b00 0x7fabfc06e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:31.264 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7fac030db640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fabfc12c290 0x7fabfc06e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:31.264 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7fac030db640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc0925e0 con 0x7fabfc12c290 2026-02-17T20:08:31.264 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7fac030db640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc0909b0 con 0x7fabfc092a20 2026-02-17T20:08:31.264 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7fac030db640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc0921a0 con 0x7fabfc094b00 2026-02-17T20:08:31.264 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7fac00e77640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fabfc092a20 0x7fabfc06dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:31.264 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7fabfbfff640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fabfc094b00 0x7fabfc06e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:31.264 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7fac00e77640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fabfc092a20 0x7fabfc06dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:56966/0 (socket says 10.20.193.123:56966) 2026-02-17T20:08:31.264 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7fac00e77640 1 -- 10.20.193.123:0/847901357 learned_addr learned my addr 10.20.193.123:0/847901357 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:31.264 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.241+0000 7fac01678640 1 --2- 10.20.193.123:0/847901357 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fabfc12c290 0x7fabfc06e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:31.264 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7fac00e77640 1 -- 10.20.193.123:0/847901357 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fabfc094b00 msgr2=0x7fabfc06e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.264 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7fac00e77640 1 --2- 10.20.193.123:0/847901357 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fabfc094b00 0x7fabfc06e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.264 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7fac00e77640 1 -- 10.20.193.123:0/847901357 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fabfc12c290 msgr2=0x7fabfc06e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.265 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7fac00e77640 1 --2- 10.20.193.123:0/847901357 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fabfc12c290 0x7fabfc06e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.265 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7fc09c292640 1 Processor -- start 2026-02-17T20:08:31.265 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7fac00e77640 1 -- 10.20.193.123:0/847901357 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe8009390 con 0x7fabfc092a20 2026-02-17T20:08:31.265 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7fabfbfff640 1 --2- 10.20.193.123:0/847901357 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fabfc094b00 0x7fabfc06e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:08:31.266 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7fc09c292640 1 -- start start 2026-02-17T20:08:31.266 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7faa5f6db640 1 -- 10.20.193.123:0/2076857350 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7faa58090570 msgr2=0x7faa58095c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.266 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7faa5f6db640 1 --2- 10.20.193.123:0/2076857350 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7faa58090570 0x7faa58095c40 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7faa54009940 tx=0x7faa5402ee80 comp rx=0 tx=0).stop 2026-02-17T20:08:31.267 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7f7e19d88640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f7e14092a20 0x7f7e1406dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:31.267 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7f7e19d88640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f7e14094b00 0x7f7e1406e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:31.267 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7f7e19d88640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f7e1412c290 0x7f7e1406e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:31.267 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7f7e19d88640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1408cec0 con 0x7f7e14094b00 2026-02-17T20:08:31.267 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7f7e19d88640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e14091e30 con 0x7f7e14092a20 2026-02-17T20:08:31.267 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7f7e19d88640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1408cb70 con 0x7f7e1412c290 2026-02-17T20:08:31.268 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7faa5f6db640 1 -- 10.20.193.123:0/2076857350 shutdown_connections 2026-02-17T20:08:31.268 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7faa5f6db640 1 --2- 10.20.193.123:0/2076857350 >> v2:10.20.193.123:3300/0 conn(0x7faa5812c3c0 0x7faa5812e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.268 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7faa5f6db640 1 --2- 10.20.193.123:0/2076857350 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7faa58096180 0x7faa580965f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.268 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7fac00e77640 1 --2- 10.20.193.123:0/847901357 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fabfc092a20 0x7fabfc06dc60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fabf003a040 tx=0x7fabf0037000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:31.268 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7faa5f6db640 1 --2- 10.20.193.123:0/2076857350 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7faa58090570 0x7faa58095c40 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.268 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7faa5f6db640 1 -- 10.20.193.123:0/2076857350 >> 10.20.193.123:0/2076857350 conn(0x7faa58096d30 msgr2=0x7faa58097130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:31.269 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7f7e137fe640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f7e14092a20 0x7f7e1406dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:31.269 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7f7e137fe640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f7e14092a20 0x7f7e1406dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:56982/0 (socket says 10.20.193.123:56982) 2026-02-17T20:08:31.269 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7f7e137fe640 1 -- 10.20.193.123:0/3960337516 learned_addr learned my addr 10.20.193.123:0/3960337516 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:31.269 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7f7e12ffd640 1 --2- 10.20.193.123:0/3960337516 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f7e14094b00 0x7f7e1406e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:31.269 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7faa5f6db640 1 -- 10.20.193.123:0/2076857350 shutdown_connections 2026-02-17T20:08:31.270 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7f7e13fff640 1 --2- 10.20.193.123:0/3960337516 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f7e1412c290 0x7f7e1406e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:31.270 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7faa5f6db640 1 -- 10.20.193.123:0/2076857350 wait complete. 2026-02-17T20:08:31.271 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7fabf97fa640 1 -- 10.20.193.123:0/847901357 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf0037d50 con 0x7fabfc092a20 2026-02-17T20:08:31.271 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7fabf97fa640 1 -- 10.20.193.123:0/847901357 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf0042440 con 0x7fabfc092a20 2026-02-17T20:08:31.271 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7fabf97fa640 1 -- 10.20.193.123:0/847901357 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf0042800 con 0x7fabfc092a20 2026-02-17T20:08:31.271 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7fac030db640 1 -- 10.20.193.123:0/847901357 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabf0009450 con 0x7fabfc092a20 2026-02-17T20:08:31.271 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7f7e137fe640 1 -- 10.20.193.123:0/3960337516 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f7e1412c290 msgr2=0x7f7e1406e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.271 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7f7e137fe640 1 --2- 10.20.193.123:0/3960337516 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f7e1412c290 0x7f7e1406e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.271 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7f7e137fe640 1 -- 10.20.193.123:0/3960337516 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f7e14094b00 msgr2=0x7f7e1406e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.272 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7f7e137fe640 1 --2- 10.20.193.123:0/3960337516 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f7e14094b00 0x7f7e1406e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.272 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7f7e137fe640 1 -- 10.20.193.123:0/3960337516 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dfc009390 con 0x7f7e14092a20 2026-02-17T20:08:31.272 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7fc09c292640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fc094096a60 0x7fc09411a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:31.272 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7fc09c292640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fc094097370 0x7fc09411a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:31.272 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7fc09c292640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc09412a560 0x7fc09411af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:31.272 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7fc09c292640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09411d3c0 con 0x7fc094097370 2026-02-17T20:08:31.273 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7fac030db640 1 -- 10.20.193.123:0/847901357 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabfc091f70 con 0x7fabfc092a20 2026-02-17T20:08:31.273 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7fc09c292640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc09411d960 con 0x7fc09412a560 2026-02-17T20:08:31.273 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7fc09c292640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc094128ef0 con 0x7fc094096a60 2026-02-17T20:08:31.273 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7f7e137fe640 1 --2- 10.20.193.123:0/3960337516 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f7e14092a20 0x7f7e1406dc30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7e0400ea20 tx=0x7f7e040090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:31.274 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7fc09982d640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fc094097370 0x7fc09411a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:31.274 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7fc09982d640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fc094097370 0x7fc09411a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:41956/0 (socket says 10.20.193.123:41956) 2026-02-17T20:08:31.274 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7fc09982d640 1 -- 10.20.193.123:0/1774795270 learned_addr learned my addr 10.20.193.123:0/1774795270 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:31.274 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7fc09a82f640 1 --2- 10.20.193.123:0/1774795270 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc09412a560 0x7fc09411af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:31.274 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7fc09a02e640 1 --2- 10.20.193.123:0/1774795270 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fc094096a60 0x7fc09411a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:31.274 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7fc09982d640 1 -- 10.20.193.123:0/1774795270 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fc094096a60 msgr2=0x7fc09411a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.275 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7fc09982d640 1 --2- 10.20.193.123:0/1774795270 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fc094096a60 0x7fc09411a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.275 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7fc09982d640 1 -- 10.20.193.123:0/1774795270 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc09412a560 msgr2=0x7fc09411af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.275 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7fc09982d640 1 --2- 10.20.193.123:0/1774795270 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc09412a560 0x7fc09411af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.275 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7f7e0bfff640 1 -- 10.20.193.123:0/3960337516 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0400ca70 con 0x7f7e14092a20 2026-02-17T20:08:31.275 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7f7e0bfff640 1 -- 10.20.193.123:0/3960337516 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e0400cbd0 con 0x7f7e14092a20 2026-02-17T20:08:31.275 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7f7e19d88640 1 -- 10.20.193.123:0/3960337516 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e140917f0 con 0x7f7e14092a20 2026-02-17T20:08:31.276 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7fc09982d640 1 -- 10.20.193.123:0/1774795270 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc08c009a20 con 0x7fc094097370 2026-02-17T20:08:31.276 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7fc09a02e640 1 --2- 10.20.193.123:0/1774795270 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fc094096a60 0x7fc09411a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T20:08:31.276 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7fc09982d640 1 --2- 10.20.193.123:0/1774795270 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fc094097370 0x7fc09411a9e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc08400c560 tx=0x7fc084007d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:31.276 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7f7e0bfff640 1 -- 10.20.193.123:0/3960337516 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e04013470 con 0x7f7e14092a20 2026-02-17T20:08:31.276 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7f7e19d88640 1 -- 10.20.193.123:0/3960337516 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e1406ebf0 con 0x7f7e14092a20 2026-02-17T20:08:31.277 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7fac030db640 1 -- 10.20.193.123:0/847901357 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fabfc05f010 con 0x7fabfc092a20 2026-02-17T20:08:31.277 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7faa5f6db640 1 Processor -- start 2026-02-17T20:08:31.277 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7faa5f6db640 1 -- start start 2026-02-17T20:08:31.278 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7fc08affd640 1 -- 10.20.193.123:0/1774795270 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc084005aa0 con 0x7fc094097370 2026-02-17T20:08:31.278 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7fc08affd640 1 -- 10.20.193.123:0/1774795270 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc084005c00 con 0x7fc094097370 2026-02-17T20:08:31.278 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.242+0000 7fc09c292640 1 -- 10.20.193.123:0/1774795270 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc094128b00 con 0x7fc094097370 2026-02-17T20:08:31.278 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.243+0000 7fc08affd640 1 -- 10.20.193.123:0/1774795270 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0840070f0 con 0x7fc094097370 2026-02-17T20:08:31.278 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.243+0000 7fc09c292640 1 -- 10.20.193.123:0/1774795270 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc09411b460 con 0x7fc094097370 2026-02-17T20:08:31.279 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.243+0000 7faa5f6db640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7faa58090570 0x7faa5808e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:31.279 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.243+0000 7faa5f6db640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7faa58096180 0x7faa5808ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:31.279 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.243+0000 7faa5f6db640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7faa5812c3c0 0x7faa5808f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:31.279 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.243+0000 7faa5f6db640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5812e820 con 0x7faa58090570 2026-02-17T20:08:31.279 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.243+0000 7faa5f6db640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa5808f680 con 0x7faa5812c3c0 2026-02-17T20:08:31.279 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.243+0000 7faa5f6db640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa5808d220 con 0x7faa58096180 2026-02-17T20:08:31.279 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.243+0000 7fabf97fa640 1 -- 10.20.193.123:0/847901357 <== mon.1 v2:10.20.193.123:3301/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7fabf003e040 con 0x7fabfc092a20 2026-02-17T20:08:31.280 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.243+0000 7f7e19d88640 1 -- 10.20.193.123:0/3960337516 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7e1405f010 con 0x7f7e14092a20 2026-02-17T20:08:31.280 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.243+0000 7faa5d477640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7faa58090570 0x7faa5808e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:31.280 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.243+0000 7faa5d477640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7faa58090570 0x7faa5808e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:41960/0 (socket says 10.20.193.123:41960) 2026-02-17T20:08:31.280 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.243+0000 7faa5d477640 1 -- 10.20.193.123:0/1644528080 learned_addr learned my addr 10.20.193.123:0/1644528080 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:31.280 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.243+0000 7faa5cc76640 1 --2- 10.20.193.123:0/1644528080 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7faa58096180 0x7faa5808ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:31.281 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.243+0000 7fc09c292640 1 -- 10.20.193.123:0/1774795270 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc0940986e0 con 0x7fc094097370 2026-02-17T20:08:31.281 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.243+0000 7faa5dc78640 1 --2- 10.20.193.123:0/1644528080 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7faa5812c3c0 0x7faa5808f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:31.281 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.243+0000 7faa5d477640 1 -- 10.20.193.123:0/1644528080 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7faa58096180 msgr2=0x7faa5808ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.281 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.243+0000 7faa5d477640 1 --2- 10.20.193.123:0/1644528080 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7faa58096180 0x7faa5808ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.281 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.243+0000 7faa5d477640 1 -- 10.20.193.123:0/1644528080 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7faa5812c3c0 msgr2=0x7faa5808f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.281 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.243+0000 7faa5d477640 1 --2- 10.20.193.123:0/1644528080 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7faa5812c3c0 0x7faa5808f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.282 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.243+0000 7faa5d477640 1 -- 10.20.193.123:0/1644528080 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa54009450 con 0x7faa58090570 2026-02-17T20:08:31.282 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.243+0000 7faa5dc78640 1 --2- 10.20.193.123:0/1644528080 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7faa5812c3c0 0x7faa5808f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T20:08:31.282 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.243+0000 7faa5cc76640 1 --2- 10.20.193.123:0/1644528080 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7faa58096180 0x7faa5808ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T20:08:31.282 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.243+0000 7f7e0bfff640 1 -- 10.20.193.123:0/3960337516 <== mon.1 v2:10.20.193.123:3301/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7f7e04013860 con 0x7f7e14092a20 2026-02-17T20:08:31.282 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.243+0000 7faa5d477640 1 --2- 10.20.193.123:0/1644528080 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7faa58090570 0x7faa5808e6c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7faa5402f390 tx=0x7faa54037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:31.282 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.243+0000 7fabf97fa640 1 -- 10.20.193.123:0/847901357 <== mon.1 v2:10.20.193.123:3301/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2862+0+0 (secure 0 0 0) 0x7fabf0087bb0 con 0x7fabfc092a20 2026-02-17T20:08:31.283 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.243+0000 7fabf97fa640 1 -- 10.20.193.123:0/847901357 --> v1:10.20.193.123:6801/24324 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fabe0057430 con 0x7fabe0053750 2026-02-17T20:08:31.283 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.243+0000 7fabf97fa640 1 -- 10.20.193.123:0/847901357 <== mon.1 v2:10.20.193.123:3301/0 6 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7fabf008c220 con 0x7fabfc092a20 2026-02-17T20:08:31.283 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.243+0000 7faa4dffb640 1 -- 10.20.193.123:0/1644528080 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa54041610 con 0x7faa58090570 2026-02-17T20:08:31.283 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.243+0000 7faa4dffb640 1 -- 10.20.193.123:0/1644528080 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa54041790 con 0x7faa58090570 2026-02-17T20:08:31.283 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.243+0000 7faa5f6db640 1 -- 10.20.193.123:0/1644528080 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa5808dd90 con 0x7faa58090570 2026-02-17T20:08:31.283 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.243+0000 7faa4dffb640 1 -- 10.20.193.123:0/1644528080 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa54041b50 con 0x7faa58090570 2026-02-17T20:08:31.283 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.243+0000 7f7e0bfff640 1 -- 10.20.193.123:0/3960337516 <== mon.1 v2:10.20.193.123:3301/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2862+0+0 (secure 0 0 0) 0x7f7e04063c60 con 0x7f7e14092a20 2026-02-17T20:08:31.284 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.243+0000 7faa5f6db640 1 -- 10.20.193.123:0/1644528080 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa5808fff0 con 0x7faa58090570 2026-02-17T20:08:31.284 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.243+0000 7f7e0bfff640 1 -- 10.20.193.123:0/3960337516 --> v1:10.20.193.123:6813/24327 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7df40574e0 con 0x7f7df4053800 2026-02-17T20:08:31.284 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.243+0000 7f7e0bfff640 1 -- 10.20.193.123:0/3960337516 <== mon.1 v2:10.20.193.123:3301/0 6 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e04068220 con 0x7f7e14092a20 2026-02-17T20:08:31.284 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.243+0000 7fc08affd640 1 -- 10.20.193.123:0/1774795270 <== mon.0 v2:10.20.193.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7fc084007520 con 0x7fc094097370 2026-02-17T20:08:31.284 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.244+0000 7fabf97fa640 1 -- 10.20.193.123:0/847901357 <== osd.0 v1:10.20.193.123:6801/24324 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25011 (unknown 0 0 1028417783) 0x7fabe0057430 con 0x7fabe0053750 2026-02-17T20:08:31.285 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.244+0000 7faa437fe640 1 -- 10.20.193.123:0/1644528080 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faa30000fd0 con 0x7faa58090570 2026-02-17T20:08:31.285 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.244+0000 7f7e0bfff640 1 -- 10.20.193.123:0/3960337516 <== osd.3 v1:10.20.193.123:6813/24327 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25011 (unknown 0 0 1028417783) 0x7f7df40574e0 con 0x7f7df4053800 2026-02-17T20:08:31.285 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.244+0000 7fc08affd640 1 -- 10.20.193.123:0/1774795270 <== mon.0 v2:10.20.193.123:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2862+0+0 (secure 0 0 0) 0x7fc0840633f0 con 0x7fc094097370 2026-02-17T20:08:31.285 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.244+0000 7fc08affd640 1 -- 10.20.193.123:0/1774795270 --> v1:10.20.193.123:6805/24325 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc078057430 con 0x7fc078053750 2026-02-17T20:08:31.285 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.244+0000 7fc08affd640 1 -- 10.20.193.123:0/1774795270 <== mon.0 v2:10.20.193.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc0840637c0 con 0x7fc094097370 2026-02-17T20:08:31.286 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.244+0000 7faa4dffb640 1 -- 10.20.193.123:0/1644528080 <== mon.0 v2:10.20.193.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7faa540403a0 con 0x7faa58090570 2026-02-17T20:08:31.286 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.244+0000 7faa4dffb640 1 -- 10.20.193.123:0/1644528080 <== mon.0 v2:10.20.193.123:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2862+0+0 (secure 0 0 0) 0x7faa54088bb0 con 0x7faa58090570 2026-02-17T20:08:31.286 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.244+0000 7faa4dffb640 1 -- 10.20.193.123:0/1644528080 --> v1:10.20.193.123:6809/24326 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faa3c057500 con 0x7faa3c053820 2026-02-17T20:08:31.286 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.244+0000 7faa4dffb640 1 -- 10.20.193.123:0/1644528080 <== mon.0 v2:10.20.193.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa5408d240 con 0x7faa58090570 2026-02-17T20:08:31.286 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.245+0000 7faa4dffb640 1 -- 10.20.193.123:0/1644528080 <== osd.2 v1:10.20.193.123:6809/24326 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25011 (unknown 0 0 1028417783) 0x7faa3c057500 con 0x7faa3c053820 2026-02-17T20:08:31.286 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.246+0000 7fc08affd640 1 -- 10.20.193.123:0/1774795270 <== osd.1 v1:10.20.193.123:6805/24325 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25011 (unknown 0 0 1028417783) 0x7fc078057430 con 0x7fc078053750 2026-02-17T20:08:31.286 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.250+0000 7f7e19d88640 1 -- 10.20.193.123:0/3960337516 --> v1:10.20.193.123:6813/24327 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7e1408f180 con 0x7f7df4053800 2026-02-17T20:08:31.287 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.250+0000 7f7e0bfff640 1 -- 10.20.193.123:0/3960337516 <== osd.3 v1:10.20.193.123:6813/24327 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1985699914) 0x7f7e1408f180 con 0x7f7df4053800 2026-02-17T20:08:31.287 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.250+0000 7f7e19d88640 1 -- 10.20.193.123:0/3960337516 >> v1:10.20.193.123:6813/24327 conn(0x7f7df4053800 legacy=0x7f7df4055c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.287 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.251+0000 7f7e19d88640 1 -- 10.20.193.123:0/3960337516 >> v1:10.20.193.123:6800/23720 conn(0x7f7df404d180 legacy=0x7f7df404f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.287 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.251+0000 7f7e19d88640 1 -- 10.20.193.123:0/3960337516 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f7e14092a20 msgr2=0x7f7e1406dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.287 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.251+0000 7f7e19d88640 1 --2- 10.20.193.123:0/3960337516 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f7e14092a20 0x7f7e1406dc30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7e0400ea20 tx=0x7f7e040090f0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.287 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.251+0000 7f7e13fff640 1 -- 10.20.193.123:0/3960337516 reap_dead start 2026-02-17T20:08:31.287 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.251+0000 7f7e19d88640 1 -- 10.20.193.123:0/3960337516 shutdown_connections 2026-02-17T20:08:31.288 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.251+0000 7f7e19d88640 1 -- 10.20.193.123:0/3960337516 >> 10.20.193.123:0/3960337516 conn(0x7f7e14099cf0 msgr2=0x7f7e1412b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:31.288 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.251+0000 7f7e19d88640 1 -- 10.20.193.123:0/3960337516 shutdown_connections 2026-02-17T20:08:31.288 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.251+0000 7f7e19d88640 1 -- 10.20.193.123:0/3960337516 wait complete. 2026-02-17T20:08:31.288 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.251+0000 7faa437fe640 1 -- 10.20.193.123:0/1644528080 --> v1:10.20.193.123:6809/24326 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faa30002ca0 con 0x7faa3c053820 2026-02-17T20:08:31.288 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.251+0000 7faa4dffb640 1 -- 10.20.193.123:0/1644528080 <== osd.2 v1:10.20.193.123:6809/24326 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2217796425) 0x7faa30002ca0 con 0x7faa3c053820 2026-02-17T20:08:31.289 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.251+0000 7faa437fe640 1 -- 10.20.193.123:0/1644528080 >> v1:10.20.193.123:6809/24326 conn(0x7faa3c053820 legacy=0x7faa3c055c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.289 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.251+0000 7faa437fe640 1 -- 10.20.193.123:0/1644528080 >> v1:10.20.193.123:6800/23720 conn(0x7faa3c04d1a0 legacy=0x7faa3c04f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.289 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.251+0000 7faa437fe640 1 -- 10.20.193.123:0/1644528080 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7faa58090570 msgr2=0x7faa5808e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.289 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.251+0000 7faa437fe640 1 --2- 10.20.193.123:0/1644528080 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7faa58090570 0x7faa5808e6c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7faa5402f390 tx=0x7faa54037000 comp rx=0 tx=0).stop 2026-02-17T20:08:31.289 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.251+0000 7faa5dc78640 1 -- 10.20.193.123:0/1644528080 reap_dead start 2026-02-17T20:08:31.289 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.251+0000 7faa437fe640 1 -- 10.20.193.123:0/1644528080 shutdown_connections 2026-02-17T20:08:31.289 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.251+0000 7faa437fe640 1 -- 10.20.193.123:0/1644528080 >> 10.20.193.123:0/1644528080 conn(0x7faa58096d30 msgr2=0x7faa58098fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:31.289 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.251+0000 7faa437fe640 1 -- 10.20.193.123:0/1644528080 shutdown_connections 2026-02-17T20:08:31.289 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.251+0000 7faa437fe640 1 -- 10.20.193.123:0/1644528080 wait complete. 2026-02-17T20:08:31.289 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.252+0000 7fac030db640 1 -- 10.20.193.123:0/847901357 --> v1:10.20.193.123:6801/24324 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fabfc06eee0 con 0x7fabe0053750 2026-02-17T20:08:31.290 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.252+0000 7fabf97fa640 1 -- 10.20.193.123:0/847901357 <== osd.0 v1:10.20.193.123:6801/24324 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2217796425) 0x7fabfc06eee0 con 0x7fabe0053750 2026-02-17T20:08:31.290 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.252+0000 7fac030db640 1 -- 10.20.193.123:0/847901357 >> v1:10.20.193.123:6801/24324 conn(0x7fabe0053750 legacy=0x7fabe0055bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.290 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.252+0000 7fac030db640 1 -- 10.20.193.123:0/847901357 >> v1:10.20.193.123:6800/23720 conn(0x7fabe004d0d0 legacy=0x7fabe004f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.290 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.252+0000 7fac030db640 1 -- 10.20.193.123:0/847901357 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fabfc092a20 msgr2=0x7fabfc06dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.290 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.252+0000 7fac030db640 1 --2- 10.20.193.123:0/847901357 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fabfc092a20 0x7fabfc06dc60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fabf003a040 tx=0x7fabf0037000 comp rx=0 tx=0).stop 2026-02-17T20:08:31.290 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.252+0000 7fac01678640 1 -- 10.20.193.123:0/847901357 reap_dead start 2026-02-17T20:08:31.290 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.252+0000 7fac030db640 1 -- 10.20.193.123:0/847901357 shutdown_connections 2026-02-17T20:08:31.291 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.252+0000 7fac030db640 1 -- 10.20.193.123:0/847901357 >> 10.20.193.123:0/847901357 conn(0x7fabfc099cf0 msgr2=0x7fabfc12b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:31.291 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.253+0000 7fac030db640 1 -- 10.20.193.123:0/847901357 shutdown_connections 2026-02-17T20:08:31.291 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.253+0000 7fac030db640 1 -- 10.20.193.123:0/847901357 wait complete. 2026-02-17T20:08:31.291 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.254+0000 7fc09c292640 1 -- 10.20.193.123:0/1774795270 --> v1:10.20.193.123:6805/24325 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc09405f010 con 0x7fc078053750 2026-02-17T20:08:31.291 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.255+0000 7fc08affd640 1 -- 10.20.193.123:0/1774795270 <== osd.1 v1:10.20.193.123:6805/24325 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1985699914) 0x7fc09405f010 con 0x7fc078053750 2026-02-17T20:08:31.292 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.255+0000 7fc09c292640 1 -- 10.20.193.123:0/1774795270 >> v1:10.20.193.123:6805/24325 conn(0x7fc078053750 legacy=0x7fc078055bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.292 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.255+0000 7fc09c292640 1 -- 10.20.193.123:0/1774795270 >> v1:10.20.193.123:6800/23720 conn(0x7fc07804d0d0 legacy=0x7fc07804f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.292 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.255+0000 7fc09c292640 1 -- 10.20.193.123:0/1774795270 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fc094097370 msgr2=0x7fc09411a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.292 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.255+0000 7fc09c292640 1 --2- 10.20.193.123:0/1774795270 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fc094097370 0x7fc09411a9e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc08400c560 tx=0x7fc084007d00 comp rx=0 tx=0).stop 2026-02-17T20:08:31.292 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.255+0000 7fc09a82f640 1 -- 10.20.193.123:0/1774795270 reap_dead start 2026-02-17T20:08:31.292 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.255+0000 7fc09c292640 1 -- 10.20.193.123:0/1774795270 shutdown_connections 2026-02-17T20:08:31.292 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.255+0000 7fc09c292640 1 -- 10.20.193.123:0/1774795270 >> 10.20.193.123:0/1774795270 conn(0x7fc09409d950 msgr2=0x7fc09409b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:31.292 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.255+0000 7fc09c292640 1 -- 10.20.193.123:0/1774795270 shutdown_connections 2026-02-17T20:08:31.292 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.255+0000 7fc09c292640 1 -- 10.20.193.123:0/1774795270 wait complete. 2026-02-17T20:08:31.292 INFO:teuthology.orchestra.run.trial123.stdout:38654705666 2026-02-17T20:08:31.293 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T20:08:31.293 INFO:teuthology.orchestra.run.trial123.stdout:38654705667 2026-02-17T20:08:31.294 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T20:08:31.294 INFO:teuthology.orchestra.run.trial123.stdout:38654705667 2026-02-17T20:08:31.294 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T20:08:31.295 INFO:teuthology.orchestra.run.trial123.stdout:38654705666 2026-02-17T20:08:31.295 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T20:08:31.399 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.401+0000 7f0a0ecdb640 1 Processor -- start 2026-02-17T20:08:31.399 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.401+0000 7f0a0ecdb640 1 -- start start 2026-02-17T20:08:31.400 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.401+0000 7f0cfaed2640 1 Processor -- start 2026-02-17T20:08:31.400 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.401+0000 7f0cfaed2640 1 -- start start 2026-02-17T20:08:31.401 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.401+0000 7f0a0ecdb640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f0a08127d40 0x7f0a08128110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:31.401 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.401+0000 7f0a0ecdb640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0a08128650 0x7f0a08126cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:31.401 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.401+0000 7f0a0ecdb640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0a08127200 0x7f0a08127660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:31.401 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.401+0000 7f0a0ecdb640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a0806e330 con 0x7f0a08127d40 2026-02-17T20:08:31.401 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.401+0000 7f0a0ecdb640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0806cd50 con 0x7f0a08128650 2026-02-17T20:08:31.401 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.401+0000 7f0a0ecdb640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0806d6a0 con 0x7f0a08127200 2026-02-17T20:08:31.402 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.401+0000 7f0cfaed2640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0cf4090570 0x7f0cf4095c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:31.402 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.401+0000 7f0cfaed2640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f0cf4096180 0x7f0cf40965b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:31.403 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.401+0000 7f0cfaed2640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cf40945c0 con 0x7f0cf412c3c0 2026-02-17T20:08:31.403 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.401+0000 7f0cfaed2640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cf4067b50 con 0x7f0cf4096180 2026-02-17T20:08:31.403 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.401+0000 7f0cfaed2640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf4069c10 con 0x7f0cf4090570 2026-02-17T20:08:31.403 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.401+0000 7f0a0d278640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0a08127200 0x7f0a08127660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:31.403 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.401+0000 7f0a07fff640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0a08128650 0x7f0a08126cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:31.404 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.401+0000 7f0a0d278640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0a08127200 0x7f0a08127660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:45398/0 (socket says 10.20.193.123:45398) 2026-02-17T20:08:31.404 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.401+0000 7f0a0d278640 1 -- 10.20.193.123:0/749992935 learned_addr learned my addr 10.20.193.123:0/749992935 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:31.404 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.401+0000 7f0a07fff640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0a08128650 0x7f0a08126cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:56998/0 (socket says 10.20.193.123:56998) 2026-02-17T20:08:31.404 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.401+0000 7f0a0ca77640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f0a08127d40 0x7f0a08128110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:31.404 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.401+0000 7f0cf8c6e640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0cf4090570 0x7f0cf4095c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:31.404 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.401+0000 7f0cf3fff640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f0cf4096180 0x7f0cf40965b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:31.405 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.401+0000 7f0cf946f640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7f0cf412c3c0 0x7f0cf412e7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:37288/0 (socket says 10.20.193.123:37288) 2026-02-17T20:08:31.405 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.401+0000 7f0cf946f640 1 -- 10.20.193.123:0/1588586860 learned_addr learned my addr 10.20.193.123:0/1588586860 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:08:31.405 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.401+0000 7f0a0d278640 1 -- 10.20.193.123:0/749992935 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0a08128650 msgr2=0x7f0a08126cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:08:31.405 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.401+0000 7f0a0d278640 1 --2- 10.20.193.123:0/749992935 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0a08128650 0x7f0a08126cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.405 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.401+0000 7f0a0d278640 1 -- 10.20.193.123:0/749992935 >> v2:10.20.193.123:3300/0 conn(0x7f0a08127d40 msgr2=0x7f0a08128110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:08:31.406 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.401+0000 7f0a0d278640 1 --2- 10.20.193.123:0/749992935 >> v2:10.20.193.123:3300/0 conn(0x7f0a08127d40 0x7f0a08128110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.406 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.401+0000 7f0a0d278640 1 -- 10.20.193.123:0/749992935 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a0806e510 con 0x7f0a08127200 2026-02-17T20:08:31.406 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.401+0000 7f0a07fff640 1 --2- 10.20.193.123:0/749992935 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0a08128650 0x7f0a08126cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:08:31.406 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.401+0000 7f0cf8c6e640 1 -- 10.20.193.123:0/1588586860 >> v2:10.20.193.123:3300/0 conn(0x7f0cf4096180 msgr2=0x7f0cf40965b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:08:31.406 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.401+0000 7f0cf8c6e640 1 --2- 10.20.193.123:0/1588586860 >> v2:10.20.193.123:3300/0 conn(0x7f0cf4096180 0x7f0cf40965b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.406 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.401+0000 7f0cf8c6e640 1 -- 10.20.193.123:0/1588586860 >> v1:10.20.193.123:6789/0 conn(0x7f0cf412c3c0 legacy=0x7f0cf412e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.406 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.401+0000 7f0cf8c6e640 1 -- 10.20.193.123:0/1588586860 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf4067fe0 con 0x7f0cf4090570 2026-02-17T20:08:31.407 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.401+0000 7fc5ed00c640 1 Processor -- start 2026-02-17T20:08:31.408 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.402+0000 7fc5ed00c640 1 -- start start 2026-02-17T20:08:31.408 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.402+0000 7fc5ed00c640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc5e808e360 0x7fc5e808e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:31.408 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.402+0000 7fc5ed00c640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fc5e812cad0 0x7fc5e812eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:31.408 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.402+0000 7fc5ed00c640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5e808f530 con 0x7fc5e808ec70 2026-02-17T20:08:31.408 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.402+0000 7fc5ed00c640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5e8090480 con 0x7fc5e812cad0 2026-02-17T20:08:31.408 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.402+0000 7fc5ed00c640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e8094750 con 0x7fc5e808e360 2026-02-17T20:08:31.408 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.402+0000 7f0cf8c6e640 1 --2- 10.20.193.123:0/1588586860 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0cf4090570 0x7f0cf4095c40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0ce8009850 tx=0x7f0ce802ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66d1099ab05887de server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:31.409 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.402+0000 7fc5e6d9d640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc5e808e360 0x7fc5e808e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:31.409 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.402+0000 7fc5dffff640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7fc5e808ec70 0x7fc5e812b3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:37296/0 (socket says 10.20.193.123:37296) 2026-02-17T20:08:31.409 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.402+0000 7fc5dffff640 1 -- 10.20.193.123:0/2645578177 learned_addr learned my addr 10.20.193.123:0/2645578177 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:08:31.409 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.402+0000 7fc5e759e640 1 --2- 10.20.193.123:0/2645578177 >> v2:10.20.193.123:3300/0 conn(0x7fc5e812cad0 0x7fc5e812eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:31.410 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.402+0000 7f0a0d278640 1 --2- 10.20.193.123:0/749992935 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0a08127200 0x7f0a08127660 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0a00009f50 tx=0x7f0a0002f340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65c70e9248009cd8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:31.410 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.402+0000 7f0cf37fe640 1 -- 10.20.193.123:0/1588586860 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce802f8b0 con 0x7f0cf4090570 2026-02-17T20:08:31.410 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.402+0000 7fc5e6d9d640 1 -- 10.20.193.123:0/2645578177 >> v2:10.20.193.123:3300/0 conn(0x7fc5e812cad0 msgr2=0x7fc5e812eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:08:31.410 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.402+0000 7fc5e6d9d640 1 --2- 10.20.193.123:0/2645578177 >> v2:10.20.193.123:3300/0 conn(0x7fc5e812cad0 0x7fc5e812eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.411 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.402+0000 7f0cf37fe640 1 -- 10.20.193.123:0/1588586860 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce802fa10 con 0x7f0cf4090570 2026-02-17T20:08:31.411 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.402+0000 7fc5e6d9d640 1 -- 10.20.193.123:0/2645578177 >> v1:10.20.193.123:6789/0 conn(0x7fc5e808ec70 legacy=0x7fc5e812b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.411 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.402+0000 7fc5e659c640 1 -- 10.20.193.123:0/2645578177 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2180938685 0 0) 0x7fc5e808f530 con 0x7fc5e808ec70 2026-02-17T20:08:31.411 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.402+0000 7fc5e6d9d640 1 -- 10.20.193.123:0/2645578177 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e808f880 con 0x7fc5e808e360 2026-02-17T20:08:31.412 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.402+0000 7f0cf37fe640 1 -- 10.20.193.123:0/1588586860 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce802fdf0 con 0x7f0cf4090570 2026-02-17T20:08:31.412 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.402+0000 7f0a077fe640 1 -- 10.20.193.123:0/749992935 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0002fc00 con 0x7f0a08127200 2026-02-17T20:08:31.412 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.402+0000 7f0a077fe640 1 -- 10.20.193.123:0/749992935 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0002fd60 con 0x7f0a08127200 2026-02-17T20:08:31.412 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.402+0000 7f0a077fe640 1 -- 10.20.193.123:0/749992935 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a00007630 con 0x7f0a08127200 2026-02-17T20:08:31.413 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.402+0000 7fe902d6e640 1 Processor -- start 2026-02-17T20:08:31.413 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.402+0000 7fe902d6e640 1 -- start start 2026-02-17T20:08:31.414 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.402+0000 7f0cfaed2640 1 -- 10.20.193.123:0/1588586860 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0cf4090570 msgr2=0x7f0cf4095c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.414 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.402+0000 7f0cfaed2640 1 --2- 10.20.193.123:0/1588586860 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0cf4090570 0x7f0cf4095c40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0ce8009850 tx=0x7f0ce802ed50 comp rx=0 tx=0).stop 2026-02-17T20:08:31.414 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.402+0000 7f0cfaed2640 1 -- 10.20.193.123:0/1588586860 shutdown_connections 2026-02-17T20:08:31.414 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.402+0000 7f0cfaed2640 1 --2- 10.20.193.123:0/1588586860 >> v2:10.20.193.123:3300/0 conn(0x7f0cf4096180 0x7f0cf40965b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.414 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.402+0000 7f0cfaed2640 1 --2- 10.20.193.123:0/1588586860 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0cf4090570 0x7f0cf4095c40 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.414 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.402+0000 7f0cfaed2640 1 -- 10.20.193.123:0/1588586860 >> 10.20.193.123:0/1588586860 conn(0x7f0cf4096d30 msgr2=0x7f0cf4097130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:31.414 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.402+0000 7f0cfaed2640 1 -- 10.20.193.123:0/1588586860 shutdown_connections 2026-02-17T20:08:31.414 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.402+0000 7f0cfaed2640 1 -- 10.20.193.123:0/1588586860 wait complete. 2026-02-17T20:08:31.415 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.402+0000 7fc5e6d9d640 1 --2- 10.20.193.123:0/2645578177 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc5e808e360 0x7fc5e808e730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8009880 tx=0x7fc5d802ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8693f8f89f587eb server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:31.415 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.402+0000 7fe902d6e640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe8fc096a60 0x7fe8fc096e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:31.415 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.402+0000 7fe902d6e640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fe8fc129550 0x7fe8fc132420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:31.416 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.402+0000 7fc5e659c640 1 -- 10.20.193.123:0/2645578177 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d802f8a0 con 0x7fc5e808e360 2026-02-17T20:08:31.416 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.402+0000 7fe902d6e640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8fc099560 con 0x7fe8fc097370 2026-02-17T20:08:31.416 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.402+0000 7fe902d6e640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8fc098390 con 0x7fe8fc129550 2026-02-17T20:08:31.416 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.402+0000 7fe902d6e640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8fc0992a0 con 0x7fe8fc096a60 2026-02-17T20:08:31.416 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.402+0000 7f0a0ecdb640 1 -- 10.20.193.123:0/749992935 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0a08127200 msgr2=0x7f0a08127660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.417 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.402+0000 7f0a0ecdb640 1 --2- 10.20.193.123:0/749992935 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0a08127200 0x7f0a08127660 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0a00009f50 tx=0x7f0a0002f340 comp rx=0 tx=0).stop 2026-02-17T20:08:31.417 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7fc5e659c640 1 -- 10.20.193.123:0/2645578177 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d802fa00 con 0x7fc5e808e360 2026-02-17T20:08:31.417 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7fc5e659c640 1 -- 10.20.193.123:0/2645578177 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d802fda0 con 0x7fc5e808e360 2026-02-17T20:08:31.417 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7fe900b0a640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe8fc096a60 0x7fe8fc096e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:31.418 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7f0a0ecdb640 1 -- 10.20.193.123:0/749992935 shutdown_connections 2026-02-17T20:08:31.418 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7f0a0ecdb640 1 --2- 10.20.193.123:0/749992935 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0a08127200 0x7f0a08127660 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.418 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7f0a0ecdb640 1 --2- 10.20.193.123:0/749992935 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0a08128650 0x7f0a08126cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.418 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7f0a0ecdb640 1 --2- 10.20.193.123:0/749992935 >> v2:10.20.193.123:3300/0 conn(0x7f0a08127d40 0x7f0a08128110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.418 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7f0a0ecdb640 1 -- 10.20.193.123:0/749992935 >> 10.20.193.123:0/749992935 conn(0x7f0a0809ba80 msgr2=0x7f0a0809be80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:31.419 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7fe900b0a640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe8fc096a60 0x7fe8fc096e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:57008/0 (socket says 10.20.193.123:57008) 2026-02-17T20:08:31.419 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7fe90130b640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fe8fc129550 0x7fe8fc132420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:31.419 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7fe900b0a640 1 -- 10.20.193.123:0/3778243824 learned_addr learned my addr 10.20.193.123:0/3778243824 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:31.419 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7fe8fbfff640 1 --1- 10.20.193.123:0/3778243824 >> v1:10.20.193.123:6789/0 conn(0x7fe8fc097370 0x7fe8fc128e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:37306/0 (socket says 10.20.193.123:37306) 2026-02-17T20:08:31.419 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7f0a0ecdb640 1 -- 10.20.193.123:0/749992935 shutdown_connections 2026-02-17T20:08:31.419 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7f0a0ecdb640 1 -- 10.20.193.123:0/749992935 wait complete. 2026-02-17T20:08:31.420 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7fe900b0a640 1 -- 10.20.193.123:0/3778243824 >> v2:10.20.193.123:3300/0 conn(0x7fe8fc129550 msgr2=0x7fe8fc132420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:08:31.420 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7fe900b0a640 1 --2- 10.20.193.123:0/3778243824 >> v2:10.20.193.123:3300/0 conn(0x7fe8fc129550 0x7fe8fc132420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.420 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7fe900b0a640 1 -- 10.20.193.123:0/3778243824 >> v1:10.20.193.123:6789/0 conn(0x7fe8fc097370 legacy=0x7fe8fc128e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.420 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7fe900b0a640 1 -- 10.20.193.123:0/3778243824 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8fc069140 con 0x7fe8fc096a60 2026-02-17T20:08:31.420 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7fe8fb7fe640 1 -- 10.20.193.123:0/3778243824 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3819215748 0 0) 0x7fe8fc099560 con 0x7fe8fc097370 2026-02-17T20:08:31.421 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7fc5ed00c640 1 -- 10.20.193.123:0/2645578177 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc5e808e360 msgr2=0x7fc5e808e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.421 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7fc5ed00c640 1 --2- 10.20.193.123:0/2645578177 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc5e808e360 0x7fc5e808e730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8009880 tx=0x7fc5d802ed80 comp rx=0 tx=0).stop 2026-02-17T20:08:31.421 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7fc5ed00c640 1 -- 10.20.193.123:0/2645578177 shutdown_connections 2026-02-17T20:08:31.421 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7fc5ed00c640 1 --2- 10.20.193.123:0/2645578177 >> v2:10.20.193.123:3300/0 conn(0x7fc5e812cad0 0x7fc5e812eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.421 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7fc5ed00c640 1 --2- 10.20.193.123:0/2645578177 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc5e808e360 0x7fc5e808e730 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.421 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7fc5ed00c640 1 -- 10.20.193.123:0/2645578177 >> 10.20.193.123:0/2645578177 conn(0x7fc5e8096d30 msgr2=0x7fc5e8097130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:31.422 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7f0cfaed2640 1 Processor -- start 2026-02-17T20:08:31.422 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7fc5ed00c640 1 -- 10.20.193.123:0/2645578177 shutdown_connections 2026-02-17T20:08:31.422 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7fc5ed00c640 1 -- 10.20.193.123:0/2645578177 wait complete. 2026-02-17T20:08:31.422 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7f0cfaed2640 1 -- start start 2026-02-17T20:08:31.423 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7fe900b0a640 1 --2- 10.20.193.123:0/3778243824 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe8fc096a60 0x7fe8fc096e30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe8f0009910 tx=0x7fe8f002ee10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87cee36ba030166c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:31.423 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7f0cfaed2640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0cf4090570 0x7f0cf408a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:31.423 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7f0cfaed2640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0cf4096180 0x7f0cf408ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:31.424 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7f0cfaed2640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0cf412c3c0 0x7f0cf408b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:31.424 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7f0cfaed2640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf412f7c0 con 0x7f0cf412c3c0 2026-02-17T20:08:31.424 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7f0cfaed2640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf408db50 con 0x7f0cf4096180 2026-02-17T20:08:31.424 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7f0cfaed2640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf408bae0 con 0x7f0cf4090570 2026-02-17T20:08:31.424 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7fe8fb7fe640 1 -- 10.20.193.123:0/3778243824 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f002f970 con 0x7fe8fc096a60 2026-02-17T20:08:31.424 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7f0a0ecdb640 1 Processor -- start 2026-02-17T20:08:31.425 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7fe8fb7fe640 1 -- 10.20.193.123:0/3778243824 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f002fad0 con 0x7fe8fc096a60 2026-02-17T20:08:31.425 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7f0cf3fff640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0cf4096180 0x7f0cf408ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:31.425 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7f0cf8c6e640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0cf4090570 0x7f0cf408a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:31.426 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7fe8fb7fe640 1 -- 10.20.193.123:0/3778243824 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f002fe70 con 0x7fe8fc096a60 2026-02-17T20:08:31.426 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7f0cf946f640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0cf412c3c0 0x7f0cf408b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:31.426 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7f0cf8c6e640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0cf4090570 0x7f0cf408a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:45420/0 (socket says 10.20.193.123:45420) 2026-02-17T20:08:31.426 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7f0cf8c6e640 1 -- 10.20.193.123:0/4119475314 learned_addr learned my addr 10.20.193.123:0/4119475314 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:31.426 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7f0a0ecdb640 1 -- start start 2026-02-17T20:08:31.427 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7f0cf946f640 1 -- 10.20.193.123:0/4119475314 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0cf4090570 msgr2=0x7f0cf408a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.427 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7f0cf946f640 1 --2- 10.20.193.123:0/4119475314 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0cf4090570 0x7f0cf408a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.427 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7f0cf946f640 1 -- 10.20.193.123:0/4119475314 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0cf4096180 msgr2=0x7f0cf408ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.427 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7f0cf946f640 1 --2- 10.20.193.123:0/4119475314 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0cf4096180 0x7f0cf408ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.427 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7f0cf946f640 1 -- 10.20.193.123:0/4119475314 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce8009390 con 0x7f0cf412c3c0 2026-02-17T20:08:31.427 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7f0cf8c6e640 1 --2- 10.20.193.123:0/4119475314 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0cf4090570 0x7f0cf408a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:08:31.428 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7f0cf3fff640 1 --2- 10.20.193.123:0/4119475314 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0cf4096180 0x7f0cf408ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:08:31.428 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7fe902d6e640 1 -- 10.20.193.123:0/3778243824 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe8fc096a60 msgr2=0x7fe8fc096e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.428 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7fe902d6e640 1 --2- 10.20.193.123:0/3778243824 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe8fc096a60 0x7fe8fc096e30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe8f0009910 tx=0x7fe8f002ee10 comp rx=0 tx=0).stop 2026-02-17T20:08:31.428 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7f0cf946f640 1 --2- 10.20.193.123:0/4119475314 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0cf412c3c0 0x7f0cf408b2d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4069b10 tx=0x7f0cec0019e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:31.429 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7fe902d6e640 1 -- 10.20.193.123:0/3778243824 shutdown_connections 2026-02-17T20:08:31.429 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7fe902d6e640 1 --2- 10.20.193.123:0/3778243824 >> v2:10.20.193.123:3300/0 conn(0x7fe8fc129550 0x7fe8fc132420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.429 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7fe902d6e640 1 --2- 10.20.193.123:0/3778243824 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe8fc096a60 0x7fe8fc096e30 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.429 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7fe902d6e640 1 -- 10.20.193.123:0/3778243824 >> 10.20.193.123:0/3778243824 conn(0x7fe8fc09da30 msgr2=0x7fe8fc09de30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:31.429 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7fc5ed00c640 1 Processor -- start 2026-02-17T20:08:31.430 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7fe902d6e640 1 -- 10.20.193.123:0/3778243824 shutdown_connections 2026-02-17T20:08:31.430 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7fe902d6e640 1 -- 10.20.193.123:0/3778243824 wait complete. 2026-02-17T20:08:31.430 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.403+0000 7f0cf17fa640 1 -- 10.20.193.123:0/4119475314 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec00ce90 con 0x7f0cf412c3c0 2026-02-17T20:08:31.430 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7f0a0ecdb640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0a08127200 0x7f0a08068640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:31.431 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7f0cf17fa640 1 -- 10.20.193.123:0/4119475314 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cec00a850 con 0x7f0cf412c3c0 2026-02-17T20:08:31.431 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7fc5ed00c640 1 -- start start 2026-02-17T20:08:31.431 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7f0a0ecdb640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0a08127d40 0x7f0a08068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:31.431 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7f0a0ecdb640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0a08128650 0x7f0a080690c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:31.432 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7f0cfaed2640 1 -- 10.20.193.123:0/4119475314 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cf408c220 con 0x7f0cf412c3c0 2026-02-17T20:08:31.432 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7f0a0ecdb640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a081207c0 con 0x7f0a08127d40 2026-02-17T20:08:31.432 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7f0a0ecdb640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0806a170 con 0x7f0a08127200 2026-02-17T20:08:31.432 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7f0a0ecdb640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a08120380 con 0x7f0a08128650 2026-02-17T20:08:31.433 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7f0cf17fa640 1 -- 10.20.193.123:0/4119475314 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec00ac70 con 0x7f0cf412c3c0 2026-02-17T20:08:31.433 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7f0cfaed2640 1 -- 10.20.193.123:0/4119475314 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cf412be80 con 0x7f0cf412c3c0 2026-02-17T20:08:31.434 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7f0a0ca77640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0a08127200 0x7f0a08068640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:31.434 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7f0a0ca77640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0a08127200 0x7f0a08068640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:57024/0 (socket says 10.20.193.123:57024) 2026-02-17T20:08:31.434 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7f0a0ca77640 1 -- 10.20.193.123:0/11674493 learned_addr learned my addr 10.20.193.123:0/11674493 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:31.434 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7f0a0d278640 1 --2- 10.20.193.123:0/11674493 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0a08128650 0x7f0a080690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:31.434 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7f0a07fff640 1 --2- 10.20.193.123:0/11674493 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0a08127d40 0x7f0a08068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:31.434 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7f0a0ca77640 1 -- 10.20.193.123:0/11674493 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0a08128650 msgr2=0x7f0a080690c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.434 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7f0a0ca77640 1 --2- 10.20.193.123:0/11674493 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0a08128650 0x7f0a080690c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.434 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7f0a0ca77640 1 -- 10.20.193.123:0/11674493 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0a08127d40 msgr2=0x7f0a08068b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.434 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7f0a0ca77640 1 --2- 10.20.193.123:0/11674493 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0a08127d40 0x7f0a08068b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.434 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7f0a0ca77640 1 -- 10.20.193.123:0/11674493 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f4009390 con 0x7f0a08127200 2026-02-17T20:08:31.435 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7fc5ed00c640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fc5e808e360 0x7fc5e80673d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:31.435 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7fc5ed00c640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fc5e808ec70 0x7fc5e8067910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:31.435 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7fc5ed00c640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc5e812cad0 0x7fc5e8067e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:31.435 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7fc5ed00c640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e811ff50 con 0x7fc5e808ec70 2026-02-17T20:08:31.435 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7fc5ed00c640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e808da40 con 0x7fc5e812cad0 2026-02-17T20:08:31.435 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7fc5ed00c640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e808d070 con 0x7fc5e808e360 2026-02-17T20:08:31.435 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7fc5e6d9d640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fc5e808e360 0x7fc5e80673d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:31.436 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7f0a0ca77640 1 --2- 10.20.193.123:0/11674493 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0a08127200 0x7f0a08068640 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f09fc00ea20 tx=0x7f09fc0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:31.436 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7fc5e6d9d640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fc5e808e360 0x7fc5e80673d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:45440/0 (socket says 10.20.193.123:45440) 2026-02-17T20:08:31.436 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7fc5e6d9d640 1 -- 10.20.193.123:0/3344528999 learned_addr learned my addr 10.20.193.123:0/3344528999 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:31.436 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7fc5e759e640 1 --2- 10.20.193.123:0/3344528999 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc5e812cad0 0x7fc5e8067e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:31.436 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7f0a057fa640 1 -- 10.20.193.123:0/11674493 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09fc00ca70 con 0x7f0a08127200 2026-02-17T20:08:31.437 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7f0a057fa640 1 -- 10.20.193.123:0/11674493 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09fc00cbd0 con 0x7f0a08127200 2026-02-17T20:08:31.437 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7fe902d6e640 1 Processor -- start 2026-02-17T20:08:31.437 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7f0a0ecdb640 1 -- 10.20.193.123:0/11674493 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a00009ae0 con 0x7f0a08127200 2026-02-17T20:08:31.437 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7f0a057fa640 1 -- 10.20.193.123:0/11674493 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09fc013470 con 0x7f0a08127200 2026-02-17T20:08:31.438 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7fc5dffff640 1 --2- 10.20.193.123:0/3344528999 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fc5e808ec70 0x7fc5e8067910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:31.438 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7fc5e759e640 1 -- 10.20.193.123:0/3344528999 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fc5e808e360 msgr2=0x7fc5e80673d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.438 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7fc5e759e640 1 --2- 10.20.193.123:0/3344528999 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fc5e808e360 0x7fc5e80673d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.438 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7fc5e759e640 1 -- 10.20.193.123:0/3344528999 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fc5e808ec70 msgr2=0x7fc5e8067910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.438 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7fc5e759e640 1 --2- 10.20.193.123:0/3344528999 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fc5e808ec70 0x7fc5e8067910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.438 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7fc5e759e640 1 -- 10.20.193.123:0/3344528999 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d8009390 con 0x7fc5e812cad0 2026-02-17T20:08:31.438 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7fe902d6e640 1 -- start start 2026-02-17T20:08:31.439 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7fc5e6d9d640 1 --2- 10.20.193.123:0/3344528999 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fc5e808e360 0x7fc5e80673d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:08:31.439 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7fc5dffff640 1 --2- 10.20.193.123:0/3344528999 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fc5e808ec70 0x7fc5e8067910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T20:08:31.439 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7f0a0ecdb640 1 -- 10.20.193.123:0/11674493 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a08126600 con 0x7f0a08127200 2026-02-17T20:08:31.439 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7f0cfaed2640 1 -- 10.20.193.123:0/4119475314 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cf408d2d0 con 0x7f0cf412c3c0 2026-02-17T20:08:31.439 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7fc5e759e640 1 --2- 10.20.193.123:0/3344528999 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc5e812cad0 0x7fc5e8067e50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc5e8090190 tx=0x7fc5e000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:31.440 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7fe902d6e640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe8fc096a60 0x7fe8fc118650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:31.440 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7fe902d6e640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fe8fc097370 0x7fe8fc118b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:31.440 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7f0cf17fa640 1 -- 10.20.193.123:0/4119475314 <== mon.0 v2:10.20.193.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7f0cec007300 con 0x7f0cf412c3c0 2026-02-17T20:08:31.440 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7fe902d6e640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fe8fc129550 0x7fe8fc1be4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:31.440 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7fe902d6e640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8fc11b050 con 0x7fe8fc129550 2026-02-17T20:08:31.440 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7fe902d6e640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8fc119850 con 0x7fe8fc096a60 2026-02-17T20:08:31.440 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7fe902d6e640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8fc11b290 con 0x7fe8fc097370 2026-02-17T20:08:31.441 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7fc5df7fe640 1 -- 10.20.193.123:0/3344528999 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e000ce20 con 0x7fc5e812cad0 2026-02-17T20:08:31.441 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7fc5df7fe640 1 -- 10.20.193.123:0/3344528999 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5e000f040 con 0x7fc5e812cad0 2026-02-17T20:08:31.441 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7fc5ed00c640 1 -- 10.20.193.123:0/3344528999 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5e8120970 con 0x7fc5e812cad0 2026-02-17T20:08:31.441 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7fc5df7fe640 1 -- 10.20.193.123:0/3344528999 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e00146d0 con 0x7fc5e812cad0 2026-02-17T20:08:31.441 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7fe8fbfff640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fe8fc097370 0x7fe8fc118b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:31.441 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7fe90130b640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fe8fc129550 0x7fe8fc1be4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:31.441 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7fc5ed00c640 1 -- 10.20.193.123:0/3344528999 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5e812c5e0 con 0x7fc5e812cad0 2026-02-17T20:08:31.442 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7fe90130b640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fe8fc129550 0x7fe8fc1be4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:42032/0 (socket says 10.20.193.123:42032) 2026-02-17T20:08:31.442 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7fe90130b640 1 -- 10.20.193.123:0/1354706961 learned_addr learned my addr 10.20.193.123:0/1354706961 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:31.442 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7fe8fbfff640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fe8fc097370 0x7fe8fc118b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:45450/0 (socket says 10.20.193.123:45450) 2026-02-17T20:08:31.442 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.404+0000 7fe900b0a640 1 --2- 10.20.193.123:0/1354706961 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe8fc096a60 0x7fe8fc118650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:31.442 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.405+0000 7fe8fbfff640 1 -- 10.20.193.123:0/1354706961 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe8fc096a60 msgr2=0x7fe8fc118650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.442 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.405+0000 7f0cf17fa640 1 -- 10.20.193.123:0/4119475314 <== mon.0 v2:10.20.193.123:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2862+0+0 (secure 0 0 0) 0x7f0cec0638b0 con 0x7f0cf412c3c0 2026-02-17T20:08:31.443 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.405+0000 7fe8fbfff640 1 --2- 10.20.193.123:0/1354706961 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe8fc096a60 0x7fe8fc118650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.443 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.405+0000 7fe8fbfff640 1 -- 10.20.193.123:0/1354706961 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fe8fc129550 msgr2=0x7fe8fc1be4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.443 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.405+0000 7fe8fbfff640 1 --2- 10.20.193.123:0/1354706961 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fe8fc129550 0x7fe8fc1be4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.443 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.405+0000 7fe8fbfff640 1 -- 10.20.193.123:0/1354706961 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f0009450 con 0x7fe8fc097370 2026-02-17T20:08:31.443 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.405+0000 7fe90130b640 1 --2- 10.20.193.123:0/1354706961 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fe8fc129550 0x7fe8fc1be4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:08:31.443 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.405+0000 7f0a0ecdb640 1 -- 10.20.193.123:0/11674493 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a081267f0 con 0x7f0a08127200 2026-02-17T20:08:31.444 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.405+0000 7fe900b0a640 1 --2- 10.20.193.123:0/1354706961 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe8fc096a60 0x7fe8fc118650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T20:08:31.444 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.405+0000 7fe8fbfff640 1 --2- 10.20.193.123:0/1354706961 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fe8fc097370 0x7fe8fc118b90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8000c00 tx=0x7fe8e8007c40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:31.444 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.405+0000 7fe8f97fa640 1 -- 10.20.193.123:0/1354706961 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e80072e0 con 0x7fe8fc097370 2026-02-17T20:08:31.444 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.405+0000 7fe902d6e640 1 -- 10.20.193.123:0/1354706961 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8fc11bc70 con 0x7fe8fc097370 2026-02-17T20:08:31.444 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.405+0000 7fe8f97fa640 1 -- 10.20.193.123:0/1354706961 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e8007460 con 0x7fe8fc097370 2026-02-17T20:08:31.444 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.405+0000 7fe8f97fa640 1 -- 10.20.193.123:0/1354706961 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e8007da0 con 0x7fe8fc097370 2026-02-17T20:08:31.444 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.405+0000 7fe902d6e640 1 -- 10.20.193.123:0/1354706961 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8fc11b7c0 con 0x7fe8fc097370 2026-02-17T20:08:31.444 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.405+0000 7f0a057fa640 1 -- 10.20.193.123:0/11674493 <== mon.1 v2:10.20.193.123:3301/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7f09fc013860 con 0x7f0a08127200 2026-02-17T20:08:31.445 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.405+0000 7fc5ed00c640 1 -- 10.20.193.123:0/3344528999 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5e81200c0 con 0x7fc5e812cad0 2026-02-17T20:08:31.445 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.405+0000 7fc5df7fe640 1 -- 10.20.193.123:0/3344528999 <== mon.1 v2:10.20.193.123:3301/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7fc5e0014a40 con 0x7fc5e812cad0 2026-02-17T20:08:31.445 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.405+0000 7f0a057fa640 1 -- 10.20.193.123:0/11674493 <== mon.1 v2:10.20.193.123:3301/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2862+0+0 (secure 0 0 0) 0x7f09fc063c30 con 0x7f0a08127200 2026-02-17T20:08:31.445 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.405+0000 7fe902d6e640 1 -- 10.20.193.123:0/1354706961 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8fc05f010 con 0x7fe8fc097370 2026-02-17T20:08:31.445 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.405+0000 7fc5df7fe640 1 -- 10.20.193.123:0/3344528999 <== mon.1 v2:10.20.193.123:3301/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2862+0+0 (secure 0 0 0) 0x7fc5e0064740 con 0x7fc5e812cad0 2026-02-17T20:08:31.446 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.405+0000 7fe8f97fa640 1 -- 10.20.193.123:0/1354706961 <== mon.2 v2:10.20.193.123:3302/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7fe8e8005bf0 con 0x7fe8fc097370 2026-02-17T20:08:31.446 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.406+0000 7fe8f97fa640 1 -- 10.20.193.123:0/1354706961 <== mon.2 v2:10.20.193.123:3302/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2862+0+0 (secure 0 0 0) 0x7fe8e8062c80 con 0x7fe8fc097370 2026-02-17T20:08:31.446 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.406+0000 7f0cf17fa640 1 -- 10.20.193.123:0/4119475314 <== mon.0 v2:10.20.193.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7f0cec03e7c0 con 0x7f0cf412c3c0 2026-02-17T20:08:31.446 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.407+0000 7fe8f97fa640 1 -- 10.20.193.123:0/1354706961 <== mon.2 v2:10.20.193.123:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7fe8e803db10 con 0x7fe8fc097370 2026-02-17T20:08:31.446 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.408+0000 7f0a057fa640 1 -- 10.20.193.123:0/11674493 <== mon.1 v2:10.20.193.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7f09fc06a080 con 0x7f0a08127200 2026-02-17T20:08:31.446 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.409+0000 7fc5df7fe640 1 -- 10.20.193.123:0/3344528999 <== mon.1 v2:10.20.193.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7fc5e003f5b0 con 0x7fc5e812cad0 2026-02-17T20:08:31.469 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.471+0000 7f0cfaed2640 1 -- 10.20.193.123:0/4119475314 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0cf412c100 con 0x7f0cf412c3c0 2026-02-17T20:08:31.469 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.471+0000 7fe902d6e640 1 -- 10.20.193.123:0/1354706961 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe8fc064930 con 0x7fe8fc097370 2026-02-17T20:08:31.469 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.471+0000 7f0cf17fa640 1 -- 10.20.193.123:0/4119475314 <== mon.0 v2:10.20.193.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0cec041fd0 con 0x7f0cf412c3c0 2026-02-17T20:08:31.469 INFO:teuthology.orchestra.run.trial123.stdout:38654705665 2026-02-17T20:08:31.470 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.471+0000 7fe8f97fa640 1 -- 10.20.193.123:0/1354706961 <== mon.2 v2:10.20.193.123:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe8e8017020 con 0x7fe8fc097370 2026-02-17T20:08:31.470 INFO:teuthology.orchestra.run.trial123.stdout:38654705666 2026-02-17T20:08:31.470 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.472+0000 7f0cfaed2640 1 -- 10.20.193.123:0/4119475314 >> v1:10.20.193.123:6800/23720 conn(0x7f0cd804d0d0 legacy=0x7f0cd804f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.470 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.472+0000 7f0cfaed2640 1 -- 10.20.193.123:0/4119475314 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0cf412c3c0 msgr2=0x7f0cf408b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.470 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.472+0000 7f0cfaed2640 1 --2- 10.20.193.123:0/4119475314 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0cf412c3c0 0x7f0cf408b2d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4069b10 tx=0x7f0cec0019e0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.470 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.472+0000 7f0cfaed2640 1 -- 10.20.193.123:0/4119475314 shutdown_connections 2026-02-17T20:08:31.471 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.472+0000 7f0cfaed2640 1 --2- 10.20.193.123:0/4119475314 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0cf412c3c0 0x7f0cf408b2d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.471 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.472+0000 7f0cfaed2640 1 --2- 10.20.193.123:0/4119475314 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0cf4096180 0x7f0cf408ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.471 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.472+0000 7f0cfaed2640 1 --2- 10.20.193.123:0/4119475314 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0cf4090570 0x7f0cf408a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.471 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.472+0000 7f0cfaed2640 1 -- 10.20.193.123:0/4119475314 >> 10.20.193.123:0/4119475314 conn(0x7f0cf4096d30 msgr2=0x7f0cf408eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:31.471 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.472+0000 7f0cfaed2640 1 -- 10.20.193.123:0/4119475314 shutdown_connections 2026-02-17T20:08:31.471 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.472+0000 7fe902d6e640 1 -- 10.20.193.123:0/1354706961 >> v1:10.20.193.123:6800/23720 conn(0x7fe8e004d0d0 legacy=0x7fe8e004f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.471 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.472+0000 7fe902d6e640 1 -- 10.20.193.123:0/1354706961 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fe8fc097370 msgr2=0x7fe8fc118b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.471 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.472+0000 7fe902d6e640 1 --2- 10.20.193.123:0/1354706961 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fe8fc097370 0x7fe8fc118b90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8000c00 tx=0x7fe8e8007c40 comp rx=0 tx=0).stop 2026-02-17T20:08:31.471 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.472+0000 7f0cfaed2640 1 -- 10.20.193.123:0/4119475314 wait complete. 2026-02-17T20:08:31.472 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.472+0000 7fe902d6e640 1 -- 10.20.193.123:0/1354706961 shutdown_connections 2026-02-17T20:08:31.472 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.472+0000 7fe902d6e640 1 --2- 10.20.193.123:0/1354706961 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fe8fc129550 0x7fe8fc1be4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.472 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.472+0000 7fe902d6e640 1 --2- 10.20.193.123:0/1354706961 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fe8fc097370 0x7fe8fc118b90 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.472 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.472+0000 7fe902d6e640 1 --2- 10.20.193.123:0/1354706961 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe8fc096a60 0x7fe8fc118650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.472 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.472+0000 7fe902d6e640 1 -- 10.20.193.123:0/1354706961 >> 10.20.193.123:0/1354706961 conn(0x7fe8fc09da30 msgr2=0x7fe8fc1b1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:31.472 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.472+0000 7fe902d6e640 1 -- 10.20.193.123:0/1354706961 shutdown_connections 2026-02-17T20:08:31.472 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.472+0000 7fe902d6e640 1 -- 10.20.193.123:0/1354706961 wait complete. 2026-02-17T20:08:31.472 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.473+0000 7fc5ed00c640 1 -- 10.20.193.123:0/3344528999 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc5e805f010 con 0x7fc5e812cad0 2026-02-17T20:08:31.472 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.473+0000 7fc5df7fe640 1 -- 10.20.193.123:0/3344528999 <== mon.1 v2:10.20.193.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc5e0018070 con 0x7fc5e812cad0 2026-02-17T20:08:31.473 INFO:teuthology.orchestra.run.trial123.stdout:38654705665 2026-02-17T20:08:31.473 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.473+0000 7f0a0ecdb640 1 -- 10.20.193.123:0/11674493 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0a0805f010 con 0x7f0a08127200 2026-02-17T20:08:31.473 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.473+0000 7f0a057fa640 1 -- 10.20.193.123:0/11674493 <== mon.1 v2:10.20.193.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f09fc03eaa0 con 0x7f0a08127200 2026-02-17T20:08:31.473 INFO:teuthology.orchestra.run.trial123.stdout:38654705666 2026-02-17T20:08:31.474 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.474+0000 7fc5ed00c640 1 -- 10.20.193.123:0/3344528999 >> v1:10.20.193.123:6800/23720 conn(0x7fc5c804d0d0 legacy=0x7fc5c804f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.474 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.474+0000 7fc5ed00c640 1 -- 10.20.193.123:0/3344528999 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc5e812cad0 msgr2=0x7fc5e8067e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.474 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.474+0000 7fc5ed00c640 1 --2- 10.20.193.123:0/3344528999 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc5e812cad0 0x7fc5e8067e50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc5e8090190 tx=0x7fc5e000b040 comp rx=0 tx=0).stop 2026-02-17T20:08:31.474 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.474+0000 7fc5ed00c640 1 -- 10.20.193.123:0/3344528999 shutdown_connections 2026-02-17T20:08:31.474 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.474+0000 7fc5ed00c640 1 --2- 10.20.193.123:0/3344528999 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc5e812cad0 0x7fc5e8067e50 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.474 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.474+0000 7fc5ed00c640 1 --2- 10.20.193.123:0/3344528999 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fc5e808ec70 0x7fc5e8067910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.474 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.474+0000 7fc5ed00c640 1 --2- 10.20.193.123:0/3344528999 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fc5e808e360 0x7fc5e80673d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.474 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.474+0000 7fc5ed00c640 1 -- 10.20.193.123:0/3344528999 >> 10.20.193.123:0/3344528999 conn(0x7fc5e8096d30 msgr2=0x7fc5e8092af0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:31.474 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.474+0000 7fc5ed00c640 1 -- 10.20.193.123:0/3344528999 shutdown_connections 2026-02-17T20:08:31.474 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.474+0000 7fc5ed00c640 1 -- 10.20.193.123:0/3344528999 wait complete. 2026-02-17T20:08:31.475 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.475+0000 7f0a0ecdb640 1 -- 10.20.193.123:0/11674493 >> v1:10.20.193.123:6800/23720 conn(0x7f09ec04d0d0 legacy=0x7f09ec04f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.475 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.475+0000 7f0a0ecdb640 1 -- 10.20.193.123:0/11674493 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0a08127200 msgr2=0x7f0a08068640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:31.475 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.475+0000 7f0a0ecdb640 1 --2- 10.20.193.123:0/11674493 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0a08127200 0x7f0a08068640 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f09fc00ea20 tx=0x7f09fc0090f0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.475 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.475+0000 7f0a0ecdb640 1 -- 10.20.193.123:0/11674493 shutdown_connections 2026-02-17T20:08:31.475 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.475+0000 7f0a0ecdb640 1 --2- 10.20.193.123:0/11674493 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0a08128650 0x7f0a080690c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.475 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.475+0000 7f0a0ecdb640 1 --2- 10.20.193.123:0/11674493 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0a08127d40 0x7f0a08068b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.475 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.475+0000 7f0a0ecdb640 1 --2- 10.20.193.123:0/11674493 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0a08127200 0x7f0a08068640 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:31.475 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.475+0000 7f0a0ecdb640 1 -- 10.20.193.123:0/11674493 >> 10.20.193.123:0/11674493 conn(0x7f0a0809ba80 msgr2=0x7f0a08113b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:31.475 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.475+0000 7f0a0ecdb640 1 -- 10.20.193.123:0/11674493 shutdown_connections 2026-02-17T20:08:31.475 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:31.475+0000 7f0a0ecdb640 1 -- 10.20.193.123:0/11674493 wait complete. 2026-02-17T20:08:31.479 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705666 got 38654705665 for osd.1 2026-02-17T20:08:31.479 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705666 for osd.0 2026-02-17T20:08:31.479 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705666 got 38654705665 for osd.3 2026-02-17T20:08:31.480 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705666 for osd.2 2026-02-17T20:08:32.480 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T20:08:32.480 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T20:08:32.480 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T20:08:32.481 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T20:08:32.548 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.550+0000 7f20a5892640 1 Processor -- start 2026-02-17T20:08:32.548 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.550+0000 7f20a5892640 1 -- start start 2026-02-17T20:08:32.549 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.551+0000 7f20a5892640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f20a0127d40 0x7f20a0128110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:32.549 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.551+0000 7f20a5892640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f20a0128650 0x7f20a0126cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:32.549 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.551+0000 7f20a5892640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20a006cd50 con 0x7f20a0127200 2026-02-17T20:08:32.549 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.551+0000 7f20a5892640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20a006e510 con 0x7f20a0127d40 2026-02-17T20:08:32.549 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.551+0000 7f20a5892640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a006de80 con 0x7f20a0128650 2026-02-17T20:08:32.549 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.551+0000 7f209e7fc640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f20a0128650 0x7f20a0126cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:32.549 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.551+0000 7f209e7fc640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f20a0128650 0x7f20a0126cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:57058/0 (socket says 10.20.193.123:57058) 2026-02-17T20:08:32.549 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.551+0000 7f209e7fc640 1 -- 10.20.193.123:0/3794834949 learned_addr learned my addr 10.20.193.123:0/3794834949 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:32.549 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.551+0000 7f209effd640 1 --2- 10.20.193.123:0/3794834949 >> v2:10.20.193.123:3300/0 conn(0x7f20a0127d40 0x7f20a0128110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:32.549 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.551+0000 7f209dffb640 1 -- 10.20.193.123:0/3794834949 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2925722123 0 0) 0x7f20a006cd50 con 0x7f20a0127200 2026-02-17T20:08:32.549 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.551+0000 7f209e7fc640 1 -- 10.20.193.123:0/3794834949 >> v2:10.20.193.123:3300/0 conn(0x7f20a0127d40 msgr2=0x7f20a0128110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:08:32.549 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.551+0000 7f209e7fc640 1 --2- 10.20.193.123:0/3794834949 >> v2:10.20.193.123:3300/0 conn(0x7f20a0127d40 0x7f20a0128110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:32.549 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.551+0000 7f209e7fc640 1 -- 10.20.193.123:0/3794834949 >> v1:10.20.193.123:6789/0 conn(0x7f20a0127200 legacy=0x7f20a012f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:32.549 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.551+0000 7f209e7fc640 1 -- 10.20.193.123:0/3794834949 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a006d6a0 con 0x7f20a0128650 2026-02-17T20:08:32.549 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.551+0000 7f6f3836e640 1 Processor -- start 2026-02-17T20:08:32.549 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.551+0000 7f6f3836e640 1 -- start start 2026-02-17T20:08:32.549 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.551+0000 7f209e7fc640 1 --2- 10.20.193.123:0/3794834949 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f20a0128650 0x7f20a0126cc0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2094009910 tx=0x7f209402ee10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce110828481c7912 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:32.549 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.551+0000 7f209dffb640 1 -- 10.20.193.123:0/3794834949 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209402f970 con 0x7f20a0128650 2026-02-17T20:08:32.550 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.551+0000 7f209dffb640 1 -- 10.20.193.123:0/3794834949 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f209402fad0 con 0x7f20a0128650 2026-02-17T20:08:32.550 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.551+0000 7f209dffb640 1 -- 10.20.193.123:0/3794834949 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209402fe70 con 0x7f20a0128650 2026-02-17T20:08:32.550 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.551+0000 7f0a716db640 1 Processor -- start 2026-02-17T20:08:32.550 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.552+0000 7f6f3836e640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f6f30090570 0x7f6f30095c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:32.550 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.552+0000 7f6f3836e640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f6f30096180 0x7f6f300965b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:32.550 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.552+0000 7f6f3836e640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f6f3012c3c0 0x7f6f3012e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:32.550 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.552+0000 7f6f3836e640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f30067b50 con 0x7f6f30090570 2026-02-17T20:08:32.550 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.552+0000 7f6f3836e640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f30069c10 con 0x7f6f30096180 2026-02-17T20:08:32.550 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.552+0000 7f6f3836e640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f300675e0 con 0x7f6f3012c3c0 2026-02-17T20:08:32.550 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.552+0000 7f0a716db640 1 -- start start 2026-02-17T20:08:32.550 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.552+0000 7f6f35909640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f6f30096180 0x7f6f300965b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:32.550 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.552+0000 7f6f3610a640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f6f30090570 0x7f6f30095c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:32.550 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.552+0000 7f6f35909640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f6f30096180 0x7f6f300965b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:57074/0 (socket says 10.20.193.123:57074) 2026-02-17T20:08:32.551 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.552+0000 7f6f35909640 1 -- 10.20.193.123:0/1212365734 learned_addr learned my addr 10.20.193.123:0/1212365734 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:32.551 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.552+0000 7f6f3690b640 1 --2- 10.20.193.123:0/1212365734 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f6f3012c3c0 0x7f6f3012e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:32.551 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.552+0000 7f20a5892640 1 -- 10.20.193.123:0/3794834949 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f20a0128650 msgr2=0x7f20a0126cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:32.551 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.552+0000 7f20a5892640 1 --2- 10.20.193.123:0/3794834949 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f20a0128650 0x7f20a0126cc0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2094009910 tx=0x7f209402ee10 comp rx=0 tx=0).stop 2026-02-17T20:08:32.551 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.552+0000 7f6f35909640 1 -- 10.20.193.123:0/1212365734 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f6f3012c3c0 msgr2=0x7f6f3012e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:08:32.551 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.552+0000 7f6f35909640 1 --2- 10.20.193.123:0/1212365734 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f6f3012c3c0 0x7f6f3012e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:32.551 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.552+0000 7f20a5892640 1 -- 10.20.193.123:0/3794834949 shutdown_connections 2026-02-17T20:08:32.551 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.552+0000 7f20a5892640 1 --2- 10.20.193.123:0/3794834949 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f20a0128650 0x7f20a0126cc0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:32.551 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.552+0000 7f6f35909640 1 -- 10.20.193.123:0/1212365734 >> v2:10.20.193.123:3300/0 conn(0x7f6f30090570 msgr2=0x7f6f30095c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:08:32.551 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.552+0000 7f6f35909640 1 --2- 10.20.193.123:0/1212365734 >> v2:10.20.193.123:3300/0 conn(0x7f6f30090570 0x7f6f30095c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:32.551 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.552+0000 7f20a5892640 1 --2- 10.20.193.123:0/3794834949 >> v2:10.20.193.123:3300/0 conn(0x7f20a0127d40 0x7f20a0128110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:32.551 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.552+0000 7f20a5892640 1 -- 10.20.193.123:0/3794834949 >> 10.20.193.123:0/3794834949 conn(0x7f20a009ba80 msgr2=0x7f20a009be80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:32.551 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.552+0000 7f6f35909640 1 -- 10.20.193.123:0/1212365734 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f300945c0 con 0x7f6f30096180 2026-02-17T20:08:32.551 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.552+0000 7f6f3610a640 1 --2- 10.20.193.123:0/1212365734 >> v2:10.20.193.123:3300/0 conn(0x7f6f30090570 0x7f6f30095c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:08:32.552 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.552+0000 7f0a716db640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0a6c06ee50 0x7f0a6c095c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:32.552 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.552+0000 7f0a716db640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f0a6c096570 0x7f0a6c131b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:32.552 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.552+0000 7f20a5892640 1 -- 10.20.193.123:0/3794834949 shutdown_connections 2026-02-17T20:08:32.552 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.552+0000 7f0a716db640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a6c0911a0 con 0x7f0a6c096180 2026-02-17T20:08:32.552 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.552+0000 7f0a716db640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a6c0673d0 con 0x7f0a6c096570 2026-02-17T20:08:32.552 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.552+0000 7f0a716db640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c067c50 con 0x7f0a6c06ee50 2026-02-17T20:08:32.552 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.552+0000 7f20a5892640 1 -- 10.20.193.123:0/3794834949 wait complete. 2026-02-17T20:08:32.552 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.552+0000 7f0a6affd640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0a6c06ee50 0x7f0a6c095c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:32.552 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.552+0000 7f0a6affd640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0a6c06ee50 0x7f0a6c095c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:57088/0 (socket says 10.20.193.123:57088) 2026-02-17T20:08:32.552 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.552+0000 7f0a6a7fc640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7f0a6c096180 0x7f0a6c12e3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:37320/0 (socket says 10.20.193.123:37320) 2026-02-17T20:08:32.552 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.552+0000 7f0a6affd640 1 -- 10.20.193.123:0/576024638 learned_addr learned my addr 10.20.193.123:0/576024638 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:32.552 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.552+0000 7f0a6b7fe640 1 --2- 10.20.193.123:0/576024638 >> v2:10.20.193.123:3300/0 conn(0x7f0a6c096570 0x7f0a6c131b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:32.552 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.552+0000 7f0a6affd640 1 -- 10.20.193.123:0/576024638 >> v2:10.20.193.123:3300/0 conn(0x7f0a6c096570 msgr2=0x7f0a6c131b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:08:32.552 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.552+0000 7f0a6affd640 1 --2- 10.20.193.123:0/576024638 >> v2:10.20.193.123:3300/0 conn(0x7f0a6c096570 0x7f0a6c131b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:32.552 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.552+0000 7f0a6affd640 1 -- 10.20.193.123:0/576024638 >> v1:10.20.193.123:6789/0 conn(0x7f0a6c096180 legacy=0x7f0a6c12e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:32.552 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.552+0000 7f0a6affd640 1 -- 10.20.193.123:0/576024638 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a6c068070 con 0x7f0a6c06ee50 2026-02-17T20:08:32.553 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.552+0000 7f0a6b7fe640 1 --2- 10.20.193.123:0/576024638 >> v2:10.20.193.123:3300/0 conn(0x7f0a6c096570 0x7f0a6c131b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:08:32.553 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.552+0000 7f6f35909640 1 --2- 10.20.193.123:0/1212365734 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f6f30096180 0x7f6f300965b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6f20009910 tx=0x7f6f2002ee10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=952eea38216cc0c1 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:32.553 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.552+0000 7f6f35108640 1 -- 10.20.193.123:0/1212365734 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2002f920 con 0x7f6f30096180 2026-02-17T20:08:32.553 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.552+0000 7f6f35108640 1 -- 10.20.193.123:0/1212365734 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2002fa80 con 0x7f6f30096180 2026-02-17T20:08:32.553 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.552+0000 7f6f35108640 1 -- 10.20.193.123:0/1212365734 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2002fe60 con 0x7f6f30096180 2026-02-17T20:08:32.553 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f20a5892640 1 Processor -- start 2026-02-17T20:08:32.553 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f0a6affd640 1 --2- 10.20.193.123:0/576024638 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0a6c06ee50 0x7f0a6c095c40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c009910 tx=0x7f0a5c02ee20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a919d87d9b43876c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:32.553 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f20a5892640 1 -- start start 2026-02-17T20:08:32.553 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f0a69ffb640 1 -- 10.20.193.123:0/576024638 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c02f980 con 0x7f0a6c06ee50 2026-02-17T20:08:32.553 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f6f3836e640 1 -- 10.20.193.123:0/1212365734 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f6f30096180 msgr2=0x7f6f300965b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:32.553 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f6f3836e640 1 --2- 10.20.193.123:0/1212365734 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f6f30096180 0x7f6f300965b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6f20009910 tx=0x7f6f2002ee10 comp rx=0 tx=0).stop 2026-02-17T20:08:32.553 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f0a69ffb640 1 -- 10.20.193.123:0/576024638 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a5c02fae0 con 0x7f0a6c06ee50 2026-02-17T20:08:32.554 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f0a69ffb640 1 -- 10.20.193.123:0/576024638 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c037440 con 0x7f0a6c06ee50 2026-02-17T20:08:32.554 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f6f3836e640 1 -- 10.20.193.123:0/1212365734 shutdown_connections 2026-02-17T20:08:32.554 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f6f3836e640 1 --2- 10.20.193.123:0/1212365734 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f6f3012c3c0 0x7f6f3012e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:32.554 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f6f3836e640 1 --2- 10.20.193.123:0/1212365734 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f6f30096180 0x7f6f300965b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:32.554 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f6f3836e640 1 --2- 10.20.193.123:0/1212365734 >> v2:10.20.193.123:3300/0 conn(0x7f6f30090570 0x7f6f30095c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:32.554 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f6f3836e640 1 -- 10.20.193.123:0/1212365734 >> 10.20.193.123:0/1212365734 conn(0x7f6f30096d30 msgr2=0x7f6f30097130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:32.554 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f6f3836e640 1 -- 10.20.193.123:0/1212365734 shutdown_connections 2026-02-17T20:08:32.554 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f6f3836e640 1 -- 10.20.193.123:0/1212365734 wait complete. 2026-02-17T20:08:32.554 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f20a5892640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f20a0127200 0x7f20a01259f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:32.554 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f20a5892640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f20a0127d40 0x7f20a01175b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:32.554 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f20a5892640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f20a0128650 0x7f20a0117af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:32.554 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f20a5892640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a011ad20 con 0x7f20a0127200 2026-02-17T20:08:32.554 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f20a5892640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a0119090 con 0x7f20a0127d40 2026-02-17T20:08:32.554 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f20a5892640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20a011a950 con 0x7f20a0128650 2026-02-17T20:08:32.554 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f209effd640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f20a0127200 0x7f20a01259f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:32.554 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f209e7fc640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f20a0127d40 0x7f20a01175b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:32.554 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f23fdedb640 1 Processor -- start 2026-02-17T20:08:32.555 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f209f7fe640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f20a0128650 0x7f20a0117af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:32.555 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f209effd640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f20a0127200 0x7f20a01259f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:42074/0 (socket says 10.20.193.123:42074) 2026-02-17T20:08:32.555 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f209effd640 1 -- 10.20.193.123:0/144643319 learned_addr learned my addr 10.20.193.123:0/144643319 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:32.555 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f23fdedb640 1 -- start start 2026-02-17T20:08:32.555 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f209e7fc640 1 -- 10.20.193.123:0/144643319 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f20a0128650 msgr2=0x7f20a0117af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:32.555 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f209e7fc640 1 --2- 10.20.193.123:0/144643319 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f20a0128650 0x7f20a0117af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:32.555 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f209e7fc640 1 -- 10.20.193.123:0/144643319 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f20a0127200 msgr2=0x7f20a01259f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:32.555 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f209e7fc640 1 --2- 10.20.193.123:0/144643319 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f20a0127200 0x7f20a01259f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:32.555 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f209e7fc640 1 -- 10.20.193.123:0/144643319 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2094009450 con 0x7f20a0127d40 2026-02-17T20:08:32.555 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f209effd640 1 --2- 10.20.193.123:0/144643319 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f20a0127200 0x7f20a01259f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:08:32.555 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f0a716db640 1 -- 10.20.193.123:0/576024638 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0a6c06ee50 msgr2=0x7f0a6c095c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:32.555 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f0a716db640 1 --2- 10.20.193.123:0/576024638 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0a6c06ee50 0x7f0a6c095c40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c009910 tx=0x7f0a5c02ee20 comp rx=0 tx=0).stop 2026-02-17T20:08:32.555 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f209e7fc640 1 --2- 10.20.193.123:0/144643319 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f20a0127d40 0x7f20a01175b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2094036000 tx=0x7f2094037000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:32.555 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f0a716db640 1 -- 10.20.193.123:0/576024638 shutdown_connections 2026-02-17T20:08:32.556 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f0a716db640 1 --2- 10.20.193.123:0/576024638 >> v2:10.20.193.123:3300/0 conn(0x7f0a6c096570 0x7f0a6c131b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:32.556 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f0a716db640 1 --2- 10.20.193.123:0/576024638 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0a6c06ee50 0x7f0a6c095c40 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:32.556 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f0a716db640 1 -- 10.20.193.123:0/576024638 >> 10.20.193.123:0/576024638 conn(0x7f0a6c096d30 msgr2=0x7f0a6c097130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:32.556 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f23fdedb640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f23f806ee50 0x7f23f8095c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:32.556 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f0a716db640 1 -- 10.20.193.123:0/576024638 shutdown_connections 2026-02-17T20:08:32.556 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f2087fff640 1 -- 10.20.193.123:0/144643319 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2094037ea0 con 0x7f20a0127d40 2026-02-17T20:08:32.556 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f23fdedb640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f23f8096180 0x7f23f8096570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:32.556 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f0a716db640 1 -- 10.20.193.123:0/576024638 wait complete. 2026-02-17T20:08:32.556 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f2087fff640 1 -- 10.20.193.123:0/144643319 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2094042440 con 0x7f20a0127d40 2026-02-17T20:08:32.556 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f20a5892640 1 -- 10.20.193.123:0/144643319 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20a011a170 con 0x7f20a0127d40 2026-02-17T20:08:32.557 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f23fdedb640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23f8096ab0 con 0x7f23f812e3e0 2026-02-17T20:08:32.557 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f23fdedb640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23f80673d0 con 0x7f23f8096180 2026-02-17T20:08:32.557 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f2087fff640 1 -- 10.20.193.123:0/144643319 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2094042820 con 0x7f20a0127d40 2026-02-17T20:08:32.557 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f23fdedb640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23f80911a0 con 0x7f23f806ee50 2026-02-17T20:08:32.557 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f6f3836e640 1 Processor -- start 2026-02-17T20:08:32.557 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f23f77fe640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f23f806ee50 0x7f23f8095c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:32.557 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f20a5892640 1 -- 10.20.193.123:0/144643319 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20a0118250 con 0x7f20a0127d40 2026-02-17T20:08:32.558 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f23f77fe640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f23f806ee50 0x7f23f8095c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:57102/0 (socket says 10.20.193.123:57102) 2026-02-17T20:08:32.558 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f23f77fe640 1 -- 10.20.193.123:0/3912170589 learned_addr learned my addr 10.20.193.123:0/3912170589 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:32.558 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f23f6ffd640 1 --2- 10.20.193.123:0/3912170589 >> v2:10.20.193.123:3300/0 conn(0x7f23f8096180 0x7f23f8096570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:32.558 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.553+0000 7f6f3836e640 1 -- start start 2026-02-17T20:08:32.558 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f23f6ffd640 1 -- 10.20.193.123:0/3912170589 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f23f806ee50 msgr2=0x7f23f8095c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:08:32.558 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f23f6ffd640 1 --2- 10.20.193.123:0/3912170589 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f23f806ee50 0x7f23f8095c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:32.558 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f23f6ffd640 1 -- 10.20.193.123:0/3912170589 >> v1:10.20.193.123:6789/0 conn(0x7f23f812e3e0 legacy=0x7f23f81307c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:32.558 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f23f6ffd640 1 -- 10.20.193.123:0/3912170589 --> v2:10.20.193.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f8067c50 con 0x7f23f8096180 2026-02-17T20:08:32.559 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f6f3836e640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f6f30090570 0x7f6f301bee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:32.559 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f6f3836e640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f6f30096180 0x7f6f301bf380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:32.559 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f6f3836e640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f6f3012c3c0 0x7f6f3008bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:32.559 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f6f3836e640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3008dce0 con 0x7f6f30096180 2026-02-17T20:08:32.559 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f6f3836e640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f30120960 con 0x7f6f30090570 2026-02-17T20:08:32.559 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f6f3836e640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f301206d0 con 0x7f6f3012c3c0 2026-02-17T20:08:32.559 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f6f3610a640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f6f30090570 0x7f6f301bee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:32.559 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f6f3610a640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f6f30090570 0x7f6f301bee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:57108/0 (socket says 10.20.193.123:57108) 2026-02-17T20:08:32.559 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f6f35909640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f6f30096180 0x7f6f301bf380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:32.559 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f6f3610a640 1 -- 10.20.193.123:0/3700561262 learned_addr learned my addr 10.20.193.123:0/3700561262 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:32.559 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f6f3690b640 1 --2- 10.20.193.123:0/3700561262 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f6f3012c3c0 0x7f6f3008bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:32.559 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f0a716db640 1 Processor -- start 2026-02-17T20:08:32.559 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f0a716db640 1 -- start start 2026-02-17T20:08:32.560 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f20a5892640 1 -- 10.20.193.123:0/144643319 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20a011a3b0 con 0x7f20a0127d40 2026-02-17T20:08:32.560 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f23f6ffd640 1 --2- 10.20.193.123:0/3912170589 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f23f8096180 0x7f23f8096570 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f23ec009850 tx=0x7f23ec02ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cedca429b3cc152c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:32.560 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f6f3690b640 1 -- 10.20.193.123:0/3700561262 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f6f30090570 msgr2=0x7f6f301bee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:32.560 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f6f3690b640 1 --2- 10.20.193.123:0/3700561262 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f6f30090570 0x7f6f301bee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:32.560 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f6f3690b640 1 -- 10.20.193.123:0/3700561262 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f6f30096180 msgr2=0x7f6f301bf380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:32.560 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f6f3690b640 1 --2- 10.20.193.123:0/3700561262 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f6f30096180 0x7f6f301bf380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:32.560 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f6f3690b640 1 -- 10.20.193.123:0/3700561262 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f2c009390 con 0x7f6f3012c3c0 2026-02-17T20:08:32.560 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f6f35909640 1 --2- 10.20.193.123:0/3700561262 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f6f30096180 0x7f6f301bf380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:08:32.560 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f6f3690b640 1 --2- 10.20.193.123:0/3700561262 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f6f3012c3c0 0x7f6f3008bc50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6f28009e80 tx=0x7f6f2800b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:32.560 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f6f26ffd640 1 -- 10.20.193.123:0/3700561262 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2800ce00 con 0x7f6f3012c3c0 2026-02-17T20:08:32.561 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f2087fff640 1 -- 10.20.193.123:0/144643319 <== mon.1 v2:10.20.193.123:3301/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7f209403e040 con 0x7f20a0127d40 2026-02-17T20:08:32.561 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f0a716db640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0a6c06ee50 0x7f0a6c08a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:32.561 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f0a716db640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0a6c096180 0x7f0a6c08add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:32.561 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f6f26ffd640 1 -- 10.20.193.123:0/3700561262 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2800f040 con 0x7f6f3012c3c0 2026-02-17T20:08:32.561 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f6f3836e640 1 -- 10.20.193.123:0/3700561262 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f20009450 con 0x7f6f3012c3c0 2026-02-17T20:08:32.561 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f0a716db640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0a6c096570 0x7f0a6c08b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:32.561 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f0a716db640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c08c2d0 con 0x7f0a6c096180 2026-02-17T20:08:32.561 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f0a716db640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c098de0 con 0x7f0a6c06ee50 2026-02-17T20:08:32.561 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f6f26ffd640 1 -- 10.20.193.123:0/3700561262 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f280146d0 con 0x7f6f3012c3c0 2026-02-17T20:08:32.562 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f0a716db640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c08d380 con 0x7f0a6c096570 2026-02-17T20:08:32.562 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f23f67fc640 1 -- 10.20.193.123:0/3912170589 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ec02f8b0 con 0x7f23f8096180 2026-02-17T20:08:32.562 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f6f3836e640 1 -- 10.20.193.123:0/3700561262 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f301bf8c0 con 0x7f6f3012c3c0 2026-02-17T20:08:32.562 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f23f67fc640 1 -- 10.20.193.123:0/3912170589 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23ec02fa10 con 0x7f23f8096180 2026-02-17T20:08:32.562 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f23f67fc640 1 -- 10.20.193.123:0/3912170589 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ec02fdf0 con 0x7f23f8096180 2026-02-17T20:08:32.562 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f0a6a7fc640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0a6c096180 0x7f0a6c08add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:32.562 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f0a6affd640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0a6c06ee50 0x7f0a6c08a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:32.563 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f0a6affd640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0a6c06ee50 0x7f0a6c08a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:57118/0 (socket says 10.20.193.123:57118) 2026-02-17T20:08:32.563 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f0a6affd640 1 -- 10.20.193.123:0/587765626 learned_addr learned my addr 10.20.193.123:0/587765626 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:32.563 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f0a6a7fc640 1 --2- 10.20.193.123:0/587765626 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0a6c096180 0x7f0a6c08add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:42096/0 (socket says 10.20.193.123:42096) 2026-02-17T20:08:32.563 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f0a6b7fe640 1 --2- 10.20.193.123:0/587765626 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0a6c096570 0x7f0a6c08b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:32.563 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f0a6affd640 1 -- 10.20.193.123:0/587765626 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0a6c096570 msgr2=0x7f0a6c08b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:32.563 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f0a6affd640 1 --2- 10.20.193.123:0/587765626 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0a6c096570 0x7f0a6c08b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:32.563 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f0a6affd640 1 -- 10.20.193.123:0/587765626 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0a6c096180 msgr2=0x7f0a6c08add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:32.563 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f0a6affd640 1 --2- 10.20.193.123:0/587765626 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0a6c096180 0x7f0a6c08add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:32.563 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f2087fff640 1 -- 10.20.193.123:0/144643319 <== mon.1 v2:10.20.193.123:3301/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2862+0+0 (secure 0 0 0) 0x7f2094087f10 con 0x7f20a0127d40 2026-02-17T20:08:32.563 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f0a6affd640 1 -- 10.20.193.123:0/587765626 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a64009a20 con 0x7f0a6c06ee50 2026-02-17T20:08:32.563 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f0a6a7fc640 1 --2- 10.20.193.123:0/587765626 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0a6c096180 0x7f0a6c08add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:08:32.563 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f0a6affd640 1 --2- 10.20.193.123:0/587765626 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0a6c06ee50 0x7f0a6c08a890 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c03a040 tx=0x7f0a5c037000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:32.564 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f23fdedb640 1 -- 10.20.193.123:0/3912170589 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f23f8096180 msgr2=0x7f23f8096570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:32.564 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.554+0000 7f23fdedb640 1 --2- 10.20.193.123:0/3912170589 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f23f8096180 0x7f23f8096570 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f23ec009850 tx=0x7f23ec02ed50 comp rx=0 tx=0).stop 2026-02-17T20:08:32.564 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.555+0000 7f23fdedb640 1 -- 10.20.193.123:0/3912170589 shutdown_connections 2026-02-17T20:08:32.564 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.555+0000 7f23fdedb640 1 --2- 10.20.193.123:0/3912170589 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f23f8096180 0x7f23f8096570 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:32.564 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.555+0000 7f23fdedb640 1 --2- 10.20.193.123:0/3912170589 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f23f806ee50 0x7f23f8095c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:32.564 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.555+0000 7f23fdedb640 1 -- 10.20.193.123:0/3912170589 >> 10.20.193.123:0/3912170589 conn(0x7f23f8096d30 msgr2=0x7f23f8097130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:32.564 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.555+0000 7f23fdedb640 1 -- 10.20.193.123:0/3912170589 shutdown_connections 2026-02-17T20:08:32.564 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.555+0000 7f23fdedb640 1 -- 10.20.193.123:0/3912170589 wait complete. 2026-02-17T20:08:32.565 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.555+0000 7f6f3836e640 1 -- 10.20.193.123:0/3700561262 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f3005f010 con 0x7f6f3012c3c0 2026-02-17T20:08:32.565 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.555+0000 7f6f26ffd640 1 -- 10.20.193.123:0/3700561262 <== mon.2 v2:10.20.193.123:3302/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7f6f28014a40 con 0x7f6f3012c3c0 2026-02-17T20:08:32.565 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.555+0000 7f6f26ffd640 1 -- 10.20.193.123:0/3700561262 <== mon.2 v2:10.20.193.123:3302/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2862+0+0 (secure 0 0 0) 0x7f6f28064770 con 0x7f6f3012c3c0 2026-02-17T20:08:32.566 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.555+0000 7f23fdedb640 1 Processor -- start 2026-02-17T20:08:32.566 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.555+0000 7f23fdedb640 1 -- start start 2026-02-17T20:08:32.566 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.555+0000 7f23fdedb640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f23f806ee50 0x7f23f808a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:32.566 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.555+0000 7f23fdedb640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f23f8096180 0x7f23f808ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:32.566 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.555+0000 7f23fdedb640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f23f812e3e0 0x7f23f808b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:32.566 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.555+0000 7f23fdedb640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f808dc60 con 0x7f23f806ee50 2026-02-17T20:08:32.566 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.555+0000 7f23fdedb640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23f808c900 con 0x7f23f812e3e0 2026-02-17T20:08:32.566 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.555+0000 7f23fdedb640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23f808c6c0 con 0x7f23f8096180 2026-02-17T20:08:32.566 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.555+0000 7f23f6ffd640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f23f8096180 0x7f23f808ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:32.566 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.555+0000 7f23f77fe640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f23f806ee50 0x7f23f808a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:32.566 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.556+0000 7f23f6ffd640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f23f8096180 0x7f23f808ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:45502/0 (socket says 10.20.193.123:45502) 2026-02-17T20:08:32.566 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.556+0000 7f23f6ffd640 1 -- 10.20.193.123:0/2826118651 learned_addr learned my addr 10.20.193.123:0/2826118651 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:32.566 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.556+0000 7f23f7fff640 1 --2- 10.20.193.123:0/2826118651 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f23f812e3e0 0x7f23f808b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:32.566 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.556+0000 7f23f6ffd640 1 -- 10.20.193.123:0/2826118651 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f23f812e3e0 msgr2=0x7f23f808b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:32.566 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.556+0000 7f23f6ffd640 1 --2- 10.20.193.123:0/2826118651 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f23f812e3e0 0x7f23f808b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:32.566 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.556+0000 7f23f6ffd640 1 -- 10.20.193.123:0/2826118651 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f23f806ee50 msgr2=0x7f23f808a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:32.566 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.556+0000 7f23f6ffd640 1 --2- 10.20.193.123:0/2826118651 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f23f806ee50 0x7f23f808a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:32.566 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.556+0000 7f23f6ffd640 1 -- 10.20.193.123:0/2826118651 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23ec009390 con 0x7f23f8096180 2026-02-17T20:08:32.567 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.556+0000 7f23f77fe640 1 --2- 10.20.193.123:0/2826118651 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f23f806ee50 0x7f23f808a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:08:32.567 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.556+0000 7f23f6ffd640 1 --2- 10.20.193.123:0/2826118651 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f23f8096180 0x7f23f808ac10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f23ec009360 tx=0x7f23ec037000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:32.567 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.556+0000 7f0a537fe640 1 -- 10.20.193.123:0/587765626 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c042650 con 0x7f0a6c06ee50 2026-02-17T20:08:32.567 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.556+0000 7f0a537fe640 1 -- 10.20.193.123:0/587765626 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a5c0427f0 con 0x7f0a6c06ee50 2026-02-17T20:08:32.567 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.556+0000 7f0a716db640 1 -- 10.20.193.123:0/587765626 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a5c009450 con 0x7f0a6c06ee50 2026-02-17T20:08:32.567 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.556+0000 7f0a537fe640 1 -- 10.20.193.123:0/587765626 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c042bb0 con 0x7f0a6c06ee50 2026-02-17T20:08:32.567 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.556+0000 7f2087fff640 1 -- 10.20.193.123:0/144643319 <== mon.1 v2:10.20.193.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7f20a011a3b0 con 0x7f20a0127d40 2026-02-17T20:08:32.567 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.556+0000 7f0a716db640 1 -- 10.20.193.123:0/587765626 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a6c08da40 con 0x7f0a6c06ee50 2026-02-17T20:08:32.568 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.556+0000 7f23dffff640 1 -- 10.20.193.123:0/2826118651 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ec037e60 con 0x7f23f8096180 2026-02-17T20:08:32.568 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.557+0000 7f23dffff640 1 -- 10.20.193.123:0/2826118651 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23ec042420 con 0x7f23f8096180 2026-02-17T20:08:32.568 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.557+0000 7f23fdedb640 1 -- 10.20.193.123:0/2826118651 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23f812e050 con 0x7f23f8096180 2026-02-17T20:08:32.568 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.557+0000 7f23dffff640 1 -- 10.20.193.123:0/2826118651 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ec0427e0 con 0x7f23f8096180 2026-02-17T20:08:32.568 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.557+0000 7f6f26ffd640 1 -- 10.20.193.123:0/3700561262 <== mon.2 v2:10.20.193.123:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7f6f2803f560 con 0x7f6f3012c3c0 2026-02-17T20:08:32.568 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.557+0000 7f23fdedb640 1 -- 10.20.193.123:0/2826118651 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23f808b690 con 0x7f23f8096180 2026-02-17T20:08:32.569 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.557+0000 7f0a537fe640 1 -- 10.20.193.123:0/587765626 <== mon.1 v2:10.20.193.123:3301/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7f0a5c03e040 con 0x7f0a6c06ee50 2026-02-17T20:08:32.569 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.557+0000 7f0a716db640 1 -- 10.20.193.123:0/587765626 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a6c05f010 con 0x7f0a6c06ee50 2026-02-17T20:08:32.569 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.557+0000 7f23fdedb640 1 -- 10.20.193.123:0/2826118651 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23f805f010 con 0x7f23f8096180 2026-02-17T20:08:32.569 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.557+0000 7f23dffff640 1 -- 10.20.193.123:0/2826118651 <== mon.2 v2:10.20.193.123:3302/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7f23ec03e040 con 0x7f23f8096180 2026-02-17T20:08:32.569 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.557+0000 7f0a537fe640 1 -- 10.20.193.123:0/587765626 <== mon.1 v2:10.20.193.123:3301/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2862+0+0 (secure 0 0 0) 0x7f0a5c088250 con 0x7f0a6c06ee50 2026-02-17T20:08:32.569 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.558+0000 7f23dffff640 1 -- 10.20.193.123:0/2826118651 <== mon.2 v2:10.20.193.123:3302/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2862+0+0 (secure 0 0 0) 0x7f23ec087eb0 con 0x7f23f8096180 2026-02-17T20:08:32.569 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.559+0000 7f23dffff640 1 -- 10.20.193.123:0/2826118651 <== mon.2 v2:10.20.193.123:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7f23ec062d90 con 0x7f23f8096180 2026-02-17T20:08:32.570 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.559+0000 7f0a537fe640 1 -- 10.20.193.123:0/587765626 <== mon.1 v2:10.20.193.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7f0a5c063210 con 0x7f0a6c06ee50 2026-02-17T20:08:32.618 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.621+0000 7f6f3836e640 1 -- 10.20.193.123:0/3700561262 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6f30064930 con 0x7f6f3012c3c0 2026-02-17T20:08:32.619 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.621+0000 7f6f26ffd640 1 -- 10.20.193.123:0/3700561262 <== mon.2 v2:10.20.193.123:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6f28018070 con 0x7f6f3012c3c0 2026-02-17T20:08:32.619 INFO:teuthology.orchestra.run.trial123.stdout:38654705665 2026-02-17T20:08:32.619 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.622+0000 7f23fdedb640 1 -- 10.20.193.123:0/2826118651 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f23f8090640 con 0x7f23f8096180 2026-02-17T20:08:32.619 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.622+0000 7f23dffff640 1 -- 10.20.193.123:0/2826118651 <== mon.2 v2:10.20.193.123:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f23ec047020 con 0x7f23f8096180 2026-02-17T20:08:32.620 INFO:teuthology.orchestra.run.trial123.stdout:38654705666 2026-02-17T20:08:32.620 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.622+0000 7f6f3836e640 1 -- 10.20.193.123:0/3700561262 >> v1:10.20.193.123:6800/23720 conn(0x7f6f1404d100 legacy=0x7f6f1404f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:32.620 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.622+0000 7f6f3836e640 1 -- 10.20.193.123:0/3700561262 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f6f3012c3c0 msgr2=0x7f6f3008bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:32.620 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.622+0000 7f6f3836e640 1 --2- 10.20.193.123:0/3700561262 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f6f3012c3c0 0x7f6f3008bc50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6f28009e80 tx=0x7f6f2800b040 comp rx=0 tx=0).stop 2026-02-17T20:08:32.620 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.622+0000 7f6f3836e640 1 -- 10.20.193.123:0/3700561262 shutdown_connections 2026-02-17T20:08:32.621 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.622+0000 7f6f3836e640 1 --2- 10.20.193.123:0/3700561262 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f6f3012c3c0 0x7f6f3008bc50 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:32.621 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.622+0000 7f6f3836e640 1 --2- 10.20.193.123:0/3700561262 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f6f30096180 0x7f6f301bf380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:32.621 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.622+0000 7f6f3836e640 1 --2- 10.20.193.123:0/3700561262 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f6f30090570 0x7f6f301bee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:32.621 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.622+0000 7f6f3836e640 1 -- 10.20.193.123:0/3700561262 >> 10.20.193.123:0/3700561262 conn(0x7f6f30096d30 msgr2=0x7f6f3008fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:32.621 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.622+0000 7f0a716db640 1 -- 10.20.193.123:0/587765626 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0a6c090640 con 0x7f0a6c06ee50 2026-02-17T20:08:32.621 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.622+0000 7f6f3836e640 1 -- 10.20.193.123:0/3700561262 shutdown_connections 2026-02-17T20:08:32.621 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.622+0000 7f6f3836e640 1 -- 10.20.193.123:0/3700561262 wait complete. 2026-02-17T20:08:32.621 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.622+0000 7f0a537fe640 1 -- 10.20.193.123:0/587765626 <== mon.1 v2:10.20.193.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0a5c047090 con 0x7f0a6c06ee50 2026-02-17T20:08:32.622 INFO:teuthology.orchestra.run.trial123.stdout:38654705666 2026-02-17T20:08:32.622 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.623+0000 7f20a5892640 1 -- 10.20.193.123:0/144643319 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f20a011a3b0 con 0x7f20a0127d40 2026-02-17T20:08:32.622 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.623+0000 7f23fdedb640 1 -- 10.20.193.123:0/2826118651 >> v1:10.20.193.123:6800/23720 conn(0x7f23e404d100 legacy=0x7f23e404f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:32.622 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.623+0000 7f23fdedb640 1 -- 10.20.193.123:0/2826118651 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f23f8096180 msgr2=0x7f23f808ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:32.622 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.623+0000 7f23fdedb640 1 --2- 10.20.193.123:0/2826118651 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f23f8096180 0x7f23f808ac10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f23ec009360 tx=0x7f23ec037000 comp rx=0 tx=0).stop 2026-02-17T20:08:32.622 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.623+0000 7f2087fff640 1 -- 10.20.193.123:0/144643319 <== mon.1 v2:10.20.193.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f20a011a3b0 con 0x7f20a0127d40 2026-02-17T20:08:32.623 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.623+0000 7f23fdedb640 1 -- 10.20.193.123:0/2826118651 shutdown_connections 2026-02-17T20:08:32.623 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.623+0000 7f23fdedb640 1 --2- 10.20.193.123:0/2826118651 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f23f812e3e0 0x7f23f808b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:32.623 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.623+0000 7f23fdedb640 1 --2- 10.20.193.123:0/2826118651 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f23f8096180 0x7f23f808ac10 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:32.623 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.623+0000 7f23fdedb640 1 --2- 10.20.193.123:0/2826118651 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f23f806ee50 0x7f23f808a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:32.623 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.623+0000 7f23fdedb640 1 -- 10.20.193.123:0/2826118651 >> 10.20.193.123:0/2826118651 conn(0x7f23f8096d30 msgr2=0x7f23f808fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:32.623 INFO:teuthology.orchestra.run.trial123.stdout:38654705665 2026-02-17T20:08:32.623 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.623+0000 7f23fdedb640 1 -- 10.20.193.123:0/2826118651 shutdown_connections 2026-02-17T20:08:32.623 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.623+0000 7f23fdedb640 1 -- 10.20.193.123:0/2826118651 wait complete. 2026-02-17T20:08:32.624 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.623+0000 7f0a716db640 1 -- 10.20.193.123:0/587765626 >> v1:10.20.193.123:6800/23720 conn(0x7f0a5804d0d0 legacy=0x7f0a5804f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:32.624 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.623+0000 7f0a716db640 1 -- 10.20.193.123:0/587765626 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0a6c06ee50 msgr2=0x7f0a6c08a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:32.624 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.623+0000 7f0a716db640 1 --2- 10.20.193.123:0/587765626 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0a6c06ee50 0x7f0a6c08a890 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c03a040 tx=0x7f0a5c037000 comp rx=0 tx=0).stop 2026-02-17T20:08:32.624 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.623+0000 7f0a716db640 1 -- 10.20.193.123:0/587765626 shutdown_connections 2026-02-17T20:08:32.624 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.623+0000 7f0a716db640 1 --2- 10.20.193.123:0/587765626 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0a6c096570 0x7f0a6c08b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:32.624 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.623+0000 7f0a716db640 1 --2- 10.20.193.123:0/587765626 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0a6c096180 0x7f0a6c08add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:32.624 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.623+0000 7f0a716db640 1 --2- 10.20.193.123:0/587765626 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0a6c06ee50 0x7f0a6c08a890 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:32.624 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.623+0000 7f0a716db640 1 -- 10.20.193.123:0/587765626 >> 10.20.193.123:0/587765626 conn(0x7f0a6c096d30 msgr2=0x7f0a6c093730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:32.624 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.623+0000 7f0a716db640 1 -- 10.20.193.123:0/587765626 shutdown_connections 2026-02-17T20:08:32.625 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.623+0000 7f0a716db640 1 -- 10.20.193.123:0/587765626 wait complete. 2026-02-17T20:08:32.625 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.624+0000 7f20a5892640 1 -- 10.20.193.123:0/144643319 >> v1:10.20.193.123:6800/23720 conn(0x7f208c04d0d0 legacy=0x7f208c04f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:32.625 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.624+0000 7f20a5892640 1 -- 10.20.193.123:0/144643319 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f20a0127d40 msgr2=0x7f20a01175b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:32.625 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.624+0000 7f20a5892640 1 --2- 10.20.193.123:0/144643319 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f20a0127d40 0x7f20a01175b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2094036000 tx=0x7f2094037000 comp rx=0 tx=0).stop 2026-02-17T20:08:32.625 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.624+0000 7f20a5892640 1 -- 10.20.193.123:0/144643319 shutdown_connections 2026-02-17T20:08:32.625 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.624+0000 7f20a5892640 1 --2- 10.20.193.123:0/144643319 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f20a0128650 0x7f20a0117af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:32.625 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.624+0000 7f20a5892640 1 --2- 10.20.193.123:0/144643319 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f20a0127d40 0x7f20a01175b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:32.625 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.624+0000 7f20a5892640 1 --2- 10.20.193.123:0/144643319 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f20a0127200 0x7f20a01259f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:32.625 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.624+0000 7f20a5892640 1 -- 10.20.193.123:0/144643319 >> 10.20.193.123:0/144643319 conn(0x7f20a009ba80 msgr2=0x7f20a01afac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:32.625 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.624+0000 7f20a5892640 1 -- 10.20.193.123:0/144643319 shutdown_connections 2026-02-17T20:08:32.626 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:32.624+0000 7f20a5892640 1 -- 10.20.193.123:0/144643319 wait complete. 2026-02-17T20:08:32.628 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705666 for osd.0 2026-02-17T20:08:32.629 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705666 got 38654705665 for osd.3 2026-02-17T20:08:32.629 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705666 for osd.2 2026-02-17T20:08:32.630 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705666 got 38654705665 for osd.1 2026-02-17T20:08:33.629 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T20:08:33.630 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T20:08:33.630 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T20:08:33.632 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T20:08:33.699 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.701+0000 7f12a23d4640 1 Processor -- start 2026-02-17T20:08:33.700 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.701+0000 7f12a23d4640 1 -- start start 2026-02-17T20:08:33.700 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.701+0000 7f04bb7bc640 1 Processor -- start 2026-02-17T20:08:33.700 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.701+0000 7f04bb7bc640 1 -- start start 2026-02-17T20:08:33.701 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.702+0000 7f12a23d4640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f129c096a60 0x7f129c096e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:33.701 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.702+0000 7f04bb7bc640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f04b4096a60 0x7f04b4096e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:33.702 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.702+0000 7f04bb7bc640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f04b4097370 0x7f04b4129e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:33.702 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.702+0000 7f04bb7bc640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f04b412a390 0x7f04b412a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:33.702 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.702+0000 7f04bb7bc640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04b4099ac0 con 0x7f04b4096a60 2026-02-17T20:08:33.702 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.702+0000 7f04bb7bc640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04b412ad30 con 0x7f04b4097370 2026-02-17T20:08:33.702 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.702+0000 7f04bb7bc640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04b409a5c0 con 0x7f04b412a390 2026-02-17T20:08:33.702 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.702+0000 7f04b9558640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f04b4096a60 0x7f04b4096e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:33.702 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.702+0000 7f04b8d57640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f04b4097370 0x7f04b4129e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:33.702 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.702+0000 7f04b9d59640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f04b412a390 0x7f04b412a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:33.702 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.702+0000 7f04b8d57640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f04b4097370 0x7f04b4129e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:57134/0 (socket says 10.20.193.123:57134) 2026-02-17T20:08:33.702 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.702+0000 7f04b8d57640 1 -- 10.20.193.123:0/3324050012 learned_addr learned my addr 10.20.193.123:0/3324050012 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:33.703 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.702+0000 7f129bfff640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f129c096a60 0x7f129c096e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:33.703 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.702+0000 7f129bfff640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f129c096a60 0x7f129c096e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:42106/0 (socket says 10.20.193.123:42106) 2026-02-17T20:08:33.703 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.702+0000 7f04b9d59640 1 -- 10.20.193.123:0/3324050012 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f04b4097370 msgr2=0x7f04b4129e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:08:33.703 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.702+0000 7f04b9d59640 1 --2- 10.20.193.123:0/3324050012 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f04b4097370 0x7f04b4129e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:33.704 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.702+0000 7f12a23d4640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f129c12a560 0x7f129c1321a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:33.704 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.702+0000 7f04b9d59640 1 -- 10.20.193.123:0/3324050012 >> v2:10.20.193.123:3300/0 conn(0x7f04b4096a60 msgr2=0x7f04b4096e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:08:33.704 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.702+0000 7f04b9d59640 1 --2- 10.20.193.123:0/3324050012 >> v2:10.20.193.123:3300/0 conn(0x7f04b4096a60 0x7f04b4096e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:33.705 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.702+0000 7f129bfff640 1 -- 10.20.193.123:0/1918382785 learned_addr learned my addr 10.20.193.123:0/1918382785 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:33.705 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.702+0000 7f04b9d59640 1 -- 10.20.193.123:0/3324050012 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b4099310 con 0x7f04b412a390 2026-02-17T20:08:33.705 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.702+0000 7f12a23d4640 1 -- 10.20.193.123:0/1918382785 --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f129c09a5c0 con 0x7f129c097370 2026-02-17T20:08:33.705 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.702+0000 7f12a23d4640 1 -- 10.20.193.123:0/1918382785 --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f129c099ac0 con 0x7f129c096a60 2026-02-17T20:08:33.706 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.702+0000 7f12a23d4640 1 -- 10.20.193.123:0/1918382785 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f129c099310 con 0x7f129c12a560 2026-02-17T20:08:33.706 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.702+0000 7f2525ddd640 1 Processor -- start 2026-02-17T20:08:33.706 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.702+0000 7f12a0971640 1 --2- 10.20.193.123:0/1918382785 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f129c12a560 0x7f129c1321a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:33.707 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.702+0000 7f2525ddd640 1 -- start start 2026-02-17T20:08:33.707 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.702+0000 7f129bfff640 1 -- 10.20.193.123:0/1918382785 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f129c12a560 msgr2=0x7f129c1321a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:08:33.707 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.702+0000 7f129bfff640 1 --2- 10.20.193.123:0/1918382785 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f129c12a560 0x7f129c1321a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:33.707 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.702+0000 7f129bfff640 1 -- 10.20.193.123:0/1918382785 >> v1:10.20.193.123:6789/0 conn(0x7f129c097370 legacy=0x7f129c129e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:33.707 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.702+0000 7f129bfff640 1 -- 10.20.193.123:0/1918382785 --> v2:10.20.193.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f129c09a300 con 0x7f129c096a60 2026-02-17T20:08:33.707 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.702+0000 7f129affd640 1 -- 10.20.193.123:0/1918382785 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2019729405 0 0) 0x7f129c09a5c0 con 0x7f129c097370 2026-02-17T20:08:33.709 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.703+0000 7f2525ddd640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f252008e360 0x7f252008e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:33.709 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.703+0000 7f2525ddd640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f252012cad0 0x7f252012eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:33.709 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.703+0000 7f2525ddd640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f252008f530 con 0x7f252008ec70 2026-02-17T20:08:33.709 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.703+0000 7f2525ddd640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2520090480 con 0x7f252008e360 2026-02-17T20:08:33.709 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.703+0000 7f2525ddd640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2520094750 con 0x7f252012cad0 2026-02-17T20:08:33.709 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.703+0000 7f251f7fe640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f252008e360 0x7f252008e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:33.709 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.703+0000 7f251effd640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7f252008ec70 0x7f252012b3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:37354/0 (socket says 10.20.193.123:37354) 2026-02-17T20:08:33.709 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.703+0000 7f251effd640 1 -- 10.20.193.123:0/3463138047 learned_addr learned my addr 10.20.193.123:0/3463138047 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:08:33.709 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.703+0000 7f251ffff640 1 --2- 10.20.193.123:0/3463138047 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f252012cad0 0x7f252012eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:33.709 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.703+0000 7f251f7fe640 1 -- 10.20.193.123:0/3463138047 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f252012cad0 msgr2=0x7f252012eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:08:33.710 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.703+0000 7f251f7fe640 1 --2- 10.20.193.123:0/3463138047 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f252012cad0 0x7f252012eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:33.710 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.703+0000 7f251e7fc640 1 -- 10.20.193.123:0/3463138047 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 29727612 0 0) 0x7f252008f530 con 0x7f252008ec70 2026-02-17T20:08:33.710 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.703+0000 7f251f7fe640 1 -- 10.20.193.123:0/3463138047 >> v1:10.20.193.123:6789/0 conn(0x7f252008ec70 legacy=0x7f252012b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:33.710 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.703+0000 7f251f7fe640 1 -- 10.20.193.123:0/3463138047 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f252008f880 con 0x7f252008e360 2026-02-17T20:08:33.710 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.703+0000 7f129bfff640 1 --2- 10.20.193.123:0/1918382785 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f129c096a60 0x7f129c096e30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f128c009940 tx=0x7f128c02ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a86db05550f33186 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:33.710 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.703+0000 7f04b9d59640 1 --2- 10.20.193.123:0/3324050012 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f04b412a390 0x7f04b412a7f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f04ac009850 tx=0x7f04ac02ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=141d8a016e28ff38 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:33.711 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.703+0000 7f129affd640 1 -- 10.20.193.123:0/1918382785 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128c02f9a0 con 0x7f129c096a60 2026-02-17T20:08:33.711 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.703+0000 7f04abfff640 1 -- 10.20.193.123:0/3324050012 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ac02f800 con 0x7f04b412a390 2026-02-17T20:08:33.712 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.703+0000 7f129affd640 1 -- 10.20.193.123:0/1918382785 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128c02fb00 con 0x7f129c096a60 2026-02-17T20:08:33.712 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.703+0000 7f129affd640 1 -- 10.20.193.123:0/1918382785 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128c02fea0 con 0x7f129c096a60 2026-02-17T20:08:33.712 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.703+0000 7f04abfff640 1 -- 10.20.193.123:0/3324050012 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04ac02f960 con 0x7f04b412a390 2026-02-17T20:08:33.712 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.703+0000 7f04abfff640 1 -- 10.20.193.123:0/3324050012 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ac02fd40 con 0x7f04b412a390 2026-02-17T20:08:33.712 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.703+0000 7f251f7fe640 1 --2- 10.20.193.123:0/3463138047 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f252008e360 0x7f252008e730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2510009880 tx=0x7f251002ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a72719a4d36f4fb2 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:33.713 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.703+0000 7f12a23d4640 1 -- 10.20.193.123:0/1918382785 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f129c096a60 msgr2=0x7f129c096e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:33.713 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.703+0000 7f04bb7bc640 1 -- 10.20.193.123:0/3324050012 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f04b412a390 msgr2=0x7f04b412a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:33.713 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.703+0000 7f04bb7bc640 1 --2- 10.20.193.123:0/3324050012 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f04b412a390 0x7f04b412a7f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f04ac009850 tx=0x7f04ac02ecf0 comp rx=0 tx=0).stop 2026-02-17T20:08:33.714 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.703+0000 7f12a23d4640 1 --2- 10.20.193.123:0/1918382785 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f129c096a60 0x7f129c096e30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f128c009940 tx=0x7f128c02ee80 comp rx=0 tx=0).stop 2026-02-17T20:08:33.714 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.703+0000 7f12a23d4640 1 -- 10.20.193.123:0/1918382785 shutdown_connections 2026-02-17T20:08:33.714 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.703+0000 7f12a23d4640 1 --2- 10.20.193.123:0/1918382785 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f129c12a560 0x7f129c1321a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:33.714 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.703+0000 7f12a23d4640 1 --2- 10.20.193.123:0/1918382785 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f129c096a60 0x7f129c096e30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:33.714 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.703+0000 7f12a23d4640 1 -- 10.20.193.123:0/1918382785 >> 10.20.193.123:0/1918382785 conn(0x7f129c09d950 msgr2=0x7f129c09dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:33.714 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.703+0000 7f251e7fc640 1 -- 10.20.193.123:0/3463138047 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251002f890 con 0x7f252008e360 2026-02-17T20:08:33.715 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.703+0000 7f04bb7bc640 1 -- 10.20.193.123:0/3324050012 shutdown_connections 2026-02-17T20:08:33.715 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.703+0000 7f04bb7bc640 1 --2- 10.20.193.123:0/3324050012 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f04b412a390 0x7f04b412a7f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:33.715 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.703+0000 7f04bb7bc640 1 --2- 10.20.193.123:0/3324050012 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f04b4097370 0x7f04b4129e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:33.715 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.703+0000 7f04bb7bc640 1 --2- 10.20.193.123:0/3324050012 >> v2:10.20.193.123:3300/0 conn(0x7f04b4096a60 0x7f04b4096e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:33.715 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.703+0000 7f04bb7bc640 1 -- 10.20.193.123:0/3324050012 >> 10.20.193.123:0/3324050012 conn(0x7f04b409d950 msgr2=0x7f04b409dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:33.715 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.703+0000 7f251e7fc640 1 -- 10.20.193.123:0/3463138047 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251002f9f0 con 0x7f252008e360 2026-02-17T20:08:33.715 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.703+0000 7f251e7fc640 1 -- 10.20.193.123:0/3463138047 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251002fd90 con 0x7f252008e360 2026-02-17T20:08:33.716 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.704+0000 7f12a23d4640 1 -- 10.20.193.123:0/1918382785 shutdown_connections 2026-02-17T20:08:33.716 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.704+0000 7f04bb7bc640 1 -- 10.20.193.123:0/3324050012 shutdown_connections 2026-02-17T20:08:33.716 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.704+0000 7f04bb7bc640 1 -- 10.20.193.123:0/3324050012 wait complete. 2026-02-17T20:08:33.716 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.704+0000 7f12a23d4640 1 -- 10.20.193.123:0/1918382785 wait complete. 2026-02-17T20:08:33.717 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.704+0000 7f2525ddd640 1 -- 10.20.193.123:0/3463138047 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f252008e360 msgr2=0x7f252008e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:33.717 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.704+0000 7f2525ddd640 1 --2- 10.20.193.123:0/3463138047 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f252008e360 0x7f252008e730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2510009880 tx=0x7f251002ed80 comp rx=0 tx=0).stop 2026-02-17T20:08:33.718 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.704+0000 7f2525ddd640 1 -- 10.20.193.123:0/3463138047 shutdown_connections 2026-02-17T20:08:33.718 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.704+0000 7f2525ddd640 1 --2- 10.20.193.123:0/3463138047 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f252012cad0 0x7f252012eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:33.718 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.704+0000 7f2525ddd640 1 --2- 10.20.193.123:0/3463138047 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f252008e360 0x7f252008e730 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:33.718 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.704+0000 7f2525ddd640 1 -- 10.20.193.123:0/3463138047 >> 10.20.193.123:0/3463138047 conn(0x7f2520096d30 msgr2=0x7f2520097130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:33.718 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.704+0000 7f2525ddd640 1 -- 10.20.193.123:0/3463138047 shutdown_connections 2026-02-17T20:08:33.718 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.704+0000 7f2525ddd640 1 -- 10.20.193.123:0/3463138047 wait complete. 2026-02-17T20:08:33.718 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.704+0000 7f12a23d4640 1 Processor -- start 2026-02-17T20:08:33.719 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.704+0000 7f04bb7bc640 1 Processor -- start 2026-02-17T20:08:33.719 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.704+0000 7f04bb7bc640 1 -- start start 2026-02-17T20:08:33.719 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.704+0000 7f12a23d4640 1 -- start start 2026-02-17T20:08:33.719 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.704+0000 7f04bb7bc640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f04b4096a60 0x7f04b41be0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:33.720 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.704+0000 7f12a23d4640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f129c096a60 0x7f129c11a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:33.720 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.704+0000 7f04bb7bc640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f04b4097370 0x7f04b41be5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:33.720 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.704+0000 7f2525ddd640 1 Processor -- start 2026-02-17T20:08:33.721 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.704+0000 7f12a23d4640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f129c097370 0x7f129c11a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:33.721 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.704+0000 7f04bb7bc640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f04b412a390 0x7f04b41beb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:33.721 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.704+0000 7f04bb7bc640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b411cd10 con 0x7f04b412a390 2026-02-17T20:08:33.721 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.704+0000 7f12a23d4640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f129c12a560 0x7f129c11ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:33.722 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.704+0000 7f04bb7bc640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04b411d4b0 con 0x7f04b4096a60 2026-02-17T20:08:33.722 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.704+0000 7f04bb7bc640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04b411e750 con 0x7f04b4097370 2026-02-17T20:08:33.722 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.704+0000 7f12a23d4640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f129c11d500 con 0x7f129c096a60 2026-02-17T20:08:33.722 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.704+0000 7f12a23d4640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f129c11cd20 con 0x7f129c12a560 2026-02-17T20:08:33.722 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.704+0000 7f12a23d4640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f129c127cd0 con 0x7f129c097370 2026-02-17T20:08:33.723 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.704+0000 7f04b9558640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f04b4096a60 0x7f04b41be0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:33.723 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.704+0000 7f2525ddd640 1 -- start start 2026-02-17T20:08:33.723 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.704+0000 7f04b8d57640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f04b4097370 0x7f04b41be5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:33.723 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.704+0000 7f04b9558640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f04b4096a60 0x7f04b41be0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:57156/0 (socket says 10.20.193.123:57156) 2026-02-17T20:08:33.724 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.704+0000 7f129bfff640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f129c096a60 0x7f129c11a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:33.724 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.704+0000 7f129b7fe640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f129c097370 0x7f129c11a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:33.724 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.704+0000 7f04b9558640 1 -- 10.20.193.123:0/2764332818 learned_addr learned my addr 10.20.193.123:0/2764332818 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:33.724 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.704+0000 7f04b9d59640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f04b412a390 0x7f04b41beb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:33.725 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.704+0000 7f129bfff640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f129c096a60 0x7f129c11a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:42124/0 (socket says 10.20.193.123:42124) 2026-02-17T20:08:33.725 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.704+0000 7f129bfff640 1 -- 10.20.193.123:0/41339758 learned_addr learned my addr 10.20.193.123:0/41339758 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:33.725 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.704+0000 7f12a0971640 1 --2- 10.20.193.123:0/41339758 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f129c12a560 0x7f129c11ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:33.725 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.705+0000 7f129bfff640 1 -- 10.20.193.123:0/41339758 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f129c097370 msgr2=0x7f129c11a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:33.725 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.705+0000 7f129bfff640 1 --2- 10.20.193.123:0/41339758 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f129c097370 0x7f129c11a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:33.725 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.705+0000 7f129bfff640 1 -- 10.20.193.123:0/41339758 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f129c12a560 msgr2=0x7f129c11ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:33.726 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.705+0000 7f129bfff640 1 --2- 10.20.193.123:0/41339758 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f129c12a560 0x7f129c11ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:33.726 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.705+0000 7f129bfff640 1 -- 10.20.193.123:0/41339758 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f128c009450 con 0x7f129c096a60 2026-02-17T20:08:33.726 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.705+0000 7f04b9558640 1 -- 10.20.193.123:0/2764332818 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f04b4097370 msgr2=0x7f04b41be5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:33.726 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.705+0000 7f04b9558640 1 --2- 10.20.193.123:0/2764332818 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f04b4097370 0x7f04b41be5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:33.726 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.705+0000 7f04b9558640 1 -- 10.20.193.123:0/2764332818 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f04b412a390 msgr2=0x7f04b41beb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:33.726 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.705+0000 7f04b9558640 1 --2- 10.20.193.123:0/2764332818 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f04b412a390 0x7f04b41beb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:33.726 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.705+0000 7f04b9558640 1 -- 10.20.193.123:0/2764332818 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04ac009390 con 0x7f04b4096a60 2026-02-17T20:08:33.727 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.705+0000 7f12a0971640 1 --2- 10.20.193.123:0/41339758 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f129c12a560 0x7f129c11ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T20:08:33.727 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.705+0000 7f04b8d57640 1 --2- 10.20.193.123:0/2764332818 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f04b4097370 0x7f04b41be5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:08:33.727 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.705+0000 7f2525ddd640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f252008e360 0x7f252008d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:33.728 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.705+0000 7f129bfff640 1 --2- 10.20.193.123:0/41339758 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f129c096a60 0x7f129c11a0f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f128c03a040 tx=0x7f128c037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:33.728 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.705+0000 7f2525ddd640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f252008ec70 0x7f252008d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:33.728 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.705+0000 7f2525ddd640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f252012cad0 0x7f2520091720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:33.728 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.705+0000 7f2525ddd640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252008ce10 con 0x7f252008e360 2026-02-17T20:08:33.728 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.705+0000 7f04b9558640 1 --2- 10.20.193.123:0/2764332818 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f04b4096a60 0x7f04b41be0b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f04b0009e50 tx=0x7f04b000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:33.729 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.705+0000 7f2525ddd640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f252008cb70 con 0x7f252008ec70 2026-02-17T20:08:33.729 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.705+0000 7f2525ddd640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25200999a0 con 0x7f252012cad0 2026-02-17T20:08:33.729 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.705+0000 7f251f7fe640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f252008e360 0x7f252008d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:33.729 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.705+0000 7f1298ff9640 1 -- 10.20.193.123:0/41339758 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128c042650 con 0x7f129c096a60 2026-02-17T20:08:33.730 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.705+0000 7f251effd640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f252008ec70 0x7f252008d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:33.730 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.705+0000 7f251ffff640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f252012cad0 0x7f2520091720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:33.730 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.705+0000 7f251f7fe640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f252008e360 0x7f252008d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:42136/0 (socket says 10.20.193.123:42136) 2026-02-17T20:08:33.730 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.705+0000 7f251f7fe640 1 -- 10.20.193.123:0/640170213 learned_addr learned my addr 10.20.193.123:0/640170213 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:33.731 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.705+0000 7f1298ff9640 1 -- 10.20.193.123:0/41339758 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128c0427f0 con 0x7f129c096a60 2026-02-17T20:08:33.731 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.705+0000 7f12a23d4640 1 -- 10.20.193.123:0/41339758 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f129c11d8d0 con 0x7f129c096a60 2026-02-17T20:08:33.731 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.705+0000 7f04a9ffb640 1 -- 10.20.193.123:0/2764332818 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b000ce20 con 0x7f04b4096a60 2026-02-17T20:08:33.731 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.705+0000 7f1298ff9640 1 -- 10.20.193.123:0/41339758 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128c042bb0 con 0x7f129c096a60 2026-02-17T20:08:33.732 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.705+0000 7f04a9ffb640 1 -- 10.20.193.123:0/2764332818 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b000f040 con 0x7f04b4096a60 2026-02-17T20:08:33.732 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.705+0000 7f04bb7bc640 1 -- 10.20.193.123:0/2764332818 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04b411e970 con 0x7f04b4096a60 2026-02-17T20:08:33.732 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.705+0000 7f12a23d4640 1 -- 10.20.193.123:0/41339758 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f129c128740 con 0x7f129c096a60 2026-02-17T20:08:33.732 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.705+0000 7f04a9ffb640 1 -- 10.20.193.123:0/2764332818 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b00146b0 con 0x7f04b4096a60 2026-02-17T20:08:33.732 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.705+0000 7f04bb7bc640 1 -- 10.20.193.123:0/2764332818 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04b411bc80 con 0x7f04b4096a60 2026-02-17T20:08:33.733 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.705+0000 7f251ffff640 1 -- 10.20.193.123:0/640170213 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f252008ec70 msgr2=0x7f252008d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:33.734 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.705+0000 7f251ffff640 1 --2- 10.20.193.123:0/640170213 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f252008ec70 0x7f252008d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:33.734 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.705+0000 7f251ffff640 1 -- 10.20.193.123:0/640170213 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f252008e360 msgr2=0x7f252008d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:33.734 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.705+0000 7f251ffff640 1 --2- 10.20.193.123:0/640170213 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f252008e360 0x7f252008d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:33.734 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.705+0000 7f251ffff640 1 -- 10.20.193.123:0/640170213 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2510009390 con 0x7f252012cad0 2026-02-17T20:08:33.734 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.705+0000 7f251f7fe640 1 --2- 10.20.193.123:0/640170213 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f252008e360 0x7f252008d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:08:33.734 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.705+0000 7f251ffff640 1 --2- 10.20.193.123:0/640170213 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f252012cad0 0x7f2520091720 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2520096590 tx=0x7f251800b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:33.734 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.705+0000 7f2507fff640 1 -- 10.20.193.123:0/640170213 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251800cdf0 con 0x7f252012cad0 2026-02-17T20:08:33.734 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.705+0000 7f2507fff640 1 -- 10.20.193.123:0/640170213 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251800f040 con 0x7f252012cad0 2026-02-17T20:08:33.734 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.705+0000 7f2525ddd640 1 -- 10.20.193.123:0/640170213 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f252008c2c0 con 0x7f252012cad0 2026-02-17T20:08:33.734 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.705+0000 7f2507fff640 1 -- 10.20.193.123:0/640170213 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25180146d0 con 0x7f252012cad0 2026-02-17T20:08:33.734 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.705+0000 7f2525ddd640 1 -- 10.20.193.123:0/640170213 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f252012c090 con 0x7f252012cad0 2026-02-17T20:08:33.735 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.705+0000 7f12a23d4640 1 -- 10.20.193.123:0/41339758 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f129c128930 con 0x7f129c096a60 2026-02-17T20:08:33.735 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.705+0000 7f04bb7bc640 1 -- 10.20.193.123:0/2764332818 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04b405f010 con 0x7f04b4096a60 2026-02-17T20:08:33.735 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.706+0000 7f04a9ffb640 1 -- 10.20.193.123:0/2764332818 <== mon.1 v2:10.20.193.123:3301/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7f04b0014a20 con 0x7f04b4096a60 2026-02-17T20:08:33.735 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.706+0000 7f1298ff9640 1 -- 10.20.193.123:0/41339758 <== mon.0 v2:10.20.193.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7f128c03e040 con 0x7f129c096a60 2026-02-17T20:08:33.736 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.706+0000 7f2525ddd640 1 -- 10.20.193.123:0/640170213 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f252005f010 con 0x7f252012cad0 2026-02-17T20:08:33.736 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.706+0000 7f2507fff640 1 -- 10.20.193.123:0/640170213 <== mon.2 v2:10.20.193.123:3302/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7f2518014a40 con 0x7f252012cad0 2026-02-17T20:08:33.736 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.706+0000 7f1298ff9640 1 -- 10.20.193.123:0/41339758 <== mon.0 v2:10.20.193.123:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2862+0+0 (secure 0 0 0) 0x7f128c088200 con 0x7f129c096a60 2026-02-17T20:08:33.736 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.706+0000 7f04a9ffb640 1 -- 10.20.193.123:0/2764332818 <== mon.1 v2:10.20.193.123:3301/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2862+0+0 (secure 0 0 0) 0x7f04b0064410 con 0x7f04b4096a60 2026-02-17T20:08:33.737 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.706+0000 7f2507fff640 1 -- 10.20.193.123:0/640170213 <== mon.2 v2:10.20.193.123:3302/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2862+0+0 (secure 0 0 0) 0x7f2518064770 con 0x7f252012cad0 2026-02-17T20:08:33.737 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.708+0000 7f04a9ffb640 1 -- 10.20.193.123:0/2764332818 <== mon.1 v2:10.20.193.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7f04b003f2a0 con 0x7f04b4096a60 2026-02-17T20:08:33.737 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.708+0000 7f1298ff9640 1 -- 10.20.193.123:0/41339758 <== mon.0 v2:10.20.193.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7f128c0631a0 con 0x7f129c096a60 2026-02-17T20:08:33.738 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.708+0000 7f2507fff640 1 -- 10.20.193.123:0/640170213 <== mon.2 v2:10.20.193.123:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7f251803f560 con 0x7f252012cad0 2026-02-17T20:08:33.738 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.740+0000 7f48fc49b640 1 Processor -- start 2026-02-17T20:08:33.738 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.740+0000 7f48fc49b640 1 -- start start 2026-02-17T20:08:33.741 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.741+0000 7f48fc49b640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f48f4097540 0x7f48f412f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:33.741 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.741+0000 7f48fc49b640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f48f412f6c0 0x7f48f4131aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:33.741 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.741+0000 7f48fc49b640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48f409a5c0 con 0x7f48f4096a60 2026-02-17T20:08:33.741 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.741+0000 7f48fc49b640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48f4099ac0 con 0x7f48f4097540 2026-02-17T20:08:33.741 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.741+0000 7f48fc49b640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48f4099310 con 0x7f48f412f6c0 2026-02-17T20:08:33.742 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.741+0000 7f48fa237640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7f48f4096a60 0x7f48f4096e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:37366/0 (socket says 10.20.193.123:37366) 2026-02-17T20:08:33.742 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.741+0000 7f48fa237640 1 -- 10.20.193.123:0/1864637281 learned_addr learned my addr 10.20.193.123:0/1864637281 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:08:33.742 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.741+0000 7f48f9a36640 1 --2- 10.20.193.123:0/1864637281 >> v2:10.20.193.123:3300/0 conn(0x7f48f4097540 0x7f48f412f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:33.742 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.741+0000 7f48faa38640 1 --2- 10.20.193.123:0/1864637281 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f48f412f6c0 0x7f48f4131aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:33.742 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.741+0000 7f48f9235640 1 -- 10.20.193.123:0/1864637281 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 202370877 0 0) 0x7f48f409a5c0 con 0x7f48f4096a60 2026-02-17T20:08:33.742 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.741+0000 7f48f9235640 1 -- 10.20.193.123:0/1864637281 --> v1:10.20.193.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48e00034e0 con 0x7f48f4096a60 2026-02-17T20:08:33.742 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.741+0000 7f48f9a36640 1 -- 10.20.193.123:0/1864637281 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f48f412f6c0 msgr2=0x7f48f4131aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:08:33.742 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.741+0000 7f48f9a36640 1 --2- 10.20.193.123:0/1864637281 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f48f412f6c0 0x7f48f4131aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:33.742 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.741+0000 7f48f9a36640 1 -- 10.20.193.123:0/1864637281 >> v1:10.20.193.123:6789/0 conn(0x7f48f4096a60 legacy=0x7f48f4096e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:33.742 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.741+0000 7f48f9235640 1 -- 10.20.193.123:0/1864637281 <== mon.0 v1:10.20.193.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3366287025 0 0) 0x7f48e00034e0 con 0x7f48f4096a60 2026-02-17T20:08:33.742 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.741+0000 7f48f9a36640 1 -- 10.20.193.123:0/1864637281 --> v2:10.20.193.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f409a300 con 0x7f48f4097540 2026-02-17T20:08:33.742 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.741+0000 7f48f9a36640 1 --2- 10.20.193.123:0/1864637281 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f48f4097540 0x7f48f412f180 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f48e4009880 tx=0x7f48e402eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d99dd716acccffa server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:33.742 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.741+0000 7f48f9235640 1 -- 10.20.193.123:0/1864637281 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f00014f0 con 0x7f48f4097540 2026-02-17T20:08:33.742 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.741+0000 7f48f9235640 1 -- 10.20.193.123:0/1864637281 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e402f5e0 con 0x7f48f4097540 2026-02-17T20:08:33.742 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.741+0000 7f48f9235640 1 -- 10.20.193.123:0/1864637281 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e402f980 con 0x7f48f4097540 2026-02-17T20:08:33.742 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.742+0000 7f48fc49b640 1 -- 10.20.193.123:0/1864637281 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f48f4097540 msgr2=0x7f48f412f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:33.743 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.742+0000 7f48fc49b640 1 --2- 10.20.193.123:0/1864637281 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f48f4097540 0x7f48f412f180 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f48e4009880 tx=0x7f48e402eda0 comp rx=0 tx=0).stop 2026-02-17T20:08:33.743 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.742+0000 7f48fc49b640 1 -- 10.20.193.123:0/1864637281 shutdown_connections 2026-02-17T20:08:33.743 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.742+0000 7f48fc49b640 1 --2- 10.20.193.123:0/1864637281 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f48f4097540 0x7f48f412f180 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:33.743 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.742+0000 7f48fc49b640 1 --2- 10.20.193.123:0/1864637281 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f48f412f6c0 0x7f48f4131aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:33.743 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.742+0000 7f48fc49b640 1 -- 10.20.193.123:0/1864637281 >> 10.20.193.123:0/1864637281 conn(0x7f48f409d950 msgr2=0x7f48f409dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:33.743 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.742+0000 7f48fc49b640 1 -- 10.20.193.123:0/1864637281 shutdown_connections 2026-02-17T20:08:33.743 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.742+0000 7f48fc49b640 1 -- 10.20.193.123:0/1864637281 wait complete. 2026-02-17T20:08:33.743 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.742+0000 7f48fc49b640 1 Processor -- start 2026-02-17T20:08:33.743 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.742+0000 7f48fc49b640 1 -- start start 2026-02-17T20:08:33.743 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.742+0000 7f48fc49b640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f48f4096a60 0x7f48f41be330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:33.743 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.742+0000 7f48fc49b640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f48f4097540 0x7f48f41be870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:33.743 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.743+0000 7f48fc49b640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f48f412f6c0 0x7f48f41bedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:33.743 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.743+0000 7f48fc49b640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f411dbd0 con 0x7f48f4096a60 2026-02-17T20:08:33.743 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.743+0000 7f48fc49b640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48f411e350 con 0x7f48f412f6c0 2026-02-17T20:08:33.743 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.743+0000 7f48fc49b640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48f411fce0 con 0x7f48f4097540 2026-02-17T20:08:33.743 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.743+0000 7f48fa237640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f48f4096a60 0x7f48f41be330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:33.743 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.743+0000 7f48fa237640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f48f4096a60 0x7f48f41be330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:42150/0 (socket says 10.20.193.123:42150) 2026-02-17T20:08:33.744 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.743+0000 7f48fa237640 1 -- 10.20.193.123:0/2620058351 learned_addr learned my addr 10.20.193.123:0/2620058351 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:33.744 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.743+0000 7f48faa38640 1 --2- 10.20.193.123:0/2620058351 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f48f412f6c0 0x7f48f41bedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:33.744 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.743+0000 7f48f9a36640 1 --2- 10.20.193.123:0/2620058351 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f48f4097540 0x7f48f41be870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:33.744 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.743+0000 7f48fa237640 1 -- 10.20.193.123:0/2620058351 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f48f4097540 msgr2=0x7f48f41be870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:33.744 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.743+0000 7f48fa237640 1 --2- 10.20.193.123:0/2620058351 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f48f4097540 0x7f48f41be870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:33.744 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.743+0000 7f48fa237640 1 -- 10.20.193.123:0/2620058351 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f48f412f6c0 msgr2=0x7f48f41bedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:33.744 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.743+0000 7f48fa237640 1 --2- 10.20.193.123:0/2620058351 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f48f412f6c0 0x7f48f41bedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:33.744 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.743+0000 7f48fa237640 1 -- 10.20.193.123:0/2620058351 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e4009390 con 0x7f48f4096a60 2026-02-17T20:08:33.744 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.743+0000 7f48fa237640 1 --2- 10.20.193.123:0/2620058351 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f48f4096a60 0x7f48f41be330 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f48f000cb10 tx=0x7f48f0001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:33.744 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.743+0000 7f48eaffd640 1 -- 10.20.193.123:0/2620058351 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f0007360 con 0x7f48f4096a60 2026-02-17T20:08:33.744 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.743+0000 7f48eaffd640 1 -- 10.20.193.123:0/2620058351 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f00074c0 con 0x7f48f4096a60 2026-02-17T20:08:33.744 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.743+0000 7f48fc49b640 1 -- 10.20.193.123:0/2620058351 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48f411f710 con 0x7f48f4096a60 2026-02-17T20:08:33.744 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.743+0000 7f48eaffd640 1 -- 10.20.193.123:0/2620058351 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f0007670 con 0x7f48f4096a60 2026-02-17T20:08:33.744 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.743+0000 7f48fc49b640 1 -- 10.20.193.123:0/2620058351 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48f411cb10 con 0x7f48f4096a60 2026-02-17T20:08:33.744 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.743+0000 7f48fc49b640 1 -- 10.20.193.123:0/2620058351 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48f405f010 con 0x7f48f4096a60 2026-02-17T20:08:33.744 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.744+0000 7f48eaffd640 1 -- 10.20.193.123:0/2620058351 <== mon.0 v2:10.20.193.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7f48f0004ca0 con 0x7f48f4096a60 2026-02-17T20:08:33.745 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.744+0000 7f48eaffd640 1 -- 10.20.193.123:0/2620058351 <== mon.0 v2:10.20.193.123:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2862+0+0 (secure 0 0 0) 0x7f48f0063120 con 0x7f48f4096a60 2026-02-17T20:08:33.745 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.745+0000 7f48eaffd640 1 -- 10.20.193.123:0/2620058351 <== mon.0 v2:10.20.193.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7f48f003e030 con 0x7f48f4096a60 2026-02-17T20:08:33.769 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.771+0000 7f2525ddd640 1 -- 10.20.193.123:0/640170213 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2520099780 con 0x7f252012cad0 2026-02-17T20:08:33.769 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.771+0000 7f2507fff640 1 -- 10.20.193.123:0/640170213 <== mon.2 v2:10.20.193.123:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2518018070 con 0x7f252012cad0 2026-02-17T20:08:33.769 INFO:teuthology.orchestra.run.trial123.stdout:38654705667 2026-02-17T20:08:33.769 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.771+0000 7f12a23d4640 1 -- 10.20.193.123:0/41339758 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f129c05f010 con 0x7f129c096a60 2026-02-17T20:08:33.770 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.771+0000 7f1298ff9640 1 -- 10.20.193.123:0/41339758 <== mon.0 v2:10.20.193.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f128c047090 con 0x7f129c096a60 2026-02-17T20:08:33.770 INFO:teuthology.orchestra.run.trial123.stdout:38654705667 2026-02-17T20:08:33.770 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.772+0000 7f04bb7bc640 1 -- 10.20.193.123:0/2764332818 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f04b40647b0 con 0x7f04b4096a60 2026-02-17T20:08:33.770 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.772+0000 7f04a9ffb640 1 -- 10.20.193.123:0/2764332818 <== mon.1 v2:10.20.193.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f04b0042ab0 con 0x7f04b4096a60 2026-02-17T20:08:33.770 INFO:teuthology.orchestra.run.trial123.stdout:38654705666 2026-02-17T20:08:33.771 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.772+0000 7f2525ddd640 1 -- 10.20.193.123:0/640170213 >> v1:10.20.193.123:6800/23720 conn(0x7f250c04d0d0 legacy=0x7f250c04f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:33.771 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.772+0000 7f2525ddd640 1 -- 10.20.193.123:0/640170213 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f252012cad0 msgr2=0x7f2520091720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:33.771 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.772+0000 7f2525ddd640 1 --2- 10.20.193.123:0/640170213 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f252012cad0 0x7f2520091720 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2520096590 tx=0x7f251800b040 comp rx=0 tx=0).stop 2026-02-17T20:08:33.771 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.772+0000 7f2525ddd640 1 -- 10.20.193.123:0/640170213 shutdown_connections 2026-02-17T20:08:33.771 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.772+0000 7f2525ddd640 1 --2- 10.20.193.123:0/640170213 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f252012cad0 0x7f2520091720 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:33.771 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.772+0000 7f2525ddd640 1 --2- 10.20.193.123:0/640170213 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f252008ec70 0x7f252008d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:33.771 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.772+0000 7f2525ddd640 1 --2- 10.20.193.123:0/640170213 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f252008e360 0x7f252008d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:33.771 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.772+0000 7f2525ddd640 1 -- 10.20.193.123:0/640170213 >> 10.20.193.123:0/640170213 conn(0x7f2520096d30 msgr2=0x7f2520067c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:33.771 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.772+0000 7f2525ddd640 1 -- 10.20.193.123:0/640170213 shutdown_connections 2026-02-17T20:08:33.772 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.772+0000 7f2525ddd640 1 -- 10.20.193.123:0/640170213 wait complete. 2026-02-17T20:08:33.772 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.773+0000 7f12a23d4640 1 -- 10.20.193.123:0/41339758 >> v1:10.20.193.123:6800/23720 conn(0x7f128804d0d0 legacy=0x7f128804f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:33.772 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.773+0000 7f12a23d4640 1 -- 10.20.193.123:0/41339758 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f129c096a60 msgr2=0x7f129c11a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:33.772 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.773+0000 7f12a23d4640 1 --2- 10.20.193.123:0/41339758 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f129c096a60 0x7f129c11a0f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f128c03a040 tx=0x7f128c037000 comp rx=0 tx=0).stop 2026-02-17T20:08:33.772 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.773+0000 7f12a23d4640 1 -- 10.20.193.123:0/41339758 shutdown_connections 2026-02-17T20:08:33.772 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.773+0000 7f12a23d4640 1 --2- 10.20.193.123:0/41339758 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f129c12a560 0x7f129c11ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:33.772 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.773+0000 7f12a23d4640 1 --2- 10.20.193.123:0/41339758 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f129c097370 0x7f129c11a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:33.772 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.773+0000 7f12a23d4640 1 --2- 10.20.193.123:0/41339758 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f129c096a60 0x7f129c11a0f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:33.773 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.773+0000 7f12a23d4640 1 -- 10.20.193.123:0/41339758 >> 10.20.193.123:0/41339758 conn(0x7f129c09d950 msgr2=0x7f129c09b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:33.773 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.773+0000 7f12a23d4640 1 -- 10.20.193.123:0/41339758 shutdown_connections 2026-02-17T20:08:33.773 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.773+0000 7f12a23d4640 1 -- 10.20.193.123:0/41339758 wait complete. 2026-02-17T20:08:33.773 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.773+0000 7f04bb7bc640 1 -- 10.20.193.123:0/2764332818 >> v1:10.20.193.123:6800/23720 conn(0x7f049804d0d0 legacy=0x7f049804f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:33.773 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.773+0000 7f04bb7bc640 1 -- 10.20.193.123:0/2764332818 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f04b4096a60 msgr2=0x7f04b41be0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:33.773 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.773+0000 7f04bb7bc640 1 --2- 10.20.193.123:0/2764332818 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f04b4096a60 0x7f04b41be0b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f04b0009e50 tx=0x7f04b000b040 comp rx=0 tx=0).stop 2026-02-17T20:08:33.773 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.773+0000 7f04bb7bc640 1 -- 10.20.193.123:0/2764332818 shutdown_connections 2026-02-17T20:08:33.774 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.773+0000 7f04bb7bc640 1 --2- 10.20.193.123:0/2764332818 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f04b412a390 0x7f04b41beb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:33.774 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.773+0000 7f04bb7bc640 1 --2- 10.20.193.123:0/2764332818 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f04b4097370 0x7f04b41be5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:33.774 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.773+0000 7f04bb7bc640 1 --2- 10.20.193.123:0/2764332818 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f04b4096a60 0x7f04b41be0b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:33.774 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.773+0000 7f04bb7bc640 1 -- 10.20.193.123:0/2764332818 >> 10.20.193.123:0/2764332818 conn(0x7f04b409d950 msgr2=0x7f04b41147c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:33.774 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.773+0000 7f04bb7bc640 1 -- 10.20.193.123:0/2764332818 shutdown_connections 2026-02-17T20:08:33.774 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.773+0000 7f04bb7bc640 1 -- 10.20.193.123:0/2764332818 wait complete. 2026-02-17T20:08:33.778 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705667 for osd.2 2026-02-17T20:08:33.778 DEBUG:teuthology.parallel:result is None 2026-02-17T20:08:33.779 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705667 for osd.0 2026-02-17T20:08:33.779 DEBUG:teuthology.parallel:result is None 2026-02-17T20:08:33.780 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705666 got 38654705666 for osd.3 2026-02-17T20:08:33.780 DEBUG:teuthology.parallel:result is None 2026-02-17T20:08:33.806 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.809+0000 7f48fc49b640 1 -- 10.20.193.123:0/2620058351 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f48f40647b0 con 0x7f48f4096a60 2026-02-17T20:08:33.807 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.809+0000 7f48eaffd640 1 -- 10.20.193.123:0/2620058351 <== mon.0 v2:10.20.193.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f48f0018030 con 0x7f48f4096a60 2026-02-17T20:08:33.807 INFO:teuthology.orchestra.run.trial123.stdout:38654705666 2026-02-17T20:08:33.808 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.810+0000 7f48fc49b640 1 -- 10.20.193.123:0/2620058351 >> v1:10.20.193.123:6800/23720 conn(0x7f48d804d0d0 legacy=0x7f48d804f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:33.808 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.810+0000 7f48fc49b640 1 -- 10.20.193.123:0/2620058351 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f48f4096a60 msgr2=0x7f48f41be330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:33.808 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.810+0000 7f48fc49b640 1 --2- 10.20.193.123:0/2620058351 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f48f4096a60 0x7f48f41be330 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f48f000cb10 tx=0x7f48f0001ae0 comp rx=0 tx=0).stop 2026-02-17T20:08:33.808 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.810+0000 7f48fc49b640 1 -- 10.20.193.123:0/2620058351 shutdown_connections 2026-02-17T20:08:33.808 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.810+0000 7f48fc49b640 1 --2- 10.20.193.123:0/2620058351 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f48f412f6c0 0x7f48f41bedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:33.808 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.810+0000 7f48fc49b640 1 --2- 10.20.193.123:0/2620058351 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f48f4097540 0x7f48f41be870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:33.808 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.810+0000 7f48fc49b640 1 --2- 10.20.193.123:0/2620058351 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f48f4096a60 0x7f48f41be330 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:33.808 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.810+0000 7f48fc49b640 1 -- 10.20.193.123:0/2620058351 >> 10.20.193.123:0/2620058351 conn(0x7f48f409d950 msgr2=0x7f48f4115c20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:33.809 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.810+0000 7f48fc49b640 1 -- 10.20.193.123:0/2620058351 shutdown_connections 2026-02-17T20:08:33.809 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.810+0000 7f48fc49b640 1 -- 10.20.193.123:0/2620058351 wait complete. 2026-02-17T20:08:33.815 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705666 got 38654705666 for osd.1 2026-02-17T20:08:33.815 DEBUG:teuthology.parallel:result is None 2026-02-17T20:08:33.815 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-17T20:08:33.815 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T20:08:33.918 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.920+0000 7febf4988640 1 Processor -- start 2026-02-17T20:08:33.918 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.920+0000 7febf4988640 1 -- start start 2026-02-17T20:08:33.918 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.921+0000 7febf4988640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7febec06b9c0 0x7febec06bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:33.919 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.921+0000 7febf4988640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7febec06c2d0 0x7febec127c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:33.919 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.921+0000 7febf4988640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febec06e110 con 0x7febec1281a0 2026-02-17T20:08:33.919 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.921+0000 7febf4988640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febec06dde0 con 0x7febec06c2d0 2026-02-17T20:08:33.919 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.921+0000 7febf4988640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7febec06e360 con 0x7febec06b9c0 2026-02-17T20:08:33.919 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.921+0000 7febf2f25640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7febec1281a0 0x7febec12f170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:37380/0 (socket says 10.20.193.123:37380) 2026-02-17T20:08:33.919 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.921+0000 7febf2f25640 1 -- 10.20.193.123:0/2013505202 learned_addr learned my addr 10.20.193.123:0/2013505202 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:08:33.919 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.921+0000 7febf1f23640 1 --2- 10.20.193.123:0/2013505202 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7febec06c2d0 0x7febec127c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:33.919 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.921+0000 7febf2724640 1 --2- 10.20.193.123:0/2013505202 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7febec06b9c0 0x7febec06bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:33.919 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.921+0000 7febf1722640 1 -- 10.20.193.123:0/2013505202 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2483226698 0 0) 0x7febec06e110 con 0x7febec1281a0 2026-02-17T20:08:33.919 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.921+0000 7febf1722640 1 -- 10.20.193.123:0/2013505202 --> v1:10.20.193.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febd80034e0 con 0x7febec1281a0 2026-02-17T20:08:33.919 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.921+0000 7febf1f23640 1 -- 10.20.193.123:0/2013505202 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7febec06b9c0 msgr2=0x7febec06bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:08:33.919 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.921+0000 7febf1f23640 1 --2- 10.20.193.123:0/2013505202 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7febec06b9c0 0x7febec06bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:33.919 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.921+0000 7febf1f23640 1 -- 10.20.193.123:0/2013505202 >> v1:10.20.193.123:6789/0 conn(0x7febec1281a0 legacy=0x7febec12f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:33.919 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.921+0000 7febf1f23640 1 -- 10.20.193.123:0/2013505202 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febec097fd0 con 0x7febec06c2d0 2026-02-17T20:08:33.919 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.921+0000 7febf2724640 1 --2- 10.20.193.123:0/2013505202 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7febec06b9c0 0x7febec06bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:08:33.919 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.921+0000 7febf1f23640 1 --2- 10.20.193.123:0/2013505202 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7febec06c2d0 0x7febec127c60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7febe4009880 tx=0x7febe402ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7850cf9221d3ca7 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:33.919 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.921+0000 7febf1722640 1 -- 10.20.193.123:0/2013505202 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe402f890 con 0x7febec06c2d0 2026-02-17T20:08:33.920 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.921+0000 7febf1722640 1 -- 10.20.193.123:0/2013505202 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe402f9f0 con 0x7febec06c2d0 2026-02-17T20:08:33.920 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.921+0000 7febf1722640 1 -- 10.20.193.123:0/2013505202 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe402fd90 con 0x7febec06c2d0 2026-02-17T20:08:33.920 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.922+0000 7febf4988640 1 -- 10.20.193.123:0/2013505202 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7febec06c2d0 msgr2=0x7febec127c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:33.920 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.922+0000 7febf4988640 1 --2- 10.20.193.123:0/2013505202 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7febec06c2d0 0x7febec127c60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7febe4009880 tx=0x7febe402ed80 comp rx=0 tx=0).stop 2026-02-17T20:08:33.920 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.922+0000 7febf4988640 1 -- 10.20.193.123:0/2013505202 shutdown_connections 2026-02-17T20:08:33.920 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.922+0000 7febf4988640 1 --2- 10.20.193.123:0/2013505202 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7febec06c2d0 0x7febec127c60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:33.920 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.922+0000 7febf4988640 1 --2- 10.20.193.123:0/2013505202 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7febec06b9c0 0x7febec06bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:33.920 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.922+0000 7febf4988640 1 -- 10.20.193.123:0/2013505202 >> 10.20.193.123:0/2013505202 conn(0x7febec09b640 msgr2=0x7febec09ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:33.920 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.922+0000 7febf4988640 1 -- 10.20.193.123:0/2013505202 shutdown_connections 2026-02-17T20:08:33.920 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.922+0000 7febf4988640 1 -- 10.20.193.123:0/2013505202 wait complete. 2026-02-17T20:08:33.920 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.922+0000 7febf4988640 1 Processor -- start 2026-02-17T20:08:33.920 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.922+0000 7febf4988640 1 -- start start 2026-02-17T20:08:33.920 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.923+0000 7febf4988640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7febec06b9c0 0x7febec1be790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:33.920 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.923+0000 7febf4988640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7febec06c2d0 0x7febec1becd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:33.920 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.923+0000 7febf4988640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7febec1281a0 0x7febec068640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:33.920 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.923+0000 7febf4988640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febec125e00 con 0x7febec06c2d0 2026-02-17T20:08:33.920 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.923+0000 7febf4988640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febec120ae0 con 0x7febec1281a0 2026-02-17T20:08:33.921 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.923+0000 7febf4988640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7febec11fe70 con 0x7febec06b9c0 2026-02-17T20:08:33.921 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.923+0000 7febf2724640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7febec06b9c0 0x7febec1be790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:33.921 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.923+0000 7febf2724640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7febec06b9c0 0x7febec1be790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:45560/0 (socket says 10.20.193.123:45560) 2026-02-17T20:08:33.921 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.923+0000 7febf2724640 1 -- 10.20.193.123:0/1692149086 learned_addr learned my addr 10.20.193.123:0/1692149086 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:33.921 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.923+0000 7febf2f25640 1 --2- 10.20.193.123:0/1692149086 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7febec1281a0 0x7febec068640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:33.921 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.923+0000 7febf1f23640 1 --2- 10.20.193.123:0/1692149086 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7febec06c2d0 0x7febec1becd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:33.921 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.923+0000 7febf2724640 1 -- 10.20.193.123:0/1692149086 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7febec1281a0 msgr2=0x7febec068640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:33.921 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.923+0000 7febf2724640 1 --2- 10.20.193.123:0/1692149086 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7febec1281a0 0x7febec068640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:33.921 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.923+0000 7febf2724640 1 -- 10.20.193.123:0/1692149086 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7febec06c2d0 msgr2=0x7febec1becd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:33.921 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.923+0000 7febf2724640 1 --2- 10.20.193.123:0/1692149086 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7febec06c2d0 0x7febec1becd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:33.921 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.923+0000 7febf2724640 1 -- 10.20.193.123:0/1692149086 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe0009390 con 0x7febec06b9c0 2026-02-17T20:08:33.921 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.923+0000 7febf2724640 1 --2- 10.20.193.123:0/1692149086 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7febec06b9c0 0x7febec1be790 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7febe000ec80 tx=0x7febe00090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:33.921 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.923+0000 7febdeffd640 1 -- 10.20.193.123:0/1692149086 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe000cbd0 con 0x7febec06b9c0 2026-02-17T20:08:33.921 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.923+0000 7febdeffd640 1 -- 10.20.193.123:0/1692149086 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe000cd30 con 0x7febec06b9c0 2026-02-17T20:08:33.921 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.923+0000 7febf4988640 1 -- 10.20.193.123:0/1692149086 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febe4009390 con 0x7febec06b9c0 2026-02-17T20:08:33.921 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.923+0000 7febdeffd640 1 -- 10.20.193.123:0/1692149086 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe00136a0 con 0x7febec06b9c0 2026-02-17T20:08:33.921 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.923+0000 7febf4988640 1 -- 10.20.193.123:0/1692149086 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febec1bf210 con 0x7febec06b9c0 2026-02-17T20:08:33.921 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.923+0000 7febf4988640 1 -- 10.20.193.123:0/1692149086 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febec05f010 con 0x7febec06b9c0 2026-02-17T20:08:33.921 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.924+0000 7febdeffd640 1 -- 10.20.193.123:0/1692149086 <== mon.2 v2:10.20.193.123:3302/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7febe0013a10 con 0x7febec06b9c0 2026-02-17T20:08:33.922 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.924+0000 7febdeffd640 1 -- 10.20.193.123:0/1692149086 <== mon.2 v2:10.20.193.123:3302/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2834+0+0 (secure 0 0 0) 0x7febe0063d70 con 0x7febec06b9c0 2026-02-17T20:08:33.923 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.926+0000 7febdeffd640 1 -- 10.20.193.123:0/1692149086 <== mon.2 v2:10.20.193.123:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7febe003eb70 con 0x7febec06b9c0 2026-02-17T20:08:33.983 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.985+0000 7febf4988640 1 -- 10.20.193.123:0/1692149086 --> v1:10.20.193.123:6800/23720 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7febec064750 con 0x7febd004d0d0 2026-02-17T20:08:33.984 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.986+0000 7febdeffd640 1 -- 10.20.193.123:0/1692149086 <== mgr.4103 v1:10.20.193.123:6800/23720 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+34912 (unknown 2965378022 0 713853561) 0x7febec064750 con 0x7febd004d0d0 2026-02-17T20:08:33.984 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:08:33.986 INFO:teuthology.orchestra.run.trial123.stderr:dumped all 2026-02-17T20:08:33.986 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.987+0000 7febf4988640 1 -- 10.20.193.123:0/1692149086 >> v1:10.20.193.123:6800/23720 conn(0x7febd004d0d0 legacy=0x7febd004f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:33.986 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.987+0000 7febf4988640 1 -- 10.20.193.123:0/1692149086 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7febec06b9c0 msgr2=0x7febec1be790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:33.986 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.987+0000 7febf4988640 1 --2- 10.20.193.123:0/1692149086 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7febec06b9c0 0x7febec1be790 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7febe000ec80 tx=0x7febe00090f0 comp rx=0 tx=0).stop 2026-02-17T20:08:33.986 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.987+0000 7febf4988640 1 -- 10.20.193.123:0/1692149086 shutdown_connections 2026-02-17T20:08:33.986 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.987+0000 7febf4988640 1 --2- 10.20.193.123:0/1692149086 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7febec1281a0 0x7febec068640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:33.986 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.987+0000 7febf4988640 1 --2- 10.20.193.123:0/1692149086 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7febec06c2d0 0x7febec1becd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:33.987 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.987+0000 7febf4988640 1 --2- 10.20.193.123:0/1692149086 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7febec06b9c0 0x7febec1be790 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:33.987 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.987+0000 7febf4988640 1 -- 10.20.193.123:0/1692149086 >> 10.20.193.123:0/1692149086 conn(0x7febec09b640 msgr2=0x7febec126df0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:33.987 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.987+0000 7febf4988640 1 -- 10.20.193.123:0/1692149086 shutdown_connections 2026-02-17T20:08:33.987 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:33.987+0000 7febf4988640 1 -- 10.20.193.123:0/1692149086 wait complete. 2026-02-17T20:08:33.991 INFO:teuthology.orchestra.run.trial123.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2026-02-17T20:08:33.884798+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1208176,"kb_used_data":1608,"kb_used_omap":6,"kb_used_meta":1206009,"kb_avail":376279184,"statfs":{"total":386547056640,"available":385309884416,"internally_reserved":0,"allocated":1646592,"data_stored":1300566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6812,"internal_metadata":1234953572},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.738784"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":14,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T20:08:30.690298+0000","last_change":"2026-02-17T20:08:30.690429+0000","last_active":"2026-02-17T20:08:30.690298+0000","last_peered":"2026-02-17T20:08:30.690298+0000","last_clean":"2026-02-17T20:08:30.690298+0000","last_became_active":"2026-02-17T20:08:28.684753+0000","last_became_peered":"2026-02-17T20:08:28.684753+0000","last_unstale":"2026-02-17T20:08:30.690298+0000","last_undegraded":"2026-02-17T20:08:30.690298+0000","last_fullsized":"2026-02-17T20:08:30.690298+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:08:20.381745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026193599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.6","version":"0'0","reported_seq":14,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T20:08:30.690336+0000","last_change":"2026-02-17T20:08:30.690459+0000","last_active":"2026-02-17T20:08:30.690336+0000","last_peered":"2026-02-17T20:08:30.690336+0000","last_clean":"2026-02-17T20:08:30.690336+0000","last_became_active":"2026-02-17T20:08:28.686321+0000","last_became_peered":"2026-02-17T20:08:28.686321+0000","last_unstale":"2026-02-17T20:08:30.690336+0000","last_undegraded":"2026-02-17T20:08:30.690336+0000","last_fullsized":"2026-02-17T20:08:30.690336+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T00:54:43.830886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033416199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.5","version":"0'0","reported_seq":14,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T20:08:30.978678+0000","last_change":"2026-02-17T20:08:30.978866+0000","last_active":"2026-02-17T20:08:30.978678+0000","last_peered":"2026-02-17T20:08:30.978678+0000","last_clean":"2026-02-17T20:08:30.978678+0000","last_became_active":"2026-02-17T20:08:28.686233+0000","last_became_peered":"2026-02-17T20:08:28.686233+0000","last_unstale":"2026-02-17T20:08:30.978678+0000","last_undegraded":"2026-02-17T20:08:30.978678+0000","last_fullsized":"2026-02-17T20:08:30.978678+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T00:46:35.006943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026693600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.4","version":"0'0","reported_seq":14,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T20:08:30.690152+0000","last_change":"2026-02-17T20:08:30.690311+0000","last_active":"2026-02-17T20:08:30.690152+0000","last_peered":"2026-02-17T20:08:30.690152+0000","last_clean":"2026-02-17T20:08:30.690152+0000","last_became_active":"2026-02-17T20:08:28.686342+0000","last_became_peered":"2026-02-17T20:08:28.686342+0000","last_unstale":"2026-02-17T20:08:30.690152+0000","last_undegraded":"2026-02-17T20:08:30.690152+0000","last_fullsized":"2026-02-17T20:08:30.690152+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:08:20.381745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000242539,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"12'72","reported_seq":99,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T20:08:30.212802+0000","last_change":"2026-02-17T20:08:29.687945+0000","last_active":"2026-02-17T20:08:30.212802+0000","last_peered":"2026-02-17T20:08:30.212802+0000","last_clean":"2026-02-17T20:08:30.212802+0000","last_became_active":"2026-02-17T20:08:29.687535+0000","last_became_peered":"2026-02-17T20:08:29.687535+0000","last_unstale":"2026-02-17T20:08:30.212802+0000","last_undegraded":"2026-02-17T20:08:30.212802+0000","last_fullsized":"2026-02-17T20:08:30.212802+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:28.678564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:28.678564+0000","last_clean_scrub_stamp":"2026-02-17T20:08:28.678564+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:18:04.973223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"11'1","reported_seq":15,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T20:08:30.690228+0000","last_change":"2026-02-17T20:08:30.690362+0000","last_active":"2026-02-17T20:08:30.690228+0000","last_peered":"2026-02-17T20:08:30.690228+0000","last_clean":"2026-02-17T20:08:30.690228+0000","last_became_active":"2026-02-17T20:08:28.686114+0000","last_became_peered":"2026-02-17T20:08:28.686114+0000","last_unstale":"2026-02-17T20:08:30.690228+0000","last_undegraded":"2026-02-17T20:08:30.690228+0000","last_fullsized":"2026-02-17T20:08:30.690228+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T00:32:00.928743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000198235,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.2","version":"13'2","reported_seq":16,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T20:08:30.691919+0000","last_change":"2026-02-17T20:08:30.691919+0000","last_active":"2026-02-17T20:08:30.691919+0000","last_peered":"2026-02-17T20:08:30.691919+0000","last_clean":"2026-02-17T20:08:30.691919+0000","last_became_active":"2026-02-17T20:08:28.686207+0000","last_became_peered":"2026-02-17T20:08:28.686207+0000","last_unstale":"2026-02-17T20:08:30.691919+0000","last_undegraded":"2026-02-17T20:08:30.691919+0000","last_fullsized":"2026-02-17T20:08:30.691919+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T00:46:35.006943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059736000000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.1","version":"0'0","reported_seq":14,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T20:08:30.690174+0000","last_change":"2026-02-17T20:08:30.690309+0000","last_active":"2026-02-17T20:08:30.690174+0000","last_peered":"2026-02-17T20:08:30.690174+0000","last_clean":"2026-02-17T20:08:30.690174+0000","last_became_active":"2026-02-17T20:08:28.686245+0000","last_became_peered":"2026-02-17T20:08:28.686245+0000","last_unstale":"2026-02-17T20:08:30.690174+0000","last_undegraded":"2026-02-17T20:08:30.690174+0000","last_fullsized":"2026-02-17T20:08:30.690174+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T00:32:00.928743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00023917200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T20:08:30.690165+0000","last_change":"2026-02-17T20:08:30.690267+0000","last_active":"2026-02-17T20:08:30.690165+0000","last_peered":"2026-02-17T20:08:30.690165+0000","last_clean":"2026-02-17T20:08:30.690165+0000","last_became_active":"2026-02-17T20:08:28.686208+0000","last_became_peered":"2026-02-17T20:08:28.686208+0000","last_unstale":"2026-02-17T20:08:30.690165+0000","last_undegraded":"2026-02-17T20:08:30.690165+0000","last_fullsized":"2026-02-17T20:08:30.690165+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T00:54:43.830886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000175532,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705667,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302456,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069384,"statfs":{"total":96636764160,"available":96327049216,"internally_reserved":0,"allocated":708608,"data_stored":620605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1703,"internal_metadata":308738393},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.16}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.14899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.221}]}]},{"osd":2,"up_from":9,"seq":38654705668,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301628,"kb_used_data":108,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070212,"statfs":{"total":96636764160,"available":96327897088,"internally_reserved":0,"allocated":110592,"data_stored":29659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1703,"internal_metadata":308738393},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.108}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.13600000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302456,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069384,"statfs":{"total":96636764160,"available":96327049216,"internally_reserved":0,"allocated":708608,"data_stored":620046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1703,"internal_metadata":308738393},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301636,"kb_used_data":116,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070204,"statfs":{"total":96636764160,"available":96327888896,"internally_reserved":0,"allocated":118784,"data_stored":30256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1703,"internal_metadata":308738393},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.129}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.17000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T20:08:33.993 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T20:08:34.063 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.060+0000 7f68a39d4640 1 Processor -- start 2026-02-17T20:08:34.063 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.060+0000 7f68a39d4640 1 -- start start 2026-02-17T20:08:34.063 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.061+0000 7f68a39d4640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f689c096a60 0x7f689c096e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:34.064 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.061+0000 7f68a39d4640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f689c097370 0x7f689c129e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:34.064 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.061+0000 7f68a39d4640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f689c12a3a0 0x7f689c12a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:34.064 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.061+0000 7f68a39d4640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f689c097e40 con 0x7f689c097370 2026-02-17T20:08:34.064 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.061+0000 7f68a39d4640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f689c12ad60 con 0x7f689c096a60 2026-02-17T20:08:34.064 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.061+0000 7f68a39d4640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f689c09a430 con 0x7f689c12a3a0 2026-02-17T20:08:34.064 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.061+0000 7f68a1770640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f689c096a60 0x7f689c096e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:34.064 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.061+0000 7f68a0f6f640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f689c097370 0x7f689c129e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:34.064 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.061+0000 7f68a1770640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f689c096a60 0x7f689c096e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:57200/0 (socket says 10.20.193.123:57200) 2026-02-17T20:08:34.064 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.061+0000 7f68a1770640 1 -- 10.20.193.123:0/3441831818 learned_addr learned my addr 10.20.193.123:0/3441831818 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:34.065 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.061+0000 7f68a1f71640 1 --2- 10.20.193.123:0/3441831818 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f689c12a3a0 0x7f689c12a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:34.065 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.061+0000 7f68a1770640 1 -- 10.20.193.123:0/3441831818 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f689c12a3a0 msgr2=0x7f689c12a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:08:34.065 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.061+0000 7f68a1770640 1 --2- 10.20.193.123:0/3441831818 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f689c12a3a0 0x7f689c12a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:34.065 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.061+0000 7f68a1770640 1 -- 10.20.193.123:0/3441831818 >> v2:10.20.193.123:3300/0 conn(0x7f689c097370 msgr2=0x7f689c129e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:08:34.065 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.061+0000 7f68a1770640 1 --2- 10.20.193.123:0/3441831818 >> v2:10.20.193.123:3300/0 conn(0x7f689c097370 0x7f689c129e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:34.065 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.061+0000 7f68a1770640 1 -- 10.20.193.123:0/3441831818 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f689c09a680 con 0x7f689c096a60 2026-02-17T20:08:34.065 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.061+0000 7f68a0f6f640 1 --2- 10.20.193.123:0/3441831818 >> v2:10.20.193.123:3300/0 conn(0x7f689c097370 0x7f689c129e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:08:34.065 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.061+0000 7f68a1770640 1 --2- 10.20.193.123:0/3441831818 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f689c096a60 0x7f689c096e30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6898009940 tx=0x7f689802ee20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6e6a8cac70f226c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:34.065 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.062+0000 7f6893fff640 1 -- 10.20.193.123:0/3441831818 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689802f8f0 con 0x7f689c096a60 2026-02-17T20:08:34.065 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.062+0000 7f6893fff640 1 -- 10.20.193.123:0/3441831818 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f689802fa50 con 0x7f689c096a60 2026-02-17T20:08:34.065 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.062+0000 7f6893fff640 1 -- 10.20.193.123:0/3441831818 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689802fdf0 con 0x7f689c096a60 2026-02-17T20:08:34.066 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.062+0000 7f68a39d4640 1 -- 10.20.193.123:0/3441831818 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f689c096a60 msgr2=0x7f689c096e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:34.066 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.062+0000 7f68a39d4640 1 --2- 10.20.193.123:0/3441831818 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f689c096a60 0x7f689c096e30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6898009940 tx=0x7f689802ee20 comp rx=0 tx=0).stop 2026-02-17T20:08:34.066 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.062+0000 7f68a39d4640 1 -- 10.20.193.123:0/3441831818 shutdown_connections 2026-02-17T20:08:34.066 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.062+0000 7f68a39d4640 1 --2- 10.20.193.123:0/3441831818 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f689c12a3a0 0x7f689c12a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:34.066 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.062+0000 7f68a39d4640 1 --2- 10.20.193.123:0/3441831818 >> v2:10.20.193.123:3300/0 conn(0x7f689c097370 0x7f689c129e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:34.066 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.062+0000 7f68a39d4640 1 --2- 10.20.193.123:0/3441831818 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f689c096a60 0x7f689c096e30 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:34.066 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.062+0000 7f68a39d4640 1 -- 10.20.193.123:0/3441831818 >> 10.20.193.123:0/3441831818 conn(0x7f689c09d8d0 msgr2=0x7f689c09dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:34.066 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.062+0000 7f68a39d4640 1 -- 10.20.193.123:0/3441831818 shutdown_connections 2026-02-17T20:08:34.066 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.062+0000 7f68a39d4640 1 -- 10.20.193.123:0/3441831818 wait complete. 2026-02-17T20:08:34.066 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.062+0000 7f68a39d4640 1 Processor -- start 2026-02-17T20:08:34.067 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.063+0000 7f68a39d4640 1 -- start start 2026-02-17T20:08:34.067 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.063+0000 7f68a39d4640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f689c096a60 0x7f689c11aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:34.067 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.063+0000 7f68a39d4640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f689c097370 0x7f689c11af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:34.067 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.063+0000 7f68a39d4640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f689c12a3a0 0x7f689c11b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:34.067 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.063+0000 7f68a39d4640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689c11c5b0 con 0x7f689c096a60 2026-02-17T20:08:34.067 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.063+0000 7f68a39d4640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f689c11bab0 con 0x7f689c097370 2026-02-17T20:08:34.067 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.063+0000 7f68a39d4640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f689c11e190 con 0x7f689c12a3a0 2026-02-17T20:08:34.067 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.063+0000 7f68a1770640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f689c096a60 0x7f689c11aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:34.067 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.063+0000 7f68a1770640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f689c096a60 0x7f689c11aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:42182/0 (socket says 10.20.193.123:42182) 2026-02-17T20:08:34.067 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.063+0000 7f68a1770640 1 -- 10.20.193.123:0/3119701887 learned_addr learned my addr 10.20.193.123:0/3119701887 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:34.068 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.063+0000 7f68a0f6f640 1 --2- 10.20.193.123:0/3119701887 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f689c097370 0x7f689c11af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:34.068 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.063+0000 7f68a1f71640 1 --2- 10.20.193.123:0/3119701887 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f689c12a3a0 0x7f689c11b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:34.068 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.063+0000 7f68a1770640 1 -- 10.20.193.123:0/3119701887 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f689c12a3a0 msgr2=0x7f689c11b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:34.068 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.063+0000 7f68a1770640 1 --2- 10.20.193.123:0/3119701887 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f689c12a3a0 0x7f689c11b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:34.068 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.063+0000 7f68a1770640 1 -- 10.20.193.123:0/3119701887 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f689c097370 msgr2=0x7f689c11af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:34.068 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.063+0000 7f68a1770640 1 --2- 10.20.193.123:0/3119701887 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f689c097370 0x7f689c11af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:34.068 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.063+0000 7f68a1770640 1 -- 10.20.193.123:0/3119701887 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f688c009390 con 0x7f689c096a60 2026-02-17T20:08:34.068 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.063+0000 7f68a0f6f640 1 --2- 10.20.193.123:0/3119701887 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f689c097370 0x7f689c11af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:08:34.068 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.063+0000 7f68a1770640 1 --2- 10.20.193.123:0/3119701887 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f689c096a60 0x7f689c11aa00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f689803a040 tx=0x7f6898037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:34.068 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.063+0000 7f6891ffb640 1 -- 10.20.193.123:0/3119701887 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6898037d10 con 0x7f689c096a60 2026-02-17T20:08:34.068 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.063+0000 7f6891ffb640 1 -- 10.20.193.123:0/3119701887 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6898037e90 con 0x7f689c096a60 2026-02-17T20:08:34.069 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.063+0000 7f68a39d4640 1 -- 10.20.193.123:0/3119701887 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6898009450 con 0x7f689c096a60 2026-02-17T20:08:34.069 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.063+0000 7f6891ffb640 1 -- 10.20.193.123:0/3119701887 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6898042670 con 0x7f689c096a60 2026-02-17T20:08:34.069 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.063+0000 7f68a39d4640 1 -- 10.20.193.123:0/3119701887 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f689c11ceb0 con 0x7f689c096a60 2026-02-17T20:08:34.069 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.064+0000 7f68a39d4640 1 -- 10.20.193.123:0/3119701887 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f689c05f010 con 0x7f689c096a60 2026-02-17T20:08:34.069 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.064+0000 7f6891ffb640 1 -- 10.20.193.123:0/3119701887 <== mon.0 v2:10.20.193.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7f689803e040 con 0x7f689c096a60 2026-02-17T20:08:34.069 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.064+0000 7f6891ffb640 1 -- 10.20.193.123:0/3119701887 <== mon.0 v2:10.20.193.123:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2834+0+0 (secure 0 0 0) 0x7f6898087ef0 con 0x7f689c096a60 2026-02-17T20:08:34.070 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.066+0000 7f6891ffb640 1 -- 10.20.193.123:0/3119701887 <== mon.0 v2:10.20.193.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7f6898062ea0 con 0x7f689c096a60 2026-02-17T20:08:34.126 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.129+0000 7f68a39d4640 1 -- 10.20.193.123:0/3119701887 --> v1:10.20.193.123:6800/23720 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f689c11d650 con 0x7f688004d0d0 2026-02-17T20:08:34.127 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.129+0000 7f6891ffb640 1 -- 10.20.193.123:0/3119701887 <== mgr.4103 v1:10.20.193.123:6800/23720 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+34912 (unknown 2965378022 0 713853561) 0x7f689c11d650 con 0x7f688004d0d0 2026-02-17T20:08:34.128 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:08:34.129 INFO:teuthology.orchestra.run.trial123.stderr:dumped all 2026-02-17T20:08:34.129 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.130+0000 7f68a39d4640 1 -- 10.20.193.123:0/3119701887 >> v1:10.20.193.123:6800/23720 conn(0x7f688004d0d0 legacy=0x7f688004f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:34.129 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.130+0000 7f68a39d4640 1 -- 10.20.193.123:0/3119701887 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f689c096a60 msgr2=0x7f689c11aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:34.129 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.130+0000 7f68a39d4640 1 --2- 10.20.193.123:0/3119701887 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f689c096a60 0x7f689c11aa00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f689803a040 tx=0x7f6898037000 comp rx=0 tx=0).stop 2026-02-17T20:08:34.129 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.130+0000 7f68a39d4640 1 -- 10.20.193.123:0/3119701887 shutdown_connections 2026-02-17T20:08:34.130 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.130+0000 7f68a39d4640 1 --2- 10.20.193.123:0/3119701887 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f689c12a3a0 0x7f689c11b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:34.130 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.130+0000 7f68a39d4640 1 --2- 10.20.193.123:0/3119701887 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f689c097370 0x7f689c11af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:34.130 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.130+0000 7f68a39d4640 1 --2- 10.20.193.123:0/3119701887 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f689c096a60 0x7f689c11aa00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:34.130 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.130+0000 7f68a39d4640 1 -- 10.20.193.123:0/3119701887 >> 10.20.193.123:0/3119701887 conn(0x7f689c09d8d0 msgr2=0x7f689c1b1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:34.130 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.130+0000 7f68a39d4640 1 -- 10.20.193.123:0/3119701887 shutdown_connections 2026-02-17T20:08:34.130 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.130+0000 7f68a39d4640 1 -- 10.20.193.123:0/3119701887 wait complete. 2026-02-17T20:08:34.135 INFO:teuthology.orchestra.run.trial123.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2026-02-17T20:08:33.884798+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1208176,"kb_used_data":1608,"kb_used_omap":6,"kb_used_meta":1206009,"kb_avail":376279184,"statfs":{"total":386547056640,"available":385309884416,"internally_reserved":0,"allocated":1646592,"data_stored":1300566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6812,"internal_metadata":1234953572},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.738784"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":14,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T20:08:30.690298+0000","last_change":"2026-02-17T20:08:30.690429+0000","last_active":"2026-02-17T20:08:30.690298+0000","last_peered":"2026-02-17T20:08:30.690298+0000","last_clean":"2026-02-17T20:08:30.690298+0000","last_became_active":"2026-02-17T20:08:28.684753+0000","last_became_peered":"2026-02-17T20:08:28.684753+0000","last_unstale":"2026-02-17T20:08:30.690298+0000","last_undegraded":"2026-02-17T20:08:30.690298+0000","last_fullsized":"2026-02-17T20:08:30.690298+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:08:20.381745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026193599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.6","version":"0'0","reported_seq":14,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T20:08:30.690336+0000","last_change":"2026-02-17T20:08:30.690459+0000","last_active":"2026-02-17T20:08:30.690336+0000","last_peered":"2026-02-17T20:08:30.690336+0000","last_clean":"2026-02-17T20:08:30.690336+0000","last_became_active":"2026-02-17T20:08:28.686321+0000","last_became_peered":"2026-02-17T20:08:28.686321+0000","last_unstale":"2026-02-17T20:08:30.690336+0000","last_undegraded":"2026-02-17T20:08:30.690336+0000","last_fullsized":"2026-02-17T20:08:30.690336+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T00:54:43.830886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033416199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.5","version":"0'0","reported_seq":14,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T20:08:30.978678+0000","last_change":"2026-02-17T20:08:30.978866+0000","last_active":"2026-02-17T20:08:30.978678+0000","last_peered":"2026-02-17T20:08:30.978678+0000","last_clean":"2026-02-17T20:08:30.978678+0000","last_became_active":"2026-02-17T20:08:28.686233+0000","last_became_peered":"2026-02-17T20:08:28.686233+0000","last_unstale":"2026-02-17T20:08:30.978678+0000","last_undegraded":"2026-02-17T20:08:30.978678+0000","last_fullsized":"2026-02-17T20:08:30.978678+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T00:46:35.006943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026693600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.4","version":"0'0","reported_seq":14,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T20:08:30.690152+0000","last_change":"2026-02-17T20:08:30.690311+0000","last_active":"2026-02-17T20:08:30.690152+0000","last_peered":"2026-02-17T20:08:30.690152+0000","last_clean":"2026-02-17T20:08:30.690152+0000","last_became_active":"2026-02-17T20:08:28.686342+0000","last_became_peered":"2026-02-17T20:08:28.686342+0000","last_unstale":"2026-02-17T20:08:30.690152+0000","last_undegraded":"2026-02-17T20:08:30.690152+0000","last_fullsized":"2026-02-17T20:08:30.690152+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:08:20.381745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000242539,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"12'72","reported_seq":99,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T20:08:30.212802+0000","last_change":"2026-02-17T20:08:29.687945+0000","last_active":"2026-02-17T20:08:30.212802+0000","last_peered":"2026-02-17T20:08:30.212802+0000","last_clean":"2026-02-17T20:08:30.212802+0000","last_became_active":"2026-02-17T20:08:29.687535+0000","last_became_peered":"2026-02-17T20:08:29.687535+0000","last_unstale":"2026-02-17T20:08:30.212802+0000","last_undegraded":"2026-02-17T20:08:30.212802+0000","last_fullsized":"2026-02-17T20:08:30.212802+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:28.678564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:28.678564+0000","last_clean_scrub_stamp":"2026-02-17T20:08:28.678564+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:18:04.973223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"11'1","reported_seq":15,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T20:08:30.690228+0000","last_change":"2026-02-17T20:08:30.690362+0000","last_active":"2026-02-17T20:08:30.690228+0000","last_peered":"2026-02-17T20:08:30.690228+0000","last_clean":"2026-02-17T20:08:30.690228+0000","last_became_active":"2026-02-17T20:08:28.686114+0000","last_became_peered":"2026-02-17T20:08:28.686114+0000","last_unstale":"2026-02-17T20:08:30.690228+0000","last_undegraded":"2026-02-17T20:08:30.690228+0000","last_fullsized":"2026-02-17T20:08:30.690228+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T00:32:00.928743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000198235,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.2","version":"13'2","reported_seq":16,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T20:08:30.691919+0000","last_change":"2026-02-17T20:08:30.691919+0000","last_active":"2026-02-17T20:08:30.691919+0000","last_peered":"2026-02-17T20:08:30.691919+0000","last_clean":"2026-02-17T20:08:30.691919+0000","last_became_active":"2026-02-17T20:08:28.686207+0000","last_became_peered":"2026-02-17T20:08:28.686207+0000","last_unstale":"2026-02-17T20:08:30.691919+0000","last_undegraded":"2026-02-17T20:08:30.691919+0000","last_fullsized":"2026-02-17T20:08:30.691919+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T00:46:35.006943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059736000000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.1","version":"0'0","reported_seq":14,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T20:08:30.690174+0000","last_change":"2026-02-17T20:08:30.690309+0000","last_active":"2026-02-17T20:08:30.690174+0000","last_peered":"2026-02-17T20:08:30.690174+0000","last_clean":"2026-02-17T20:08:30.690174+0000","last_became_active":"2026-02-17T20:08:28.686245+0000","last_became_peered":"2026-02-17T20:08:28.686245+0000","last_unstale":"2026-02-17T20:08:30.690174+0000","last_undegraded":"2026-02-17T20:08:30.690174+0000","last_fullsized":"2026-02-17T20:08:30.690174+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T00:32:00.928743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00023917200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T20:08:30.690165+0000","last_change":"2026-02-17T20:08:30.690267+0000","last_active":"2026-02-17T20:08:30.690165+0000","last_peered":"2026-02-17T20:08:30.690165+0000","last_clean":"2026-02-17T20:08:30.690165+0000","last_became_active":"2026-02-17T20:08:28.686208+0000","last_became_peered":"2026-02-17T20:08:28.686208+0000","last_unstale":"2026-02-17T20:08:30.690165+0000","last_undegraded":"2026-02-17T20:08:30.690165+0000","last_fullsized":"2026-02-17T20:08:30.690165+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T00:54:43.830886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000175532,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705667,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302456,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069384,"statfs":{"total":96636764160,"available":96327049216,"internally_reserved":0,"allocated":708608,"data_stored":620605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1703,"internal_metadata":308738393},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.16}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.14899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.221}]}]},{"osd":2,"up_from":9,"seq":38654705668,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301628,"kb_used_data":108,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070212,"statfs":{"total":96636764160,"available":96327897088,"internally_reserved":0,"allocated":110592,"data_stored":29659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1703,"internal_metadata":308738393},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.108}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.13600000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302456,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069384,"statfs":{"total":96636764160,"available":96327049216,"internally_reserved":0,"allocated":708608,"data_stored":620046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1703,"internal_metadata":308738393},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301636,"kb_used_data":116,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070204,"statfs":{"total":96636764160,"available":96327888896,"internally_reserved":0,"allocated":118784,"data_stored":30256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1703,"internal_metadata":308738393},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.129}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.17000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T20:08:34.137 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-17T20:08:34.137 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-17T20:08:34.137 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-17T20:08:34.137 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T20:08:34.204 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.202+0000 7f04845d4640 1 Processor -- start 2026-02-17T20:08:34.204 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.202+0000 7f04845d4640 1 -- start start 2026-02-17T20:08:34.204 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.202+0000 7f04845d4640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f047c097540 0x7f047c12f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:34.204 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.202+0000 7f04845d4640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f047c12f6c0 0x7f047c131aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:34.205 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.202+0000 7f04845d4640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f047c099240 con 0x7f047c096a60 2026-02-17T20:08:34.205 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.202+0000 7f04845d4640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f047c099470 con 0x7f047c12f6c0 2026-02-17T20:08:34.205 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.202+0000 7f04845d4640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f047c097910 con 0x7f047c097540 2026-02-17T20:08:34.205 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.202+0000 7f0482370640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7f047c096a60 0x7f047c096e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:37390/0 (socket says 10.20.193.123:37390) 2026-02-17T20:08:34.205 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.202+0000 7f0481b6f640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f047c097540 0x7f047c12f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:34.205 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.202+0000 7f0482370640 1 -- 10.20.193.123:0/431384768 learned_addr learned my addr 10.20.193.123:0/431384768 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:08:34.205 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.202+0000 7f0482b71640 1 --2- 10.20.193.123:0/431384768 >> v2:10.20.193.123:3300/0 conn(0x7f047c12f6c0 0x7f047c131aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:34.205 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.203+0000 7f0481b6f640 1 -- 10.20.193.123:0/431384768 >> v2:10.20.193.123:3300/0 conn(0x7f047c12f6c0 msgr2=0x7f047c131aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:08:34.205 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.203+0000 7f0481b6f640 1 --2- 10.20.193.123:0/431384768 >> v2:10.20.193.123:3300/0 conn(0x7f047c12f6c0 0x7f047c131aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:34.205 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.203+0000 7f0481b6f640 1 -- 10.20.193.123:0/431384768 >> v1:10.20.193.123:6789/0 conn(0x7f047c096a60 legacy=0x7f047c096e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:34.205 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.203+0000 7f0481b6f640 1 -- 10.20.193.123:0/431384768 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f047c09a2d0 con 0x7f047c097540 2026-02-17T20:08:34.206 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.203+0000 7f0481b6f640 1 --2- 10.20.193.123:0/431384768 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f047c097540 0x7f047c12f180 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f046c009880 tx=0x7f046c02ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9be66c677a16b7e0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:34.206 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.203+0000 7f048136e640 1 -- 10.20.193.123:0/431384768 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046c02f8a0 con 0x7f047c097540 2026-02-17T20:08:34.206 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.203+0000 7f048136e640 1 -- 10.20.193.123:0/431384768 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f046c02fa00 con 0x7f047c097540 2026-02-17T20:08:34.206 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.203+0000 7f048136e640 1 -- 10.20.193.123:0/431384768 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046c02fda0 con 0x7f047c097540 2026-02-17T20:08:34.206 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.203+0000 7f04845d4640 1 -- 10.20.193.123:0/431384768 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f047c097540 msgr2=0x7f047c12f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:34.206 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.203+0000 7f04845d4640 1 --2- 10.20.193.123:0/431384768 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f047c097540 0x7f047c12f180 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f046c009880 tx=0x7f046c02ed80 comp rx=0 tx=0).stop 2026-02-17T20:08:34.206 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.203+0000 7f04845d4640 1 -- 10.20.193.123:0/431384768 shutdown_connections 2026-02-17T20:08:34.206 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.203+0000 7f04845d4640 1 --2- 10.20.193.123:0/431384768 >> v2:10.20.193.123:3300/0 conn(0x7f047c12f6c0 0x7f047c131aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:34.206 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.203+0000 7f04845d4640 1 --2- 10.20.193.123:0/431384768 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f047c097540 0x7f047c12f180 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:34.206 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.203+0000 7f04845d4640 1 -- 10.20.193.123:0/431384768 >> 10.20.193.123:0/431384768 conn(0x7f047c09d920 msgr2=0x7f047c09dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:34.207 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.203+0000 7f04845d4640 1 -- 10.20.193.123:0/431384768 shutdown_connections 2026-02-17T20:08:34.207 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.203+0000 7f04845d4640 1 -- 10.20.193.123:0/431384768 wait complete. 2026-02-17T20:08:34.207 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.204+0000 7f04845d4640 1 Processor -- start 2026-02-17T20:08:34.207 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.204+0000 7f04845d4640 1 -- start start 2026-02-17T20:08:34.207 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.204+0000 7f04845d4640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f047c096a60 0x7f047c1173d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:34.207 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.204+0000 7f04845d4640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f047c097540 0x7f047c117910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:34.207 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.204+0000 7f04845d4640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f047c12f6c0 0x7f047c117e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:34.207 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.204+0000 7f04845d4640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f047c11a000 con 0x7f047c096a60 2026-02-17T20:08:34.207 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.204+0000 7f04845d4640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f047c118eb0 con 0x7f047c097540 2026-02-17T20:08:34.207 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.204+0000 7f04845d4640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f047c11abb0 con 0x7f047c12f6c0 2026-02-17T20:08:34.207 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.204+0000 7f0482370640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f047c096a60 0x7f047c1173d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:34.208 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.204+0000 7f0481b6f640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f047c097540 0x7f047c117910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:34.208 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.204+0000 7f0481b6f640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f047c097540 0x7f047c117910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:57232/0 (socket says 10.20.193.123:57232) 2026-02-17T20:08:34.208 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.204+0000 7f0482370640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f047c096a60 0x7f047c1173d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:42210/0 (socket says 10.20.193.123:42210) 2026-02-17T20:08:34.208 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.204+0000 7f0481b6f640 1 -- 10.20.193.123:0/125877842 learned_addr learned my addr 10.20.193.123:0/125877842 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:34.208 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.204+0000 7f0482b71640 1 --2- 10.20.193.123:0/125877842 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f047c12f6c0 0x7f047c117e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:34.208 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.204+0000 7f0481b6f640 1 -- 10.20.193.123:0/125877842 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f047c12f6c0 msgr2=0x7f047c117e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:34.208 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.204+0000 7f0481b6f640 1 --2- 10.20.193.123:0/125877842 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f047c12f6c0 0x7f047c117e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:34.208 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.204+0000 7f0481b6f640 1 -- 10.20.193.123:0/125877842 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f047c096a60 msgr2=0x7f047c1173d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:34.208 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.204+0000 7f0481b6f640 1 --2- 10.20.193.123:0/125877842 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f047c096a60 0x7f047c1173d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:34.208 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.204+0000 7f0481b6f640 1 -- 10.20.193.123:0/125877842 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f046c009390 con 0x7f047c097540 2026-02-17T20:08:34.209 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.204+0000 7f0481b6f640 1 --2- 10.20.193.123:0/125877842 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f047c097540 0x7f047c117910 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f046c009360 tx=0x7f046c037000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:34.209 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.204+0000 7f0472ffd640 1 -- 10.20.193.123:0/125877842 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046c037e60 con 0x7f047c097540 2026-02-17T20:08:34.209 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.204+0000 7f0472ffd640 1 -- 10.20.193.123:0/125877842 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f046c042440 con 0x7f047c097540 2026-02-17T20:08:34.209 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.204+0000 7f04845d4640 1 -- 10.20.193.123:0/125877842 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f047c11a7e0 con 0x7f047c097540 2026-02-17T20:08:34.209 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.204+0000 7f0472ffd640 1 -- 10.20.193.123:0/125877842 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046c042800 con 0x7f047c097540 2026-02-17T20:08:34.209 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.204+0000 7f04845d4640 1 -- 10.20.193.123:0/125877842 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f047c129da0 con 0x7f047c097540 2026-02-17T20:08:34.209 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.205+0000 7f04845d4640 1 -- 10.20.193.123:0/125877842 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f047c05f010 con 0x7f047c097540 2026-02-17T20:08:34.209 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.205+0000 7f0472ffd640 1 -- 10.20.193.123:0/125877842 <== mon.1 v2:10.20.193.123:3301/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7f046c03e040 con 0x7f047c097540 2026-02-17T20:08:34.209 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.205+0000 7f0472ffd640 1 -- 10.20.193.123:0/125877842 <== mon.1 v2:10.20.193.123:3301/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2834+0+0 (secure 0 0 0) 0x7f046c087d30 con 0x7f047c097540 2026-02-17T20:08:34.210 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.207+0000 7f0472ffd640 1 -- 10.20.193.123:0/125877842 <== mon.1 v2:10.20.193.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7f046c062ce0 con 0x7f047c097540 2026-02-17T20:08:34.277 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.279+0000 7f04845d4640 1 -- 10.20.193.123:0/125877842 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f047c063d50 con 0x7f047c097540 2026-02-17T20:08:34.278 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.279+0000 7f0472ffd640 1 -- 10.20.193.123:0/125877842 <== mon.1 v2:10.20.193.123:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f046c047080 con 0x7f047c097540 2026-02-17T20:08:34.278 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:08:34.278 INFO:teuthology.orchestra.run.trial123.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-17T20:08:34.279 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.280+0000 7f04845d4640 1 -- 10.20.193.123:0/125877842 >> v1:10.20.193.123:6800/23720 conn(0x7f046004d0d0 legacy=0x7f046004f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:34.280 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.280+0000 7f04845d4640 1 -- 10.20.193.123:0/125877842 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f047c097540 msgr2=0x7f047c117910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:34.280 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.280+0000 7f04845d4640 1 --2- 10.20.193.123:0/125877842 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f047c097540 0x7f047c117910 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f046c009360 tx=0x7f046c037000 comp rx=0 tx=0).stop 2026-02-17T20:08:34.280 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.280+0000 7f04845d4640 1 -- 10.20.193.123:0/125877842 shutdown_connections 2026-02-17T20:08:34.280 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.280+0000 7f04845d4640 1 --2- 10.20.193.123:0/125877842 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f047c12f6c0 0x7f047c117e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:34.280 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.280+0000 7f04845d4640 1 --2- 10.20.193.123:0/125877842 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f047c097540 0x7f047c117910 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:34.280 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.280+0000 7f04845d4640 1 --2- 10.20.193.123:0/125877842 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f047c096a60 0x7f047c1173d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:34.280 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.280+0000 7f04845d4640 1 -- 10.20.193.123:0/125877842 >> 10.20.193.123:0/125877842 conn(0x7f047c09d920 msgr2=0x7f047c131460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:34.280 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.280+0000 7f04845d4640 1 -- 10.20.193.123:0/125877842 shutdown_connections 2026-02-17T20:08:34.280 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.280+0000 7f04845d4640 1 -- 10.20.193.123:0/125877842 wait complete. 2026-02-17T20:08:34.286 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-17T20:08:34.286 INFO:teuthology.run_tasks:Running task exec... 2026-02-17T20:08:34.303 INFO:teuthology.task.exec:Executing custom commands... 2026-02-17T20:08:34.304 INFO:teuthology.task.exec:Running commands on role osd.0 host ubuntu@trial123.front.sepia.ceph.com 2026-02-17T20:08:34.304 DEBUG:teuthology.orchestra.run.trial123:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd set-require-min-compat-client quincy' 2026-02-17T20:08:34.366 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.367+0000 7fae70203640 1 Processor -- start 2026-02-17T20:08:34.366 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.367+0000 7fae70203640 1 -- start start 2026-02-17T20:08:34.366 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.368+0000 7fae70203640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fae6812abc0 0x7fae6812f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:34.366 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.368+0000 7fae70203640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fae6812fae0 0x7fae68131ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:34.366 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.368+0000 7fae70203640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae68069e40 con 0x7fae6812a0e0 2026-02-17T20:08:34.366 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.368+0000 7fae70203640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae6809a4d0 con 0x7fae6812fae0 2026-02-17T20:08:34.366 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.368+0000 7fae70203640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae6809a910 con 0x7fae6812abc0 2026-02-17T20:08:34.366 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.368+0000 7fae6df9f640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7fae6812a0e0 0x7fae6812a4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:37406/0 (socket says 10.20.193.123:37406) 2026-02-17T20:08:34.366 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.368+0000 7fae6df9f640 1 -- 10.20.193.123:0/2800675196 learned_addr learned my addr 10.20.193.123:0/2800675196 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:08:34.366 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.368+0000 7fae6d79e640 1 --2- 10.20.193.123:0/2800675196 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fae6812abc0 0x7fae6812f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:34.366 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.368+0000 7fae6e7a0640 1 --2- 10.20.193.123:0/2800675196 >> v2:10.20.193.123:3300/0 conn(0x7fae6812fae0 0x7fae68131ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:34.367 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.368+0000 7fae6cf9d640 1 -- 10.20.193.123:0/2800675196 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3227159187 0 0) 0x7fae68069e40 con 0x7fae6812a0e0 2026-02-17T20:08:34.367 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.368+0000 7fae6cf9d640 1 -- 10.20.193.123:0/2800675196 --> v1:10.20.193.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae540034e0 con 0x7fae6812a0e0 2026-02-17T20:08:34.367 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.368+0000 7fae6d79e640 1 -- 10.20.193.123:0/2800675196 >> v2:10.20.193.123:3300/0 conn(0x7fae6812fae0 msgr2=0x7fae68131ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:08:34.367 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.368+0000 7fae6d79e640 1 --2- 10.20.193.123:0/2800675196 >> v2:10.20.193.123:3300/0 conn(0x7fae6812fae0 0x7fae68131ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:34.367 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.368+0000 7fae6d79e640 1 -- 10.20.193.123:0/2800675196 >> v1:10.20.193.123:6789/0 conn(0x7fae6812a0e0 legacy=0x7fae6812a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:34.367 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.368+0000 7fae6d79e640 1 -- 10.20.193.123:0/2800675196 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae68097cb0 con 0x7fae6812abc0 2026-02-17T20:08:34.368 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.369+0000 7fae6d79e640 1 --2- 10.20.193.123:0/2800675196 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fae6812abc0 0x7fae6812f5a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fae58009850 tx=0x7fae5802ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64562faa1b4f744e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:34.369 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.369+0000 7fae6cf9d640 1 -- 10.20.193.123:0/2800675196 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5802f8b0 con 0x7fae6812abc0 2026-02-17T20:08:34.369 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.369+0000 7fae6cf9d640 1 -- 10.20.193.123:0/2800675196 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae5802fa10 con 0x7fae6812abc0 2026-02-17T20:08:34.369 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.369+0000 7fae6cf9d640 1 -- 10.20.193.123:0/2800675196 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5802fd90 con 0x7fae6812abc0 2026-02-17T20:08:34.369 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.369+0000 7fae70203640 1 -- 10.20.193.123:0/2800675196 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fae6812abc0 msgr2=0x7fae6812f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:34.369 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.369+0000 7fae70203640 1 --2- 10.20.193.123:0/2800675196 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fae6812abc0 0x7fae6812f5a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fae58009850 tx=0x7fae5802ed50 comp rx=0 tx=0).stop 2026-02-17T20:08:34.369 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.369+0000 7fae70203640 1 -- 10.20.193.123:0/2800675196 shutdown_connections 2026-02-17T20:08:34.369 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.369+0000 7fae70203640 1 --2- 10.20.193.123:0/2800675196 >> v2:10.20.193.123:3300/0 conn(0x7fae6812fae0 0x7fae68131ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:34.369 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.369+0000 7fae70203640 1 --2- 10.20.193.123:0/2800675196 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fae6812abc0 0x7fae6812f5a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:34.369 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.369+0000 7fae70203640 1 -- 10.20.193.123:0/2800675196 >> 10.20.193.123:0/2800675196 conn(0x7fae6809e300 msgr2=0x7fae68068c00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:34.369 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.369+0000 7fae70203640 1 -- 10.20.193.123:0/2800675196 shutdown_connections 2026-02-17T20:08:34.369 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.369+0000 7fae70203640 1 -- 10.20.193.123:0/2800675196 wait complete. 2026-02-17T20:08:34.369 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.369+0000 7fae70203640 1 Processor -- start 2026-02-17T20:08:34.369 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.369+0000 7fae70203640 1 -- start start 2026-02-17T20:08:34.369 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.370+0000 7fae70203640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fae6812a0e0 0x7fae68114690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:34.369 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.370+0000 7fae70203640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fae6812abc0 0x7fae68114bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:34.369 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.370+0000 7fae70203640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fae6812fae0 0x7fae68115110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:34.369 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.370+0000 7fae70203640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae68117610 con 0x7fae6812a0e0 2026-02-17T20:08:34.369 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.370+0000 7fae70203640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae68117bd0 con 0x7fae6812fae0 2026-02-17T20:08:34.369 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.370+0000 7fae70203640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae6812ee00 con 0x7fae6812abc0 2026-02-17T20:08:34.370 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.370+0000 7fae6df9f640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fae6812a0e0 0x7fae68114690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:34.370 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.370+0000 7fae6e7a0640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fae6812fae0 0x7fae68115110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:34.370 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.370+0000 7fae6df9f640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fae6812a0e0 0x7fae68114690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:42232/0 (socket says 10.20.193.123:42232) 2026-02-17T20:08:34.370 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.370+0000 7fae6df9f640 1 -- 10.20.193.123:0/3372412336 learned_addr learned my addr 10.20.193.123:0/3372412336 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:34.370 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.370+0000 7fae6d79e640 1 --2- 10.20.193.123:0/3372412336 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fae6812abc0 0x7fae68114bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:34.370 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.370+0000 7fae6df9f640 1 -- 10.20.193.123:0/3372412336 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fae6812abc0 msgr2=0x7fae68114bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:34.370 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.370+0000 7fae6df9f640 1 --2- 10.20.193.123:0/3372412336 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fae6812abc0 0x7fae68114bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:34.370 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.370+0000 7fae6df9f640 1 -- 10.20.193.123:0/3372412336 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fae6812fae0 msgr2=0x7fae68115110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:34.370 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.370+0000 7fae6df9f640 1 --2- 10.20.193.123:0/3372412336 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fae6812fae0 0x7fae68115110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:34.370 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.370+0000 7fae6df9f640 1 -- 10.20.193.123:0/3372412336 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae58009390 con 0x7fae6812a0e0 2026-02-17T20:08:34.370 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.370+0000 7fae6df9f640 1 --2- 10.20.193.123:0/3372412336 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fae6812a0e0 0x7fae68114690 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fae6400c7c0 tx=0x7fae64007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:34.370 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.370+0000 7fae5e7fc640 1 -- 10.20.193.123:0/3372412336 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae64005870 con 0x7fae6812a0e0 2026-02-17T20:08:34.370 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.370+0000 7fae5e7fc640 1 -- 10.20.193.123:0/3372412336 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae640059d0 con 0x7fae6812a0e0 2026-02-17T20:08:34.370 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.370+0000 7fae70203640 1 -- 10.20.193.123:0/3372412336 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae68117e70 con 0x7fae6812a0e0 2026-02-17T20:08:34.370 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.370+0000 7fae5e7fc640 1 -- 10.20.193.123:0/3372412336 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae64005d90 con 0x7fae6812a0e0 2026-02-17T20:08:34.370 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.370+0000 7fae70203640 1 -- 10.20.193.123:0/3372412336 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae68115650 con 0x7fae6812a0e0 2026-02-17T20:08:34.370 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.371+0000 7fae70203640 1 -- 10.20.193.123:0/3372412336 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae68065950 con 0x7fae6812a0e0 2026-02-17T20:08:34.370 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.371+0000 7fae5e7fc640 1 -- 10.20.193.123:0/3372412336 <== mon.0 v2:10.20.193.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7fae64007300 con 0x7fae6812a0e0 2026-02-17T20:08:34.371 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.371+0000 7fae5e7fc640 1 -- 10.20.193.123:0/3372412336 <== mon.0 v2:10.20.193.123:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2834+0+0 (secure 0 0 0) 0x7fae640632f0 con 0x7fae6812a0e0 2026-02-17T20:08:34.371 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.373+0000 7fae5e7fc640 1 -- 10.20.193.123:0/3372412336 <== mon.0 v2:10.20.193.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7fae68065950 con 0x7fae6812a0e0 2026-02-17T20:08:34.438 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.440+0000 7fae70203640 1 -- 10.20.193.123:0/3372412336 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "osd set-require-min-compat-client", "version": "quincy"} v 0) v1 -- 0x7fae68065950 con 0x7fae6812a0e0 2026-02-17T20:08:34.884 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.886+0000 7fae5e7fc640 1 -- 10.20.193.123:0/3372412336 <== mon.0 v2:10.20.193.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd set-require-min-compat-client", "version": "quincy"}]=0 set require_min_compat_client to quincy v15) v1 ==== 141+0+0 (secure 0 0 0) 0x7fae68065950 con 0x7fae6812a0e0 2026-02-17T20:08:34.884 INFO:teuthology.orchestra.run.trial123.stderr:set require_min_compat_client to quincy 2026-02-17T20:08:34.888 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.890+0000 7fae70203640 1 -- 10.20.193.123:0/3372412336 >> v1:10.20.193.123:6800/23720 conn(0x7fae4c04d0d0 legacy=0x7fae4c04f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:34.888 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.890+0000 7fae70203640 1 -- 10.20.193.123:0/3372412336 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fae6812a0e0 msgr2=0x7fae68114690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:34.888 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.890+0000 7fae70203640 1 --2- 10.20.193.123:0/3372412336 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fae6812a0e0 0x7fae68114690 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fae6400c7c0 tx=0x7fae64007d60 comp rx=0 tx=0).stop 2026-02-17T20:08:34.888 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.890+0000 7fae70203640 1 -- 10.20.193.123:0/3372412336 shutdown_connections 2026-02-17T20:08:34.888 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.890+0000 7fae70203640 1 --2- 10.20.193.123:0/3372412336 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fae6812fae0 0x7fae68115110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:34.888 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.890+0000 7fae70203640 1 --2- 10.20.193.123:0/3372412336 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fae6812abc0 0x7fae68114bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:34.888 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.890+0000 7fae70203640 1 --2- 10.20.193.123:0/3372412336 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fae6812a0e0 0x7fae68114690 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:34.888 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.890+0000 7fae70203640 1 -- 10.20.193.123:0/3372412336 >> 10.20.193.123:0/3372412336 conn(0x7fae6809e300 msgr2=0x7fae68127390 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:34.888 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.890+0000 7fae70203640 1 -- 10.20.193.123:0/3372412336 shutdown_connections 2026-02-17T20:08:34.888 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.890+0000 7fae70203640 1 -- 10.20.193.123:0/3372412336 wait complete. 2026-02-17T20:08:34.896 INFO:teuthology.run_tasks:Running task print... 2026-02-17T20:08:34.908 INFO:teuthology.task.print:**** done ceph 2026-02-17T20:08:34.908 INFO:teuthology.run_tasks:Running task print... 2026-02-17T20:08:34.921 INFO:teuthology.task.print:*** upgrading, no cephfs present 2026-02-17T20:08:34.921 INFO:teuthology.run_tasks:Running task exec... 2026-02-17T20:08:34.933 INFO:teuthology.task.exec:Executing custom commands... 2026-02-17T20:08:34.933 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@trial123.front.sepia.ceph.com 2026-02-17T20:08:34.933 DEBUG:teuthology.orchestra.run.trial123:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs dump' 2026-02-17T20:08:35.001 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.998+0000 7f06800c7640 1 Processor -- start 2026-02-17T20:08:35.001 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.998+0000 7f06800c7640 1 -- start start 2026-02-17T20:08:35.001 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.999+0000 7f06800c7640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f06780974f0 0x7f06781282f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:35.001 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.999+0000 7f06800c7640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f067805e500 0x7f06781300e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:35.001 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.999+0000 7f06800c7640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f067806e950 con 0x7f0678128830 2026-02-17T20:08:35.001 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.999+0000 7f06800c7640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0678127ec0 con 0x7f067805e500 2026-02-17T20:08:35.002 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.999+0000 7f06800c7640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f067806e670 con 0x7f06780974f0 2026-02-17T20:08:35.002 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.999+0000 7f067de63640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f06780974f0 0x7f06781282f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:35.002 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.999+0000 7f067e664640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f067805e500 0x7f06781300e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:35.002 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.999+0000 7f067d662640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7f0678128830 0x7f067805ddf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:37410/0 (socket says 10.20.193.123:37410) 2026-02-17T20:08:35.002 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.999+0000 7f067de63640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f06780974f0 0x7f06781282f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:57252/0 (socket says 10.20.193.123:57252) 2026-02-17T20:08:35.002 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.999+0000 7f067d662640 1 -- 10.20.193.123:0/2973374842 learned_addr learned my addr 10.20.193.123:0/2973374842 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:08:35.002 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.999+0000 7f067ce61640 1 -- 10.20.193.123:0/2973374842 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3844700890 0 0) 0x7f067806e950 con 0x7f0678128830 2026-02-17T20:08:35.002 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.999+0000 7f067ce61640 1 -- 10.20.193.123:0/2973374842 --> v1:10.20.193.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06640034e0 con 0x7f0678128830 2026-02-17T20:08:35.002 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.999+0000 7f067de63640 1 -- 10.20.193.123:0/2973374842 >> v2:10.20.193.123:3300/0 conn(0x7f067805e500 msgr2=0x7f06781300e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:08:35.002 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.999+0000 7f067de63640 1 --2- 10.20.193.123:0/2973374842 >> v2:10.20.193.123:3300/0 conn(0x7f067805e500 0x7f06781300e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:35.002 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.999+0000 7f067de63640 1 -- 10.20.193.123:0/2973374842 >> v1:10.20.193.123:6789/0 conn(0x7f0678128830 legacy=0x7f067805ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:35.002 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.999+0000 7f067de63640 1 -- 10.20.193.123:0/2973374842 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0678128c00 con 0x7f06780974f0 2026-02-17T20:08:35.003 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.999+0000 7f067de63640 1 --2- 10.20.193.123:0/2973374842 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f06780974f0 0x7f06781282f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0674009850 tx=0x7f067402ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5a70db4de500ac8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:35.003 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.999+0000 7f067ce61640 1 -- 10.20.193.123:0/2973374842 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067402f8b0 con 0x7f06780974f0 2026-02-17T20:08:35.003 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.999+0000 7f067ce61640 1 -- 10.20.193.123:0/2973374842 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f067402fa10 con 0x7f06780974f0 2026-02-17T20:08:35.003 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:34.999+0000 7f067ce61640 1 -- 10.20.193.123:0/2973374842 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067402fdb0 con 0x7f06780974f0 2026-02-17T20:08:35.003 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:35.000+0000 7f06800c7640 1 -- 10.20.193.123:0/2973374842 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f06780974f0 msgr2=0x7f06781282f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:35.003 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:35.000+0000 7f06800c7640 1 --2- 10.20.193.123:0/2973374842 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f06780974f0 0x7f06781282f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0674009850 tx=0x7f067402ed50 comp rx=0 tx=0).stop 2026-02-17T20:08:35.003 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:35.000+0000 7f06800c7640 1 -- 10.20.193.123:0/2973374842 shutdown_connections 2026-02-17T20:08:35.003 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:35.000+0000 7f06800c7640 1 --2- 10.20.193.123:0/2973374842 >> v2:10.20.193.123:3300/0 conn(0x7f067805e500 0x7f06781300e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:35.003 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:35.000+0000 7f06800c7640 1 --2- 10.20.193.123:0/2973374842 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f06780974f0 0x7f06781282f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:35.003 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:35.000+0000 7f06800c7640 1 -- 10.20.193.123:0/2973374842 >> 10.20.193.123:0/2973374842 conn(0x7f067809b050 msgr2=0x7f0678096a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:35.003 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:35.000+0000 7f06800c7640 1 -- 10.20.193.123:0/2973374842 shutdown_connections 2026-02-17T20:08:35.003 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:35.000+0000 7f06800c7640 1 -- 10.20.193.123:0/2973374842 wait complete. 2026-02-17T20:08:35.004 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:35.000+0000 7f06800c7640 1 Processor -- start 2026-02-17T20:08:35.004 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:35.000+0000 7f06800c7640 1 -- start start 2026-02-17T20:08:35.004 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:35.001+0000 7f06800c7640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f067805e500 0x7f0678110fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:35.004 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:35.001+0000 7f06800c7640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f06780974f0 0x7f0678111510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:35.004 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:35.001+0000 7f06800c7640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0678128830 0x7f0678111a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:08:35.004 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:35.001+0000 7f06800c7640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0678126dd0 con 0x7f06780974f0 2026-02-17T20:08:35.004 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:35.001+0000 7f06800c7640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06781256b0 con 0x7f067805e500 2026-02-17T20:08:35.004 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:35.001+0000 7f06800c7640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06781139f0 con 0x7f0678128830 2026-02-17T20:08:35.004 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:35.001+0000 7f067de63640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f067805e500 0x7f0678110fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:35.004 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:35.001+0000 7f067de63640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f067805e500 0x7f0678110fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:57264/0 (socket says 10.20.193.123:57264) 2026-02-17T20:08:35.004 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:35.001+0000 7f067de63640 1 -- 10.20.193.123:0/2114853435 learned_addr learned my addr 10.20.193.123:0/2114853435 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:08:35.004 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:35.001+0000 7f067d662640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f06780974f0 0x7f0678111510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:35.005 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:35.001+0000 7f067e664640 1 --2- 10.20.193.123:0/2114853435 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0678128830 0x7f0678111a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:08:35.005 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:35.001+0000 7f067de63640 1 -- 10.20.193.123:0/2114853435 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0678128830 msgr2=0x7f0678111a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:35.005 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:35.001+0000 7f067de63640 1 --2- 10.20.193.123:0/2114853435 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0678128830 0x7f0678111a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:35.005 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:35.001+0000 7f067de63640 1 -- 10.20.193.123:0/2114853435 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f06780974f0 msgr2=0x7f0678111510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:35.005 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:35.001+0000 7f067de63640 1 --2- 10.20.193.123:0/2114853435 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f06780974f0 0x7f0678111510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:35.005 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:35.001+0000 7f067de63640 1 -- 10.20.193.123:0/2114853435 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0674009390 con 0x7f067805e500 2026-02-17T20:08:35.005 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:35.001+0000 7f067d662640 1 --2- 10.20.193.123:0/2114853435 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f06780974f0 0x7f0678111510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:08:35.005 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:35.001+0000 7f067de63640 1 --2- 10.20.193.123:0/2114853435 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f067805e500 0x7f0678110fd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0674009360 tx=0x7f0674037000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:08:35.005 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:35.001+0000 7f066e7fc640 1 -- 10.20.193.123:0/2114853435 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0674037d90 con 0x7f067805e500 2026-02-17T20:08:35.005 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:35.001+0000 7f066e7fc640 1 -- 10.20.193.123:0/2114853435 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0674042440 con 0x7f067805e500 2026-02-17T20:08:35.005 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:35.001+0000 7f06800c7640 1 -- 10.20.193.123:0/2114853435 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0678124ef0 con 0x7f067805e500 2026-02-17T20:08:35.005 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:35.001+0000 7f066e7fc640 1 -- 10.20.193.123:0/2114853435 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06740427e0 con 0x7f067805e500 2026-02-17T20:08:35.006 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:35.001+0000 7f06800c7640 1 -- 10.20.193.123:0/2114853435 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06781bc3c0 con 0x7f067805e500 2026-02-17T20:08:35.006 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:35.002+0000 7f06800c7640 1 -- 10.20.193.123:0/2114853435 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0678065950 con 0x7f067805e500 2026-02-17T20:08:35.006 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:35.002+0000 7f066e7fc640 1 -- 10.20.193.123:0/2114853435 <== mon.1 v2:10.20.193.123:3301/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7f067403e040 con 0x7f067805e500 2026-02-17T20:08:35.006 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:35.002+0000 7f066e7fc640 1 -- 10.20.193.123:0/2114853435 <== mon.1 v2:10.20.193.123:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2806+0+0 (secure 0 0 0) 0x7f0674087e10 con 0x7f067805e500 2026-02-17T20:08:35.006 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:35.004+0000 7f066e7fc640 1 -- 10.20.193.123:0/2114853435 <== mon.1 v2:10.20.193.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7f0678065950 con 0x7f067805e500 2026-02-17T20:08:35.074 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:35.076+0000 7f06800c7640 1 -- 10.20.193.123:0/2114853435 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0678065950 con 0x7f067805e500 2026-02-17T20:08:35.074 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:35.076+0000 7f066e7fc640 1 -- 10.20.193.123:0/2114853435 <== mon.1 v2:10.20.193.123:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 1 v1) v1 ==== 75+0+358 (secure 0 0 0) 0x7f0678065950 con 0x7f067805e500 2026-02-17T20:08:35.075 INFO:teuthology.orchestra.run.trial123.stdout:e1 2026-02-17T20:08:35.075 INFO:teuthology.orchestra.run.trial123.stdout:enable_multiple, ever_enabled_multiple: 1,1 2026-02-17T20:08:35.075 INFO:teuthology.orchestra.run.trial123.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2026-02-17T20:08:35.075 INFO:teuthology.orchestra.run.trial123.stdout:legacy client fscid: -1 2026-02-17T20:08:35.075 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:08:35.075 INFO:teuthology.orchestra.run.trial123.stdout:No filesystems configured 2026-02-17T20:08:35.076 INFO:teuthology.orchestra.run.trial123.stderr:dumped fsmap epoch 1 2026-02-17T20:08:35.076 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:35.077+0000 7f06800c7640 1 -- 10.20.193.123:0/2114853435 >> v1:10.20.193.123:6800/23720 conn(0x7f065c04d0d0 legacy=0x7f065c04f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:35.077 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:35.077+0000 7f06800c7640 1 -- 10.20.193.123:0/2114853435 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f067805e500 msgr2=0x7f0678110fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:08:35.077 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:35.077+0000 7f06800c7640 1 --2- 10.20.193.123:0/2114853435 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f067805e500 0x7f0678110fd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0674009360 tx=0x7f0674037000 comp rx=0 tx=0).stop 2026-02-17T20:08:35.077 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:35.077+0000 7f06800c7640 1 -- 10.20.193.123:0/2114853435 shutdown_connections 2026-02-17T20:08:35.077 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:35.077+0000 7f06800c7640 1 --2- 10.20.193.123:0/2114853435 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0678128830 0x7f0678111a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:35.077 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:35.077+0000 7f06800c7640 1 --2- 10.20.193.123:0/2114853435 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f06780974f0 0x7f0678111510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:35.077 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:35.077+0000 7f06800c7640 1 --2- 10.20.193.123:0/2114853435 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f067805e500 0x7f0678110fd0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:08:35.077 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:35.077+0000 7f06800c7640 1 -- 10.20.193.123:0/2114853435 >> 10.20.193.123:0/2114853435 conn(0x7f067809b050 msgr2=0x7f0678098500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:08:35.077 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:35.077+0000 7f06800c7640 1 -- 10.20.193.123:0/2114853435 shutdown_connections 2026-02-17T20:08:35.077 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:08:35.077+0000 7f06800c7640 1 -- 10.20.193.123:0/2114853435 wait complete. 2026-02-17T20:08:35.081 INFO:teuthology.run_tasks:Running task install.upgrade... 2026-02-17T20:08:35.097 INFO:teuthology.task.install:project ceph config {'mon.a': None} overrides {'flavor': 'default', 'sha1': '0a9403ad6667fb8ffa43f11d9a5d3062d3558d8e'} 2026-02-17T20:08:35.097 INFO:teuthology.task.install:remote ubuntu@trial123.front.sepia.ceph.com config {'flavor': 'default', 'sha1': '0a9403ad6667fb8ffa43f11d9a5d3062d3558d8e'} 2026-02-17T20:08:35.097 INFO:teuthology.task.install:extra packages: [] 2026-02-17T20:08:35.106 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-17T20:08:35.106 INFO:teuthology.task.install:Upgrading ceph rpm packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd 2026-02-17T20:08:35.106 DEBUG:teuthology.orchestra.run.trial123:> rpm -q ceph-common --qf '%{VERSION}-%{RELEASE}' 2026-02-17T20:08:35.126 INFO:teuthology.orchestra.run.trial123.stdout:17.2.9-0.el9 2026-02-17T20:08:35.127 INFO:teuthology.packaging:The installed version of ceph-common is 17.2.9-0.el9 2026-02-17T20:08:35.127 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=0a9403ad6667fb8ffa43f11d9a5d3062d3558d8e 2026-02-17T20:08:35.294 INFO:teuthology.task.install:Ceph rpm upgrade from 17.2.9-0.el9 to 19.2.3-694.g0a9403ad 2026-02-17T20:08:35.294 INFO:teuthology.task.install.rpm:Host trial123 is: centos 9.stream x86_64 2026-02-17T20:08:35.295 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=0a9403ad6667fb8ffa43f11d9a5d3062d3558d8e 2026-02-17T20:08:35.441 INFO:teuthology.task.install.rpm:Repo base URL: https://2.chacra.ceph.com/r/ceph/wip-jcollin-testing-20260217.030412-squid/0a9403ad6667fb8ffa43f11d9a5d3062d3558d8e/centos/9/flavors/default/ 2026-02-17T20:08:35.441 DEBUG:teuthology.orchestra.run.trial123:> sudo rm -f /etc/yum.repos.d/ceph.repo 2026-02-17T20:08:35.609 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-jcollin-testing-20260217.030412-squid/0a9403ad6667fb8ffa43f11d9a5d3062d3558d8e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-jcollin-testing-20260217.030412-squid/0a9403ad6667fb8ffa43f11d9a5d3062d3558d8e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-jcollin-testing-20260217.030412-squid/0a9403ad6667fb8ffa43f11d9a5d3062d3558d8e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-17T20:08:35.609 DEBUG:teuthology.orchestra.run.trial123:> set -ex 2026-02-17T20:08:35.609 DEBUG:teuthology.orchestra.run.trial123:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-17T20:08:35.635 DEBUG:teuthology.orchestra.run.trial123:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0a9403ad6667fb8ffa43f11d9a5d3062d3558d8e/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-17T20:08:35.699 DEBUG:teuthology.orchestra.run.trial123:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-17T20:08:35.762 DEBUG:teuthology.orchestra.run.trial123:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-17T20:08:35.818 INFO:teuthology.orchestra.run.trial123.stdout:check_obsoletes = 1 2026-02-17T20:08:35.827 DEBUG:teuthology.orchestra.run.trial123:> sudo yum clean all 2026-02-17T20:08:35.986 INFO:teuthology.orchestra.run.trial123.stdout:56 files removed 2026-02-17T20:08:36.001 DEBUG:teuthology.orchestra.run.trial123:> sudo yum -y upgrade ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd 2026-02-17T20:08:36.279 INFO:teuthology.orchestra.run.trial123.stdout:ceph packages for x86_64 660 kB/s | 86 kB 00:00 2026-02-17T20:08:36.412 INFO:teuthology.orchestra.run.trial123.stdout:ceph noarch packages 112 kB/s | 12 kB 00:00 2026-02-17T20:08:36.542 INFO:teuthology.orchestra.run.trial123.stdout:ceph source packages 17 kB/s | 1.9 kB 00:00 2026-02-17T20:08:38.109 INFO:teuthology.orchestra.run.trial123.stdout:CentOS Stream 9 - BaseOS 5.8 MB/s | 8.9 MB 00:01 2026-02-17T20:08:41.263 INFO:teuthology.orchestra.run.trial123.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-17T20:08:44.557 INFO:teuthology.orchestra.run.trial123.stdout:CentOS Stream 9 - CRB 8.4 MB/s | 7.8 MB 00:00 2026-02-17T20:08:45.733 INFO:teuthology.orchestra.run.trial123.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 20 kB 00:00 2026-02-17T20:08:46.277 INFO:teuthology.orchestra.run.trial123.stdout:Extra Packages for Enterprise Linux 42 MB/s | 20 MB 00:00 2026-02-17T20:08:49.503 INFO:teuthology.orchestra.run.trial123.stdout:lab-extras 2.5 MB/s | 50 kB 00:00 2026-02-17T20:08:50.698 INFO:teuthology.orchestra.run.trial123.stderr:Package cephadm available, but not installed. 2026-02-17T20:08:50.698 INFO:teuthology.orchestra.run.trial123.stdout:No match for argument: cephadm 2026-02-17T20:08:50.700 INFO:teuthology.orchestra.run.trial123.stderr:Package ceph-mgr-dashboard available, but not installed. 2026-02-17T20:08:50.701 INFO:teuthology.orchestra.run.trial123.stdout:No match for argument: ceph-mgr-dashboard 2026-02-17T20:08:50.701 INFO:teuthology.orchestra.run.trial123.stderr:Package ceph-mgr-diskprediction-local available, but not installed. 2026-02-17T20:08:50.701 INFO:teuthology.orchestra.run.trial123.stdout:No match for argument: ceph-mgr-diskprediction-local 2026-02-17T20:08:50.702 INFO:teuthology.orchestra.run.trial123.stderr:Package ceph-mgr-rook available, but not installed. 2026-02-17T20:08:50.702 INFO:teuthology.orchestra.run.trial123.stdout:No match for argument: ceph-mgr-rook 2026-02-17T20:08:50.702 INFO:teuthology.orchestra.run.trial123.stderr:Package ceph-mgr-cephadm available, but not installed. 2026-02-17T20:08:50.703 INFO:teuthology.orchestra.run.trial123.stdout:No match for argument: ceph-mgr-cephadm 2026-02-17T20:08:50.703 INFO:teuthology.orchestra.run.trial123.stderr:Package ceph-volume available, but not installed. 2026-02-17T20:08:50.703 INFO:teuthology.orchestra.run.trial123.stdout:No match for argument: ceph-volume 2026-02-17T20:08:50.741 INFO:teuthology.orchestra.run.trial123.stdout:Dependencies resolved. 2026-02-17T20:08:50.743 INFO:teuthology.orchestra.run.trial123.stdout:================================================================================ 2026-02-17T20:08:50.743 INFO:teuthology.orchestra.run.trial123.stdout: Package Arch Version Repository Size 2026-02-17T20:08:50.743 INFO:teuthology.orchestra.run.trial123.stdout:================================================================================ 2026-02-17T20:08:50.743 INFO:teuthology.orchestra.run.trial123.stdout:Upgrading: 2026-02-17T20:08:50.743 INFO:teuthology.orchestra.run.trial123.stdout: ceph x86_64 2:19.2.3-694.g0a9403ad.el9 ceph 6.5 k 2026-02-17T20:08:50.743 INFO:teuthology.orchestra.run.trial123.stdout: ceph-base x86_64 2:19.2.3-694.g0a9403ad.el9 ceph 5.5 M 2026-02-17T20:08:50.743 INFO:teuthology.orchestra.run.trial123.stdout: ceph-common x86_64 2:19.2.3-694.g0a9403ad.el9 ceph 22 M 2026-02-17T20:08:50.743 INFO:teuthology.orchestra.run.trial123.stdout: ceph-fuse x86_64 2:19.2.3-694.g0a9403ad.el9 ceph 1.2 M 2026-02-17T20:08:50.743 INFO:teuthology.orchestra.run.trial123.stdout: ceph-immutable-object-cache 2026-02-17T20:08:50.744 INFO:teuthology.orchestra.run.trial123.stdout: x86_64 2:19.2.3-694.g0a9403ad.el9 ceph 145 k 2026-02-17T20:08:50.744 INFO:teuthology.orchestra.run.trial123.stdout: ceph-mds x86_64 2:19.2.3-694.g0a9403ad.el9 ceph 2.4 M 2026-02-17T20:08:50.744 INFO:teuthology.orchestra.run.trial123.stdout: ceph-mgr x86_64 2:19.2.3-694.g0a9403ad.el9 ceph 1.1 M 2026-02-17T20:08:50.744 INFO:teuthology.orchestra.run.trial123.stdout: ceph-mgr-modules-core noarch 2:19.2.3-694.g0a9403ad.el9 ceph-noarch 253 k 2026-02-17T20:08:50.744 INFO:teuthology.orchestra.run.trial123.stdout: ceph-mon x86_64 2:19.2.3-694.g0a9403ad.el9 ceph 4.7 M 2026-02-17T20:08:50.744 INFO:teuthology.orchestra.run.trial123.stdout: ceph-osd x86_64 2:19.2.3-694.g0a9403ad.el9 ceph 17 M 2026-02-17T20:08:50.744 INFO:teuthology.orchestra.run.trial123.stdout: ceph-radosgw x86_64 2:19.2.3-694.g0a9403ad.el9 ceph 11 M 2026-02-17T20:08:50.744 INFO:teuthology.orchestra.run.trial123.stdout: ceph-selinux x86_64 2:19.2.3-694.g0a9403ad.el9 ceph 25 k 2026-02-17T20:08:50.744 INFO:teuthology.orchestra.run.trial123.stdout: ceph-test x86_64 2:19.2.3-694.g0a9403ad.el9 ceph 50 M 2026-02-17T20:08:50.744 INFO:teuthology.orchestra.run.trial123.stdout: libcephfs-devel x86_64 2:19.2.3-694.g0a9403ad.el9 ceph 34 k 2026-02-17T20:08:50.744 INFO:teuthology.orchestra.run.trial123.stdout: libcephfs2 x86_64 2:19.2.3-694.g0a9403ad.el9 ceph 1.0 M 2026-02-17T20:08:50.744 INFO:teuthology.orchestra.run.trial123.stdout: libcephsqlite x86_64 2:19.2.3-694.g0a9403ad.el9 ceph 163 k 2026-02-17T20:08:50.745 INFO:teuthology.orchestra.run.trial123.stdout: librados-devel x86_64 2:19.2.3-694.g0a9403ad.el9 ceph 126 k 2026-02-17T20:08:50.745 INFO:teuthology.orchestra.run.trial123.stdout: librados2 x86_64 2:19.2.3-694.g0a9403ad.el9 ceph 3.4 M 2026-02-17T20:08:50.745 INFO:teuthology.orchestra.run.trial123.stdout: libradosstriper1 x86_64 2:19.2.3-694.g0a9403ad.el9 ceph 503 k 2026-02-17T20:08:50.745 INFO:teuthology.orchestra.run.trial123.stdout: librbd1 x86_64 2:19.2.3-694.g0a9403ad.el9 ceph 3.2 M 2026-02-17T20:08:50.745 INFO:teuthology.orchestra.run.trial123.stdout: librgw2 x86_64 2:19.2.3-694.g0a9403ad.el9 ceph 5.4 M 2026-02-17T20:08:50.745 INFO:teuthology.orchestra.run.trial123.stdout: python3-ceph-argparse x86_64 2:19.2.3-694.g0a9403ad.el9 ceph 45 k 2026-02-17T20:08:50.745 INFO:teuthology.orchestra.run.trial123.stdout: python3-ceph-common x86_64 2:19.2.3-694.g0a9403ad.el9 ceph 142 k 2026-02-17T20:08:50.745 INFO:teuthology.orchestra.run.trial123.stdout: python3-cephfs x86_64 2:19.2.3-694.g0a9403ad.el9 ceph 196 k 2026-02-17T20:08:50.745 INFO:teuthology.orchestra.run.trial123.stdout: python3-rados x86_64 2:19.2.3-694.g0a9403ad.el9 ceph 323 k 2026-02-17T20:08:50.745 INFO:teuthology.orchestra.run.trial123.stdout: python3-rbd x86_64 2:19.2.3-694.g0a9403ad.el9 ceph 303 k 2026-02-17T20:08:50.745 INFO:teuthology.orchestra.run.trial123.stdout: python3-rgw x86_64 2:19.2.3-694.g0a9403ad.el9 ceph 100 k 2026-02-17T20:08:50.745 INFO:teuthology.orchestra.run.trial123.stdout: rbd-fuse x86_64 2:19.2.3-694.g0a9403ad.el9 ceph 85 k 2026-02-17T20:08:50.746 INFO:teuthology.orchestra.run.trial123.stdout: rbd-mirror x86_64 2:19.2.3-694.g0a9403ad.el9 ceph 3.1 M 2026-02-17T20:08:50.746 INFO:teuthology.orchestra.run.trial123.stdout: rbd-nbd x86_64 2:19.2.3-694.g0a9403ad.el9 ceph 171 k 2026-02-17T20:08:50.746 INFO:teuthology.orchestra.run.trial123.stdout:Installing dependencies: 2026-02-17T20:08:50.746 INFO:teuthology.orchestra.run.trial123.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-17T20:08:50.746 INFO:teuthology.orchestra.run.trial123.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-17T20:08:50.746 INFO:teuthology.orchestra.run.trial123.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-17T20:08:50.746 INFO:teuthology.orchestra.run.trial123.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-17T20:08:50.746 INFO:teuthology.orchestra.run.trial123.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-17T20:08:50.746 INFO:teuthology.orchestra.run.trial123.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-17T20:08:50.746 INFO:teuthology.orchestra.run.trial123.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-17T20:08:50.746 INFO:teuthology.orchestra.run.trial123.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-17T20:08:50.746 INFO:teuthology.orchestra.run.trial123.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-17T20:08:50.747 INFO:teuthology.orchestra.run.trial123.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-17T20:08:50.747 INFO:teuthology.orchestra.run.trial123.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-17T20:08:50.747 INFO:teuthology.orchestra.run.trial123.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-17T20:08:50.747 INFO:teuthology.orchestra.run.trial123.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-17T20:08:50.747 INFO:teuthology.orchestra.run.trial123.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-17T20:08:50.747 INFO:teuthology.orchestra.run.trial123.stdout:Installing weak dependencies: 2026-02-17T20:08:50.747 INFO:teuthology.orchestra.run.trial123.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-17T20:08:50.747 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:08:50.747 INFO:teuthology.orchestra.run.trial123.stdout:Transaction Summary 2026-02-17T20:08:50.747 INFO:teuthology.orchestra.run.trial123.stdout:================================================================================ 2026-02-17T20:08:50.747 INFO:teuthology.orchestra.run.trial123.stdout:Install 15 Packages 2026-02-17T20:08:50.747 INFO:teuthology.orchestra.run.trial123.stdout:Upgrade 30 Packages 2026-02-17T20:08:50.748 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:08:50.748 INFO:teuthology.orchestra.run.trial123.stdout:Total download size: 140 M 2026-02-17T20:08:50.748 INFO:teuthology.orchestra.run.trial123.stdout:Downloading Packages: 2026-02-17T20:08:51.723 INFO:teuthology.orchestra.run.trial123.stdout:(1/45): pciutils-3.7.0-7.el9.x86_64.rpm 147 kB/s | 93 kB 00:00 2026-02-17T20:08:51.791 INFO:teuthology.orchestra.run.trial123.stdout:(2/45): boost-program-options-1.75.0-13.el9.x86 1.5 MB/s | 104 kB 00:00 2026-02-17T20:08:51.811 INFO:teuthology.orchestra.run.trial123.stdout:(3/45): unzip-6.0-59.el9.x86_64.rpm 252 kB/s | 182 kB 00:00 2026-02-17T20:08:51.836 INFO:teuthology.orchestra.run.trial123.stdout:(4/45): libnbd-1.20.3-4.el9.x86_64.rpm 3.5 MB/s | 164 kB 00:00 2026-02-17T20:08:51.865 INFO:teuthology.orchestra.run.trial123.stdout:(5/45): qatlib-25.08.0-2.el9.x86_64.rpm 8.2 MB/s | 240 kB 00:00 2026-02-17T20:08:51.889 INFO:teuthology.orchestra.run.trial123.stdout:(6/45): zip-3.0-35.el9.x86_64.rpm 333 kB/s | 266 kB 00:00 2026-02-17T20:08:51.891 INFO:teuthology.orchestra.run.trial123.stdout:(7/45): qatlib-service-25.08.0-2.el9.x86_64.rpm 1.4 MB/s | 37 kB 00:00 2026-02-17T20:08:51.895 INFO:teuthology.orchestra.run.trial123.stdout:(8/45): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2026-02-17T20:08:51.967 INFO:teuthology.orchestra.run.trial123.stdout:(9/45): lua-devel-5.4.4-4.el9.x86_64.rpm 291 kB/s | 22 kB 00:00 2026-02-17T20:08:51.968 INFO:teuthology.orchestra.run.trial123.stdout:(10/45): qatzip-libs-1.3.1-1.el9.x86_64.rpm 844 kB/s | 66 kB 00:00 2026-02-17T20:08:52.085 INFO:teuthology.orchestra.run.trial123.stdout:(11/45): libarrow-doc-9.0.0-15.el9.noarch.rpm 211 kB/s | 25 kB 00:00 2026-02-17T20:08:52.186 INFO:teuthology.orchestra.run.trial123.stdout:(12/45): luarocks-3.9.2-5.el9.noarch.rpm 695 kB/s | 151 kB 00:00 2026-02-17T20:08:52.296 INFO:teuthology.orchestra.run.trial123.stdout:(13/45): re2-20211101-20.el9.x86_64.rpm 1.7 MB/s | 191 kB 00:00 2026-02-17T20:08:52.313 INFO:teuthology.orchestra.run.trial123.stdout:(14/45): parquet-libs-9.0.0-15.el9.x86_64.rpm 3.6 MB/s | 838 kB 00:00 2026-02-17T20:08:52.334 INFO:teuthology.orchestra.run.trial123.stdout:(15/45): libarrow-9.0.0-15.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2026-02-17T20:08:52.516 INFO:teuthology.orchestra.run.trial123.stdout:(16/45): ceph-19.2.3-694.g0a9403ad.el9.x86_64.r 29 kB/s | 6.5 kB 00:00 2026-02-17T20:08:52.944 INFO:teuthology.orchestra.run.trial123.stdout:(17/45): ceph-fuse-19.2.3-694.g0a9403ad.el9.x86 2.7 MB/s | 1.2 MB 00:00 2026-02-17T20:08:52.982 INFO:teuthology.orchestra.run.trial123.stdout:(18/45): ceph-immutable-object-cache-19.2.3-694 3.7 MB/s | 145 kB 00:00 2026-02-17T20:08:53.317 INFO:teuthology.orchestra.run.trial123.stdout:(19/45): ceph-base-19.2.3-694.g0a9403ad.el9.x86 5.5 MB/s | 5.5 MB 00:01 2026-02-17T20:08:53.389 INFO:teuthology.orchestra.run.trial123.stdout:(20/45): ceph-mds-19.2.3-694.g0a9403ad.el9.x86_ 6.0 MB/s | 2.4 MB 00:00 2026-02-17T20:08:53.447 INFO:teuthology.orchestra.run.trial123.stdout:(21/45): ceph-mgr-19.2.3-694.g0a9403ad.el9.x86_ 8.2 MB/s | 1.1 MB 00:00 2026-02-17T20:08:54.344 INFO:teuthology.orchestra.run.trial123.stdout:(22/45): ceph-mon-19.2.3-694.g0a9403ad.el9.x86_ 5.0 MB/s | 4.7 MB 00:00 2026-02-17T20:08:54.961 INFO:teuthology.orchestra.run.trial123.stdout:(23/45): ceph-osd-19.2.3-694.g0a9403ad.el9.x86_ 11 MB/s | 17 MB 00:01 2026-02-17T20:08:55.014 INFO:teuthology.orchestra.run.trial123.stdout:(24/45): ceph-selinux-19.2.3-694.g0a9403ad.el9. 469 kB/s | 25 kB 00:00 2026-02-17T20:08:55.087 INFO:teuthology.orchestra.run.trial123.stdout:(25/45): ceph-common-19.2.3-694.g0a9403ad.el9.x 7.9 MB/s | 22 MB 00:02 2026-02-17T20:08:55.150 INFO:teuthology.orchestra.run.trial123.stdout:(26/45): libcephfs-devel-19.2.3-694.g0a9403ad.e 530 kB/s | 34 kB 00:00 2026-02-17T20:08:55.280 INFO:teuthology.orchestra.run.trial123.stdout:(27/45): libcephfs2-19.2.3-694.g0a9403ad.el9.x8 7.6 MB/s | 1.0 MB 00:00 2026-02-17T20:08:55.345 INFO:teuthology.orchestra.run.trial123.stdout:(28/45): libcephsqlite-19.2.3-694.g0a9403ad.el9 2.4 MB/s | 163 kB 00:00 2026-02-17T20:08:55.410 INFO:teuthology.orchestra.run.trial123.stdout:(29/45): librados-devel-19.2.3-694.g0a9403ad.el 1.9 MB/s | 126 kB 00:00 2026-02-17T20:08:55.959 INFO:teuthology.orchestra.run.trial123.stdout:(30/45): librados2-19.2.3-694.g0a9403ad.el9.x86 6.3 MB/s | 3.4 MB 00:00 2026-02-17T20:08:56.076 INFO:teuthology.orchestra.run.trial123.stdout:(31/45): libradosstriper1-19.2.3-694.g0a9403ad. 4.2 MB/s | 503 kB 00:00 2026-02-17T20:08:56.587 INFO:teuthology.orchestra.run.trial123.stdout:(32/45): librbd1-19.2.3-694.g0a9403ad.el9.x86_6 6.2 MB/s | 3.2 MB 00:00 2026-02-17T20:08:57.376 INFO:teuthology.orchestra.run.trial123.stdout:(33/45): librgw2-19.2.3-694.g0a9403ad.el9.x86_6 6.9 MB/s | 5.4 MB 00:00 2026-02-17T20:08:57.432 INFO:teuthology.orchestra.run.trial123.stdout:(34/45): python3-ceph-argparse-19.2.3-694.g0a94 799 kB/s | 45 kB 00:00 2026-02-17T20:08:57.493 INFO:teuthology.orchestra.run.trial123.stdout:(35/45): python3-ceph-common-19.2.3-694.g0a9403 2.3 MB/s | 142 kB 00:00 2026-02-17T20:08:57.560 INFO:teuthology.orchestra.run.trial123.stdout:(36/45): python3-cephfs-19.2.3-694.g0a9403ad.el 2.9 MB/s | 196 kB 00:00 2026-02-17T20:08:57.629 INFO:teuthology.orchestra.run.trial123.stdout:(37/45): python3-rados-19.2.3-694.g0a9403ad.el9 4.6 MB/s | 323 kB 00:00 2026-02-17T20:08:57.644 INFO:teuthology.orchestra.run.trial123.stdout:(38/45): ceph-radosgw-19.2.3-694.g0a9403ad.el9. 3.3 MB/s | 11 MB 00:03 2026-02-17T20:08:57.691 INFO:teuthology.orchestra.run.trial123.stdout:(39/45): python3-rbd-19.2.3-694.g0a9403ad.el9.x 4.9 MB/s | 303 kB 00:00 2026-02-17T20:08:57.706 INFO:teuthology.orchestra.run.trial123.stdout:(40/45): python3-rgw-19.2.3-694.g0a9403ad.el9.x 1.6 MB/s | 100 kB 00:00 2026-02-17T20:08:57.755 INFO:teuthology.orchestra.run.trial123.stdout:(41/45): rbd-fuse-19.2.3-694.g0a9403ad.el9.x86_ 1.3 MB/s | 85 kB 00:00 2026-02-17T20:08:57.822 INFO:teuthology.orchestra.run.trial123.stdout:(42/45): rbd-nbd-19.2.3-694.g0a9403ad.el9.x86_6 2.5 MB/s | 171 kB 00:00 2026-02-17T20:08:57.891 INFO:teuthology.orchestra.run.trial123.stdout:(43/45): ceph-mgr-modules-core-19.2.3-694.g0a94 3.6 MB/s | 253 kB 00:00 2026-02-17T20:08:58.724 INFO:teuthology.orchestra.run.trial123.stdout:(44/45): rbd-mirror-19.2.3-694.g0a9403ad.el9.x8 3.1 MB/s | 3.1 MB 00:01 2026-02-17T20:09:00.087 INFO:teuthology.orchestra.run.trial123.stdout:(45/45): ceph-test-19.2.3-694.g0a9403ad.el9.x86 9.8 MB/s | 50 MB 00:05 2026-02-17T20:09:00.089 INFO:teuthology.orchestra.run.trial123.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:09:00.089 INFO:teuthology.orchestra.run.trial123.stdout:Total 15 MB/s | 140 MB 00:09 2026-02-17T20:09:00.177 INFO:teuthology.orchestra.run.trial123.stdout:Running transaction check 2026-02-17T20:09:00.203 INFO:teuthology.orchestra.run.trial123.stdout:Transaction check succeeded. 2026-02-17T20:09:00.204 INFO:teuthology.orchestra.run.trial123.stdout:Running transaction test 2026-02-17T20:09:00.670 INFO:teuthology.orchestra.run.trial123.stdout:Transaction test succeeded. 2026-02-17T20:09:00.670 INFO:teuthology.orchestra.run.trial123.stdout:Running transaction 2026-02-17T20:09:01.322 INFO:teuthology.orchestra.run.trial123.stdout: Preparing : 1/1 2026-02-17T20:09:01.328 INFO:teuthology.orchestra.run.trial123.stdout: Upgrading : librados2-2:19.2.3-694.g0a9403ad.el9.x86_64 1/75 2026-02-17T20:09:01.386 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: librados2-2:19.2.3-694.g0a9403ad.el9.x86_64 1/75 2026-02-17T20:09:01.387 INFO:teuthology.orchestra.run.trial123.stdout: Upgrading : libcephfs2-2:19.2.3-694.g0a9403ad.el9.x86_64 2/75 2026-02-17T20:09:01.417 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: libcephfs2-2:19.2.3-694.g0a9403ad.el9.x86_64 2/75 2026-02-17T20:09:01.422 INFO:teuthology.orchestra.run.trial123.stdout: Upgrading : python3-rados-2:19.2.3-694.g0a9403ad.el9.x86_64 3/75 2026-02-17T20:09:01.567 INFO:teuthology.orchestra.run.trial123.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 4/75 2026-02-17T20:09:01.568 INFO:teuthology.orchestra.run.trial123.stdout: Upgrading : librbd1-2:19.2.3-694.g0a9403ad.el9.x86_64 5/75 2026-02-17T20:09:01.587 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: librbd1-2:19.2.3-694.g0a9403ad.el9.x86_64 5/75 2026-02-17T20:09:01.588 INFO:teuthology.orchestra.run.trial123.stdout: Upgrading : libcephsqlite-2:19.2.3-694.g0a9403ad.el9.x86_64 6/75 2026-02-17T20:09:01.622 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: libcephsqlite-2:19.2.3-694.g0a9403ad.el9.x86_64 6/75 2026-02-17T20:09:01.623 INFO:teuthology.orchestra.run.trial123.stdout: Upgrading : libradosstriper1-2:19.2.3-694.g0a9403ad.el9.x86_64 7/75 2026-02-17T20:09:01.637 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: libradosstriper1-2:19.2.3-694.g0a9403ad.el9.x86_64 7/75 2026-02-17T20:09:01.643 INFO:teuthology.orchestra.run.trial123.stdout: Upgrading : python3-ceph-argparse-2:19.2.3-694.g0a9403ad.el9.x 8/75 2026-02-17T20:09:01.648 INFO:teuthology.orchestra.run.trial123.stdout: Installing : lua-5.4.4-4.el9.x86_64 9/75 2026-02-17T20:09:01.655 INFO:teuthology.orchestra.run.trial123.stdout: Installing : unzip-6.0-59.el9.x86_64 10/75 2026-02-17T20:09:01.680 INFO:teuthology.orchestra.run.trial123.stdout: Installing : zip-3.0-35.el9.x86_64 11/75 2026-02-17T20:09:01.684 INFO:teuthology.orchestra.run.trial123.stdout: Installing : luarocks-3.9.2-5.el9.noarch 12/75 2026-02-17T20:09:01.694 INFO:teuthology.orchestra.run.trial123.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 13/75 2026-02-17T20:09:01.710 INFO:teuthology.orchestra.run.trial123.stdout: Upgrading : python3-cephfs-2:19.2.3-694.g0a9403ad.el9.x86_64 14/75 2026-02-17T20:09:01.717 INFO:teuthology.orchestra.run.trial123.stdout: Upgrading : python3-rbd-2:19.2.3-694.g0a9403ad.el9.x86_64 15/75 2026-02-17T20:09:01.763 INFO:teuthology.orchestra.run.trial123.stdout: Upgrading : librados-devel-2:19.2.3-694.g0a9403ad.el9.x86_64 16/75 2026-02-17T20:09:01.791 INFO:teuthology.orchestra.run.trial123.stdout: Upgrading : ceph-mgr-modules-core-2:19.2.3-694.g0a9403ad.el9.n 17/75 2026-02-17T20:09:01.795 INFO:teuthology.orchestra.run.trial123.stdout: Upgrading : python3-ceph-common-2:19.2.3-694.g0a9403ad.el9.x86 18/75 2026-02-17T20:09:01.827 INFO:teuthology.orchestra.run.trial123.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/75 2026-02-17T20:09:01.829 INFO:teuthology.orchestra.run.trial123.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 20/75 2026-02-17T20:09:01.831 INFO:teuthology.orchestra.run.trial123.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 21/75 2026-02-17T20:09:01.837 INFO:teuthology.orchestra.run.trial123.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 22/75 2026-02-17T20:09:02.071 INFO:teuthology.orchestra.run.trial123.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 23/75 2026-02-17T20:09:02.079 INFO:teuthology.orchestra.run.trial123.stdout: Upgrading : librgw2-2:19.2.3-694.g0a9403ad.el9.x86_64 24/75 2026-02-17T20:09:02.096 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: librgw2-2:19.2.3-694.g0a9403ad.el9.x86_64 24/75 2026-02-17T20:09:02.098 INFO:teuthology.orchestra.run.trial123.stdout: Upgrading : python3-rgw-2:19.2.3-694.g0a9403ad.el9.x86_64 25/75 2026-02-17T20:09:03.124 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: ceph-common-2:19.2.3-694.g0a9403ad.el9.x86_64 26/75 2026-02-17T20:09:03.134 INFO:teuthology.orchestra.run.trial123.stdout: Upgrading : ceph-common-2:19.2.3-694.g0a9403ad.el9.x86_64 26/75 2026-02-17T20:09:03.152 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: ceph-common-2:19.2.3-694.g0a9403ad.el9.x86_64 26/75 2026-02-17T20:09:03.156 INFO:teuthology.orchestra.run.trial123.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/75 2026-02-17T20:09:03.159 INFO:teuthology.orchestra.run.trial123.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/75 2026-02-17T20:09:03.160 INFO:teuthology.orchestra.run.trial123.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/75 2026-02-17T20:09:03.177 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/75 2026-02-17T20:09:03.457 INFO:teuthology.orchestra.run.trial123.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/75 2026-02-17T20:09:03.463 INFO:teuthology.orchestra.run.trial123.stdout: Upgrading : ceph-base-2:19.2.3-694.g0a9403ad.el9.x86_64 31/75 2026-02-17T20:09:03.479 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: ceph-base-2:19.2.3-694.g0a9403ad.el9.x86_64 31/75 2026-02-17T20:09:03.479 INFO:teuthology.orchestra.run.trial123.stdout: Upgrading : ceph-selinux-2:19.2.3-694.g0a9403ad.el9.x86_64 32/75 2026-02-17T20:09:07.765 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: ceph-selinux-2:19.2.3-694.g0a9403ad.el9.x86_64 32/75 2026-02-17T20:09:07.768 INFO:teuthology.orchestra.run.trial123.stdout: Upgrading : ceph-mds-2:19.2.3-694.g0a9403ad.el9.x86_64 33/75 2026-02-17T20:09:07.825 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: ceph-mds-2:19.2.3-694.g0a9403ad.el9.x86_64 33/75 2026-02-17T20:09:07.827 INFO:teuthology.orchestra.run.trial123.stdout: Upgrading : ceph-mgr-2:19.2.3-694.g0a9403ad.el9.x86_64 34/75 2026-02-17T20:09:08.047 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: ceph-mgr-2:19.2.3-694.g0a9403ad.el9.x86_64 34/75 2026-02-17T20:09:08.057 INFO:teuthology.orchestra.run.trial123.stdout: Upgrading : ceph-mon-2:19.2.3-694.g0a9403ad.el9.x86_64 35/75 2026-02-17T20:09:08.810 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: ceph-mon-2:19.2.3-694.g0a9403ad.el9.x86_64 35/75 2026-02-17T20:09:08.825 INFO:teuthology.orchestra.run.trial123.stdout: Upgrading : ceph-osd-2:19.2.3-694.g0a9403ad.el9.x86_64 36/75 2026-02-17T20:09:08.835 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: ceph-osd-2:19.2.3-694.g0a9403ad.el9.x86_64 36/75 2026-02-17T20:09:09.297 INFO:teuthology.orchestra.run.trial123.stdout: Upgrading : ceph-2:19.2.3-694.g0a9403ad.el9.x86_64 37/75 2026-02-17T20:09:09.316 INFO:teuthology.orchestra.run.trial123.stdout: Upgrading : ceph-radosgw-2:19.2.3-694.g0a9403ad.el9.x86_64 38/75 2026-02-17T20:09:09.331 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-694.g0a9403ad.el9.x86_64 38/75 2026-02-17T20:09:09.332 INFO:teuthology.orchestra.run.trial123.stdout: Upgrading : ceph-immutable-object-cache-2:19.2.3-694.g0a9403ad 39/75 2026-02-17T20:09:09.480 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-694.g0a9403ad 39/75 2026-02-17T20:09:09.485 INFO:teuthology.orchestra.run.trial123.stdout: Upgrading : rbd-mirror-2:19.2.3-694.g0a9403ad.el9.x86_64 40/75 2026-02-17T20:09:11.894 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: rbd-mirror-2:19.2.3-694.g0a9403ad.el9.x86_64 40/75 2026-02-17T20:09:11.900 INFO:teuthology.orchestra.run.trial123.stdout: Upgrading : ceph-test-2:19.2.3-694.g0a9403ad.el9.x86_64 41/75 2026-02-17T20:09:11.905 INFO:teuthology.orchestra.run.trial123.stdout: Upgrading : libcephfs-devel-2:19.2.3-694.g0a9403ad.el9.x86_64 42/75 2026-02-17T20:09:11.915 INFO:teuthology.orchestra.run.trial123.stdout: Upgrading : rbd-fuse-2:19.2.3-694.g0a9403ad.el9.x86_64 43/75 2026-02-17T20:09:11.967 INFO:teuthology.orchestra.run.trial123.stdout: Upgrading : rbd-nbd-2:19.2.3-694.g0a9403ad.el9.x86_64 44/75 2026-02-17T20:09:11.968 INFO:teuthology.orchestra.run.trial123.stdout: Upgrading : ceph-fuse-2:19.2.3-694.g0a9403ad.el9.x86_64 45/75 2026-02-17T20:09:11.974 INFO:teuthology.orchestra.run.trial123.stdout: Cleanup : ceph-2:17.2.9-0.el9.x86_64 46/75 2026-02-17T20:09:11.978 INFO:teuthology.orchestra.run.trial123.stdout: Cleanup : ceph-test-2:17.2.9-0.el9.x86_64 47/75 2026-02-17T20:09:11.986 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: ceph-radosgw-2:17.2.9-0.el9.x86_64 48/75 2026-02-17T20:09:11.986 INFO:teuthology.orchestra.run.trial123.stdout: Cleanup : ceph-radosgw-2:17.2.9-0.el9.x86_64 48/75 2026-02-17T20:09:12.001 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: ceph-radosgw-2:17.2.9-0.el9.x86_64 48/75 2026-02-17T20:09:12.002 INFO:teuthology.orchestra.run.trial123.stdout: Cleanup : rbd-nbd-2:17.2.9-0.el9.x86_64 49/75 2026-02-17T20:09:12.008 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: rbd-mirror-2:17.2.9-0.el9.x86_64 50/75 2026-02-17T20:09:12.008 INFO:teuthology.orchestra.run.trial123.stdout: Cleanup : rbd-mirror-2:17.2.9-0.el9.x86_64 50/75 2026-02-17T20:09:12.016 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: rbd-mirror-2:17.2.9-0.el9.x86_64 50/75 2026-02-17T20:09:12.021 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: ceph-mgr-2:17.2.9-0.el9.x86_64 51/75 2026-02-17T20:09:12.021 INFO:teuthology.orchestra.run.trial123.stdout: Cleanup : ceph-mgr-2:17.2.9-0.el9.x86_64 51/75 2026-02-17T20:09:12.028 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: ceph-mgr-2:17.2.9-0.el9.x86_64 51/75 2026-02-17T20:09:12.029 INFO:teuthology.orchestra.run.trial123.stdout: Cleanup : rbd-fuse-2:17.2.9-0.el9.x86_64 52/75 2026-02-17T20:09:12.035 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.9-0.el9.x86_64 53/75 2026-02-17T20:09:12.035 INFO:teuthology.orchestra.run.trial123.stdout: Cleanup : ceph-immutable-object-cache-2:17.2.9-0.el9.x86_64 53/75 2026-02-17T20:09:12.043 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.9-0.el9.x86_64 53/75 2026-02-17T20:09:12.044 INFO:teuthology.orchestra.run.trial123.stdout: Cleanup : libcephfs-devel-2:17.2.9-0.el9.x86_64 54/75 2026-02-17T20:09:12.045 INFO:teuthology.orchestra.run.trial123.stdout: Cleanup : libcephsqlite-2:17.2.9-0.el9.x86_64 55/75 2026-02-17T20:09:12.056 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: libcephsqlite-2:17.2.9-0.el9.x86_64 55/75 2026-02-17T20:09:12.058 INFO:teuthology.orchestra.run.trial123.stdout: Cleanup : librados-devel-2:17.2.9-0.el9.x86_64 56/75 2026-02-17T20:09:12.063 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: ceph-mds-2:17.2.9-0.el9.x86_64 57/75 2026-02-17T20:09:12.064 INFO:teuthology.orchestra.run.trial123.stdout: Cleanup : ceph-mds-2:17.2.9-0.el9.x86_64 57/75 2026-02-17T20:09:12.071 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: ceph-mds-2:17.2.9-0.el9.x86_64 57/75 2026-02-17T20:09:12.076 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: ceph-mon-2:17.2.9-0.el9.x86_64 58/75 2026-02-17T20:09:12.077 INFO:teuthology.orchestra.run.trial123.stdout: Cleanup : ceph-mon-2:17.2.9-0.el9.x86_64 58/75 2026-02-17T20:09:12.085 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: ceph-mon-2:17.2.9-0.el9.x86_64 58/75 2026-02-17T20:09:12.090 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: ceph-osd-2:17.2.9-0.el9.x86_64 59/75 2026-02-17T20:09:12.091 INFO:teuthology.orchestra.run.trial123.stdout: Cleanup : ceph-osd-2:17.2.9-0.el9.x86_64 59/75 2026-02-17T20:09:12.099 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: ceph-osd-2:17.2.9-0.el9.x86_64 59/75 2026-02-17T20:09:12.099 INFO:teuthology.orchestra.run.trial123.stdout: Cleanup : ceph-selinux-2:17.2.9-0.el9.x86_64 60/75 2026-02-17T20:09:12.106 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: ceph-selinux-2:17.2.9-0.el9.x86_64 60/75 2026-02-17T20:09:12.113 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: ceph-base-2:17.2.9-0.el9.x86_64 61/75 2026-02-17T20:09:12.113 INFO:teuthology.orchestra.run.trial123.stdout: Cleanup : ceph-base-2:17.2.9-0.el9.x86_64 61/75 2026-02-17T20:09:12.128 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: ceph-base-2:17.2.9-0.el9.x86_64 61/75 2026-02-17T20:09:12.128 INFO:teuthology.orchestra.run.trial123.stdout: Cleanup : ceph-common-2:17.2.9-0.el9.x86_64 62/75 2026-02-17T20:09:12.137 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: ceph-common-2:17.2.9-0.el9.x86_64 62/75 2026-02-17T20:09:12.137 INFO:teuthology.orchestra.run.trial123.stdout: Cleanup : libradosstriper1-2:17.2.9-0.el9.x86_64 63/75 2026-02-17T20:09:12.149 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: libradosstriper1-2:17.2.9-0.el9.x86_64 63/75 2026-02-17T20:09:12.150 INFO:teuthology.orchestra.run.trial123.stdout: Cleanup : python3-cephfs-2:17.2.9-0.el9.x86_64 64/75 2026-02-17T20:09:12.152 INFO:teuthology.orchestra.run.trial123.stdout: Cleanup : python3-rbd-2:17.2.9-0.el9.x86_64 65/75 2026-02-17T20:09:12.152 INFO:teuthology.orchestra.run.trial123.stdout: Cleanup : librbd1-2:17.2.9-0.el9.x86_64 66/75 2026-02-17T20:09:12.163 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: librbd1-2:17.2.9-0.el9.x86_64 66/75 2026-02-17T20:09:12.164 INFO:teuthology.orchestra.run.trial123.stdout: Cleanup : python3-rgw-2:17.2.9-0.el9.x86_64 67/75 2026-02-17T20:09:12.164 INFO:teuthology.orchestra.run.trial123.stdout: Cleanup : librgw2-2:17.2.9-0.el9.x86_64 68/75 2026-02-17T20:09:12.176 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: librgw2-2:17.2.9-0.el9.x86_64 68/75 2026-02-17T20:09:12.177 INFO:teuthology.orchestra.run.trial123.stdout: Cleanup : python3-rados-2:17.2.9-0.el9.x86_64 69/75 2026-02-17T20:09:12.177 INFO:teuthology.orchestra.run.trial123.stdout: Cleanup : libcephfs2-2:17.2.9-0.el9.x86_64 70/75 2026-02-17T20:09:12.190 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: libcephfs2-2:17.2.9-0.el9.x86_64 70/75 2026-02-17T20:09:12.192 INFO:teuthology.orchestra.run.trial123.stdout: Cleanup : ceph-fuse-2:17.2.9-0.el9.x86_64 71/75 2026-02-17T20:09:12.192 INFO:teuthology.orchestra.run.trial123.stdout: Cleanup : python3-ceph-argparse-2:17.2.9-0.el9.x86_64 72/75 2026-02-17T20:09:12.195 INFO:teuthology.orchestra.run.trial123.stdout: Cleanup : python3-ceph-common-2:17.2.9-0.el9.x86_64 73/75 2026-02-17T20:09:12.197 INFO:teuthology.orchestra.run.trial123.stdout: Cleanup : ceph-mgr-modules-core-2:17.2.9-0.el9.noarch 74/75 2026-02-17T20:09:12.197 INFO:teuthology.orchestra.run.trial123.stdout: Cleanup : librados2-2:17.2.9-0.el9.x86_64 75/75 2026-02-17T20:09:12.254 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: librados2-2:17.2.9-0.el9.x86_64 75/75 2026-02-17T20:09:12.254 INFO:teuthology.orchestra.run.trial123.stdout:Creating group 'qat' with GID 991. 2026-02-17T20:09:12.255 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:09:12.584 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 1/75 2026-02-17T20:09:12.584 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : unzip-6.0-59.el9.x86_64 2/75 2026-02-17T20:09:12.584 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : zip-3.0-35.el9.x86_64 3/75 2026-02-17T20:09:12.584 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 4/75 2026-02-17T20:09:12.584 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 5/75 2026-02-17T20:09:12.584 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : lua-5.4.4-4.el9.x86_64 6/75 2026-02-17T20:09:12.584 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 7/75 2026-02-17T20:09:12.584 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 8/75 2026-02-17T20:09:12.584 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 9/75 2026-02-17T20:09:12.584 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 10/75 2026-02-17T20:09:12.584 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 11/75 2026-02-17T20:09:12.584 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 12/75 2026-02-17T20:09:12.584 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 13/75 2026-02-17T20:09:12.584 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 14/75 2026-02-17T20:09:12.584 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : re2-1:20211101-20.el9.x86_64 15/75 2026-02-17T20:09:12.584 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : ceph-2:19.2.3-694.g0a9403ad.el9.x86_64 16/75 2026-02-17T20:09:12.584 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : ceph-2:17.2.9-0.el9.x86_64 17/75 2026-02-17T20:09:12.584 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : ceph-base-2:19.2.3-694.g0a9403ad.el9.x86_64 18/75 2026-02-17T20:09:12.584 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : ceph-base-2:17.2.9-0.el9.x86_64 19/75 2026-02-17T20:09:12.584 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : ceph-common-2:19.2.3-694.g0a9403ad.el9.x86_64 20/75 2026-02-17T20:09:12.584 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : ceph-common-2:17.2.9-0.el9.x86_64 21/75 2026-02-17T20:09:12.584 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : ceph-fuse-2:19.2.3-694.g0a9403ad.el9.x86_64 22/75 2026-02-17T20:09:12.584 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : ceph-fuse-2:17.2.9-0.el9.x86_64 23/75 2026-02-17T20:09:12.584 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-694.g0a9403ad 24/75 2026-02-17T20:09:12.584 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : ceph-immutable-object-cache-2:17.2.9-0.el9.x86_64 25/75 2026-02-17T20:09:12.585 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : ceph-mds-2:19.2.3-694.g0a9403ad.el9.x86_64 26/75 2026-02-17T20:09:12.585 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : ceph-mds-2:17.2.9-0.el9.x86_64 27/75 2026-02-17T20:09:12.585 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : ceph-mgr-2:19.2.3-694.g0a9403ad.el9.x86_64 28/75 2026-02-17T20:09:12.585 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : ceph-mgr-2:17.2.9-0.el9.x86_64 29/75 2026-02-17T20:09:12.585 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : ceph-mon-2:19.2.3-694.g0a9403ad.el9.x86_64 30/75 2026-02-17T20:09:12.585 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : ceph-mon-2:17.2.9-0.el9.x86_64 31/75 2026-02-17T20:09:12.585 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : ceph-osd-2:19.2.3-694.g0a9403ad.el9.x86_64 32/75 2026-02-17T20:09:12.585 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : ceph-osd-2:17.2.9-0.el9.x86_64 33/75 2026-02-17T20:09:12.585 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : ceph-radosgw-2:19.2.3-694.g0a9403ad.el9.x86_64 34/75 2026-02-17T20:09:12.586 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : ceph-radosgw-2:17.2.9-0.el9.x86_64 35/75 2026-02-17T20:09:12.586 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : ceph-selinux-2:19.2.3-694.g0a9403ad.el9.x86_64 36/75 2026-02-17T20:09:12.586 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : ceph-selinux-2:17.2.9-0.el9.x86_64 37/75 2026-02-17T20:09:12.586 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : ceph-test-2:19.2.3-694.g0a9403ad.el9.x86_64 38/75 2026-02-17T20:09:12.586 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : ceph-test-2:17.2.9-0.el9.x86_64 39/75 2026-02-17T20:09:12.586 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : libcephfs-devel-2:19.2.3-694.g0a9403ad.el9.x86_64 40/75 2026-02-17T20:09:12.586 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : libcephfs-devel-2:17.2.9-0.el9.x86_64 41/75 2026-02-17T20:09:12.586 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : libcephfs2-2:19.2.3-694.g0a9403ad.el9.x86_64 42/75 2026-02-17T20:09:12.586 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : libcephfs2-2:17.2.9-0.el9.x86_64 43/75 2026-02-17T20:09:12.586 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : libcephsqlite-2:19.2.3-694.g0a9403ad.el9.x86_64 44/75 2026-02-17T20:09:12.586 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : libcephsqlite-2:17.2.9-0.el9.x86_64 45/75 2026-02-17T20:09:12.586 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : librados-devel-2:19.2.3-694.g0a9403ad.el9.x86_64 46/75 2026-02-17T20:09:12.586 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : librados-devel-2:17.2.9-0.el9.x86_64 47/75 2026-02-17T20:09:12.586 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : librados2-2:19.2.3-694.g0a9403ad.el9.x86_64 48/75 2026-02-17T20:09:12.586 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : librados2-2:17.2.9-0.el9.x86_64 49/75 2026-02-17T20:09:12.586 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : libradosstriper1-2:19.2.3-694.g0a9403ad.el9.x86_64 50/75 2026-02-17T20:09:12.586 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : libradosstriper1-2:17.2.9-0.el9.x86_64 51/75 2026-02-17T20:09:12.586 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : librbd1-2:19.2.3-694.g0a9403ad.el9.x86_64 52/75 2026-02-17T20:09:12.586 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : librbd1-2:17.2.9-0.el9.x86_64 53/75 2026-02-17T20:09:12.586 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : librgw2-2:19.2.3-694.g0a9403ad.el9.x86_64 54/75 2026-02-17T20:09:12.586 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : librgw2-2:17.2.9-0.el9.x86_64 55/75 2026-02-17T20:09:12.586 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : python3-ceph-argparse-2:19.2.3-694.g0a9403ad.el9.x 56/75 2026-02-17T20:09:12.586 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : python3-ceph-argparse-2:17.2.9-0.el9.x86_64 57/75 2026-02-17T20:09:12.586 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : python3-ceph-common-2:19.2.3-694.g0a9403ad.el9.x86 58/75 2026-02-17T20:09:12.586 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : python3-ceph-common-2:17.2.9-0.el9.x86_64 59/75 2026-02-17T20:09:12.586 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : python3-cephfs-2:19.2.3-694.g0a9403ad.el9.x86_64 60/75 2026-02-17T20:09:12.586 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : python3-cephfs-2:17.2.9-0.el9.x86_64 61/75 2026-02-17T20:09:12.586 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : python3-rados-2:19.2.3-694.g0a9403ad.el9.x86_64 62/75 2026-02-17T20:09:12.586 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : python3-rados-2:17.2.9-0.el9.x86_64 63/75 2026-02-17T20:09:12.586 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : python3-rbd-2:19.2.3-694.g0a9403ad.el9.x86_64 64/75 2026-02-17T20:09:12.586 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : python3-rbd-2:17.2.9-0.el9.x86_64 65/75 2026-02-17T20:09:12.587 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : python3-rgw-2:19.2.3-694.g0a9403ad.el9.x86_64 66/75 2026-02-17T20:09:12.587 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : python3-rgw-2:17.2.9-0.el9.x86_64 67/75 2026-02-17T20:09:12.587 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : rbd-fuse-2:19.2.3-694.g0a9403ad.el9.x86_64 68/75 2026-02-17T20:09:12.587 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : rbd-fuse-2:17.2.9-0.el9.x86_64 69/75 2026-02-17T20:09:12.587 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : rbd-mirror-2:19.2.3-694.g0a9403ad.el9.x86_64 70/75 2026-02-17T20:09:12.587 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : rbd-mirror-2:17.2.9-0.el9.x86_64 71/75 2026-02-17T20:09:12.587 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : rbd-nbd-2:19.2.3-694.g0a9403ad.el9.x86_64 72/75 2026-02-17T20:09:12.587 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : rbd-nbd-2:17.2.9-0.el9.x86_64 73/75 2026-02-17T20:09:12.587 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-694.g0a9403ad.el9.n 74/75 2026-02-17T20:09:12.656 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : ceph-mgr-modules-core-2:17.2.9-0.el9.noarch 75/75 2026-02-17T20:09:12.656 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:09:12.656 INFO:teuthology.orchestra.run.trial123.stdout:Upgraded: 2026-02-17T20:09:12.656 INFO:teuthology.orchestra.run.trial123.stdout: ceph-2:19.2.3-694.g0a9403ad.el9.x86_64 2026-02-17T20:09:12.657 INFO:teuthology.orchestra.run.trial123.stdout: ceph-base-2:19.2.3-694.g0a9403ad.el9.x86_64 2026-02-17T20:09:12.657 INFO:teuthology.orchestra.run.trial123.stdout: ceph-common-2:19.2.3-694.g0a9403ad.el9.x86_64 2026-02-17T20:09:12.657 INFO:teuthology.orchestra.run.trial123.stdout: ceph-fuse-2:19.2.3-694.g0a9403ad.el9.x86_64 2026-02-17T20:09:12.657 INFO:teuthology.orchestra.run.trial123.stdout: ceph-immutable-object-cache-2:19.2.3-694.g0a9403ad.el9.x86_64 2026-02-17T20:09:12.657 INFO:teuthology.orchestra.run.trial123.stdout: ceph-mds-2:19.2.3-694.g0a9403ad.el9.x86_64 2026-02-17T20:09:12.657 INFO:teuthology.orchestra.run.trial123.stdout: ceph-mgr-2:19.2.3-694.g0a9403ad.el9.x86_64 2026-02-17T20:09:12.657 INFO:teuthology.orchestra.run.trial123.stdout: ceph-mgr-modules-core-2:19.2.3-694.g0a9403ad.el9.noarch 2026-02-17T20:09:12.657 INFO:teuthology.orchestra.run.trial123.stdout: ceph-mon-2:19.2.3-694.g0a9403ad.el9.x86_64 2026-02-17T20:09:12.657 INFO:teuthology.orchestra.run.trial123.stdout: ceph-osd-2:19.2.3-694.g0a9403ad.el9.x86_64 2026-02-17T20:09:12.657 INFO:teuthology.orchestra.run.trial123.stdout: ceph-radosgw-2:19.2.3-694.g0a9403ad.el9.x86_64 2026-02-17T20:09:12.657 INFO:teuthology.orchestra.run.trial123.stdout: ceph-selinux-2:19.2.3-694.g0a9403ad.el9.x86_64 2026-02-17T20:09:12.657 INFO:teuthology.orchestra.run.trial123.stdout: ceph-test-2:19.2.3-694.g0a9403ad.el9.x86_64 2026-02-17T20:09:12.657 INFO:teuthology.orchestra.run.trial123.stdout: libcephfs-devel-2:19.2.3-694.g0a9403ad.el9.x86_64 2026-02-17T20:09:12.657 INFO:teuthology.orchestra.run.trial123.stdout: libcephfs2-2:19.2.3-694.g0a9403ad.el9.x86_64 2026-02-17T20:09:12.657 INFO:teuthology.orchestra.run.trial123.stdout: libcephsqlite-2:19.2.3-694.g0a9403ad.el9.x86_64 2026-02-17T20:09:12.657 INFO:teuthology.orchestra.run.trial123.stdout: librados-devel-2:19.2.3-694.g0a9403ad.el9.x86_64 2026-02-17T20:09:12.657 INFO:teuthology.orchestra.run.trial123.stdout: librados2-2:19.2.3-694.g0a9403ad.el9.x86_64 2026-02-17T20:09:12.657 INFO:teuthology.orchestra.run.trial123.stdout: libradosstriper1-2:19.2.3-694.g0a9403ad.el9.x86_64 2026-02-17T20:09:12.657 INFO:teuthology.orchestra.run.trial123.stdout: librbd1-2:19.2.3-694.g0a9403ad.el9.x86_64 2026-02-17T20:09:12.657 INFO:teuthology.orchestra.run.trial123.stdout: librgw2-2:19.2.3-694.g0a9403ad.el9.x86_64 2026-02-17T20:09:12.657 INFO:teuthology.orchestra.run.trial123.stdout: python3-ceph-argparse-2:19.2.3-694.g0a9403ad.el9.x86_64 2026-02-17T20:09:12.657 INFO:teuthology.orchestra.run.trial123.stdout: python3-ceph-common-2:19.2.3-694.g0a9403ad.el9.x86_64 2026-02-17T20:09:12.657 INFO:teuthology.orchestra.run.trial123.stdout: python3-cephfs-2:19.2.3-694.g0a9403ad.el9.x86_64 2026-02-17T20:09:12.657 INFO:teuthology.orchestra.run.trial123.stdout: python3-rados-2:19.2.3-694.g0a9403ad.el9.x86_64 2026-02-17T20:09:12.657 INFO:teuthology.orchestra.run.trial123.stdout: python3-rbd-2:19.2.3-694.g0a9403ad.el9.x86_64 2026-02-17T20:09:12.657 INFO:teuthology.orchestra.run.trial123.stdout: python3-rgw-2:19.2.3-694.g0a9403ad.el9.x86_64 2026-02-17T20:09:12.657 INFO:teuthology.orchestra.run.trial123.stdout: rbd-fuse-2:19.2.3-694.g0a9403ad.el9.x86_64 2026-02-17T20:09:12.657 INFO:teuthology.orchestra.run.trial123.stdout: rbd-mirror-2:19.2.3-694.g0a9403ad.el9.x86_64 2026-02-17T20:09:12.657 INFO:teuthology.orchestra.run.trial123.stdout: rbd-nbd-2:19.2.3-694.g0a9403ad.el9.x86_64 2026-02-17T20:09:12.657 INFO:teuthology.orchestra.run.trial123.stdout:Installed: 2026-02-17T20:09:12.657 INFO:teuthology.orchestra.run.trial123.stdout: boost-program-options-1.75.0-13.el9.x86_64 libarrow-9.0.0-15.el9.x86_64 2026-02-17T20:09:12.657 INFO:teuthology.orchestra.run.trial123.stdout: libarrow-doc-9.0.0-15.el9.noarch libnbd-1.20.3-4.el9.x86_64 2026-02-17T20:09:12.657 INFO:teuthology.orchestra.run.trial123.stdout: lua-5.4.4-4.el9.x86_64 lua-devel-5.4.4-4.el9.x86_64 2026-02-17T20:09:12.657 INFO:teuthology.orchestra.run.trial123.stdout: luarocks-3.9.2-5.el9.noarch parquet-libs-9.0.0-15.el9.x86_64 2026-02-17T20:09:12.657 INFO:teuthology.orchestra.run.trial123.stdout: pciutils-3.7.0-7.el9.x86_64 qatlib-25.08.0-2.el9.x86_64 2026-02-17T20:09:12.657 INFO:teuthology.orchestra.run.trial123.stdout: qatlib-service-25.08.0-2.el9.x86_64 qatzip-libs-1.3.1-1.el9.x86_64 2026-02-17T20:09:12.657 INFO:teuthology.orchestra.run.trial123.stdout: re2-1:20211101-20.el9.x86_64 unzip-6.0-59.el9.x86_64 2026-02-17T20:09:12.657 INFO:teuthology.orchestra.run.trial123.stdout: zip-3.0-35.el9.x86_64 2026-02-17T20:09:12.657 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:09:12.657 INFO:teuthology.orchestra.run.trial123.stdout:Complete! 2026-02-17T20:09:12.710 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=0a9403ad6667fb8ffa43f11d9a5d3062d3558d8e 2026-02-17T20:09:12.868 DEBUG:teuthology.orchestra.run.trial123:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-17T20:09:12.889 INFO:teuthology.orchestra.run.trial123.stdout:19.2.3-694.g0a9403ad.el9 2026-02-17T20:09:12.889 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-694.g0a9403ad.el9 2026-02-17T20:09:12.890 INFO:teuthology.task.install:The correct ceph version 19.2.3-694.g0a9403ad is installed. 2026-02-17T20:09:12.892 INFO:teuthology.run_tasks:Running task print... 2026-02-17T20:09:12.907 INFO:teuthology.task.print:**** done install.upgrade 2026-02-17T20:09:12.907 INFO:teuthology.run_tasks:Running task ceph.restart... 2026-02-17T20:09:12.923 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-17T20:09:12.923 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T20:09:12.939 INFO:tasks.ceph.mon.a:Stopped 2026-02-17T20:09:12.939 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-17T20:09:12.940 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-17T20:09:12.981 INFO:tasks.ceph.mon.a:Started 2026-02-17T20:09:12.981 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-17T20:09:12.982 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T20:09:12.991 INFO:tasks.ceph.mon.b:Stopped 2026-02-17T20:09:12.991 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-17T20:09:12.991 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-17T20:09:13.033 INFO:tasks.ceph.mon.b:Started 2026-02-17T20:09:13.033 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-17T20:09:13.033 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T20:09:13.043 INFO:tasks.ceph.mon.c:Stopped 2026-02-17T20:09:13.043 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-17T20:09:13.043 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-17T20:09:13.086 INFO:tasks.ceph.mon.c:Started 2026-02-17T20:09:13.086 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-17T20:09:13.086 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T20:09:13.106 INFO:tasks.ceph.mgr.x:Stopped 2026-02-17T20:09:13.106 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-17T20:09:13.106 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-17T20:09:13.147 INFO:tasks.ceph.mgr.x:Started 2026-02-17T20:09:13.148 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2026-02-17T20:09:13.148 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T20:09:13.172 INFO:tasks.ceph.mgr.y:Stopped 2026-02-17T20:09:13.172 INFO:tasks.ceph.mgr.y:Restarting daemon 2026-02-17T20:09:13.172 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2026-02-17T20:09:13.214 INFO:tasks.ceph.mgr.y:Started 2026-02-17T20:09:13.214 INFO:teuthology.run_tasks:Running task ceph.healthy... 2026-02-17T20:09:13.230 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-17T20:09:13.231 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-17T20:09:13.231 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-17T20:09:13.301 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:13.303+0000 7f791f5b4640 1 Processor -- start 2026-02-17T20:09:13.301 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:13.303+0000 7f791f5b4640 1 -- start start 2026-02-17T20:09:13.301 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:13.304+0000 7f791f5b4640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f791812aa00 0x7f791812ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:13.301 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:13.304+0000 7f791f5b4640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f791812b320 0x7f791812df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:13.301 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:13.304+0000 7f791f5b4640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7918073910 con 0x7f791812e460 2026-02-17T20:09:13.302 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:13.304+0000 7f791f5b4640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f7918074290 con 0x7f791812aa00 2026-02-17T20:09:13.302 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:13.304+0000 7f791f5b4640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f7918072fa0 con 0x7f791812b320 2026-02-17T20:09:13.302 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:13.304+0000 7f791cb28640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f791812b320 0x7f791812df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:13.302 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:13.304+0000 7f791cb28640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f791812b320 0x7f791812df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:48932/0 (socket says 10.20.193.123:48932) 2026-02-17T20:09:13.302 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:13.304+0000 7f791cb28640 1 -- 10.20.193.123:0/1107576445 learned_addr learned my addr 10.20.193.123:0/1107576445 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:13.302 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:13.304+0000 7f791d329640 1 --2- 10.20.193.123:0/1107576445 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f791812aa00 0x7f791812ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:13.302 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:13.304+0000 7f791cb28640 1 -- 10.20.193.123:0/1107576445 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f791812b320 msgr2=0x7f791812df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T20:09:13.302 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:13.304+0000 7f791cb28640 1 -- 10.20.193.123:0/1107576445 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f791812b320 msgr2=0x7f791812df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T20:09:13.302 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:13.304+0000 7f791cb28640 1 --2- 10.20.193.123:0/1107576445 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f791812b320 0x7f791812df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T20:09:13.302 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:13.304+0000 7f791cb28640 1 --2- 10.20.193.123:0/1107576445 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f791812b320 0x7f791812df20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T20:09:13.302 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:13.304+0000 7f791d329640 1 -- 10.20.193.123:0/1107576445 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f791812aa00 msgr2=0x7f791812ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T20:09:13.302 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:13.304+0000 7f791d329640 1 -- 10.20.193.123:0/1107576445 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f791812aa00 msgr2=0x7f791812ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T20:09:13.303 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:13.304+0000 7f791d329640 1 --2- 10.20.193.123:0/1107576445 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f791812aa00 0x7f791812ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T20:09:13.303 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:13.304+0000 7f791d329640 1 --2- 10.20.193.123:0/1107576445 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f791812aa00 0x7f791812ade0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T20:09:13.501 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:13.504+0000 7f791cb28640 1 --2- 10.20.193.123:0/1107576445 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f791812b320 0x7f791812df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:13.501 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:13.504+0000 7f791d329640 1 --2- 10.20.193.123:0/1107576445 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f791812aa00 0x7f791812ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:13.501 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:13.504+0000 7f791cb28640 1 -- 10.20.193.123:0/1107576445 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f791812b320 msgr2=0x7f791812df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T20:09:13.501 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:13.504+0000 7f791cb28640 1 -- 10.20.193.123:0/1107576445 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f791812b320 msgr2=0x7f791812df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T20:09:13.502 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:13.504+0000 7f791cb28640 1 --2- 10.20.193.123:0/1107576445 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f791812b320 0x7f791812df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T20:09:13.502 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:13.504+0000 7f791cb28640 1 --2- 10.20.193.123:0/1107576445 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f791812b320 0x7f791812df20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T20:09:13.502 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:13.504+0000 7f791d329640 1 -- 10.20.193.123:0/1107576445 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f791812aa00 msgr2=0x7f791812ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T20:09:13.502 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:13.504+0000 7f791d329640 1 -- 10.20.193.123:0/1107576445 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f791812aa00 msgr2=0x7f791812ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T20:09:13.502 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:13.504+0000 7f791d329640 1 --2- 10.20.193.123:0/1107576445 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f791812aa00 0x7f791812ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T20:09:13.502 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:13.504+0000 7f791d329640 1 --2- 10.20.193.123:0/1107576445 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f791812aa00 0x7f791812ade0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T20:09:13.902 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:13.905+0000 7f791cb28640 1 --2- 10.20.193.123:0/1107576445 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f791812b320 0x7f791812df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:13.902 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:13.905+0000 7f791cb28640 1 -- 10.20.193.123:0/1107576445 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f791812b320 msgr2=0x7f791812df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T20:09:13.902 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:13.905+0000 7f791cb28640 1 -- 10.20.193.123:0/1107576445 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f791812b320 msgr2=0x7f791812df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T20:09:13.902 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:13.905+0000 7f791cb28640 1 --2- 10.20.193.123:0/1107576445 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f791812b320 0x7f791812df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T20:09:13.902 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:13.905+0000 7f791cb28640 1 --2- 10.20.193.123:0/1107576445 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f791812b320 0x7f791812df20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T20:09:13.902 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:13.905+0000 7f791d329640 1 --2- 10.20.193.123:0/1107576445 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f791812aa00 0x7f791812ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:13.902 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:13.905+0000 7f791d329640 1 -- 10.20.193.123:0/1107576445 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f791812aa00 msgr2=0x7f791812ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T20:09:13.903 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:13.905+0000 7f791d329640 1 -- 10.20.193.123:0/1107576445 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f791812aa00 msgr2=0x7f791812ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T20:09:13.903 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:13.905+0000 7f791d329640 1 --2- 10.20.193.123:0/1107576445 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f791812aa00 0x7f791812ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T20:09:13.903 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:13.905+0000 7f791d329640 1 --2- 10.20.193.123:0/1107576445 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f791812aa00 0x7f791812ade0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T20:09:14.702 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:14.705+0000 7f791cb28640 1 --2- 10.20.193.123:0/1107576445 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f791812b320 0x7f791812df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:14.702 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:14.705+0000 7f791cb28640 1 -- 10.20.193.123:0/1107576445 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f791812b320 msgr2=0x7f791812df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T20:09:14.703 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:14.705+0000 7f791cb28640 1 -- 10.20.193.123:0/1107576445 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f791812b320 msgr2=0x7f791812df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T20:09:14.703 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:14.705+0000 7f791cb28640 1 --2- 10.20.193.123:0/1107576445 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f791812b320 0x7f791812df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T20:09:14.703 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:14.705+0000 7f791cb28640 1 --2- 10.20.193.123:0/1107576445 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f791812b320 0x7f791812df20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T20:09:14.703 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:14.706+0000 7f791d329640 1 --2- 10.20.193.123:0/1107576445 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f791812aa00 0x7f791812ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:14.703 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:14.706+0000 7f791d329640 1 -- 10.20.193.123:0/1107576445 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f791812aa00 msgr2=0x7f791812ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T20:09:14.703 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:14.706+0000 7f791d329640 1 -- 10.20.193.123:0/1107576445 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f791812aa00 msgr2=0x7f791812ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T20:09:14.703 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:14.706+0000 7f791d329640 1 --2- 10.20.193.123:0/1107576445 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f791812aa00 0x7f791812ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T20:09:14.703 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:14.706+0000 7f791d329640 1 --2- 10.20.193.123:0/1107576445 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f791812aa00 0x7f791812ade0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T20:09:16.300 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:16.304+0000 7f7906ffd640 1 -- 10.20.193.123:0/1107576445 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f791812b320 msgr2=0x7f791812df20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T20:09:16.300 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:16.304+0000 7f7906ffd640 1 --2- 10.20.193.123:0/1107576445 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f791812b320 0x7f791812df20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:16.300 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:16.304+0000 7f7906ffd640 1 -- 10.20.193.123:0/1107576445 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f791812aa00 msgr2=0x7f791812ade0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T20:09:16.300 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:16.304+0000 7f7906ffd640 1 --2- 10.20.193.123:0/1107576445 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f791812aa00 0x7f791812ade0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:16.300 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:16.304+0000 7f7906ffd640 1 -- 10.20.193.123:0/1107576445 >> v1:10.20.193.123:6789/0 conn(0x7f791812e460 legacy=0x7f79181352b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:16.300 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:16.304+0000 7f7906ffd640 1 --2- 10.20.193.123:0/1107576445 >> v2:10.20.193.123:3300/0 conn(0x7f78fc003800 0x7f78fc005c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:16.300 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:16.304+0000 7f7906ffd640 1 -- 10.20.193.123:0/1107576445 --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7f7918072fa0 con 0x7f78fc003800 2026-02-17T20:09:16.300 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:16.304+0000 7f791d329640 1 --2- 10.20.193.123:0/1107576445 >> v2:10.20.193.123:3300/0 conn(0x7f78fc003800 0x7f78fc005c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:16.300 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:16.304+0000 7f791d329640 1 -- 10.20.193.123:0/1107576445 >> v2:10.20.193.123:3300/0 conn(0x7f78fc003800 msgr2=0x7f78fc005c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T20:09:16.300 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:16.304+0000 7f791d329640 1 -- 10.20.193.123:0/1107576445 >> v2:10.20.193.123:3300/0 conn(0x7f78fc003800 msgr2=0x7f78fc005c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T20:09:16.300 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:16.304+0000 7f791d329640 1 --2- 10.20.193.123:0/1107576445 >> v2:10.20.193.123:3300/0 conn(0x7f78fc003800 0x7f78fc005c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T20:09:16.300 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:16.304+0000 7f791d329640 1 --2- 10.20.193.123:0/1107576445 >> v2:10.20.193.123:3300/0 conn(0x7f78fc003800 0x7f78fc005c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T20:09:16.500 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:16.504+0000 7f791d329640 1 --2- 10.20.193.123:0/1107576445 >> v2:10.20.193.123:3300/0 conn(0x7f78fc003800 0x7f78fc005c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:16.500 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:16.504+0000 7f791d329640 1 -- 10.20.193.123:0/1107576445 >> v2:10.20.193.123:3300/0 conn(0x7f78fc003800 msgr2=0x7f78fc005c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T20:09:16.500 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:16.504+0000 7f791d329640 1 -- 10.20.193.123:0/1107576445 >> v2:10.20.193.123:3300/0 conn(0x7f78fc003800 msgr2=0x7f78fc005c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T20:09:16.500 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:16.504+0000 7f791d329640 1 --2- 10.20.193.123:0/1107576445 >> v2:10.20.193.123:3300/0 conn(0x7f78fc003800 0x7f78fc005c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T20:09:16.500 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:16.504+0000 7f791d329640 1 --2- 10.20.193.123:0/1107576445 >> v2:10.20.193.123:3300/0 conn(0x7f78fc003800 0x7f78fc005c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T20:09:16.901 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:16.905+0000 7f791d329640 1 --2- 10.20.193.123:0/1107576445 >> v2:10.20.193.123:3300/0 conn(0x7f78fc003800 0x7f78fc005c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:16.901 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:16.905+0000 7f791d329640 1 -- 10.20.193.123:0/1107576445 >> v2:10.20.193.123:3300/0 conn(0x7f78fc003800 msgr2=0x7f78fc005c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T20:09:16.901 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:16.905+0000 7f791d329640 1 -- 10.20.193.123:0/1107576445 >> v2:10.20.193.123:3300/0 conn(0x7f78fc003800 msgr2=0x7f78fc005c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T20:09:16.901 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:16.905+0000 7f791d329640 1 --2- 10.20.193.123:0/1107576445 >> v2:10.20.193.123:3300/0 conn(0x7f78fc003800 0x7f78fc005c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T20:09:16.901 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:16.905+0000 7f791d329640 1 --2- 10.20.193.123:0/1107576445 >> v2:10.20.193.123:3300/0 conn(0x7f78fc003800 0x7f78fc005c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T20:09:17.702 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:17.706+0000 7f791d329640 1 --2- 10.20.193.123:0/1107576445 >> v2:10.20.193.123:3300/0 conn(0x7f78fc003800 0x7f78fc005c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:17.702 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:17.706+0000 7f791d329640 1 -- 10.20.193.123:0/1107576445 >> v2:10.20.193.123:3300/0 conn(0x7f78fc003800 msgr2=0x7f78fc005c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T20:09:17.703 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:17.706+0000 7f791d329640 1 -- 10.20.193.123:0/1107576445 >> v2:10.20.193.123:3300/0 conn(0x7f78fc003800 msgr2=0x7f78fc005c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T20:09:17.703 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:17.706+0000 7f791d329640 1 --2- 10.20.193.123:0/1107576445 >> v2:10.20.193.123:3300/0 conn(0x7f78fc003800 0x7f78fc005c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T20:09:17.703 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:17.706+0000 7f791d329640 1 --2- 10.20.193.123:0/1107576445 >> v2:10.20.193.123:3300/0 conn(0x7f78fc003800 0x7f78fc005c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T20:09:19.302 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.304+0000 7f7906ffd640 1 -- 10.20.193.123:0/1107576445 >> v2:10.20.193.123:3300/0 conn(0x7f78fc003800 msgr2=0x7f78fc005c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T20:09:19.302 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.304+0000 7f7906ffd640 1 --2- 10.20.193.123:0/1107576445 >> v2:10.20.193.123:3300/0 conn(0x7f78fc003800 0x7f78fc005c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:19.302 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.304+0000 7f7906ffd640 1 --2- 10.20.193.123:0/1107576445 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f791812aa00 0x7f78fc0084b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:19.302 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.304+0000 7f7906ffd640 1 --2- 10.20.193.123:0/1107576445 >> v2:10.20.193.123:3300/0 conn(0x7f78fc003800 0x7f78fc00c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:19.302 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.304+0000 7f7906ffd640 1 -- 10.20.193.123:0/1107576445 --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f791812b760 con 0x7f791812e460 2026-02-17T20:09:19.302 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.304+0000 7f7906ffd640 1 -- 10.20.193.123:0/1107576445 --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7f7918072fa0 con 0x7f78fc003800 2026-02-17T20:09:19.302 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.304+0000 7f7906ffd640 1 -- 10.20.193.123:0/1107576445 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f78fc005d00 con 0x7f791812aa00 2026-02-17T20:09:19.303 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.304+0000 7f791d329640 1 --2- 10.20.193.123:0/1107576445 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f791812aa00 0x7f78fc0084b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:19.303 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.304+0000 7f791db2a640 1 --2- 10.20.193.123:0/1107576445 >> v2:10.20.193.123:3300/0 conn(0x7f78fc003800 0x7f78fc00c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:19.303 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.304+0000 7f791d329640 1 -- 10.20.193.123:0/1107576445 >> v2:10.20.193.123:3300/0 conn(0x7f78fc003800 msgr2=0x7f78fc00c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:19.303 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.304+0000 7f791d329640 1 --2- 10.20.193.123:0/1107576445 >> v2:10.20.193.123:3300/0 conn(0x7f78fc003800 0x7f78fc00c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:19.303 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.304+0000 7f791d329640 1 -- 10.20.193.123:0/1107576445 >> v1:10.20.193.123:6789/0 conn(0x7f791812e460 legacy=0x7f78fc00aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:19.303 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.304+0000 7f791d329640 1 -- 10.20.193.123:0/1107576445 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78fc005f00 con 0x7f791812aa00 2026-02-17T20:09:19.303 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.305+0000 7f791d329640 1 --2- 10.20.193.123:0/1107576445 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f791812aa00 0x7f78fc0084b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7908006fb0 tx=0x7f7908030c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7be5554b2af211a8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:19.303 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.305+0000 7f7907fff640 1 -- 10.20.193.123:0/1107576445 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790800f040 con 0x7f791812aa00 2026-02-17T20:09:19.303 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.305+0000 7f7907fff640 1 -- 10.20.193.123:0/1107576445 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79080326e0 con 0x7f791812aa00 2026-02-17T20:09:19.303 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.305+0000 7f7907fff640 1 -- 10.20.193.123:0/1107576445 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7908032ab0 con 0x7f791812aa00 2026-02-17T20:09:19.303 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.305+0000 7f791f5b4640 1 -- 10.20.193.123:0/1107576445 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f791812aa00 msgr2=0x7f78fc0084b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:19.303 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.305+0000 7f791f5b4640 1 --2- 10.20.193.123:0/1107576445 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f791812aa00 0x7f78fc0084b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7908006fb0 tx=0x7f7908030c60 comp rx=0 tx=0).stop 2026-02-17T20:09:19.304 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.305+0000 7f791f5b4640 1 -- 10.20.193.123:0/1107576445 shutdown_connections 2026-02-17T20:09:19.304 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.305+0000 7f791f5b4640 1 --2- 10.20.193.123:0/1107576445 >> v2:10.20.193.123:3300/0 conn(0x7f78fc003800 0x7f78fc00c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:19.304 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.305+0000 7f791f5b4640 1 --2- 10.20.193.123:0/1107576445 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f791812b320 0x7f791812df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:19.304 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.305+0000 7f791f5b4640 1 --2- 10.20.193.123:0/1107576445 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f791812aa00 0x7f78fc0084b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:19.304 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.305+0000 7f791f5b4640 1 -- 10.20.193.123:0/1107576445 >> 10.20.193.123:0/1107576445 conn(0x7f791809d6c0 msgr2=0x7f791809dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:19.304 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.305+0000 7f791f5b4640 1 -- 10.20.193.123:0/1107576445 shutdown_connections 2026-02-17T20:09:19.304 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.305+0000 7f791f5b4640 1 -- 10.20.193.123:0/1107576445 wait complete. 2026-02-17T20:09:19.304 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.306+0000 7f791f5b4640 1 Processor -- start 2026-02-17T20:09:19.306 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.306+0000 7f791f5b4640 1 -- start start 2026-02-17T20:09:19.307 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.307+0000 7f791f5b4640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f78fc003800 0x7f7918115140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:19.307 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.307+0000 7f791f5b4640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f791812aa00 0x7f7918115680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:19.307 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.307+0000 7f791f5b4640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f791812b320 0x7f79181c6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:19.307 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.307+0000 7f791f5b4640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7f791812b170 con 0x7f791812aa00 2026-02-17T20:09:19.307 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.307+0000 7f791f5b4640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f791812aff0 con 0x7f78fc003800 2026-02-17T20:09:19.307 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.307+0000 7f791f5b4640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f791812e910 con 0x7f791812b320 2026-02-17T20:09:19.307 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.307+0000 7f791d329640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f78fc003800 0x7f7918115140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:19.307 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.307+0000 7f791d329640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f78fc003800 0x7f7918115140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:45034/0 (socket says 10.20.193.123:45034) 2026-02-17T20:09:19.307 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.307+0000 7f791db2a640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f791812b320 0x7f79181c6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:19.307 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.307+0000 7f791d329640 1 -- 10.20.193.123:0/487778747 learned_addr learned my addr 10.20.193.123:0/487778747 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:19.308 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.307+0000 7f791cb28640 1 --2- 10.20.193.123:0/487778747 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f791812aa00 0x7f7918115680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:19.308 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.307+0000 7f791d329640 1 -- 10.20.193.123:0/487778747 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f791812b320 msgr2=0x7f79181c6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:19.308 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.307+0000 7f791d329640 1 --2- 10.20.193.123:0/487778747 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f791812b320 0x7f79181c6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:19.308 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.307+0000 7f791d329640 1 -- 10.20.193.123:0/487778747 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f791812aa00 msgr2=0x7f7918115680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:19.308 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.307+0000 7f791d329640 1 --2- 10.20.193.123:0/487778747 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f791812aa00 0x7f7918115680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:19.308 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.307+0000 7f791d329640 1 -- 10.20.193.123:0/487778747 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f791811fa70 con 0x7f78fc003800 2026-02-17T20:09:19.308 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.307+0000 7f791d329640 1 --2- 10.20.193.123:0/487778747 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f78fc003800 0x7f7918115140 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f790803c040 tx=0x7f79080047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:19.308 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.309+0000 7f7905ffb640 1 -- 10.20.193.123:0/487778747 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790804a070 con 0x7f78fc003800 2026-02-17T20:09:19.308 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.309+0000 7f7905ffb640 1 -- 10.20.193.123:0/487778747 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f790803a9e0 con 0x7f78fc003800 2026-02-17T20:09:19.308 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.309+0000 7f791f5b4640 1 -- 10.20.193.123:0/487778747 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7918116ee0 con 0x7f78fc003800 2026-02-17T20:09:19.308 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.309+0000 7f7905ffb640 1 -- 10.20.193.123:0/487778747 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790800f040 con 0x7f78fc003800 2026-02-17T20:09:19.308 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.309+0000 7f791f5b4640 1 -- 10.20.193.123:0/487778747 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7918115bc0 con 0x7f78fc003800 2026-02-17T20:09:19.309 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.309+0000 7f791f5b4640 1 -- 10.20.193.123:0/487778747 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7918074290 con 0x7f78fc003800 2026-02-17T20:09:19.309 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.310+0000 7f7905ffb640 1 -- 10.20.193.123:0/487778747 <== mon.1 v2:10.20.193.123:3301/0 4 ==== mgrmap(e 6) ==== 59491+0+0 (secure 0 0 0) 0x7f7908015040 con 0x7f78fc003800 2026-02-17T20:09:19.309 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.310+0000 7f791cb28640 1 -- 10.20.193.123:0/487778747 >> v1:10.20.193.123:6800/23720 conn(0x7f78e804d6e0 legacy=0x7f78e804fba0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.123:6800/23720 2026-02-17T20:09:19.309 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.310+0000 7f7905ffb640 1 -- 10.20.193.123:0/487778747 <== mon.1 v2:10.20.193.123:3301/0 5 ==== osd_map(16..16 src has 1..16) ==== 2806+0+0 (secure 0 0 0) 0x7f790808b400 con 0x7f78fc003800 2026-02-17T20:09:19.309 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.312+0000 7f7905ffb640 1 -- 10.20.193.123:0/487778747 <== mon.1 v2:10.20.193.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+144236 (secure 0 0 0) 0x7f7908054030 con 0x7f78fc003800 2026-02-17T20:09:19.315 INFO:tasks.ceph.mgr.x.trial123.stderr:2026-02-17T20:09:19.319+0000 7fda803dc140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-17T20:09:19.356 INFO:tasks.ceph.mgr.y.trial123.stderr:2026-02-17T20:09:19.360+0000 7fc383812140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-17T20:09:19.382 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.387+0000 7f791f5b4640 1 -- 10.20.193.123:0/487778747 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f791811f610 con 0x7f78fc003800 2026-02-17T20:09:19.445 INFO:tasks.ceph.mgr.x.trial123.stderr:2026-02-17T20:09:19.449+0000 7fda803dc140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-17T20:09:19.469 INFO:tasks.ceph.mgr.y.trial123.stderr:2026-02-17T20:09:19.474+0000 7fc383812140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-17T20:09:19.471 INFO:tasks.ceph.mgr.x.trial123.stderr:2026-02-17T20:09:19.475+0000 7fda803dc140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-17T20:09:19.492 INFO:tasks.ceph.mgr.y.trial123.stderr:2026-02-17T20:09:19.496+0000 7fc383812140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-17T20:09:19.505 INFO:tasks.ceph.mgr.x.trial123.stderr:2026-02-17T20:09:19.509+0000 7fda803dc140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-17T20:09:19.506 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.510+0000 7f791cb28640 1 -- 10.20.193.123:0/487778747 >> v1:10.20.193.123:6800/23720 conn(0x7f78e804d6e0 legacy=0x7f78e804fba0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.123:6800/23720 2026-02-17T20:09:19.518 INFO:tasks.ceph.mgr.y.trial123.stderr:2026-02-17T20:09:19.523+0000 7fc383812140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-17T20:09:19.529 INFO:tasks.ceph.mgr.x.trial123.stderr:2026-02-17T20:09:19.533+0000 7fda803dc140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-17T20:09:19.540 INFO:tasks.ceph.mgr.y.trial123.stderr:2026-02-17T20:09:19.544+0000 7fc383812140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-17T20:09:19.556 INFO:tasks.ceph.mgr.x.trial123.stderr:2026-02-17T20:09:19.560+0000 7fda803dc140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-17T20:09:19.565 INFO:tasks.ceph.mgr.y.trial123.stderr:2026-02-17T20:09:19.570+0000 7fc383812140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-17T20:09:19.614 INFO:tasks.ceph.mgr.x.trial123.stderr:2026-02-17T20:09:19.618+0000 7fda803dc140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-17T20:09:19.618 INFO:tasks.ceph.mgr.y.trial123.stderr:2026-02-17T20:09:19.622+0000 7fc383812140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-17T20:09:19.640 INFO:tasks.ceph.mgr.x.trial123.stderr:2026-02-17T20:09:19.644+0000 7fda803dc140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-17T20:09:19.643 INFO:tasks.ceph.mgr.y.trial123.stderr:2026-02-17T20:09:19.647+0000 7fc383812140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-17T20:09:19.690 INFO:tasks.ceph.mgr.x.trial123.stderr:2026-02-17T20:09:19.694+0000 7fda803dc140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-17T20:09:19.691 INFO:tasks.ceph.mgr.y.trial123.stderr:2026-02-17T20:09:19.696+0000 7fc383812140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-17T20:09:19.734 INFO:tasks.ceph.mgr.x.trial123.stderr:2026-02-17T20:09:19.738+0000 7fda803dc140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-17T20:09:19.734 INFO:tasks.ceph.mgr.y.trial123.stderr:2026-02-17T20:09:19.738+0000 7fc383812140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-17T20:09:19.760 INFO:tasks.ceph.mgr.x.trial123.stderr:2026-02-17T20:09:19.764+0000 7fda803dc140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-17T20:09:19.761 INFO:tasks.ceph.mgr.y.trial123.stderr:2026-02-17T20:09:19.765+0000 7fc383812140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-17T20:09:19.785 INFO:tasks.ceph.mgr.x.trial123.stderr:2026-02-17T20:09:19.789+0000 7fda803dc140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-17T20:09:19.785 INFO:tasks.ceph.mgr.y.trial123.stderr:2026-02-17T20:09:19.790+0000 7fc383812140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-17T20:09:19.811 INFO:tasks.ceph.mgr.x.trial123.stderr:2026-02-17T20:09:19.815+0000 7fda803dc140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-17T20:09:19.811 INFO:tasks.ceph.mgr.y.trial123.stderr:2026-02-17T20:09:19.816+0000 7fc383812140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-17T20:09:19.834 INFO:tasks.ceph.mgr.x.trial123.stderr:2026-02-17T20:09:19.838+0000 7fda803dc140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-17T20:09:19.834 INFO:tasks.ceph.mgr.y.trial123.stderr:2026-02-17T20:09:19.839+0000 7fc383812140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-17T20:09:19.890 INFO:tasks.ceph.mgr.x.trial123.stderr:2026-02-17T20:09:19.894+0000 7fda803dc140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-17T20:09:19.890 INFO:tasks.ceph.mgr.y.trial123.stderr:2026-02-17T20:09:19.894+0000 7fc383812140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-17T20:09:19.906 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:19.911+0000 7f791cb28640 1 -- 10.20.193.123:0/487778747 >> v1:10.20.193.123:6800/23720 conn(0x7f78e804d6e0 legacy=0x7f78e804fba0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.123:6800/23720 2026-02-17T20:09:19.913 INFO:tasks.ceph.mgr.y.trial123.stderr:2026-02-17T20:09:19.917+0000 7fc383812140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-17T20:09:19.913 INFO:tasks.ceph.mgr.x.trial123.stderr:2026-02-17T20:09:19.917+0000 7fda803dc140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-17T20:09:19.936 INFO:tasks.ceph.mgr.x.trial123.stderr:2026-02-17T20:09:19.940+0000 7fda803dc140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-17T20:09:19.936 INFO:tasks.ceph.mgr.y.trial123.stderr:2026-02-17T20:09:19.940+0000 7fc383812140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-17T20:09:19.984 INFO:tasks.ceph.mgr.x.trial123.stderr:2026-02-17T20:09:19.988+0000 7fda803dc140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-17T20:09:19.985 INFO:tasks.ceph.mgr.y.trial123.stderr:2026-02-17T20:09:19.989+0000 7fc383812140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-17T20:09:20.006 INFO:tasks.ceph.mgr.x.trial123.stderr:2026-02-17T20:09:20.010+0000 7fda803dc140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-17T20:09:20.006 INFO:tasks.ceph.mgr.y.trial123.stderr:2026-02-17T20:09:20.010+0000 7fc383812140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-17T20:09:20.053 INFO:tasks.ceph.mgr.y.trial123.stderr:2026-02-17T20:09:20.057+0000 7fc383812140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-17T20:09:20.053 INFO:tasks.ceph.mgr.x.trial123.stderr:2026-02-17T20:09:20.057+0000 7fda803dc140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-17T20:09:20.127 INFO:tasks.ceph.mgr.x.trial123.stderr:2026-02-17T20:09:20.131+0000 7fda803dc140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-17T20:09:20.127 INFO:tasks.ceph.mgr.y.trial123.stderr:2026-02-17T20:09:20.131+0000 7fc383812140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-17T20:09:20.149 INFO:tasks.ceph.mgr.x.trial123.stderr:2026-02-17T20:09:20.154+0000 7fda803dc140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-17T20:09:20.150 INFO:tasks.ceph.mgr.y.trial123.stderr:2026-02-17T20:09:20.154+0000 7fc383812140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-17T20:09:20.317 INFO:tasks.ceph.mgr.y.trial123.stderr:2026-02-17T20:09:20.321+0000 7fc383812140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-17T20:09:20.318 INFO:tasks.ceph.mgr.x.trial123.stderr:2026-02-17T20:09:20.322+0000 7fda803dc140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-17T20:09:20.707 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:20.712+0000 7f791cb28640 1 -- 10.20.193.123:0/487778747 >> v1:10.20.193.123:6800/23720 conn(0x7f78e804d6e0 legacy=0x7f78e804fba0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.123:6800/23720 2026-02-17T20:09:22.309 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:22.313+0000 7f791cb28640 1 -- 10.20.193.123:0/487778747 >> v1:10.20.193.123:6800/23720 conn(0x7f78e804d6e0 legacy=0x7f78e804fba0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.123:6800/23720 2026-02-17T20:09:24.309 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.313+0000 7f7905ffb640 1 -- 10.20.193.123:0/487778747 <== mon.1 v2:10.20.193.123:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v6) ==== 74+0+117351 (secure 0 0 0) 0x7f790808a590 con 0x7f78fc003800 2026-02-17T20:09:24.309 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:09:24.311 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.315+0000 7f791f5b4640 1 -- 10.20.193.123:0/487778747 >> v1:10.20.193.123:6800/23720 conn(0x7f78e804d6e0 legacy=0x7f78e804fba0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T20:09:24.311 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.315+0000 7f791f5b4640 1 -- 10.20.193.123:0/487778747 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f78fc003800 msgr2=0x7f7918115140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.311 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.315+0000 7f791f5b4640 1 --2- 10.20.193.123:0/487778747 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f78fc003800 0x7f7918115140 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f790803c040 tx=0x7f79080047c0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.311 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.315+0000 7f791f5b4640 1 -- 10.20.193.123:0/487778747 shutdown_connections 2026-02-17T20:09:24.311 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.315+0000 7f791f5b4640 1 --2- 10.20.193.123:0/487778747 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f791812b320 0x7f79181c6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.311 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.315+0000 7f791f5b4640 1 --2- 10.20.193.123:0/487778747 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f791812aa00 0x7f7918115680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.311 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.315+0000 7f791f5b4640 1 --2- 10.20.193.123:0/487778747 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f78fc003800 0x7f7918115140 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.311 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.315+0000 7f791f5b4640 1 -- 10.20.193.123:0/487778747 >> 10.20.193.123:0/487778747 conn(0x7f791809d6c0 msgr2=0x7f791806e150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:24.311 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.315+0000 7f791f5b4640 1 -- 10.20.193.123:0/487778747 shutdown_connections 2026-02-17T20:09:24.311 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.315+0000 7f791f5b4640 1 -- 10.20.193.123:0/487778747 wait complete. 2026-02-17T20:09:24.319 INFO:teuthology.orchestra.run.trial123.stdout:{"epoch":6,"flags":0,"active_gid":4103,"active_name":"y","active_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6800","nonce":23720}]},"active_addr":"10.20.193.123:6800/23720","active_change":"2026-02-17T20:08:20.142493+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4119,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.123:0","nonce":1130446084}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.123:0","nonce":2996849897}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.123:0","nonce":1995254470}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.123:0","nonce":3994607579}]}]} 2026-02-17T20:09:24.321 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-17T20:09:24.321 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-17T20:09:24.321 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T20:09:24.389 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.393+0000 7fdf111aa640 1 Processor -- start 2026-02-17T20:09:24.389 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.393+0000 7fdf111aa640 1 -- start start 2026-02-17T20:09:24.389 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.393+0000 7fdf111aa640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fdf0c130c60 0x7fdf0c1354f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:24.389 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.393+0000 7fdf111aa640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fdf0c135a30 0x7fdf0c137e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:24.389 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.393+0000 7fdf111aa640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf0c131040 con 0x7fdf0c130170 2026-02-17T20:09:24.389 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.393+0000 7fdf111aa640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7fdf0c071e90 con 0x7fdf0c135a30 2026-02-17T20:09:24.389 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.394+0000 7fdf111aa640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7fdf0c071800 con 0x7fdf0c130c60 2026-02-17T20:09:24.389 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.394+0000 7fdf0ad76640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7fdf0c130170 0x7fdf0c130550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:37196/0 (socket says 10.20.193.123:37196) 2026-02-17T20:09:24.389 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.394+0000 7fdf0ad76640 1 -- 10.20.193.123:0/722544604 learned_addr learned my addr 10.20.193.123:0/722544604 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:09:24.389 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.394+0000 7fdf0a575640 1 --2- 10.20.193.123:0/722544604 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fdf0c130c60 0x7fdf0c1354f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:24.389 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.394+0000 7fdf0b577640 1 --2- 10.20.193.123:0/722544604 >> v2:10.20.193.123:3300/0 conn(0x7fdf0c135a30 0x7fdf0c137e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:24.389 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.394+0000 7fdf0a575640 1 -- 10.20.193.123:0/722544604 >> v2:10.20.193.123:3300/0 conn(0x7fdf0c135a30 msgr2=0x7fdf0c137e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:24.389 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.394+0000 7fdf09d74640 1 -- 10.20.193.123:0/722544604 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3120906380 0 0) 0x7fdf0c131040 con 0x7fdf0c130170 2026-02-17T20:09:24.390 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.394+0000 7fdf0a575640 1 --2- 10.20.193.123:0/722544604 >> v2:10.20.193.123:3300/0 conn(0x7fdf0c135a30 0x7fdf0c137e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.390 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.394+0000 7fdf0a575640 1 -- 10.20.193.123:0/722544604 >> v1:10.20.193.123:6789/0 conn(0x7fdf0c130170 legacy=0x7fdf0c130550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.390 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.394+0000 7fdf0a575640 1 -- 10.20.193.123:0/722544604 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf0c072260 con 0x7fdf0c130c60 2026-02-17T20:09:24.390 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.394+0000 7fdf0a575640 1 --2- 10.20.193.123:0/722544604 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fdf0c130c60 0x7fdf0c1354f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdef40098a0 tx=0x7fdef402ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a10b8d0d7691e46 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:24.390 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.394+0000 7fdf09d74640 1 -- 10.20.193.123:0/722544604 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef403c070 con 0x7fdf0c130c60 2026-02-17T20:09:24.390 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.394+0000 7fdf09d74640 1 -- 10.20.193.123:0/722544604 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdef402fa40 con 0x7fdf0c130c60 2026-02-17T20:09:24.390 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.394+0000 7fdf09d74640 1 -- 10.20.193.123:0/722544604 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef402fe10 con 0x7fdf0c130c60 2026-02-17T20:09:24.390 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.395+0000 7fdf111aa640 1 -- 10.20.193.123:0/722544604 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fdf0c130c60 msgr2=0x7fdf0c1354f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.390 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.395+0000 7fdf111aa640 1 --2- 10.20.193.123:0/722544604 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fdf0c130c60 0x7fdf0c1354f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdef40098a0 tx=0x7fdef402ed80 comp rx=0 tx=0).stop 2026-02-17T20:09:24.390 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.395+0000 7fdf111aa640 1 -- 10.20.193.123:0/722544604 shutdown_connections 2026-02-17T20:09:24.390 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.395+0000 7fdf111aa640 1 --2- 10.20.193.123:0/722544604 >> v2:10.20.193.123:3300/0 conn(0x7fdf0c135a30 0x7fdf0c137e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.390 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.395+0000 7fdf111aa640 1 --2- 10.20.193.123:0/722544604 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fdf0c130c60 0x7fdf0c1354f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.390 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.395+0000 7fdf111aa640 1 -- 10.20.193.123:0/722544604 >> 10.20.193.123:0/722544604 conn(0x7fdf0c09d6c0 msgr2=0x7fdf0c09dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:24.390 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.395+0000 7fdf111aa640 1 -- 10.20.193.123:0/722544604 shutdown_connections 2026-02-17T20:09:24.390 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.395+0000 7fdf111aa640 1 -- 10.20.193.123:0/722544604 wait complete. 2026-02-17T20:09:24.390 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.395+0000 7fdf111aa640 1 Processor -- start 2026-02-17T20:09:24.391 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.395+0000 7fdf111aa640 1 -- start start 2026-02-17T20:09:24.391 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.395+0000 7fdf111aa640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fdf0c130170 0x7fdf0c132430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:24.391 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.395+0000 7fdf111aa640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fdf0c130c60 0x7fdf0c132970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:24.391 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.395+0000 7fdf111aa640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fdf0c135a30 0x7fdf0c132eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:24.391 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.395+0000 7fdf111aa640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdf0c138570 con 0x7fdf0c130c60 2026-02-17T20:09:24.391 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.395+0000 7fdf111aa640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7fdf0c116bf0 con 0x7fdf0c135a30 2026-02-17T20:09:24.391 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.395+0000 7fdf111aa640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7fdf0c1386f0 con 0x7fdf0c130170 2026-02-17T20:09:24.391 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.395+0000 7fdf0ad76640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fdf0c130170 0x7fdf0c132430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:24.391 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.395+0000 7fdf0a575640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fdf0c130c60 0x7fdf0c132970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:24.391 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.395+0000 7fdf0ad76640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fdf0c130170 0x7fdf0c132430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:37926/0 (socket says 10.20.193.123:37926) 2026-02-17T20:09:24.391 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.395+0000 7fdf0a575640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fdf0c130c60 0x7fdf0c132970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:41806/0 (socket says 10.20.193.123:41806) 2026-02-17T20:09:24.391 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.395+0000 7fdf0ad76640 1 -- 10.20.193.123:0/3700082022 learned_addr learned my addr 10.20.193.123:0/3700082022 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:24.391 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.395+0000 7fdf0b577640 1 --2- 10.20.193.123:0/3700082022 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fdf0c135a30 0x7fdf0c132eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:24.391 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.396+0000 7fdf0a575640 1 -- 10.20.193.123:0/3700082022 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fdf0c130170 msgr2=0x7fdf0c132430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.391 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.396+0000 7fdf0a575640 1 --2- 10.20.193.123:0/3700082022 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fdf0c130170 0x7fdf0c132430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.392 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.396+0000 7fdf0a575640 1 -- 10.20.193.123:0/3700082022 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fdf0c135a30 msgr2=0x7fdf0c132eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.392 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.396+0000 7fdf0a575640 1 --2- 10.20.193.123:0/3700082022 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fdf0c135a30 0x7fdf0c132eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.392 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.396+0000 7fdf0a575640 1 -- 10.20.193.123:0/3700082022 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf0c12a8c0 con 0x7fdf0c130c60 2026-02-17T20:09:24.392 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.396+0000 7fdf0a575640 1 --2- 10.20.193.123:0/3700082022 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fdf0c130c60 0x7fdf0c132970 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdef4036000 tx=0x7fdef40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:24.392 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.396+0000 7fdeeb7fe640 1 -- 10.20.193.123:0/3700082022 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef403c040 con 0x7fdf0c130c60 2026-02-17T20:09:24.392 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.396+0000 7fdeeb7fe640 1 -- 10.20.193.123:0/3700082022 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdef4042450 con 0x7fdf0c130c60 2026-02-17T20:09:24.392 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.396+0000 7fdeeb7fe640 1 -- 10.20.193.123:0/3700082022 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef4042860 con 0x7fdf0c130c60 2026-02-17T20:09:24.392 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.396+0000 7fdf111aa640 1 -- 10.20.193.123:0/3700082022 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf0c1333f0 con 0x7fdf0c130c60 2026-02-17T20:09:24.392 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.396+0000 7fdf111aa640 1 -- 10.20.193.123:0/3700082022 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf0c134e30 con 0x7fdf0c130c60 2026-02-17T20:09:24.392 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.397+0000 7fdeeb7fe640 1 -- 10.20.193.123:0/3700082022 <== mon.0 v2:10.20.193.123:3300/0 4 ==== mgrmap(e 7) ==== 61803+0+0 (secure 0 0 0) 0x7fdef4042a00 con 0x7fdf0c130c60 2026-02-17T20:09:24.392 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.397+0000 7fdf111aa640 1 -- 10.20.193.123:0/3700082022 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf0c130550 con 0x7fdf0c130c60 2026-02-17T20:09:24.392 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.397+0000 7fdeeb7fe640 1 -- 10.20.193.123:0/3700082022 <== mon.0 v2:10.20.193.123:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3021+0+0 (secure 0 0 0) 0x7fdef408b7e0 con 0x7fdf0c130c60 2026-02-17T20:09:24.394 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.399+0000 7fdeeb7fe640 1 -- 10.20.193.123:0/3700082022 <== mon.0 v2:10.20.193.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+144236 (secure 0 0 0) 0x7fdef402fa00 con 0x7fdf0c130c60 2026-02-17T20:09:24.459 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.464+0000 7fdf111aa640 1 -- 10.20.193.123:0/3700082022 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdf0c135060 con 0x7fdf0c130c60 2026-02-17T20:09:24.459 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.464+0000 7fdeeb7fe640 1 -- 10.20.193.123:0/3700082022 <== mon.0 v2:10.20.193.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+9012 (secure 0 0 0) 0x7fdef408a730 con 0x7fdf0c130c60 2026-02-17T20:09:24.460 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:09:24.460 INFO:teuthology.orchestra.run.trial123.stdout:{"epoch":17,"fsid":"ddf342a7-b912-46f2-b373-84d7f3b75be2","created":"2026-02-17T20:08:19.090665+0000","modified":"2026-02-17T20:09:24.315464+0000","last_up_change":"2026-02-17T20:08:26.676482+0000","last_in_change":"2026-02-17T20:08:19.810884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"quincy","min_compat_client":"jewel","require_osd_release":"quincy","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-17T20:08:27.136671+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":13,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2026-02-17T20:08:28.174323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5cfdb97e-5584-42e3-8c32-a9b4ace549f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6801","nonce":24324}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6802","nonce":24324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6804","nonce":24324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6803","nonce":24324}]},"public_addr":"10.20.193.123:6801/24324","cluster_addr":"10.20.193.123:6802/24324","heartbeat_back_addr":"10.20.193.123:6804/24324","heartbeat_front_addr":"10.20.193.123:6803/24324","state":["exists","up"]},{"osd":1,"uuid":"9b7f5906-8ae8-4a34-8e71-1ba7cf3eeda1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6805","nonce":24325}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6806","nonce":24325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6808","nonce":24325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6807","nonce":24325}]},"public_addr":"10.20.193.123:6805/24325","cluster_addr":"10.20.193.123:6806/24325","heartbeat_back_addr":"10.20.193.123:6808/24325","heartbeat_front_addr":"10.20.193.123:6807/24325","state":["exists","up"]},{"osd":2,"uuid":"db6be5e2-fdd2-460f-bf35-269d92577824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6809","nonce":24326}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6810","nonce":24326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6812","nonce":24326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6811","nonce":24326}]},"public_addr":"10.20.193.123:6809/24326","cluster_addr":"10.20.193.123:6810/24326","heartbeat_back_addr":"10.20.193.123:6812/24326","heartbeat_front_addr":"10.20.193.123:6811/24326","state":["exists","up"]},{"osd":3,"uuid":"23275d01-0d57-497c-a600-d9aeef747af2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6813","nonce":24327}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6814","nonce":24327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6816","nonce":24327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6815","nonce":24327}]},"public_addr":"10.20.193.123:6813/24327","cluster_addr":"10.20.193.123:6814/24327","heartbeat_back_addr":"10.20.193.123:6816/24327","heartbeat_front_addr":"10.20.193.123:6815/24327","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:08:24.897268+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:08:24.890530+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:08:24.941602+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:08:24.897001+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.123:0/3994607579":"2026-02-18T20:09:24.315453+0000","10.20.193.123:0/1995254470":"2026-02-18T20:09:24.315453+0000","10.20.193.123:0/2996849897":"2026-02-18T20:09:24.315453+0000","10.20.193.123:6800/23720":"2026-02-18T20:09:24.315453+0000","10.20.193.123:0/1130446084":"2026-02-18T20:09:24.315453+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T20:09:24.460 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.465+0000 7fdf111aa640 1 -- 10.20.193.123:0/3700082022 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fdf0c130c60 msgr2=0x7fdf0c132970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.460 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.465+0000 7fdf111aa640 1 --2- 10.20.193.123:0/3700082022 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fdf0c130c60 0x7fdf0c132970 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdef4036000 tx=0x7fdef40047c0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.460 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.465+0000 7fdf111aa640 1 -- 10.20.193.123:0/3700082022 shutdown_connections 2026-02-17T20:09:24.461 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.465+0000 7fdf111aa640 1 --2- 10.20.193.123:0/3700082022 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fdf0c135a30 0x7fdf0c132eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.461 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.465+0000 7fdf111aa640 1 --2- 10.20.193.123:0/3700082022 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fdf0c130c60 0x7fdf0c132970 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.461 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.465+0000 7fdf111aa640 1 --2- 10.20.193.123:0/3700082022 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fdf0c130170 0x7fdf0c132430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.461 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.465+0000 7fdf111aa640 1 -- 10.20.193.123:0/3700082022 >> 10.20.193.123:0/3700082022 conn(0x7fdf0c09d6c0 msgr2=0x7fdf0c12aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:24.461 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.465+0000 7fdf111aa640 1 -- 10.20.193.123:0/3700082022 shutdown_connections 2026-02-17T20:09:24.461 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.465+0000 7fdf111aa640 1 -- 10.20.193.123:0/3700082022 wait complete. 2026-02-17T20:09:24.468 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-17T20:09:24.468 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T20:09:24.534 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.539+0000 7f1f3ffe3640 1 Processor -- start 2026-02-17T20:09:24.534 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.539+0000 7f1f3ffe3640 1 -- start start 2026-02-17T20:09:24.535 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.539+0000 7f1f3ffe3640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f1f38130c60 0x7f1f381354f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:24.535 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.539+0000 7f1f3ffe3640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f1f38135a30 0x7f1f38137e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:24.535 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.539+0000 7f1f3ffe3640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f38131040 con 0x7f1f38130170 2026-02-17T20:09:24.535 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.539+0000 7f1f3ffe3640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7f1f38071e90 con 0x7f1f38135a30 2026-02-17T20:09:24.535 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.539+0000 7f1f3ffe3640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f1f38071800 con 0x7f1f38130c60 2026-02-17T20:09:24.535 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.539+0000 7f1f3dd58640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7f1f38130170 0x7f1f38130550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:37208/0 (socket says 10.20.193.123:37208) 2026-02-17T20:09:24.535 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.539+0000 7f1f3dd58640 1 -- 10.20.193.123:0/1980847848 learned_addr learned my addr 10.20.193.123:0/1980847848 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:09:24.535 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.539+0000 7f1f3d557640 1 --2- 10.20.193.123:0/1980847848 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f1f38130c60 0x7f1f381354f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:24.535 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.539+0000 7f1f3e559640 1 --2- 10.20.193.123:0/1980847848 >> v2:10.20.193.123:3300/0 conn(0x7f1f38135a30 0x7f1f38137e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:24.535 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.540+0000 7f1f3cd56640 1 -- 10.20.193.123:0/1980847848 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3795519787 0 0) 0x7f1f38131040 con 0x7f1f38130170 2026-02-17T20:09:24.535 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.540+0000 7f1f3cd56640 1 -- 10.20.193.123:0/1980847848 --> v1:10.20.193.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f20003620 con 0x7f1f38130170 2026-02-17T20:09:24.535 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.540+0000 7f1f3e559640 1 -- 10.20.193.123:0/1980847848 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f1f38130c60 msgr2=0x7f1f381354f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:24.535 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.540+0000 7f1f3e559640 1 --2- 10.20.193.123:0/1980847848 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f1f38130c60 0x7f1f381354f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.535 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.540+0000 7f1f3e559640 1 -- 10.20.193.123:0/1980847848 >> v1:10.20.193.123:6789/0 conn(0x7f1f38130170 legacy=0x7f1f38130550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.535 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.540+0000 7f1f3e559640 1 -- 10.20.193.123:0/1980847848 --> v2:10.20.193.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f38072260 con 0x7f1f38135a30 2026-02-17T20:09:24.536 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.540+0000 7f1f3e559640 1 --2- 10.20.193.123:0/1980847848 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f1f38135a30 0x7f1f38137e20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1f34009d90 tx=0x7f1f3402f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfb1753bd84c79a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:24.536 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.540+0000 7f1f3cd56640 1 -- 10.20.193.123:0/1980847848 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f3403c070 con 0x7f1f38135a30 2026-02-17T20:09:24.536 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.540+0000 7f1f3cd56640 1 -- 10.20.193.123:0/1980847848 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f3402fe10 con 0x7f1f38135a30 2026-02-17T20:09:24.536 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.540+0000 7f1f3cd56640 1 -- 10.20.193.123:0/1980847848 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f34037660 con 0x7f1f38135a30 2026-02-17T20:09:24.536 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.540+0000 7f1f3ffe3640 1 -- 10.20.193.123:0/1980847848 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f1f38135a30 msgr2=0x7f1f38137e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.536 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.540+0000 7f1f3ffe3640 1 --2- 10.20.193.123:0/1980847848 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f1f38135a30 0x7f1f38137e20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1f34009d90 tx=0x7f1f3402f150 comp rx=0 tx=0).stop 2026-02-17T20:09:24.536 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.540+0000 7f1f3ffe3640 1 -- 10.20.193.123:0/1980847848 shutdown_connections 2026-02-17T20:09:24.536 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.540+0000 7f1f3ffe3640 1 --2- 10.20.193.123:0/1980847848 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f1f38135a30 0x7f1f38137e20 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.536 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.540+0000 7f1f3ffe3640 1 --2- 10.20.193.123:0/1980847848 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f1f38130c60 0x7f1f381354f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.536 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.540+0000 7f1f3ffe3640 1 -- 10.20.193.123:0/1980847848 >> 10.20.193.123:0/1980847848 conn(0x7f1f3809d6c0 msgr2=0x7f1f3809dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:24.536 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.540+0000 7f1f3ffe3640 1 -- 10.20.193.123:0/1980847848 shutdown_connections 2026-02-17T20:09:24.536 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.540+0000 7f1f3ffe3640 1 -- 10.20.193.123:0/1980847848 wait complete. 2026-02-17T20:09:24.536 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.541+0000 7f1f3ffe3640 1 Processor -- start 2026-02-17T20:09:24.536 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.541+0000 7f1f3ffe3640 1 -- start start 2026-02-17T20:09:24.537 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.541+0000 7f1f3ffe3640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f1f38130170 0x7f1f381320c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:24.537 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.541+0000 7f1f3ffe3640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f1f38130c60 0x7f1f38132600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:24.537 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.541+0000 7f1f3ffe3640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f1f38135a30 0x7f1f38132b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:24.537 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.541+0000 7f1f3ffe3640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1f38138570 con 0x7f1f38130c60 2026-02-17T20:09:24.537 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.541+0000 7f1f3ffe3640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f1f38116bf0 con 0x7f1f38130170 2026-02-17T20:09:24.537 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.541+0000 7f1f3ffe3640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f1f381386f0 con 0x7f1f38135a30 2026-02-17T20:09:24.537 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.541+0000 7f1f3d557640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f1f38130c60 0x7f1f38132600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:24.537 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.541+0000 7f1f3dd58640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f1f38130170 0x7f1f381320c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:24.537 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.541+0000 7f1f3d557640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f1f38130c60 0x7f1f38132600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:41824/0 (socket says 10.20.193.123:41824) 2026-02-17T20:09:24.537 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.541+0000 7f1f3d557640 1 -- 10.20.193.123:0/1828206492 learned_addr learned my addr 10.20.193.123:0/1828206492 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:24.537 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.541+0000 7f1f3e559640 1 --2- 10.20.193.123:0/1828206492 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f1f38135a30 0x7f1f38132b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:24.537 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.541+0000 7f1f3d557640 1 -- 10.20.193.123:0/1828206492 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f1f38135a30 msgr2=0x7f1f38132b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.537 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.541+0000 7f1f3d557640 1 --2- 10.20.193.123:0/1828206492 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f1f38135a30 0x7f1f38132b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.537 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.541+0000 7f1f3d557640 1 -- 10.20.193.123:0/1828206492 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f1f38130170 msgr2=0x7f1f381320c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.537 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.541+0000 7f1f3d557640 1 --2- 10.20.193.123:0/1828206492 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f1f38130170 0x7f1f381320c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.537 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.541+0000 7f1f3d557640 1 -- 10.20.193.123:0/1828206492 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f38134510 con 0x7f1f38130c60 2026-02-17T20:09:24.537 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.541+0000 7f1f3dd58640 1 --2- 10.20.193.123:0/1828206492 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f1f38130170 0x7f1f381320c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:24.537 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.541+0000 7f1f3d557640 1 --2- 10.20.193.123:0/1828206492 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f1f38130c60 0x7f1f38132600 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c00ebe0 tx=0x7f1f2c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:24.537 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.542+0000 7f1f267fc640 1 -- 10.20.193.123:0/1828206492 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c017070 con 0x7f1f38130c60 2026-02-17T20:09:24.537 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.542+0000 7f1f267fc640 1 -- 10.20.193.123:0/1828206492 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f2c00cc40 con 0x7f1f38130c60 2026-02-17T20:09:24.537 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.542+0000 7f1f3ffe3640 1 -- 10.20.193.123:0/1828206492 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f3812a8c0 con 0x7f1f38130c60 2026-02-17T20:09:24.537 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.542+0000 7f1f267fc640 1 -- 10.20.193.123:0/1828206492 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c013470 con 0x7f1f38130c60 2026-02-17T20:09:24.537 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.542+0000 7f1f3ffe3640 1 -- 10.20.193.123:0/1828206492 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f3812a340 con 0x7f1f38130c60 2026-02-17T20:09:24.538 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.542+0000 7f1f3ffe3640 1 -- 10.20.193.123:0/1828206492 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f3812a5d0 con 0x7f1f38130c60 2026-02-17T20:09:24.538 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.542+0000 7f1f267fc640 1 -- 10.20.193.123:0/1828206492 <== mon.0 v2:10.20.193.123:3300/0 4 ==== mgrmap(e 7) ==== 61803+0+0 (secure 0 0 0) 0x7f1f2c024060 con 0x7f1f38130c60 2026-02-17T20:09:24.538 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.542+0000 7f1f267fc640 1 -- 10.20.193.123:0/1828206492 <== mon.0 v2:10.20.193.123:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3021+0+0 (secure 0 0 0) 0x7f1f2c0667a0 con 0x7f1f38130c60 2026-02-17T20:09:24.540 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.544+0000 7f1f267fc640 1 -- 10.20.193.123:0/1828206492 <== mon.0 v2:10.20.193.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+144236 (secure 0 0 0) 0x7f1f2c0656f0 con 0x7f1f38130c60 2026-02-17T20:09:24.605 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.610+0000 7f1f3ffe3640 1 -- 10.20.193.123:0/1828206492 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1f38130550 con 0x7f1f38130c60 2026-02-17T20:09:24.606 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.610+0000 7f1f267fc640 1 -- 10.20.193.123:0/1828206492 <== mon.0 v2:10.20.193.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+9012 (secure 0 0 0) 0x7f1f2c03fc70 con 0x7f1f38130c60 2026-02-17T20:09:24.606 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:09:24.606 INFO:teuthology.orchestra.run.trial123.stdout:{"epoch":17,"fsid":"ddf342a7-b912-46f2-b373-84d7f3b75be2","created":"2026-02-17T20:08:19.090665+0000","modified":"2026-02-17T20:09:24.315464+0000","last_up_change":"2026-02-17T20:08:26.676482+0000","last_in_change":"2026-02-17T20:08:19.810884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"quincy","min_compat_client":"jewel","require_osd_release":"quincy","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-17T20:08:27.136671+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":13,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2026-02-17T20:08:28.174323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5cfdb97e-5584-42e3-8c32-a9b4ace549f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6801","nonce":24324}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6802","nonce":24324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6804","nonce":24324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6803","nonce":24324}]},"public_addr":"10.20.193.123:6801/24324","cluster_addr":"10.20.193.123:6802/24324","heartbeat_back_addr":"10.20.193.123:6804/24324","heartbeat_front_addr":"10.20.193.123:6803/24324","state":["exists","up"]},{"osd":1,"uuid":"9b7f5906-8ae8-4a34-8e71-1ba7cf3eeda1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6805","nonce":24325}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6806","nonce":24325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6808","nonce":24325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6807","nonce":24325}]},"public_addr":"10.20.193.123:6805/24325","cluster_addr":"10.20.193.123:6806/24325","heartbeat_back_addr":"10.20.193.123:6808/24325","heartbeat_front_addr":"10.20.193.123:6807/24325","state":["exists","up"]},{"osd":2,"uuid":"db6be5e2-fdd2-460f-bf35-269d92577824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6809","nonce":24326}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6810","nonce":24326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6812","nonce":24326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6811","nonce":24326}]},"public_addr":"10.20.193.123:6809/24326","cluster_addr":"10.20.193.123:6810/24326","heartbeat_back_addr":"10.20.193.123:6812/24326","heartbeat_front_addr":"10.20.193.123:6811/24326","state":["exists","up"]},{"osd":3,"uuid":"23275d01-0d57-497c-a600-d9aeef747af2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6813","nonce":24327}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6814","nonce":24327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6816","nonce":24327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6815","nonce":24327}]},"public_addr":"10.20.193.123:6813/24327","cluster_addr":"10.20.193.123:6814/24327","heartbeat_back_addr":"10.20.193.123:6816/24327","heartbeat_front_addr":"10.20.193.123:6815/24327","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:08:24.897268+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:08:24.890530+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:08:24.941602+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:08:24.897001+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.123:0/3994607579":"2026-02-18T20:09:24.315453+0000","10.20.193.123:0/1995254470":"2026-02-18T20:09:24.315453+0000","10.20.193.123:0/2996849897":"2026-02-18T20:09:24.315453+0000","10.20.193.123:6800/23720":"2026-02-18T20:09:24.315453+0000","10.20.193.123:0/1130446084":"2026-02-18T20:09:24.315453+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T20:09:24.607 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.612+0000 7f1f3ffe3640 1 -- 10.20.193.123:0/1828206492 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f1f38130c60 msgr2=0x7f1f38132600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.607 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.612+0000 7f1f3ffe3640 1 --2- 10.20.193.123:0/1828206492 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f1f38130c60 0x7f1f38132600 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c00ebe0 tx=0x7f1f2c00c520 comp rx=0 tx=0).stop 2026-02-17T20:09:24.607 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.612+0000 7f1f3ffe3640 1 -- 10.20.193.123:0/1828206492 shutdown_connections 2026-02-17T20:09:24.607 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.612+0000 7f1f3ffe3640 1 --2- 10.20.193.123:0/1828206492 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f1f38135a30 0x7f1f38132b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.607 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.612+0000 7f1f3ffe3640 1 --2- 10.20.193.123:0/1828206492 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f1f38130c60 0x7f1f38132600 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.607 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.612+0000 7f1f3ffe3640 1 --2- 10.20.193.123:0/1828206492 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f1f38130170 0x7f1f381320c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.607 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.612+0000 7f1f3ffe3640 1 -- 10.20.193.123:0/1828206492 >> 10.20.193.123:0/1828206492 conn(0x7f1f3809d6c0 msgr2=0x7f1f38073690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:24.607 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.612+0000 7f1f3ffe3640 1 -- 10.20.193.123:0/1828206492 shutdown_connections 2026-02-17T20:09:24.607 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.612+0000 7f1f3ffe3640 1 -- 10.20.193.123:0/1828206492 wait complete. 2026-02-17T20:09:24.615 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T20:09:24.615 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T20:09:24.615 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T20:09:24.615 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T20:09:24.683 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.687+0000 7f2901857640 1 Processor -- start 2026-02-17T20:09:24.683 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.687+0000 7f73fd461640 1 Processor -- start 2026-02-17T20:09:24.683 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.687+0000 7f2901857640 1 -- start start 2026-02-17T20:09:24.683 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.687+0000 7f73fd461640 1 -- start start 2026-02-17T20:09:24.683 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.687+0000 7f2901857640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f28fc1335b0 0x7f28fc1359a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:24.683 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.687+0000 7f2901857640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f28fc135ee0 0x7f28fc1382d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:24.683 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.687+0000 7f73fd461640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f73f812e1b0 0x7f73f812e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:24.683 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.687+0000 7f73fd461640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f73f81160b0 0x7f73f80731a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:24.683 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.687+0000 7f2901857640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28fc1310f0 con 0x7f28fc130600 2026-02-17T20:09:24.683 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.687+0000 7f2901857640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7f28fc130240 con 0x7f28fc135ee0 2026-02-17T20:09:24.683 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.687+0000 7f2901857640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f28fc09f550 con 0x7f28fc1335b0 2026-02-17T20:09:24.683 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.687+0000 7f73fd461640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73f806e720 con 0x7f73f80736e0 2026-02-17T20:09:24.684 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.687+0000 7f73fd461640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7f73f8116cd0 con 0x7f73f81160b0 2026-02-17T20:09:24.684 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.687+0000 7f73fd461640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f73f806f2a0 con 0x7f73f812e1b0 2026-02-17T20:09:24.684 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.688+0000 7f28faffd640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7f28fc130600 0x7f28fc1309e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:37222/0 (socket says 10.20.193.123:37222) 2026-02-17T20:09:24.684 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.688+0000 7f28faffd640 1 -- 10.20.193.123:0/3106538701 learned_addr learned my addr 10.20.193.123:0/3106538701 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:09:24.684 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.688+0000 7f28fa7fc640 1 --2- 10.20.193.123:0/3106538701 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f28fc1335b0 0x7f28fc1359a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:24.684 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.688+0000 7f28fb7fe640 1 --2- 10.20.193.123:0/3106538701 >> v2:10.20.193.123:3300/0 conn(0x7f28fc135ee0 0x7f28fc1382d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:24.684 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.688+0000 7f73f6ffd640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f73f812e1b0 0x7f73f812e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:24.684 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.688+0000 7f73f77fe640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7f73f80736e0 0x7f73f8135130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:37234/0 (socket says 10.20.193.123:37234) 2026-02-17T20:09:24.684 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.688+0000 7f73f77fe640 1 -- 10.20.193.123:0/3200476226 learned_addr learned my addr 10.20.193.123:0/3200476226 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:09:24.684 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.688+0000 7f73f67fc640 1 --2- 10.20.193.123:0/3200476226 >> v2:10.20.193.123:3300/0 conn(0x7f73f81160b0 0x7f73f80731a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:24.684 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.688+0000 7f28f9ffb640 1 -- 10.20.193.123:0/3106538701 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1157210038 0 0) 0x7f28fc1310f0 con 0x7f28fc130600 2026-02-17T20:09:24.684 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.688+0000 7f28f9ffb640 1 -- 10.20.193.123:0/3106538701 --> v1:10.20.193.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28e8003620 con 0x7f28fc130600 2026-02-17T20:09:24.684 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.688+0000 7f73f6ffd640 1 -- 10.20.193.123:0/3200476226 >> v2:10.20.193.123:3300/0 conn(0x7f73f81160b0 msgr2=0x7f73f80731a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:24.684 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.688+0000 7f73f6ffd640 1 --2- 10.20.193.123:0/3200476226 >> v2:10.20.193.123:3300/0 conn(0x7f73f81160b0 0x7f73f80731a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.684 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.688+0000 7f73f6ffd640 1 -- 10.20.193.123:0/3200476226 >> v1:10.20.193.123:6789/0 conn(0x7f73f80736e0 legacy=0x7f73f8135130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.684 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.688+0000 7f73f6ffd640 1 -- 10.20.193.123:0/3200476226 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73f812ead0 con 0x7f73f812e1b0 2026-02-17T20:09:24.685 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.688+0000 7f28fb7fe640 1 -- 10.20.193.123:0/3106538701 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f28fc1335b0 msgr2=0x7f28fc1359a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:24.685 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.688+0000 7f28fb7fe640 1 --2- 10.20.193.123:0/3106538701 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f28fc1335b0 0x7f28fc1359a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.685 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.688+0000 7f28fb7fe640 1 -- 10.20.193.123:0/3106538701 >> v1:10.20.193.123:6789/0 conn(0x7f28fc130600 legacy=0x7f28fc1309e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.685 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.688+0000 7f28fb7fe640 1 -- 10.20.193.123:0/3106538701 --> v2:10.20.193.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28fc071c80 con 0x7f28fc135ee0 2026-02-17T20:09:24.685 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.688+0000 7fb3cf07e640 1 Processor -- start 2026-02-17T20:09:24.685 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.688+0000 7fb3cf07e640 1 -- start start 2026-02-17T20:09:24.685 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.688+0000 7f73f6ffd640 1 --2- 10.20.193.123:0/3200476226 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f73f812e1b0 0x7f73f812e590 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f73ec009900 tx=0x7f73ec02eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bad5b41b5d2575 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:24.685 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.688+0000 7f28fb7fe640 1 --2- 10.20.193.123:0/3106538701 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f28fc135ee0 0x7f28fc1382d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f28ec009d90 tx=0x7f28ec02f190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0971b6b3eb85fd8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:24.685 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.688+0000 7fb3cf07e640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fb3c8073890 0x7fb3c812d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:24.685 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.688+0000 7fb3cf07e640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fb3c8135460 0x7fb3c8137850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:24.685 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.688+0000 7fb3cf07e640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3c8074070 con 0x7fb3c812cb80 2026-02-17T20:09:24.685 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.688+0000 7fb3cf07e640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7fb3c8072e70 con 0x7fb3c8135460 2026-02-17T20:09:24.685 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.688+0000 7fb3cf07e640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7fb3c8073020 con 0x7fb3c8073890 2026-02-17T20:09:24.685 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.688+0000 7fb3ccdf3640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7fb3c812cb80 0x7fb3c812cf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:37250/0 (socket says 10.20.193.123:37250) 2026-02-17T20:09:24.685 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.688+0000 7fb3ccdf3640 1 -- 10.20.193.123:0/3604697060 learned_addr learned my addr 10.20.193.123:0/3604697060 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:09:24.685 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.688+0000 7f73f5ffb640 1 -- 10.20.193.123:0/3200476226 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ec03c070 con 0x7f73f812e1b0 2026-02-17T20:09:24.686 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.688+0000 7fb3cd5f4640 1 --2- 10.20.193.123:0/3604697060 >> v2:10.20.193.123:3300/0 conn(0x7fb3c8135460 0x7fb3c8137850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:24.686 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.688+0000 7fb3bffff640 1 --2- 10.20.193.123:0/3604697060 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fb3c8073890 0x7fb3c812d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:24.686 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.688+0000 7f28f9ffb640 1 -- 10.20.193.123:0/3106538701 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28ec03c070 con 0x7f28fc135ee0 2026-02-17T20:09:24.686 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.688+0000 7f28f9ffb640 1 -- 10.20.193.123:0/3106538701 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28ec02fe10 con 0x7f28fc135ee0 2026-02-17T20:09:24.686 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.688+0000 7f73f5ffb640 1 -- 10.20.193.123:0/3200476226 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73ec02fb30 con 0x7f73f812e1b0 2026-02-17T20:09:24.686 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.688+0000 7f73f5ffb640 1 -- 10.20.193.123:0/3200476226 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ec037440 con 0x7f73f812e1b0 2026-02-17T20:09:24.686 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.688+0000 7f28f9ffb640 1 -- 10.20.193.123:0/3106538701 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28ec037660 con 0x7f28fc135ee0 2026-02-17T20:09:24.686 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.688+0000 7fb3bf7fe640 1 -- 10.20.193.123:0/3604697060 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3622720004 0 0) 0x7fb3c8074070 con 0x7fb3c812cb80 2026-02-17T20:09:24.686 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.689+0000 7fb3bf7fe640 1 -- 10.20.193.123:0/3604697060 --> v1:10.20.193.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3b4003620 con 0x7fb3c812cb80 2026-02-17T20:09:24.686 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.689+0000 7fb3cd5f4640 1 -- 10.20.193.123:0/3604697060 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fb3c8073890 msgr2=0x7fb3c812d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:24.686 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.689+0000 7fb3cd5f4640 1 --2- 10.20.193.123:0/3604697060 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fb3c8073890 0x7fb3c812d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.686 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.689+0000 7fb3cd5f4640 1 -- 10.20.193.123:0/3604697060 >> v1:10.20.193.123:6789/0 conn(0x7fb3c812cb80 legacy=0x7fb3c812cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.686 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.689+0000 7fb3cd5f4640 1 -- 10.20.193.123:0/3604697060 --> v2:10.20.193.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3c8138da0 con 0x7fb3c8135460 2026-02-17T20:09:24.686 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.689+0000 7f2901857640 1 -- 10.20.193.123:0/3106538701 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f28fc135ee0 msgr2=0x7f28fc1382d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.686 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.689+0000 7f2901857640 1 --2- 10.20.193.123:0/3106538701 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f28fc135ee0 0x7f28fc1382d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f28ec009d90 tx=0x7f28ec02f190 comp rx=0 tx=0).stop 2026-02-17T20:09:24.686 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.689+0000 7f2901857640 1 -- 10.20.193.123:0/3106538701 shutdown_connections 2026-02-17T20:09:24.686 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.689+0000 7f2901857640 1 --2- 10.20.193.123:0/3106538701 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f28fc135ee0 0x7f28fc1382d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.686 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.689+0000 7f2901857640 1 --2- 10.20.193.123:0/3106538701 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f28fc1335b0 0x7f28fc1359a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.687 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.689+0000 7f73fd461640 1 -- 10.20.193.123:0/3200476226 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f73f812e1b0 msgr2=0x7f73f812e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.687 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.689+0000 7f73fd461640 1 --2- 10.20.193.123:0/3200476226 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f73f812e1b0 0x7f73f812e590 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f73ec009900 tx=0x7f73ec02eeb0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.687 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.689+0000 7f2901857640 1 -- 10.20.193.123:0/3106538701 >> 10.20.193.123:0/3106538701 conn(0x7f28fc09e7c0 msgr2=0x7f28fc09ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:24.687 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.689+0000 7f2901857640 1 -- 10.20.193.123:0/3106538701 shutdown_connections 2026-02-17T20:09:24.687 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.689+0000 7f73fd461640 1 -- 10.20.193.123:0/3200476226 shutdown_connections 2026-02-17T20:09:24.687 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.689+0000 7f73fd461640 1 --2- 10.20.193.123:0/3200476226 >> v2:10.20.193.123:3300/0 conn(0x7f73f81160b0 0x7f73f80731a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.687 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.689+0000 7f73fd461640 1 --2- 10.20.193.123:0/3200476226 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f73f812e1b0 0x7f73f812e590 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.687 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.689+0000 7f2901857640 1 -- 10.20.193.123:0/3106538701 wait complete. 2026-02-17T20:09:24.687 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.689+0000 7f73fd461640 1 -- 10.20.193.123:0/3200476226 >> 10.20.193.123:0/3200476226 conn(0x7f73f809cd00 msgr2=0x7f73f806f550 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:24.687 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.689+0000 7f73fd461640 1 -- 10.20.193.123:0/3200476226 shutdown_connections 2026-02-17T20:09:24.687 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.689+0000 7f73fd461640 1 -- 10.20.193.123:0/3200476226 wait complete. 2026-02-17T20:09:24.687 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.689+0000 7fb3cd5f4640 1 --2- 10.20.193.123:0/3604697060 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fb3c8135460 0x7fb3c8137850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4009dc0 tx=0x7fb3c402f230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e43ade3c18bfe8b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:24.687 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.689+0000 7fb3bf7fe640 1 -- 10.20.193.123:0/3604697060 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c403c070 con 0x7fb3c8135460 2026-02-17T20:09:24.687 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.689+0000 7fb3bf7fe640 1 -- 10.20.193.123:0/3604697060 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3c4037440 con 0x7fb3c8135460 2026-02-17T20:09:24.687 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.689+0000 7fb3bf7fe640 1 -- 10.20.193.123:0/3604697060 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c4037810 con 0x7fb3c8135460 2026-02-17T20:09:24.688 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.689+0000 7f92aef42640 1 Processor -- start 2026-02-17T20:09:24.688 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.689+0000 7f92aef42640 1 -- start start 2026-02-17T20:09:24.688 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.689+0000 7f2901857640 1 Processor -- start 2026-02-17T20:09:24.688 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f73fd461640 1 Processor -- start 2026-02-17T20:09:24.688 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f2901857640 1 -- start start 2026-02-17T20:09:24.688 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f73fd461640 1 -- start start 2026-02-17T20:09:24.688 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7fb3cf07e640 1 -- 10.20.193.123:0/3604697060 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fb3c8135460 msgr2=0x7fb3c8137850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.688 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7fb3cf07e640 1 --2- 10.20.193.123:0/3604697060 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fb3c8135460 0x7fb3c8137850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4009dc0 tx=0x7fb3c402f230 comp rx=0 tx=0).stop 2026-02-17T20:09:24.688 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f92aef42640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f92a812cb80 0x7f92a812cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:24.688 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f92aef42640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f92a8135460 0x7f92a8137850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:24.688 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f92aef42640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92a8074070 con 0x7f92a8073890 2026-02-17T20:09:24.688 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f92aef42640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7f92a8072e70 con 0x7f92a812cb80 2026-02-17T20:09:24.688 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f92aef42640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f92a8073020 con 0x7f92a8135460 2026-02-17T20:09:24.688 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7fb3cf07e640 1 -- 10.20.193.123:0/3604697060 shutdown_connections 2026-02-17T20:09:24.688 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7fb3cf07e640 1 --2- 10.20.193.123:0/3604697060 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fb3c8135460 0x7fb3c8137850 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.688 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7fb3cf07e640 1 --2- 10.20.193.123:0/3604697060 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fb3c8073890 0x7fb3c812d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.689 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f92accb7640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f92a812cb80 0x7f92a812cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:24.689 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f92ad4b8640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f92a8135460 0x7f92a8137850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:24.689 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7fb3cf07e640 1 -- 10.20.193.123:0/3604697060 >> 10.20.193.123:0/3604697060 conn(0x7fb3c80a30f0 msgr2=0x7fb3c80a3500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:24.689 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7fb3cf07e640 1 -- 10.20.193.123:0/3604697060 shutdown_connections 2026-02-17T20:09:24.689 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f2901857640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f28fc130600 0x7f28fc12a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:24.689 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f2901857640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f28fc1335b0 0x7f28fc12aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:24.689 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f92accb7640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f92a812cb80 0x7f92a812cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:41852/0 (socket says 10.20.193.123:41852) 2026-02-17T20:09:24.689 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f929ffff640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7f92a8073890 0x7f92a812d4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:37258/0 (socket says 10.20.193.123:37258) 2026-02-17T20:09:24.689 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f92accb7640 1 -- 10.20.193.123:0/3707313054 learned_addr learned my addr 10.20.193.123:0/3707313054 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:24.689 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f2901857640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f28fc135ee0 0x7f28fc12b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:24.689 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f2901857640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7f28fc138810 con 0x7f28fc130600 2026-02-17T20:09:24.689 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f2901857640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f28fc116cc0 con 0x7f28fc1335b0 2026-02-17T20:09:24.689 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f2901857640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f28fc138990 con 0x7f28fc135ee0 2026-02-17T20:09:24.689 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f73fd461640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f73f80736e0 0x7f73f81c7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:24.689 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f73fd461640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f73f81160b0 0x7f73f81c7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:24.689 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f73fd461640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f73f812e1b0 0x7f73f8134460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:24.689 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f73fd461640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7f73f8073f00 con 0x7f73f81160b0 2026-02-17T20:09:24.689 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f73fd461640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f73f8073d80 con 0x7f73f812e1b0 2026-02-17T20:09:24.689 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f73fd461640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f73f8136850 con 0x7f73f80736e0 2026-02-17T20:09:24.690 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7fb3cf07e640 1 -- 10.20.193.123:0/3604697060 wait complete. 2026-02-17T20:09:24.690 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f28faffd640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f28fc130600 0x7f28fc12a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:24.690 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f28faffd640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f28fc130600 0x7f28fc12a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:41862/0 (socket says 10.20.193.123:41862) 2026-02-17T20:09:24.690 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f28faffd640 1 -- 10.20.193.123:0/1404991631 learned_addr learned my addr 10.20.193.123:0/1404991631 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:24.690 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f28fa7fc640 1 --2- 10.20.193.123:0/1404991631 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f28fc1335b0 0x7f28fc12aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:24.690 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f92ad4b8640 1 -- 10.20.193.123:0/3707313054 >> v2:10.20.193.123:3300/0 conn(0x7f92a812cb80 msgr2=0x7f92a812cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:24.690 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f92ad4b8640 1 --2- 10.20.193.123:0/3707313054 >> v2:10.20.193.123:3300/0 conn(0x7f92a812cb80 0x7f92a812cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.690 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f92ad4b8640 1 -- 10.20.193.123:0/3707313054 >> v1:10.20.193.123:6789/0 conn(0x7f92a8073890 legacy=0x7f92a812d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.690 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f92ad4b8640 1 -- 10.20.193.123:0/3707313054 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92a8138da0 con 0x7f92a8135460 2026-02-17T20:09:24.690 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f73f6ffd640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f73f80736e0 0x7f73f81c7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:24.690 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f73f6ffd640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f73f80736e0 0x7f73f81c7930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:37984/0 (socket says 10.20.193.123:37984) 2026-02-17T20:09:24.690 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f73f6ffd640 1 -- 10.20.193.123:0/3463065291 learned_addr learned my addr 10.20.193.123:0/3463065291 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:24.690 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f28fb7fe640 1 --2- 10.20.193.123:0/1404991631 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f28fc135ee0 0x7f28fc12b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:24.690 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f73f77fe640 1 --2- 10.20.193.123:0/3463065291 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f73f812e1b0 0x7f73f8134460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:24.690 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f73f67fc640 1 --2- 10.20.193.123:0/3463065291 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f73f81160b0 0x7f73f81c7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:24.690 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f73f6ffd640 1 -- 10.20.193.123:0/3463065291 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f73f812e1b0 msgr2=0x7f73f8134460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.690 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f73f6ffd640 1 --2- 10.20.193.123:0/3463065291 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f73f812e1b0 0x7f73f8134460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.690 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f73f6ffd640 1 -- 10.20.193.123:0/3463065291 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f73f81160b0 msgr2=0x7f73f81c7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.690 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f73f6ffd640 1 --2- 10.20.193.123:0/3463065291 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f73f81160b0 0x7f73f81c7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.691 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f73f6ffd640 1 -- 10.20.193.123:0/3463065291 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73f8135ef0 con 0x7f73f80736e0 2026-02-17T20:09:24.691 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f73f77fe640 1 --2- 10.20.193.123:0/3463065291 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f73f812e1b0 0x7f73f8134460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T20:09:24.691 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f28faffd640 1 -- 10.20.193.123:0/1404991631 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f28fc135ee0 msgr2=0x7f28fc12b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.691 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f28faffd640 1 --2- 10.20.193.123:0/1404991631 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f28fc135ee0 0x7f28fc12b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.691 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f28faffd640 1 -- 10.20.193.123:0/1404991631 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f28fc1335b0 msgr2=0x7f28fc12aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.691 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f28faffd640 1 --2- 10.20.193.123:0/1404991631 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f28fc1335b0 0x7f28fc12aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.691 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f28faffd640 1 -- 10.20.193.123:0/1404991631 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28fc12a770 con 0x7f28fc130600 2026-02-17T20:09:24.691 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f73f6ffd640 1 --2- 10.20.193.123:0/3463065291 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f73f80736e0 0x7f73f81c7930 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f73ec009130 tx=0x7f73ec0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:24.691 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f28faffd640 1 --2- 10.20.193.123:0/1404991631 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f28fc130600 0x7f28fc12a990 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f28f000c760 tx=0x7f28f000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:24.691 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f73d77fe640 1 -- 10.20.193.123:0/3463065291 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ec03c040 con 0x7f73f80736e0 2026-02-17T20:09:24.691 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f92ad4b8640 1 --2- 10.20.193.123:0/3707313054 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f92a8135460 0x7f92a8137850 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f92a4009d90 tx=0x7f92a402f1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26760e83878e2743 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:24.691 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f73d77fe640 1 -- 10.20.193.123:0/3463065291 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73ec004240 con 0x7f73f80736e0 2026-02-17T20:09:24.691 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f73fd461640 1 -- 10.20.193.123:0/3463065291 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73f81171d0 con 0x7f73f80736e0 2026-02-17T20:09:24.691 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f73d77fe640 1 -- 10.20.193.123:0/3463065291 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ec003710 con 0x7f73f80736e0 2026-02-17T20:09:24.691 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f28d3fff640 1 -- 10.20.193.123:0/1404991631 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f0017070 con 0x7f28fc130600 2026-02-17T20:09:24.691 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f28d3fff640 1 -- 10.20.193.123:0/1404991631 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28f0005bb0 con 0x7f28fc130600 2026-02-17T20:09:24.692 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f73fd461640 1 -- 10.20.193.123:0/3463065291 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f73f8117680 con 0x7f73f80736e0 2026-02-17T20:09:24.692 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f2901857640 1 -- 10.20.193.123:0/1404991631 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28fc12b950 con 0x7f28fc130600 2026-02-17T20:09:24.692 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f28d3fff640 1 -- 10.20.193.123:0/1404991631 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f0007070 con 0x7f28fc130600 2026-02-17T20:09:24.692 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f929f7fe640 1 -- 10.20.193.123:0/3707313054 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a403c070 con 0x7f92a8135460 2026-02-17T20:09:24.692 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f929f7fe640 1 -- 10.20.193.123:0/3707313054 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92a4037440 con 0x7f92a8135460 2026-02-17T20:09:24.692 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f929f7fe640 1 -- 10.20.193.123:0/3707313054 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a4037810 con 0x7f92a8135460 2026-02-17T20:09:24.692 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7f2901857640 1 -- 10.20.193.123:0/1404991631 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28fc12cfb0 con 0x7f28fc130600 2026-02-17T20:09:24.692 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.690+0000 7fb3cf07e640 1 Processor -- start 2026-02-17T20:09:24.692 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.691+0000 7f73fd461640 1 -- 10.20.193.123:0/3463065291 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f73f812bcf0 con 0x7f73f80736e0 2026-02-17T20:09:24.692 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.691+0000 7f2901857640 1 -- 10.20.193.123:0/1404991631 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f28fc1309e0 con 0x7f28fc130600 2026-02-17T20:09:24.692 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.691+0000 7f92aef42640 1 -- 10.20.193.123:0/3707313054 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f92a8135460 msgr2=0x7f92a8137850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.692 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.691+0000 7f92aef42640 1 --2- 10.20.193.123:0/3707313054 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f92a8135460 0x7f92a8137850 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f92a4009d90 tx=0x7f92a402f1e0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.693 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.691+0000 7f92aef42640 1 -- 10.20.193.123:0/3707313054 shutdown_connections 2026-02-17T20:09:24.693 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.691+0000 7f92aef42640 1 --2- 10.20.193.123:0/3707313054 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f92a8135460 0x7f92a8137850 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.693 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.691+0000 7f92aef42640 1 --2- 10.20.193.123:0/3707313054 >> v2:10.20.193.123:3300/0 conn(0x7f92a812cb80 0x7f92a812cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.693 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.691+0000 7f92aef42640 1 -- 10.20.193.123:0/3707313054 >> 10.20.193.123:0/3707313054 conn(0x7f92a80a30f0 msgr2=0x7f92a80a3500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:24.693 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.691+0000 7f92aef42640 1 -- 10.20.193.123:0/3707313054 shutdown_connections 2026-02-17T20:09:24.693 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.691+0000 7f92aef42640 1 -- 10.20.193.123:0/3707313054 wait complete. 2026-02-17T20:09:24.693 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.691+0000 7fb3cf07e640 1 -- start start 2026-02-17T20:09:24.693 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.691+0000 7f73d77fe640 1 -- 10.20.193.123:0/3463065291 <== mon.2 v2:10.20.193.123:3302/0 4 ==== mgrmap(e 7) ==== 61803+0+0 (secure 0 0 0) 0x7f73ec02fce0 con 0x7f73f80736e0 2026-02-17T20:09:24.693 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.691+0000 7fb3cf07e640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fb3c8073890 0x7fb3c81c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:24.693 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.691+0000 7fb3cf07e640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fb3c812cb80 0x7fb3c81c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:24.693 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.691+0000 7fb3cf07e640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fb3c8135460 0x7fb3c81c7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:24.693 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.691+0000 7fb3cf07e640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c8138220 con 0x7fb3c8135460 2026-02-17T20:09:24.693 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.691+0000 7fb3cf07e640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7fb3c81380a0 con 0x7fb3c812cb80 2026-02-17T20:09:24.693 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.691+0000 7fb3cf07e640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7fb3c81383a0 con 0x7fb3c8073890 2026-02-17T20:09:24.693 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.691+0000 7fb3ccdf3640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fb3c8073890 0x7fb3c81c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:24.693 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.691+0000 7fb3bffff640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fb3c812cb80 0x7fb3c81c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:24.693 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.691+0000 7fb3cd5f4640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fb3c8135460 0x7fb3c81c7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:24.693 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.691+0000 7fb3ccdf3640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fb3c8073890 0x7fb3c81c6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:38006/0 (socket says 10.20.193.123:38006) 2026-02-17T20:09:24.693 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.691+0000 7fb3bffff640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fb3c812cb80 0x7fb3c81c73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:45138/0 (socket says 10.20.193.123:45138) 2026-02-17T20:09:24.693 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.691+0000 7fb3ccdf3640 1 -- 10.20.193.123:0/4135148089 learned_addr learned my addr 10.20.193.123:0/4135148089 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:24.694 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.691+0000 7f28d3fff640 1 -- 10.20.193.123:0/1404991631 <== mon.0 v2:10.20.193.123:3300/0 4 ==== mgrmap(e 7) ==== 61803+0+0 (secure 0 0 0) 0x7f28f0007210 con 0x7f28fc130600 2026-02-17T20:09:24.694 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.691+0000 7fb3bffff640 1 -- 10.20.193.123:0/4135148089 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fb3c8073890 msgr2=0x7fb3c81c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.694 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.691+0000 7fb3bffff640 1 --2- 10.20.193.123:0/4135148089 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fb3c8073890 0x7fb3c81c6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.694 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.691+0000 7fb3bffff640 1 -- 10.20.193.123:0/4135148089 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fb3c8135460 msgr2=0x7fb3c81c7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.694 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.691+0000 7fb3bffff640 1 --2- 10.20.193.123:0/4135148089 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fb3c8135460 0x7fb3c81c7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.694 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.691+0000 7f73d77fe640 1 -- 10.20.193.123:0/3463065291 <== mon.2 v2:10.20.193.123:3302/0 5 ==== osd_map(17..17 src has 1..17) ==== 3021+0+0 (secure 0 0 0) 0x7f73ec047070 con 0x7f73f80736e0 2026-02-17T20:09:24.694 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.691+0000 7fb3bffff640 1 -- 10.20.193.123:0/4135148089 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3c8132650 con 0x7fb3c812cb80 2026-02-17T20:09:24.694 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.691+0000 7f92aef42640 1 Processor -- start 2026-02-17T20:09:24.694 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.691+0000 7f73d77fe640 1 -- 10.20.193.123:0/3463065291 --> v1:10.20.193.123:6813/24327 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f73ec007e80 con 0x7f73c4051fc0 2026-02-17T20:09:24.694 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.691+0000 7f73d77fe640 1 -- 10.20.193.123:0/3463065291 <== mon.2 v2:10.20.193.123:3302/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f73ec08f2a0 con 0x7f73f80736e0 2026-02-17T20:09:24.694 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.691+0000 7fb3bffff640 1 --2- 10.20.193.123:0/4135148089 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fb3c812cb80 0x7fb3c81c73f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb3b000e9b0 tx=0x7fb3b000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:24.694 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.691+0000 7f92aef42640 1 -- start start 2026-02-17T20:09:24.694 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.692+0000 7fb3bd7fa640 1 -- 10.20.193.123:0/4135148089 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b0017070 con 0x7fb3c812cb80 2026-02-17T20:09:24.694 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.692+0000 7f28d3fff640 1 -- 10.20.193.123:0/1404991631 <== mon.0 v2:10.20.193.123:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3021+0+0 (secure 0 0 0) 0x7f28f00664a0 con 0x7f28fc130600 2026-02-17T20:09:24.695 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.692+0000 7fb3bd7fa640 1 -- 10.20.193.123:0/4135148089 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3b000ca00 con 0x7fb3c812cb80 2026-02-17T20:09:24.695 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.692+0000 7fb3cf07e640 1 -- 10.20.193.123:0/4135148089 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3c8133750 con 0x7fb3c812cb80 2026-02-17T20:09:24.695 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.692+0000 7fb3bd7fa640 1 -- 10.20.193.123:0/4135148089 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b000cdf0 con 0x7fb3c812cb80 2026-02-17T20:09:24.695 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.692+0000 7fb3cf07e640 1 -- 10.20.193.123:0/4135148089 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3c8132fe0 con 0x7fb3c812cb80 2026-02-17T20:09:24.695 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.692+0000 7f28d3fff640 1 -- 10.20.193.123:0/1404991631 --> v1:10.20.193.123:6805/24325 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f28f0018e80 con 0x7f28cc052030 2026-02-17T20:09:24.695 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.692+0000 7f28d3fff640 1 -- 10.20.193.123:0/1404991631 <== mon.0 v2:10.20.193.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f28f0066940 con 0x7f28fc130600 2026-02-17T20:09:24.695 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.692+0000 7f92aef42640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f92a8073890 0x7f92a8133c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:24.695 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.692+0000 7f92aef42640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f92a812cb80 0x7f92a8134190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:24.695 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.692+0000 7f92accb7640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f92a8073890 0x7f92a8133c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:24.695 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.692+0000 7f92aef42640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f92a8135460 0x7f92a81346d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:24.695 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.692+0000 7f92aef42640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7f92a8138270 con 0x7f92a8135460 2026-02-17T20:09:24.695 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.692+0000 7f92aef42640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f92a81380f0 con 0x7f92a812cb80 2026-02-17T20:09:24.695 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.692+0000 7f92aef42640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f92a81383f0 con 0x7f92a8073890 2026-02-17T20:09:24.695 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.692+0000 7f92accb7640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f92a8073890 0x7f92a8133c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:38016/0 (socket says 10.20.193.123:38016) 2026-02-17T20:09:24.695 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.692+0000 7f929ffff640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f92a812cb80 0x7f92a8134190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:24.695 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.692+0000 7f92accb7640 1 -- 10.20.193.123:0/2339617716 learned_addr learned my addr 10.20.193.123:0/2339617716 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:24.695 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.692+0000 7f92ad4b8640 1 --2- 10.20.193.123:0/2339617716 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f92a8135460 0x7f92a81346d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:24.695 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.692+0000 7f92accb7640 1 -- 10.20.193.123:0/2339617716 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f92a812cb80 msgr2=0x7f92a8134190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.696 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.692+0000 7f92accb7640 1 --2- 10.20.193.123:0/2339617716 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f92a812cb80 0x7f92a8134190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.696 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.692+0000 7f92accb7640 1 -- 10.20.193.123:0/2339617716 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f92a8135460 msgr2=0x7f92a81346d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.696 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.692+0000 7f92accb7640 1 --2- 10.20.193.123:0/2339617716 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f92a8135460 0x7f92a81346d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.696 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.692+0000 7f92accb7640 1 -- 10.20.193.123:0/2339617716 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92a81325e0 con 0x7f92a8073890 2026-02-17T20:09:24.696 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.692+0000 7fb3cf07e640 1 -- 10.20.193.123:0/4135148089 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb3c8138800 con 0x7fb3c812cb80 2026-02-17T20:09:24.696 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.692+0000 7f73d77fe640 1 -- 10.20.193.123:0/3463065291 <== osd.3 v1:10.20.193.123:6813/24327 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25011 (unknown 0 0 1028417783) 0x7f73ec007e80 con 0x7f73c4051fc0 2026-02-17T20:09:24.696 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.692+0000 7f92accb7640 1 --2- 10.20.193.123:0/2339617716 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f92a8073890 0x7f92a8133c50 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f929800e930 tx=0x7f929800ee00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:24.696 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.692+0000 7f929d7fa640 1 -- 10.20.193.123:0/2339617716 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9298017070 con 0x7f92a8073890 2026-02-17T20:09:24.696 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.692+0000 7f929d7fa640 1 -- 10.20.193.123:0/2339617716 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f929800ca00 con 0x7f92a8073890 2026-02-17T20:09:24.696 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.692+0000 7f92aef42640 1 -- 10.20.193.123:0/2339617716 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92a81c7090 con 0x7f92a8073890 2026-02-17T20:09:24.696 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.692+0000 7f929d7fa640 1 -- 10.20.193.123:0/2339617716 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f929800cdf0 con 0x7f92a8073890 2026-02-17T20:09:24.696 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.692+0000 7f28d3fff640 1 -- 10.20.193.123:0/1404991631 <== osd.1 v1:10.20.193.123:6805/24325 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25011 (unknown 0 0 1028417783) 0x7f28f0018e80 con 0x7f28cc052030 2026-02-17T20:09:24.696 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.692+0000 7f92aef42640 1 -- 10.20.193.123:0/2339617716 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f92a81c7600 con 0x7f92a8073890 2026-02-17T20:09:24.696 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.692+0000 7fb3bd7fa640 1 -- 10.20.193.123:0/4135148089 <== mon.1 v2:10.20.193.123:3301/0 4 ==== mgrmap(e 7) ==== 61803+0+0 (secure 0 0 0) 0x7fb3b0013470 con 0x7fb3c812cb80 2026-02-17T20:09:24.696 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.692+0000 7fb3bd7fa640 1 -- 10.20.193.123:0/4135148089 <== mon.1 v2:10.20.193.123:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 3021+0+0 (secure 0 0 0) 0x7fb3b0066e90 con 0x7fb3c812cb80 2026-02-17T20:09:24.696 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.693+0000 7fb3bd7fa640 1 -- 10.20.193.123:0/4135148089 --> v1:10.20.193.123:6801/24324 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb3b0003540 con 0x7fb398051fc0 2026-02-17T20:09:24.696 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.693+0000 7fb3bd7fa640 1 -- 10.20.193.123:0/4135148089 <== mon.1 v2:10.20.193.123:3301/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fb3b006c4e0 con 0x7fb3c812cb80 2026-02-17T20:09:24.697 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.693+0000 7f92aef42640 1 -- 10.20.193.123:0/2339617716 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f92a8131d70 con 0x7f92a8073890 2026-02-17T20:09:24.697 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.693+0000 7f929d7fa640 1 -- 10.20.193.123:0/2339617716 <== mon.2 v2:10.20.193.123:3302/0 4 ==== mgrmap(e 7) ==== 61803+0+0 (secure 0 0 0) 0x7f9298013470 con 0x7f92a8073890 2026-02-17T20:09:24.697 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.693+0000 7fb3bd7fa640 1 -- 10.20.193.123:0/4135148089 <== osd.0 v1:10.20.193.123:6801/24324 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25011 (unknown 0 0 1028417783) 0x7fb3b0003540 con 0x7fb398051fc0 2026-02-17T20:09:24.697 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.693+0000 7f929d7fa640 1 -- 10.20.193.123:0/2339617716 <== mon.2 v2:10.20.193.123:3302/0 5 ==== osd_map(17..17 src has 1..17) ==== 3021+0+0 (secure 0 0 0) 0x7f9298066d60 con 0x7f92a8073890 2026-02-17T20:09:24.697 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.693+0000 7f929d7fa640 1 -- 10.20.193.123:0/2339617716 --> v1:10.20.193.123:6809/24326 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9298003540 con 0x7f9278052030 2026-02-17T20:09:24.697 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.693+0000 7f929d7fa640 1 -- 10.20.193.123:0/2339617716 <== mon.2 v2:10.20.193.123:3302/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f929806c480 con 0x7f92a8073890 2026-02-17T20:09:24.697 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.694+0000 7f929d7fa640 1 -- 10.20.193.123:0/2339617716 <== osd.2 v1:10.20.193.123:6809/24326 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25011 (unknown 0 0 1028417783) 0x7f9298003540 con 0x7f9278052030 2026-02-17T20:09:24.697 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.698+0000 7f2901857640 1 -- 10.20.193.123:0/1404991631 --> v1:10.20.193.123:6805/24325 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f28fc0713e0 con 0x7f28cc052030 2026-02-17T20:09:24.697 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.698+0000 7f28d3fff640 1 -- 10.20.193.123:0/1404991631 <== osd.1 v1:10.20.193.123:6805/24325 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1990790089) 0x7f28fc0713e0 con 0x7f28cc052030 2026-02-17T20:09:24.697 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.698+0000 7f2901857640 1 -- 10.20.193.123:0/1404991631 >> v1:10.20.193.123:6805/24325 conn(0x7f28cc052030 legacy=0x7f28cc054470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.697 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.698+0000 7f2901857640 1 -- 10.20.193.123:0/1404991631 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f28fc130600 msgr2=0x7f28fc12a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.697 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.698+0000 7f2901857640 1 --2- 10.20.193.123:0/1404991631 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f28fc130600 0x7f28fc12a990 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f28f000c760 tx=0x7f28f000cc30 comp rx=0 tx=0).stop 2026-02-17T20:09:24.698 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.698+0000 7f2901857640 1 -- 10.20.193.123:0/1404991631 shutdown_connections 2026-02-17T20:09:24.698 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.698+0000 7f2901857640 1 --2- 10.20.193.123:0/1404991631 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f28fc135ee0 0x7f28fc12b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.698 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.698+0000 7f2901857640 1 --2- 10.20.193.123:0/1404991631 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f28fc1335b0 0x7f28fc12aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.698 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.698+0000 7f2901857640 1 --2- 10.20.193.123:0/1404991631 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f28fc130600 0x7f28fc12a990 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.698 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.698+0000 7f2901857640 1 -- 10.20.193.123:0/1404991631 >> 10.20.193.123:0/1404991631 conn(0x7f28fc09e7c0 msgr2=0x7f28fc0731a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:24.698 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.698+0000 7f2901857640 1 -- 10.20.193.123:0/1404991631 shutdown_connections 2026-02-17T20:09:24.698 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.698+0000 7f2901857640 1 -- 10.20.193.123:0/1404991631 wait complete. 2026-02-17T20:09:24.698 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.699+0000 7fb3cf07e640 1 -- 10.20.193.123:0/4135148089 --> v1:10.20.193.123:6801/24324 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb3c81373e0 con 0x7fb398051fc0 2026-02-17T20:09:24.698 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.699+0000 7fb3bd7fa640 1 -- 10.20.193.123:0/4135148089 <== osd.0 v1:10.20.193.123:6801/24324 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1710880829) 0x7fb3c81373e0 con 0x7fb398051fc0 2026-02-17T20:09:24.698 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.700+0000 7fb3cf07e640 1 -- 10.20.193.123:0/4135148089 >> v1:10.20.193.123:6801/24324 conn(0x7fb398051fc0 legacy=0x7fb398054400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.698 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.700+0000 7fb3cf07e640 1 -- 10.20.193.123:0/4135148089 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fb3c812cb80 msgr2=0x7fb3c81c73f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.698 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.700+0000 7fb3cf07e640 1 --2- 10.20.193.123:0/4135148089 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fb3c812cb80 0x7fb3c81c73f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb3b000e9b0 tx=0x7fb3b000ee80 comp rx=0 tx=0).stop 2026-02-17T20:09:24.698 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.700+0000 7fb3cf07e640 1 -- 10.20.193.123:0/4135148089 shutdown_connections 2026-02-17T20:09:24.698 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.700+0000 7fb3cf07e640 1 --2- 10.20.193.123:0/4135148089 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fb3c8135460 0x7fb3c81c7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.698 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.700+0000 7fb3cf07e640 1 --2- 10.20.193.123:0/4135148089 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fb3c812cb80 0x7fb3c81c73f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.698 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.700+0000 7fb3cf07e640 1 --2- 10.20.193.123:0/4135148089 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fb3c8073890 0x7fb3c81c6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.698 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.700+0000 7fb3cf07e640 1 -- 10.20.193.123:0/4135148089 >> 10.20.193.123:0/4135148089 conn(0x7fb3c80a30f0 msgr2=0x7fb3c8136a50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:24.698 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.700+0000 7fb3cf07e640 1 -- 10.20.193.123:0/4135148089 shutdown_connections 2026-02-17T20:09:24.698 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.700+0000 7fb3cf07e640 1 -- 10.20.193.123:0/4135148089 wait complete. 2026-02-17T20:09:24.698 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.701+0000 7f73fd461640 1 -- 10.20.193.123:0/3463065291 --> v1:10.20.193.123:6813/24327 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f73f80731a0 con 0x7f73c4051fc0 2026-02-17T20:09:24.698 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.701+0000 7f73d77fe640 1 -- 10.20.193.123:0/3463065291 <== osd.3 v1:10.20.193.123:6813/24327 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1990790089) 0x7f73f80731a0 con 0x7f73c4051fc0 2026-02-17T20:09:24.699 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.702+0000 7f73fd461640 1 -- 10.20.193.123:0/3463065291 >> v1:10.20.193.123:6813/24327 conn(0x7f73c4051fc0 legacy=0x7f73c4054400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.699 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.702+0000 7f73fd461640 1 -- 10.20.193.123:0/3463065291 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f73f80736e0 msgr2=0x7f73f81c7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.699 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.702+0000 7f73fd461640 1 --2- 10.20.193.123:0/3463065291 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f73f80736e0 0x7f73f81c7930 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f73ec009130 tx=0x7f73ec0047c0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.699 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.702+0000 7f73fd461640 1 -- 10.20.193.123:0/3463065291 shutdown_connections 2026-02-17T20:09:24.699 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.702+0000 7f73fd461640 1 --2- 10.20.193.123:0/3463065291 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f73f812e1b0 0x7f73f8134460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.699 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.702+0000 7f73fd461640 1 --2- 10.20.193.123:0/3463065291 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f73f81160b0 0x7f73f81c7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.699 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.702+0000 7f73fd461640 1 --2- 10.20.193.123:0/3463065291 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f73f80736e0 0x7f73f81c7930 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.699 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.702+0000 7f73fd461640 1 -- 10.20.193.123:0/3463065291 >> 10.20.193.123:0/3463065291 conn(0x7f73f809cd00 msgr2=0x7f73f8128700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:24.699 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.702+0000 7f73fd461640 1 -- 10.20.193.123:0/3463065291 shutdown_connections 2026-02-17T20:09:24.699 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.702+0000 7f73fd461640 1 -- 10.20.193.123:0/3463065291 wait complete. 2026-02-17T20:09:24.699 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.703+0000 7f92aef42640 1 -- 10.20.193.123:0/2339617716 --> v1:10.20.193.123:6809/24326 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f92a81c7ae0 con 0x7f9278052030 2026-02-17T20:09:24.699 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.703+0000 7f929d7fa640 1 -- 10.20.193.123:0/2339617716 <== osd.2 v1:10.20.193.123:6809/24326 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1710880829) 0x7f92a81c7ae0 con 0x7f9278052030 2026-02-17T20:09:24.699 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.703+0000 7f92aef42640 1 -- 10.20.193.123:0/2339617716 >> v1:10.20.193.123:6809/24326 conn(0x7f9278052030 legacy=0x7f9278054470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.700 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.703+0000 7f92aef42640 1 -- 10.20.193.123:0/2339617716 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f92a8073890 msgr2=0x7f92a8133c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.700 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.703+0000 7f92aef42640 1 --2- 10.20.193.123:0/2339617716 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f92a8073890 0x7f92a8133c50 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f929800e930 tx=0x7f929800ee00 comp rx=0 tx=0).stop 2026-02-17T20:09:24.700 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.704+0000 7f92aef42640 1 -- 10.20.193.123:0/2339617716 shutdown_connections 2026-02-17T20:09:24.700 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.704+0000 7f92aef42640 1 --2- 10.20.193.123:0/2339617716 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f92a8135460 0x7f92a81346d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.700 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.704+0000 7f92aef42640 1 --2- 10.20.193.123:0/2339617716 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f92a812cb80 0x7f92a8134190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.700 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.704+0000 7f92aef42640 1 --2- 10.20.193.123:0/2339617716 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f92a8073890 0x7f92a8133c50 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.700 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.704+0000 7f92aef42640 1 -- 10.20.193.123:0/2339617716 >> 10.20.193.123:0/2339617716 conn(0x7f92a80a30f0 msgr2=0x7f92a80705f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:24.700 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.704+0000 7f92aef42640 1 -- 10.20.193.123:0/2339617716 shutdown_connections 2026-02-17T20:09:24.700 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.704+0000 7f92aef42640 1 -- 10.20.193.123:0/2339617716 wait complete. 2026-02-17T20:09:24.700 INFO:teuthology.orchestra.run.trial123.stdout:38654705675 2026-02-17T20:09:24.700 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T20:09:24.701 INFO:teuthology.orchestra.run.trial123.stdout:38654705676 2026-02-17T20:09:24.701 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T20:09:24.704 INFO:teuthology.orchestra.run.trial123.stdout:38654705675 2026-02-17T20:09:24.704 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T20:09:24.705 INFO:teuthology.orchestra.run.trial123.stdout:38654705676 2026-02-17T20:09:24.705 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T20:09:24.772 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.777+0000 7f5d41fea640 1 Processor -- start 2026-02-17T20:09:24.772 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.777+0000 7f5d41fea640 1 -- start start 2026-02-17T20:09:24.773 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.777+0000 7fe66357b640 1 Processor -- start 2026-02-17T20:09:24.773 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.777+0000 7fe66357b640 1 -- start start 2026-02-17T20:09:24.773 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.777+0000 7f5d41fea640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f5d3c1335b0 0x7f5d3c1359a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:24.773 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.777+0000 7f5d41fea640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f5d3c135ee0 0x7f5d3c1382d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:24.773 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.777+0000 7f5d41fea640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d3c1310f0 con 0x7f5d3c130600 2026-02-17T20:09:24.773 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.777+0000 7f5d41fea640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7f5d3c130240 con 0x7f5d3c135ee0 2026-02-17T20:09:24.773 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.777+0000 7f5d41fea640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f5d3c09f550 con 0x7f5d3c1335b0 2026-02-17T20:09:24.773 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.777+0000 7f5d3b7fe640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7f5d3c130600 0x7f5d3c1309e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:37262/0 (socket says 10.20.193.123:37262) 2026-02-17T20:09:24.773 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.777+0000 7f5d3b7fe640 1 -- 10.20.193.123:0/673876511 learned_addr learned my addr 10.20.193.123:0/673876511 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:09:24.773 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.777+0000 7f5d3affd640 1 --2- 10.20.193.123:0/673876511 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f5d3c1335b0 0x7f5d3c1359a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:24.773 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.777+0000 7fe66357b640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fe65c12cb80 0x7fe65c12cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:24.773 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.777+0000 7fe66357b640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe65c073890 0x7fe65c12d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:24.773 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.777+0000 7f5d3bfff640 1 --2- 10.20.193.123:0/673876511 >> v2:10.20.193.123:3300/0 conn(0x7f5d3c135ee0 0x7f5d3c1382d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:24.773 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.777+0000 7fe66357b640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe65c074070 con 0x7fe65c1300e0 2026-02-17T20:09:24.774 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.777+0000 7fe66357b640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7fe65c12d9e0 con 0x7fe65c073890 2026-02-17T20:09:24.774 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.777+0000 7fe66357b640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7fe65c072e70 con 0x7fe65c12cb80 2026-02-17T20:09:24.774 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.777+0000 7fe6612f0640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fe65c12cb80 0x7fe65c12cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:24.774 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.777+0000 7fe660aef640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe65c073890 0x7fe65c12d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:24.774 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.777+0000 7fe6612f0640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fe65c12cb80 0x7fe65c12cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:38018/0 (socket says 10.20.193.123:38018) 2026-02-17T20:09:24.774 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.777+0000 7fe6612f0640 1 -- 10.20.193.123:0/2372656657 learned_addr learned my addr 10.20.193.123:0/2372656657 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:24.774 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.778+0000 7f5d3a7fc640 1 -- 10.20.193.123:0/673876511 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2003397666 0 0) 0x7f5d3c1310f0 con 0x7f5d3c130600 2026-02-17T20:09:24.774 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.778+0000 7f5d3affd640 1 -- 10.20.193.123:0/673876511 >> v2:10.20.193.123:3300/0 conn(0x7f5d3c135ee0 msgr2=0x7f5d3c1382d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:24.774 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.778+0000 7f5d3affd640 1 --2- 10.20.193.123:0/673876511 >> v2:10.20.193.123:3300/0 conn(0x7f5d3c135ee0 0x7f5d3c1382d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.774 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.778+0000 7f5d3affd640 1 -- 10.20.193.123:0/673876511 >> v1:10.20.193.123:6789/0 conn(0x7f5d3c130600 legacy=0x7f5d3c1309e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.774 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.778+0000 7f5d3affd640 1 -- 10.20.193.123:0/673876511 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d3c071c80 con 0x7f5d3c1335b0 2026-02-17T20:09:24.774 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.778+0000 7f6a9073b640 1 Processor -- start 2026-02-17T20:09:24.774 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.778+0000 7f6a9073b640 1 -- start start 2026-02-17T20:09:24.774 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.778+0000 7fe660aef640 1 -- 10.20.193.123:0/2372656657 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fe65c12cb80 msgr2=0x7fe65c12cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:24.774 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.778+0000 7fe64bfff640 1 -- 10.20.193.123:0/2372656657 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2229206203 0 0) 0x7fe65c074070 con 0x7fe65c1300e0 2026-02-17T20:09:24.774 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.778+0000 7fe660aef640 1 --2- 10.20.193.123:0/2372656657 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fe65c12cb80 0x7fe65c12cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.774 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.778+0000 7fe660aef640 1 -- 10.20.193.123:0/2372656657 >> v1:10.20.193.123:6789/0 conn(0x7fe65c1300e0 legacy=0x7fe65c130560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.774 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.778+0000 7fe660aef640 1 -- 10.20.193.123:0/2372656657 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe65c130c70 con 0x7fe65c073890 2026-02-17T20:09:24.774 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.778+0000 7fe6612f0640 1 --2- 10.20.193.123:0/2372656657 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fe65c12cb80 0x7fe65c12cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:24.775 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.778+0000 7f6a9073b640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f6a8812cb80 0x7f6a8812cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:24.775 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.778+0000 7f5d3affd640 1 --2- 10.20.193.123:0/673876511 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f5d3c1335b0 0x7f5d3c1359a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c0098a0 tx=0x7f5d2c02ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de1ae4f1f6f17844 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:24.775 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.778+0000 7f6a9073b640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f6a88135460 0x7f6a88137850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:24.775 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.778+0000 7f6a9073b640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a88074070 con 0x7f6a88073890 2026-02-17T20:09:24.775 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.778+0000 7f6a9073b640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7f6a88072e70 con 0x7f6a8812cb80 2026-02-17T20:09:24.775 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.778+0000 7f6a9073b640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f6a88073020 con 0x7f6a88135460 2026-02-17T20:09:24.775 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.778+0000 7f6a8e4b0640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f6a8812cb80 0x7f6a8812cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:24.775 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.778+0000 7f6a8ecb1640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f6a88135460 0x7f6a88137850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:24.775 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.778+0000 7f6a8dcaf640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7f6a88073890 0x7f6a8812d4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:37280/0 (socket says 10.20.193.123:37280) 2026-02-17T20:09:24.775 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.778+0000 7f6a8dcaf640 1 -- 10.20.193.123:0/1421919959 learned_addr learned my addr 10.20.193.123:0/1421919959 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:09:24.775 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.778+0000 7f5d3a7fc640 1 -- 10.20.193.123:0/673876511 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c03c070 con 0x7f5d3c1335b0 2026-02-17T20:09:24.775 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.778+0000 7f5d3a7fc640 1 -- 10.20.193.123:0/673876511 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d2c02fa40 con 0x7f5d3c1335b0 2026-02-17T20:09:24.775 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.778+0000 7f5d3a7fc640 1 -- 10.20.193.123:0/673876511 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c02fe10 con 0x7f5d3c1335b0 2026-02-17T20:09:24.775 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.778+0000 7f6a8d4ae640 1 -- 10.20.193.123:0/1421919959 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1589453364 0 0) 0x7f6a88074070 con 0x7f6a88073890 2026-02-17T20:09:24.775 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.778+0000 7fe660aef640 1 --2- 10.20.193.123:0/2372656657 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe65c073890 0x7fe65c12d4a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe6500098d0 tx=0x7fe65002ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7960b7b093f62f44 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:24.776 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.778+0000 7f6a8d4ae640 1 -- 10.20.193.123:0/1421919959 --> v1:10.20.193.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a70003620 con 0x7f6a88073890 2026-02-17T20:09:24.776 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.778+0000 7f6a8ecb1640 1 -- 10.20.193.123:0/1421919959 >> v2:10.20.193.123:3300/0 conn(0x7f6a8812cb80 msgr2=0x7f6a8812cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:24.776 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.778+0000 7f6a8ecb1640 1 --2- 10.20.193.123:0/1421919959 >> v2:10.20.193.123:3300/0 conn(0x7f6a8812cb80 0x7f6a8812cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.776 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.778+0000 7f6a8ecb1640 1 -- 10.20.193.123:0/1421919959 >> v1:10.20.193.123:6789/0 conn(0x7f6a88073890 legacy=0x7f6a8812d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.776 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.778+0000 7f6a8ecb1640 1 -- 10.20.193.123:0/1421919959 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a88138da0 con 0x7f6a88135460 2026-02-17T20:09:24.776 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.778+0000 7f6a8e4b0640 1 --2- 10.20.193.123:0/1421919959 >> v2:10.20.193.123:3300/0 conn(0x7f6a8812cb80 0x7f6a8812cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:24.776 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.778+0000 7fe64bfff640 1 -- 10.20.193.123:0/2372656657 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65003c070 con 0x7fe65c073890 2026-02-17T20:09:24.776 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.778+0000 7fe64bfff640 1 -- 10.20.193.123:0/2372656657 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe65002fab0 con 0x7fe65c073890 2026-02-17T20:09:24.776 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.778+0000 7fe64bfff640 1 -- 10.20.193.123:0/2372656657 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe650037440 con 0x7fe65c073890 2026-02-17T20:09:24.776 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.778+0000 7f5d41fea640 1 -- 10.20.193.123:0/673876511 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f5d3c1335b0 msgr2=0x7f5d3c1359a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.776 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.778+0000 7f5d41fea640 1 --2- 10.20.193.123:0/673876511 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f5d3c1335b0 0x7f5d3c1359a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c0098a0 tx=0x7f5d2c02ed80 comp rx=0 tx=0).stop 2026-02-17T20:09:24.776 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.778+0000 7f5d41fea640 1 -- 10.20.193.123:0/673876511 shutdown_connections 2026-02-17T20:09:24.776 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.778+0000 7f5d41fea640 1 --2- 10.20.193.123:0/673876511 >> v2:10.20.193.123:3300/0 conn(0x7f5d3c135ee0 0x7f5d3c1382d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.776 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.778+0000 7f5d41fea640 1 --2- 10.20.193.123:0/673876511 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f5d3c1335b0 0x7f5d3c1359a0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.776 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.778+0000 7f5d41fea640 1 -- 10.20.193.123:0/673876511 >> 10.20.193.123:0/673876511 conn(0x7f5d3c09e7c0 msgr2=0x7f5d3c09ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:24.776 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.779+0000 7f5d41fea640 1 -- 10.20.193.123:0/673876511 shutdown_connections 2026-02-17T20:09:24.776 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.779+0000 7f5d41fea640 1 -- 10.20.193.123:0/673876511 wait complete. 2026-02-17T20:09:24.776 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.779+0000 7fe66357b640 1 -- 10.20.193.123:0/2372656657 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe65c073890 msgr2=0x7fe65c12d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.776 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.779+0000 7fe66357b640 1 --2- 10.20.193.123:0/2372656657 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe65c073890 0x7fe65c12d4a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe6500098d0 tx=0x7fe65002ee40 comp rx=0 tx=0).stop 2026-02-17T20:09:24.777 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.779+0000 7f6a8ecb1640 1 --2- 10.20.193.123:0/1421919959 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f6a88135460 0x7f6a88137850 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6a84009d90 tx=0x7f6a8402f1f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d30d8908ef24384 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:24.777 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.779+0000 7f6a8d4ae640 1 -- 10.20.193.123:0/1421919959 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a8403c070 con 0x7f6a88135460 2026-02-17T20:09:24.777 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.779+0000 7f6a8d4ae640 1 -- 10.20.193.123:0/1421919959 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a84037440 con 0x7f6a88135460 2026-02-17T20:09:24.777 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.779+0000 7f6a8d4ae640 1 -- 10.20.193.123:0/1421919959 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a84037810 con 0x7f6a88135460 2026-02-17T20:09:24.777 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.779+0000 7f6a9073b640 1 -- 10.20.193.123:0/1421919959 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f6a88135460 msgr2=0x7f6a88137850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.777 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.779+0000 7f6a9073b640 1 --2- 10.20.193.123:0/1421919959 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f6a88135460 0x7f6a88137850 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6a84009d90 tx=0x7f6a8402f1f0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.777 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.779+0000 7f6a9073b640 1 -- 10.20.193.123:0/1421919959 shutdown_connections 2026-02-17T20:09:24.777 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.779+0000 7f6a9073b640 1 --2- 10.20.193.123:0/1421919959 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f6a88135460 0x7f6a88137850 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.777 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.779+0000 7f6a9073b640 1 --2- 10.20.193.123:0/1421919959 >> v2:10.20.193.123:3300/0 conn(0x7f6a8812cb80 0x7f6a8812cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.777 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.779+0000 7f6a9073b640 1 -- 10.20.193.123:0/1421919959 >> 10.20.193.123:0/1421919959 conn(0x7f6a880a30f0 msgr2=0x7f6a880a3500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:24.777 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.779+0000 7f6a9073b640 1 -- 10.20.193.123:0/1421919959 shutdown_connections 2026-02-17T20:09:24.777 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.779+0000 7f6a9073b640 1 -- 10.20.193.123:0/1421919959 wait complete. 2026-02-17T20:09:24.777 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.779+0000 7f5d41fea640 1 Processor -- start 2026-02-17T20:09:24.777 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.779+0000 7fe66357b640 1 -- 10.20.193.123:0/2372656657 shutdown_connections 2026-02-17T20:09:24.777 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.779+0000 7fe66357b640 1 --2- 10.20.193.123:0/2372656657 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe65c073890 0x7fe65c12d4a0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.777 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.779+0000 7fe66357b640 1 --2- 10.20.193.123:0/2372656657 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fe65c12cb80 0x7fe65c12cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.777 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.779+0000 7fe66357b640 1 -- 10.20.193.123:0/2372656657 >> 10.20.193.123:0/2372656657 conn(0x7fe65c0a30f0 msgr2=0x7fe65c0a3500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:24.777 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.779+0000 7fe66357b640 1 -- 10.20.193.123:0/2372656657 shutdown_connections 2026-02-17T20:09:24.777 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.779+0000 7f5d41fea640 1 -- start start 2026-02-17T20:09:24.778 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.779+0000 7fe66357b640 1 -- 10.20.193.123:0/2372656657 wait complete. 2026-02-17T20:09:24.778 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.779+0000 7f5d41fea640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f5d3c130600 0x7f5d3c06e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:24.778 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.779+0000 7f5d41fea640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f5d3c1335b0 0x7f5d3c06eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:24.778 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.779+0000 7f5d41fea640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f5d3c135ee0 0x7f5d3c06f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:24.778 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.779+0000 7f5d41fea640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3c138810 con 0x7f5d3c135ee0 2026-02-17T20:09:24.778 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.779+0000 7f5d41fea640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f5d3c116cc0 con 0x7f5d3c130600 2026-02-17T20:09:24.778 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.779+0000 7f5d41fea640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f5d3c138990 con 0x7f5d3c1335b0 2026-02-17T20:09:24.778 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.779+0000 7f5d3b7fe640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f5d3c130600 0x7f5d3c06e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:24.778 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.779+0000 7f5d3bfff640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f5d3c135ee0 0x7f5d3c06f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:24.778 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.779+0000 7f5d3bfff640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f5d3c135ee0 0x7f5d3c06f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:41924/0 (socket says 10.20.193.123:41924) 2026-02-17T20:09:24.778 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.779+0000 7f5d3affd640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f5d3c1335b0 0x7f5d3c06eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:24.778 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.779+0000 7f5d3bfff640 1 -- 10.20.193.123:0/2987043820 learned_addr learned my addr 10.20.193.123:0/2987043820 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:24.778 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7f6a9073b640 1 Processor -- start 2026-02-17T20:09:24.778 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7f6a9073b640 1 -- start start 2026-02-17T20:09:24.778 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7f5d3bfff640 1 -- 10.20.193.123:0/2987043820 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f5d3c1335b0 msgr2=0x7f5d3c06eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.778 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7f5d3bfff640 1 --2- 10.20.193.123:0/2987043820 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f5d3c1335b0 0x7f5d3c06eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.778 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7f5d3bfff640 1 -- 10.20.193.123:0/2987043820 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f5d3c130600 msgr2=0x7f5d3c06e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.778 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7f5d3bfff640 1 --2- 10.20.193.123:0/2987043820 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f5d3c130600 0x7f5d3c06e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.778 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7f5d3bfff640 1 -- 10.20.193.123:0/2987043820 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d3c12a990 con 0x7f5d3c135ee0 2026-02-17T20:09:24.779 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7f5d3bfff640 1 --2- 10.20.193.123:0/2987043820 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f5d3c135ee0 0x7f5d3c06f2e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5d3000ef90 tx=0x7f5d3000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:24.779 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7fe66357b640 1 Processor -- start 2026-02-17T20:09:24.779 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7f5d17fff640 1 -- 10.20.193.123:0/2987043820 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d30018020 con 0x7f5d3c135ee0 2026-02-17T20:09:24.779 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7f5d17fff640 1 -- 10.20.193.123:0/2987043820 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d30014480 con 0x7f5d3c135ee0 2026-02-17T20:09:24.779 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7f5d41fea640 1 -- 10.20.193.123:0/2987043820 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d3c070e90 con 0x7f5d3c135ee0 2026-02-17T20:09:24.779 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7f6a9073b640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f6a88073890 0x7f6a88133b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:24.779 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7f6a9073b640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f6a8812cb80 0x7f6a881340d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:24.779 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7f6a9073b640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f6a88135460 0x7f6a88134610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:24.779 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7fe66357b640 1 -- start start 2026-02-17T20:09:24.779 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7f5d17fff640 1 -- 10.20.193.123:0/2987043820 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d30014870 con 0x7f5d3c135ee0 2026-02-17T20:09:24.779 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7f6a9073b640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6a88138270 con 0x7f6a88073890 2026-02-17T20:09:24.779 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7f6a9073b640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f6a881380f0 con 0x7f6a88135460 2026-02-17T20:09:24.779 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7f6a9073b640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f6a881383f0 con 0x7f6a8812cb80 2026-02-17T20:09:24.779 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7f5d41fea640 1 -- 10.20.193.123:0/2987043820 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d3c12d620 con 0x7f5d3c135ee0 2026-02-17T20:09:24.780 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7f6a8dcaf640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f6a8812cb80 0x7f6a881340d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:24.780 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7f6a8e4b0640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f6a88073890 0x7f6a88133b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:24.780 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7f6a8ecb1640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f6a88135460 0x7f6a88134610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:24.780 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7f6a8dcaf640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f6a8812cb80 0x7f6a881340d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:38046/0 (socket says 10.20.193.123:38046) 2026-02-17T20:09:24.780 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7f6a8dcaf640 1 -- 10.20.193.123:0/2051481550 learned_addr learned my addr 10.20.193.123:0/2051481550 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:24.780 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7f6a8e4b0640 1 --2- 10.20.193.123:0/2051481550 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f6a88073890 0x7f6a88133b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:41928/0 (socket says 10.20.193.123:41928) 2026-02-17T20:09:24.780 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7f6a8dcaf640 1 -- 10.20.193.123:0/2051481550 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f6a88135460 msgr2=0x7f6a88134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.780 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7f6a8dcaf640 1 --2- 10.20.193.123:0/2051481550 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f6a88135460 0x7f6a88134610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.780 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7f6a8dcaf640 1 -- 10.20.193.123:0/2051481550 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f6a88073890 msgr2=0x7f6a88133b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.780 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7f6a8dcaf640 1 --2- 10.20.193.123:0/2051481550 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f6a88073890 0x7f6a88133b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.780 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7f6a8dcaf640 1 -- 10.20.193.123:0/2051481550 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a881325d0 con 0x7f6a8812cb80 2026-02-17T20:09:24.780 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7fe66357b640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fe65c073890 0x7fe65c133880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:24.780 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7fe66357b640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fe65c12cb80 0x7fe65c133dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:24.780 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7fe66357b640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe65c1300e0 0x7fe65c134300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:24.780 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7fe66357b640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe65c138690 con 0x7fe65c073890 2026-02-17T20:09:24.780 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7fe66357b640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7fe65c073070 con 0x7fe65c1300e0 2026-02-17T20:09:24.780 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7fe66357b640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7fe65c138810 con 0x7fe65c12cb80 2026-02-17T20:09:24.780 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7f6a8dcaf640 1 --2- 10.20.193.123:0/2051481550 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f6a8812cb80 0x7f6a881340d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c00c730 tx=0x7f6a7c00cc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:24.780 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7fe660aef640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fe65c12cb80 0x7fe65c133dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:24.780 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7fe661af1640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe65c1300e0 0x7fe65c134300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:24.780 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7f6a6effd640 1 -- 10.20.193.123:0/2051481550 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a7c017070 con 0x7f6a8812cb80 2026-02-17T20:09:24.781 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7fe660aef640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fe65c12cb80 0x7fe65c133dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:38054/0 (socket says 10.20.193.123:38054) 2026-02-17T20:09:24.781 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7fe660aef640 1 -- 10.20.193.123:0/3085065578 learned_addr learned my addr 10.20.193.123:0/3085065578 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:24.781 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7f6a6effd640 1 -- 10.20.193.123:0/2051481550 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a7c005bb0 con 0x7f6a8812cb80 2026-02-17T20:09:24.781 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7f6a9073b640 1 -- 10.20.193.123:0/2051481550 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a88131c40 con 0x7f6a8812cb80 2026-02-17T20:09:24.781 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7f6a6effd640 1 -- 10.20.193.123:0/2051481550 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a7c007070 con 0x7f6a8812cb80 2026-02-17T20:09:24.781 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7f6a9073b640 1 -- 10.20.193.123:0/2051481550 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a881c6e10 con 0x7f6a8812cb80 2026-02-17T20:09:24.781 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7fe6612f0640 1 --2- 10.20.193.123:0/3085065578 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fe65c073890 0x7fe65c133880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:24.781 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7f5d41fea640 1 -- 10.20.193.123:0/2987043820 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d3c1309e0 con 0x7f5d3c135ee0 2026-02-17T20:09:24.781 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7fe660aef640 1 -- 10.20.193.123:0/3085065578 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe65c1300e0 msgr2=0x7fe65c134300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.781 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7fe660aef640 1 --2- 10.20.193.123:0/3085065578 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe65c1300e0 0x7fe65c134300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.781 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7fe660aef640 1 -- 10.20.193.123:0/3085065578 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fe65c073890 msgr2=0x7fe65c133880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.781 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7fe660aef640 1 --2- 10.20.193.123:0/3085065578 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fe65c073890 0x7fe65c133880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.781 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7fe660aef640 1 -- 10.20.193.123:0/3085065578 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe65c135c30 con 0x7fe65c12cb80 2026-02-17T20:09:24.781 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7fe661af1640 1 --2- 10.20.193.123:0/3085065578 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe65c1300e0 0x7fe65c134300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:24.781 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7fe6612f0640 1 --2- 10.20.193.123:0/3085065578 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fe65c073890 0x7fe65c133880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T20:09:24.781 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.780+0000 7fe660aef640 1 --2- 10.20.193.123:0/3085065578 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fe65c12cb80 0x7fe65c133dc0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe650009a00 tx=0x7fe6500047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:24.781 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.781+0000 7f5d17fff640 1 -- 10.20.193.123:0/2987043820 <== mon.0 v2:10.20.193.123:3300/0 4 ==== mgrmap(e 7) ==== 61803+0+0 (secure 0 0 0) 0x7f5d30014a10 con 0x7f5d3c135ee0 2026-02-17T20:09:24.782 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.781+0000 7fe649ffb640 1 -- 10.20.193.123:0/3085065578 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65003c040 con 0x7fe65c12cb80 2026-02-17T20:09:24.782 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.781+0000 7fe649ffb640 1 -- 10.20.193.123:0/3085065578 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe650047070 con 0x7fe65c12cb80 2026-02-17T20:09:24.782 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.781+0000 7fe649ffb640 1 -- 10.20.193.123:0/3085065578 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe650042890 con 0x7fe65c12cb80 2026-02-17T20:09:24.782 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.781+0000 7fe66357b640 1 -- 10.20.193.123:0/3085065578 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe65c135ff0 con 0x7fe65c12cb80 2026-02-17T20:09:24.782 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.781+0000 7fe66357b640 1 -- 10.20.193.123:0/3085065578 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fe65c137f30 con 0x7fe65c12cb80 2026-02-17T20:09:24.782 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.781+0000 7f6a9073b640 1 -- 10.20.193.123:0/2051481550 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a88138850 con 0x7f6a8812cb80 2026-02-17T20:09:24.782 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.781+0000 7f5d17fff640 1 -- 10.20.193.123:0/2987043820 <== mon.0 v2:10.20.193.123:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3021+0+0 (secure 0 0 0) 0x7f5d300678b0 con 0x7f5d3c135ee0 2026-02-17T20:09:24.782 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.781+0000 7f6a6effd640 1 -- 10.20.193.123:0/2051481550 <== mon.2 v2:10.20.193.123:3302/0 4 ==== mgrmap(e 7) ==== 61803+0+0 (secure 0 0 0) 0x7f6a7c007210 con 0x7f6a8812cb80 2026-02-17T20:09:24.782 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.781+0000 7f6a6effd640 1 -- 10.20.193.123:0/2051481550 <== mon.2 v2:10.20.193.123:3302/0 5 ==== osd_map(17..17 src has 1..17) ==== 3021+0+0 (secure 0 0 0) 0x7f6a7c065d90 con 0x7f6a8812cb80 2026-02-17T20:09:24.782 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.781+0000 7fe66357b640 1 -- 10.20.193.123:0/3085065578 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe65c137080 con 0x7fe65c12cb80 2026-02-17T20:09:24.782 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.781+0000 7fe649ffb640 1 -- 10.20.193.123:0/3085065578 <== mon.2 v2:10.20.193.123:3302/0 4 ==== mgrmap(e 7) ==== 61803+0+0 (secure 0 0 0) 0x7fe650042a30 con 0x7fe65c12cb80 2026-02-17T20:09:24.782 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.782+0000 7fe649ffb640 1 -- 10.20.193.123:0/3085065578 <== mon.2 v2:10.20.193.123:3302/0 5 ==== osd_map(17..17 src has 1..17) ==== 3021+0+0 (secure 0 0 0) 0x7fe65008bbb0 con 0x7fe65c12cb80 2026-02-17T20:09:24.782 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.783+0000 7f5d17fff640 1 -- 10.20.193.123:0/2987043820 <== mon.0 v2:10.20.193.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+144236 (secure 0 0 0) 0x7f5d30022030 con 0x7f5d3c135ee0 2026-02-17T20:09:24.782 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.783+0000 7f6a6effd640 1 -- 10.20.193.123:0/2051481550 <== mon.2 v2:10.20.193.123:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+144236 (secure 0 0 0) 0x7f6a7c064ce0 con 0x7f6a8812cb80 2026-02-17T20:09:24.783 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.785+0000 7fe649ffb640 1 -- 10.20.193.123:0/3085065578 <== mon.2 v2:10.20.193.123:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+144236 (secure 0 0 0) 0x7fe65c137080 con 0x7fe65c12cb80 2026-02-17T20:09:24.813 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.818+0000 7f974ef8c640 1 Processor -- start 2026-02-17T20:09:24.813 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.818+0000 7f974ef8c640 1 -- start start 2026-02-17T20:09:24.813 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.818+0000 7f974ef8c640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f974806fc60 0x7f97481357d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:24.813 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.818+0000 7f974ef8c640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f9748070060 0x7f9748137d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:24.814 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.818+0000 7f974ef8c640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9748071e10 con 0x7f974809de40 2026-02-17T20:09:24.814 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.818+0000 7f974ef8c640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7f97480715a0 con 0x7f9748070060 2026-02-17T20:09:24.814 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.818+0000 7f974ef8c640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f9748071b30 con 0x7f974806fc60 2026-02-17T20:09:24.814 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.818+0000 7f974d502640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f9748070060 0x7f9748137d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:24.814 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.818+0000 7f974cd01640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7f974809de40 0x7f974806f550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:37292/0 (socket says 10.20.193.123:37292) 2026-02-17T20:09:24.814 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.818+0000 7f973ffff640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f974806fc60 0x7f97481357d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:24.814 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.818+0000 7f974cd01640 1 -- 10.20.193.123:0/1586610228 learned_addr learned my addr 10.20.193.123:0/1586610228 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:09:24.814 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.818+0000 7f973ffff640 1 -- 10.20.193.123:0/1586610228 >> v2:10.20.193.123:3300/0 conn(0x7f9748070060 msgr2=0x7f9748137d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:24.814 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.818+0000 7f973ffff640 1 --2- 10.20.193.123:0/1586610228 >> v2:10.20.193.123:3300/0 conn(0x7f9748070060 0x7f9748137d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.814 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.818+0000 7f973ffff640 1 -- 10.20.193.123:0/1586610228 >> v1:10.20.193.123:6789/0 conn(0x7f974809de40 legacy=0x7f974806f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.814 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.818+0000 7f973ffff640 1 -- 10.20.193.123:0/1586610228 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9748070ff0 con 0x7f974806fc60 2026-02-17T20:09:24.814 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.819+0000 7f973ffff640 1 --2- 10.20.193.123:0/1586610228 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f974806fc60 0x7f97481357d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f97300098d0 tx=0x7f973002edc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60ec0d8dcf2cff10 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:24.814 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.819+0000 7f973f7fe640 1 -- 10.20.193.123:0/1586610228 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f973003c070 con 0x7f974806fc60 2026-02-17T20:09:24.814 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.819+0000 7f973f7fe640 1 -- 10.20.193.123:0/1586610228 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f973002fa40 con 0x7f974806fc60 2026-02-17T20:09:24.814 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.819+0000 7f973f7fe640 1 -- 10.20.193.123:0/1586610228 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f973002fe10 con 0x7f974806fc60 2026-02-17T20:09:24.814 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.819+0000 7f974ef8c640 1 -- 10.20.193.123:0/1586610228 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f974806fc60 msgr2=0x7f97481357d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.814 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.819+0000 7f974ef8c640 1 --2- 10.20.193.123:0/1586610228 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f974806fc60 0x7f97481357d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f97300098d0 tx=0x7f973002edc0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.815 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.819+0000 7f974ef8c640 1 -- 10.20.193.123:0/1586610228 shutdown_connections 2026-02-17T20:09:24.815 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.819+0000 7f974ef8c640 1 --2- 10.20.193.123:0/1586610228 >> v2:10.20.193.123:3300/0 conn(0x7f9748070060 0x7f9748137d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.815 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.819+0000 7f974ef8c640 1 --2- 10.20.193.123:0/1586610228 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f974806fc60 0x7f97481357d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.815 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.819+0000 7f974ef8c640 1 -- 10.20.193.123:0/1586610228 >> 10.20.193.123:0/1586610228 conn(0x7f974809e7e0 msgr2=0x7f974809ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:24.815 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.819+0000 7f974ef8c640 1 -- 10.20.193.123:0/1586610228 shutdown_connections 2026-02-17T20:09:24.815 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.819+0000 7f974ef8c640 1 -- 10.20.193.123:0/1586610228 wait complete. 2026-02-17T20:09:24.815 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.819+0000 7f974ef8c640 1 Processor -- start 2026-02-17T20:09:24.815 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.819+0000 7f974ef8c640 1 -- start start 2026-02-17T20:09:24.815 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.820+0000 7f974ef8c640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f974806fc60 0x7f974811f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:24.815 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.820+0000 7f974ef8c640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f9748070060 0x7f974811f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:24.815 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.820+0000 7f974ef8c640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f974809de40 0x7f974811faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:24.815 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.820+0000 7f974ef8c640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7f97481385f0 con 0x7f9748070060 2026-02-17T20:09:24.815 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.820+0000 7f974ef8c640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f9748138470 con 0x7f974809de40 2026-02-17T20:09:24.815 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.820+0000 7f974ef8c640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f9748138770 con 0x7f974806fc60 2026-02-17T20:09:24.815 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.820+0000 7f974cd01640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f974806fc60 0x7f974811f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:24.815 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.820+0000 7f973ffff640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f9748070060 0x7f974811f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:24.815 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.820+0000 7f974cd01640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f974806fc60 0x7f974811f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:38070/0 (socket says 10.20.193.123:38070) 2026-02-17T20:09:24.815 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.820+0000 7f974cd01640 1 -- 10.20.193.123:0/2034527350 learned_addr learned my addr 10.20.193.123:0/2034527350 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:24.815 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.820+0000 7f974d502640 1 --2- 10.20.193.123:0/2034527350 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f974809de40 0x7f974811faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:24.816 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.820+0000 7f974cd01640 1 -- 10.20.193.123:0/2034527350 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f974809de40 msgr2=0x7f974811faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.816 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.820+0000 7f974cd01640 1 --2- 10.20.193.123:0/2034527350 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f974809de40 0x7f974811faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.816 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.820+0000 7f974cd01640 1 -- 10.20.193.123:0/2034527350 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f9748070060 msgr2=0x7f974811f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.816 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.820+0000 7f974cd01640 1 --2- 10.20.193.123:0/2034527350 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f9748070060 0x7f974811f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.816 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.820+0000 7f974cd01640 1 -- 10.20.193.123:0/2034527350 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9748073f20 con 0x7f974806fc60 2026-02-17T20:09:24.816 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.820+0000 7f974d502640 1 --2- 10.20.193.123:0/2034527350 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f974809de40 0x7f974811faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:24.816 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.820+0000 7f974cd01640 1 --2- 10.20.193.123:0/2034527350 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f974806fc60 0x7f974811f020 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f973800c700 tx=0x7f973800cbd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:24.816 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.820+0000 7f973d7fa640 1 -- 10.20.193.123:0/2034527350 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9738017070 con 0x7f974806fc60 2026-02-17T20:09:24.816 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.820+0000 7f973d7fa640 1 -- 10.20.193.123:0/2034527350 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9738005bb0 con 0x7f974806fc60 2026-02-17T20:09:24.816 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.820+0000 7f974ef8c640 1 -- 10.20.193.123:0/2034527350 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f974811ffe0 con 0x7f974806fc60 2026-02-17T20:09:24.816 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.820+0000 7f973d7fa640 1 -- 10.20.193.123:0/2034527350 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9738007070 con 0x7f974806fc60 2026-02-17T20:09:24.816 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.820+0000 7f974ef8c640 1 -- 10.20.193.123:0/2034527350 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f97481219b0 con 0x7f974806fc60 2026-02-17T20:09:24.816 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.821+0000 7f974ef8c640 1 -- 10.20.193.123:0/2034527350 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9748120900 con 0x7f974806fc60 2026-02-17T20:09:24.816 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.821+0000 7f973d7fa640 1 -- 10.20.193.123:0/2034527350 <== mon.2 v2:10.20.193.123:3302/0 4 ==== mgrmap(e 7) ==== 61803+0+0 (secure 0 0 0) 0x7f9738007210 con 0x7f974806fc60 2026-02-17T20:09:24.816 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.821+0000 7f973d7fa640 1 -- 10.20.193.123:0/2034527350 <== mon.2 v2:10.20.193.123:3302/0 5 ==== osd_map(17..17 src has 1..17) ==== 3021+0+0 (secure 0 0 0) 0x7f9738065da0 con 0x7f974806fc60 2026-02-17T20:09:24.818 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.823+0000 7f973d7fa640 1 -- 10.20.193.123:0/2034527350 <== mon.2 v2:10.20.193.123:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+144236 (secure 0 0 0) 0x7f9748071e10 con 0x7f974806fc60 2026-02-17T20:09:24.842 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.847+0000 7f5d41fea640 1 -- 10.20.193.123:0/2987043820 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f5d3c068530 con 0x7f5d3c135ee0 2026-02-17T20:09:24.842 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.847+0000 7f5d17fff640 1 -- 10.20.193.123:0/2987043820 <== mon.0 v2:10.20.193.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5d30010040 con 0x7f5d3c135ee0 2026-02-17T20:09:24.843 INFO:teuthology.orchestra.run.trial123.stdout:38654705674 2026-02-17T20:09:24.843 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.848+0000 7f6a9073b640 1 -- 10.20.193.123:0/2051481550 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f6a880770f0 con 0x7f6a8812cb80 2026-02-17T20:09:24.843 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.848+0000 7f6a6effd640 1 -- 10.20.193.123:0/2051481550 <== mon.2 v2:10.20.193.123:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6a7c03f260 con 0x7f6a8812cb80 2026-02-17T20:09:24.843 INFO:teuthology.orchestra.run.trial123.stdout:38654705675 2026-02-17T20:09:24.844 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.848+0000 7f5d41fea640 1 -- 10.20.193.123:0/2987043820 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f5d3c135ee0 msgr2=0x7f5d3c06f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.844 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.848+0000 7f5d41fea640 1 --2- 10.20.193.123:0/2987043820 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f5d3c135ee0 0x7f5d3c06f2e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5d3000ef90 tx=0x7f5d3000c490 comp rx=0 tx=0).stop 2026-02-17T20:09:24.844 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.848+0000 7f5d41fea640 1 -- 10.20.193.123:0/2987043820 shutdown_connections 2026-02-17T20:09:24.844 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.848+0000 7f5d41fea640 1 --2- 10.20.193.123:0/2987043820 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f5d3c135ee0 0x7f5d3c06f2e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.844 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.848+0000 7f5d41fea640 1 --2- 10.20.193.123:0/2987043820 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f5d3c1335b0 0x7f5d3c06eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.844 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.848+0000 7f5d41fea640 1 --2- 10.20.193.123:0/2987043820 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f5d3c130600 0x7f5d3c06e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.844 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.848+0000 7f5d41fea640 1 -- 10.20.193.123:0/2987043820 >> 10.20.193.123:0/2987043820 conn(0x7f5d3c09e7c0 msgr2=0x7f5d3c0731a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:24.844 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.848+0000 7f5d41fea640 1 -- 10.20.193.123:0/2987043820 shutdown_connections 2026-02-17T20:09:24.844 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.848+0000 7f5d41fea640 1 -- 10.20.193.123:0/2987043820 wait complete. 2026-02-17T20:09:24.845 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.849+0000 7f6a9073b640 1 -- 10.20.193.123:0/2051481550 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f6a8812cb80 msgr2=0x7f6a881340d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.845 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.849+0000 7f6a9073b640 1 --2- 10.20.193.123:0/2051481550 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f6a8812cb80 0x7f6a881340d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c00c730 tx=0x7f6a7c00cc00 comp rx=0 tx=0).stop 2026-02-17T20:09:24.845 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.849+0000 7f6a9073b640 1 -- 10.20.193.123:0/2051481550 shutdown_connections 2026-02-17T20:09:24.845 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.849+0000 7f6a9073b640 1 --2- 10.20.193.123:0/2051481550 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f6a88135460 0x7f6a88134610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.845 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.849+0000 7f6a9073b640 1 --2- 10.20.193.123:0/2051481550 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f6a8812cb80 0x7f6a881340d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.845 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.849+0000 7f6a9073b640 1 --2- 10.20.193.123:0/2051481550 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f6a88073890 0x7f6a88133b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.845 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.849+0000 7f6a9073b640 1 -- 10.20.193.123:0/2051481550 >> 10.20.193.123:0/2051481550 conn(0x7f6a880a30f0 msgr2=0x7f6a880703d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:24.845 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.849+0000 7f6a9073b640 1 -- 10.20.193.123:0/2051481550 shutdown_connections 2026-02-17T20:09:24.845 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.849+0000 7f6a9073b640 1 -- 10.20.193.123:0/2051481550 wait complete. 2026-02-17T20:09:24.845 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.850+0000 7fe66357b640 1 -- 10.20.193.123:0/3085065578 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fe65c130560 con 0x7fe65c12cb80 2026-02-17T20:09:24.846 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.850+0000 7fe649ffb640 1 -- 10.20.193.123:0/3085065578 <== mon.2 v2:10.20.193.123:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe650092080 con 0x7fe65c12cb80 2026-02-17T20:09:24.846 INFO:teuthology.orchestra.run.trial123.stdout:38654705674 2026-02-17T20:09:24.847 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.852+0000 7fe66357b640 1 -- 10.20.193.123:0/3085065578 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fe65c12cb80 msgr2=0x7fe65c133dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.847 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.852+0000 7fe66357b640 1 --2- 10.20.193.123:0/3085065578 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fe65c12cb80 0x7fe65c133dc0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe650009a00 tx=0x7fe6500047c0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.847 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.852+0000 7fe66357b640 1 -- 10.20.193.123:0/3085065578 shutdown_connections 2026-02-17T20:09:24.847 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.852+0000 7fe66357b640 1 --2- 10.20.193.123:0/3085065578 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe65c1300e0 0x7fe65c134300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.847 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.852+0000 7fe66357b640 1 --2- 10.20.193.123:0/3085065578 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fe65c12cb80 0x7fe65c133dc0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.847 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.852+0000 7fe66357b640 1 --2- 10.20.193.123:0/3085065578 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fe65c073890 0x7fe65c133880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.847 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.852+0000 7fe66357b640 1 -- 10.20.193.123:0/3085065578 >> 10.20.193.123:0/3085065578 conn(0x7fe65c0a30f0 msgr2=0x7fe65c12b520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:24.847 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.852+0000 7fe66357b640 1 -- 10.20.193.123:0/3085065578 shutdown_connections 2026-02-17T20:09:24.847 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.852+0000 7fe66357b640 1 -- 10.20.193.123:0/3085065578 wait complete. 2026-02-17T20:09:24.852 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705675 got 38654705674 for osd.3 2026-02-17T20:09:24.853 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705676 got 38654705675 for osd.0 2026-02-17T20:09:24.856 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705675 got 38654705674 for osd.1 2026-02-17T20:09:24.881 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.886+0000 7f974ef8c640 1 -- 10.20.193.123:0/2034527350 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f974806f550 con 0x7f974806fc60 2026-02-17T20:09:24.882 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.886+0000 7f973d7fa640 1 -- 10.20.193.123:0/2034527350 <== mon.2 v2:10.20.193.123:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9738064cf0 con 0x7f974806fc60 2026-02-17T20:09:24.882 INFO:teuthology.orchestra.run.trial123.stdout:38654705675 2026-02-17T20:09:24.883 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.887+0000 7f974ef8c640 1 -- 10.20.193.123:0/2034527350 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f974806fc60 msgr2=0x7f974811f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:24.883 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.887+0000 7f974ef8c640 1 --2- 10.20.193.123:0/2034527350 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f974806fc60 0x7f974811f020 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f973800c700 tx=0x7f973800cbd0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.883 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.887+0000 7f974ef8c640 1 -- 10.20.193.123:0/2034527350 shutdown_connections 2026-02-17T20:09:24.883 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.887+0000 7f974ef8c640 1 --2- 10.20.193.123:0/2034527350 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f974809de40 0x7f974811faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.883 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.887+0000 7f974ef8c640 1 --2- 10.20.193.123:0/2034527350 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f9748070060 0x7f974811f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.883 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.887+0000 7f974ef8c640 1 --2- 10.20.193.123:0/2034527350 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f974806fc60 0x7f974811f020 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:24.883 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.887+0000 7f974ef8c640 1 -- 10.20.193.123:0/2034527350 >> 10.20.193.123:0/2034527350 conn(0x7f974809e7e0 msgr2=0x7f974809cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:24.883 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.887+0000 7f974ef8c640 1 -- 10.20.193.123:0/2034527350 shutdown_connections 2026-02-17T20:09:24.883 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:24.887+0000 7f974ef8c640 1 -- 10.20.193.123:0/2034527350 wait complete. 2026-02-17T20:09:24.890 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705676 got 38654705675 for osd.2 2026-02-17T20:09:25.317 INFO:tasks.ceph.mgr.y.trial123.stderr:2026-02-17T20:09:25.321+0000 7fc36b99f640 -1 mgr.server handle_report got status from non-daemon mon.a 2026-02-17T20:09:25.318 INFO:tasks.ceph.mgr.y.trial123.stderr:2026-02-17T20:09:25.322+0000 7fc36b99f640 -1 mgr.server handle_report got status from non-daemon mon.c 2026-02-17T20:09:25.318 INFO:tasks.ceph.mgr.y.trial123.stderr:2026-02-17T20:09:25.322+0000 7fc36b99f640 -1 mgr.server handle_report got status from non-daemon mon.b 2026-02-17T20:09:25.852 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T20:09:25.854 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T20:09:25.856 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T20:09:25.891 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T20:09:25.920 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.924+0000 7f9dd501a640 1 Processor -- start 2026-02-17T20:09:25.920 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.924+0000 7f9dd501a640 1 -- start start 2026-02-17T20:09:25.920 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.925+0000 7f9dd501a640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f9dd0130710 0x7f9dd0130af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:25.920 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.925+0000 7f82a7bfd640 1 Processor -- start 2026-02-17T20:09:25.920 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.925+0000 7f9dd501a640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f9dd0071a40 0x7f9dd012cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:25.921 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.925+0000 7f9dd501a640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dd0070cf0 con 0x7f9dd012d150 2026-02-17T20:09:25.921 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.925+0000 7f9dd501a640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7f9dd0072220 con 0x7f9dd0130710 2026-02-17T20:09:25.921 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.925+0000 7f9dd501a640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f9dd00710d0 con 0x7f9dd0071a40 2026-02-17T20:09:25.921 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.925+0000 7f82a7bfd640 1 -- start start 2026-02-17T20:09:25.921 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.925+0000 7f9dce575640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f9dd0071a40 0x7f9dd012cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:25.921 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.925+0000 7f9dced76640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f9dd0130710 0x7f9dd0130af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:25.921 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.925+0000 7f9dcf577640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7f9dd012d150 0x7f9dd0137460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:37304/0 (socket says 10.20.193.123:37304) 2026-02-17T20:09:25.921 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.925+0000 7f9dcf577640 1 -- 10.20.193.123:0/2479142791 learned_addr learned my addr 10.20.193.123:0/2479142791 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:09:25.921 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.925+0000 7f9dcdd74640 1 -- 10.20.193.123:0/2479142791 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4147635604 0 0) 0x7f9dd0070cf0 con 0x7f9dd012d150 2026-02-17T20:09:25.921 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.925+0000 7f9dce575640 1 -- 10.20.193.123:0/2479142791 >> v2:10.20.193.123:3300/0 conn(0x7f9dd0130710 msgr2=0x7f9dd0130af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:25.921 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.925+0000 7f9dce575640 1 --2- 10.20.193.123:0/2479142791 >> v2:10.20.193.123:3300/0 conn(0x7f9dd0130710 0x7f9dd0130af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:25.921 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.925+0000 7f9dce575640 1 -- 10.20.193.123:0/2479142791 >> v1:10.20.193.123:6789/0 conn(0x7f9dd012d150 legacy=0x7f9dd0137460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:25.921 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.925+0000 7f9dce575640 1 -- 10.20.193.123:0/2479142791 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd0131030 con 0x7f9dd0071a40 2026-02-17T20:09:25.922 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.925+0000 7f82a7bfd640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f82a012cb80 0x7f82a012cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:25.922 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.925+0000 7f82a7bfd640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f82a0073890 0x7f82a012d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:25.922 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.925+0000 7f82a7bfd640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82a0074070 con 0x7f82a01300e0 2026-02-17T20:09:25.922 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.925+0000 7f82a7bfd640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7f82a012d9e0 con 0x7f82a0073890 2026-02-17T20:09:25.922 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.925+0000 7f82a7bfd640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f82a0072e70 con 0x7f82a012cb80 2026-02-17T20:09:25.922 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.925+0000 7f82a5171640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f82a0073890 0x7f82a012d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:25.922 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.925+0000 7f82a5972640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f82a012cb80 0x7f82a012cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:25.922 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.925+0000 7f82a6173640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7f82a01300e0 0x7f82a0130550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:37316/0 (socket says 10.20.193.123:37316) 2026-02-17T20:09:25.922 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.925+0000 7f82a6173640 1 -- 10.20.193.123:0/12207493 learned_addr learned my addr 10.20.193.123:0/12207493 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:09:25.922 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.926+0000 7f82a5972640 1 -- 10.20.193.123:0/12207493 >> v2:10.20.193.123:3300/0 conn(0x7f82a0073890 msgr2=0x7f82a012d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:25.922 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.926+0000 7f82a5972640 1 --2- 10.20.193.123:0/12207493 >> v2:10.20.193.123:3300/0 conn(0x7f82a0073890 0x7f82a012d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:25.922 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.926+0000 7f82a5972640 1 -- 10.20.193.123:0/12207493 >> v1:10.20.193.123:6789/0 conn(0x7f82a01300e0 legacy=0x7f82a0130550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:25.922 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.926+0000 7f82a5972640 1 -- 10.20.193.123:0/12207493 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82a0130c60 con 0x7f82a012cb80 2026-02-17T20:09:25.923 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.926+0000 7f9dce575640 1 --2- 10.20.193.123:0/2479142791 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f9dd0071a40 0x7f9dd012cc10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9db80098a0 tx=0x7f9db802ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e521cfb88931eaa server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:25.923 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.926+0000 7f9dcdd74640 1 -- 10.20.193.123:0/2479142791 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db803c070 con 0x7f9dd0071a40 2026-02-17T20:09:25.923 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.926+0000 7f9dcdd74640 1 -- 10.20.193.123:0/2479142791 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9db802fa40 con 0x7f9dd0071a40 2026-02-17T20:09:25.923 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.926+0000 7f9dcdd74640 1 -- 10.20.193.123:0/2479142791 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db802fe10 con 0x7f9dd0071a40 2026-02-17T20:09:25.923 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.926+0000 7f9dd501a640 1 -- 10.20.193.123:0/2479142791 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f9dd0071a40 msgr2=0x7f9dd012cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:25.923 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.926+0000 7f9dd501a640 1 --2- 10.20.193.123:0/2479142791 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f9dd0071a40 0x7f9dd012cc10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9db80098a0 tx=0x7f9db802ed80 comp rx=0 tx=0).stop 2026-02-17T20:09:25.923 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.926+0000 7f9dd501a640 1 -- 10.20.193.123:0/2479142791 shutdown_connections 2026-02-17T20:09:25.923 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.926+0000 7f9dd501a640 1 --2- 10.20.193.123:0/2479142791 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f9dd0071a40 0x7f9dd012cc10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:25.923 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.926+0000 7f9dd501a640 1 --2- 10.20.193.123:0/2479142791 >> v2:10.20.193.123:3300/0 conn(0x7f9dd0130710 0x7f9dd0130af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:25.923 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.926+0000 7f9dd501a640 1 -- 10.20.193.123:0/2479142791 >> 10.20.193.123:0/2479142791 conn(0x7f9dd009ec70 msgr2=0x7f9dd009f080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:25.923 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.926+0000 7f9dd501a640 1 -- 10.20.193.123:0/2479142791 shutdown_connections 2026-02-17T20:09:25.923 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.926+0000 7f82a5972640 1 --2- 10.20.193.123:0/12207493 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f82a012cb80 0x7f82a012cf60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f82900098a0 tx=0x7f829002ee10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a65a7945623814c5 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:25.923 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.926+0000 7f9dd501a640 1 -- 10.20.193.123:0/2479142791 wait complete. 2026-02-17T20:09:25.924 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.926+0000 7f82a4970640 1 -- 10.20.193.123:0/12207493 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f829003c070 con 0x7f82a012cb80 2026-02-17T20:09:25.924 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.926+0000 7f82a4970640 1 -- 10.20.193.123:0/12207493 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f829002fad0 con 0x7f82a012cb80 2026-02-17T20:09:25.924 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.926+0000 7f82a4970640 1 -- 10.20.193.123:0/12207493 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8290037440 con 0x7f82a012cb80 2026-02-17T20:09:25.924 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.926+0000 7f82a7bfd640 1 -- 10.20.193.123:0/12207493 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f82a012cb80 msgr2=0x7f82a012cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:25.924 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.926+0000 7f82a7bfd640 1 --2- 10.20.193.123:0/12207493 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f82a012cb80 0x7f82a012cf60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f82900098a0 tx=0x7f829002ee10 comp rx=0 tx=0).stop 2026-02-17T20:09:25.924 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.927+0000 7f9dd501a640 1 Processor -- start 2026-02-17T20:09:25.924 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.927+0000 7f82a7bfd640 1 -- 10.20.193.123:0/12207493 shutdown_connections 2026-02-17T20:09:25.924 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.927+0000 7f82a7bfd640 1 --2- 10.20.193.123:0/12207493 >> v2:10.20.193.123:3300/0 conn(0x7f82a0073890 0x7f82a012d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:25.924 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.927+0000 7f82a7bfd640 1 --2- 10.20.193.123:0/12207493 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f82a012cb80 0x7f82a012cf60 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:25.924 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.927+0000 7f82a7bfd640 1 -- 10.20.193.123:0/12207493 >> 10.20.193.123:0/12207493 conn(0x7f82a00a30f0 msgr2=0x7f82a00a3500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:25.924 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.927+0000 7f82a7bfd640 1 -- 10.20.193.123:0/12207493 shutdown_connections 2026-02-17T20:09:25.924 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.927+0000 7f9dd501a640 1 -- start start 2026-02-17T20:09:25.924 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.927+0000 7f82a7bfd640 1 -- 10.20.193.123:0/12207493 wait complete. 2026-02-17T20:09:25.925 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.927+0000 7f9dd501a640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f9dd0071a40 0x7f9dd01c71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:25.925 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.927+0000 7f9dd501a640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f9dd012d150 0x7f9dd01c76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:25.925 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.927+0000 7f9dd501a640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f9dd0130710 0x7f9dd011f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:25.925 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.927+0000 7f9dd501a640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd012d5c0 con 0x7f9dd0130710 2026-02-17T20:09:25.925 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.927+0000 7f9dd501a640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f9dd0130590 con 0x7f9dd0071a40 2026-02-17T20:09:25.925 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.927+0000 7f9dd501a640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f9dd012d740 con 0x7f9dd012d150 2026-02-17T20:09:25.925 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.927+0000 7f9dce575640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f9dd012d150 0x7f9dd01c76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:25.925 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.927+0000 7f9dce575640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f9dd012d150 0x7f9dd01c76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:38104/0 (socket says 10.20.193.123:38104) 2026-02-17T20:09:25.925 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.927+0000 7f9dcf577640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f9dd0130710 0x7f9dd011f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:25.925 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.927+0000 7f9dced76640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f9dd0071a40 0x7f9dd01c71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:25.925 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.927+0000 7f9dce575640 1 -- 10.20.193.123:0/2778382262 learned_addr learned my addr 10.20.193.123:0/2778382262 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:25.925 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.927+0000 7f9dced76640 1 -- 10.20.193.123:0/2778382262 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f9dd012d150 msgr2=0x7f9dd01c76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:25.925 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.927+0000 7f9dced76640 1 --2- 10.20.193.123:0/2778382262 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f9dd012d150 0x7f9dd01c76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:25.925 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.927+0000 7f9dced76640 1 -- 10.20.193.123:0/2778382262 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f9dd0130710 msgr2=0x7f9dd011f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:25.925 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.927+0000 7f9dced76640 1 --2- 10.20.193.123:0/2778382262 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f9dd0130710 0x7f9dd011f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:25.925 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.927+0000 7f9dced76640 1 -- 10.20.193.123:0/2778382262 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd012a900 con 0x7f9dd0071a40 2026-02-17T20:09:25.925 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.927+0000 7f9dce575640 1 --2- 10.20.193.123:0/2778382262 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f9dd012d150 0x7f9dd01c76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:25.925 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.927+0000 7f82a7bfd640 1 Processor -- start 2026-02-17T20:09:25.926 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.927+0000 7f9dced76640 1 --2- 10.20.193.123:0/2778382262 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f9dd0071a40 0x7f9dd01c71b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9dc400e9b0 tx=0x7f9dc400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:25.926 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.927+0000 7f82a7bfd640 1 -- start start 2026-02-17T20:09:25.926 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.927+0000 7f9daf7fe640 1 -- 10.20.193.123:0/2778382262 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc4017070 con 0x7f9dd0071a40 2026-02-17T20:09:25.926 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.927+0000 7f9daf7fe640 1 -- 10.20.193.123:0/2778382262 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dc400ca00 con 0x7f9dd0071a40 2026-02-17T20:09:25.926 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.927+0000 7f9dd501a640 1 -- 10.20.193.123:0/2778382262 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dd0121eb0 con 0x7f9dd0071a40 2026-02-17T20:09:25.926 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.927+0000 7f9daf7fe640 1 -- 10.20.193.123:0/2778382262 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc400cdf0 con 0x7f9dd0071a40 2026-02-17T20:09:25.926 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.927+0000 7f9dd501a640 1 -- 10.20.193.123:0/2778382262 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dd0121520 con 0x7f9dd0071a40 2026-02-17T20:09:25.927 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.927+0000 7f82a7bfd640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f82a0073890 0x7f82a0133df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:25.927 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.927+0000 7f82a7bfd640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f82a012cb80 0x7f82a0134330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:25.927 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.928+0000 7f82a7bfd640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f82a01300e0 0x7f82a0134870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:25.927 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.928+0000 7f82a7bfd640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7f82a0138690 con 0x7f82a012cb80 2026-02-17T20:09:25.927 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.928+0000 7f82a7bfd640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f82a0073070 con 0x7f82a0073890 2026-02-17T20:09:25.927 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.928+0000 7f82a7bfd640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f82a0138810 con 0x7f82a01300e0 2026-02-17T20:09:25.927 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.928+0000 7f82a5171640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f82a012cb80 0x7f82a0134330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:25.927 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.928+0000 7f82a6173640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f82a01300e0 0x7f82a0134870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:25.927 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.928+0000 7f82a5171640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f82a012cb80 0x7f82a0134330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:41990/0 (socket says 10.20.193.123:41990) 2026-02-17T20:09:25.927 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.928+0000 7f82a6173640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f82a01300e0 0x7f82a0134870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:38106/0 (socket says 10.20.193.123:38106) 2026-02-17T20:09:25.927 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.928+0000 7f82a5171640 1 -- 10.20.193.123:0/4039439762 learned_addr learned my addr 10.20.193.123:0/4039439762 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:25.927 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.928+0000 7f82a5171640 1 -- 10.20.193.123:0/4039439762 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f82a01300e0 msgr2=0x7f82a0134870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:25.927 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.928+0000 7f82a5171640 1 --2- 10.20.193.123:0/4039439762 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f82a01300e0 0x7f82a0134870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:25.927 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.928+0000 7f82a5171640 1 -- 10.20.193.123:0/4039439762 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f82a0073890 msgr2=0x7f82a0133df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:25.927 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.928+0000 7f82a5171640 1 --2- 10.20.193.123:0/4039439762 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f82a0073890 0x7f82a0133df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:25.927 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.928+0000 7f82a5171640 1 -- 10.20.193.123:0/4039439762 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82a01362b0 con 0x7f82a012cb80 2026-02-17T20:09:25.927 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.928+0000 7f82a5171640 1 --2- 10.20.193.123:0/4039439762 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f82a012cb80 0x7f82a0134330 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f829400ebe0 tx=0x7f829400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:25.927 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.928+0000 7f9daf7fe640 1 -- 10.20.193.123:0/2778382262 <== mon.1 v2:10.20.193.123:3301/0 4 ==== mgrmap(e 8) ==== 61895+0+0 (secure 0 0 0) 0x7f9dc4024060 con 0x7f9dd0071a40 2026-02-17T20:09:25.927 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.928+0000 7f828e7fc640 1 -- 10.20.193.123:0/4039439762 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8294017070 con 0x7f82a012cb80 2026-02-17T20:09:25.927 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.928+0000 7f828e7fc640 1 -- 10.20.193.123:0/4039439762 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f829400cc40 con 0x7f82a012cb80 2026-02-17T20:09:25.928 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.928+0000 7f82a7bfd640 1 -- 10.20.193.123:0/4039439762 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82a0136870 con 0x7f82a012cb80 2026-02-17T20:09:25.928 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.928+0000 7f9dd501a640 1 -- 10.20.193.123:0/2778382262 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dd012cc10 con 0x7f9dd0071a40 2026-02-17T20:09:25.928 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.928+0000 7f828e7fc640 1 -- 10.20.193.123:0/4039439762 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8294013470 con 0x7f82a012cb80 2026-02-17T20:09:25.928 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.928+0000 7f82a7bfd640 1 -- 10.20.193.123:0/4039439762 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82a01cd7b0 con 0x7f82a012cb80 2026-02-17T20:09:25.928 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.928+0000 7f9daf7fe640 1 -- 10.20.193.123:0/2778382262 <== mon.1 v2:10.20.193.123:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 3021+0+0 (secure 0 0 0) 0x7f9dc4066900 con 0x7f9dd0071a40 2026-02-17T20:09:25.928 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.929+0000 7f82a7bfd640 1 -- 10.20.193.123:0/4039439762 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82a0130550 con 0x7f82a012cb80 2026-02-17T20:09:25.928 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.929+0000 7f828e7fc640 1 -- 10.20.193.123:0/4039439762 <== mon.0 v2:10.20.193.123:3300/0 4 ==== mgrmap(e 8) ==== 61895+0+0 (secure 0 0 0) 0x7f8294024060 con 0x7f82a012cb80 2026-02-17T20:09:25.928 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.929+0000 7f828e7fc640 1 -- 10.20.193.123:0/4039439762 <== mon.0 v2:10.20.193.123:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3021+0+0 (secure 0 0 0) 0x7f8294066a00 con 0x7f82a012cb80 2026-02-17T20:09:25.928 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.930+0000 7f9daf7fe640 1 -- 10.20.193.123:0/2778382262 <== mon.1 v2:10.20.193.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f9dc4040870 con 0x7f9dd0071a40 2026-02-17T20:09:25.928 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.931+0000 7f828e7fc640 1 -- 10.20.193.123:0/4039439762 <== mon.0 v2:10.20.193.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f8294040970 con 0x7f82a012cb80 2026-02-17T20:09:25.962 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.967+0000 7f1ae17e6640 1 Processor -- start 2026-02-17T20:09:25.962 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.967+0000 7f1ae17e6640 1 -- start start 2026-02-17T20:09:25.963 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.967+0000 7f1ae17e6640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f1adc1304e0 0x7f1adc1308c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:25.963 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.967+0000 7f1ae17e6640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f1adc0717c0 0x7f1adc138430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:25.963 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.967+0000 7f1ae17e6640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1adc06e6e0 con 0x7f1adc070c70 2026-02-17T20:09:25.963 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.967+0000 7f1ae17e6640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7f1adc06f0f0 con 0x7f1adc0717c0 2026-02-17T20:09:25.963 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.967+0000 7f1ae17e6640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f1adc071d30 con 0x7f1adc1304e0 2026-02-17T20:09:25.963 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.967+0000 7f1ada7fc640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7f1adc070c70 0x7f1adc0710b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:37322/0 (socket says 10.20.193.123:37322) 2026-02-17T20:09:25.963 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.967+0000 7f1adb7fe640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f1adc0717c0 0x7f1adc138430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:25.963 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.967+0000 7f1ada7fc640 1 -- 10.20.193.123:0/2950100619 learned_addr learned my addr 10.20.193.123:0/2950100619 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:09:25.963 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.967+0000 7f1adaffd640 1 --2- 10.20.193.123:0/2950100619 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f1adc1304e0 0x7f1adc1308c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:25.963 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.967+0000 7f7e9ef9f640 1 Processor -- start 2026-02-17T20:09:25.963 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.967+0000 7f1adb7fe640 1 -- 10.20.193.123:0/2950100619 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f1adc1304e0 msgr2=0x7f1adc1308c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:25.963 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.967+0000 7f1adb7fe640 1 --2- 10.20.193.123:0/2950100619 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f1adc1304e0 0x7f1adc1308c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:25.964 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.967+0000 7f1adb7fe640 1 -- 10.20.193.123:0/2950100619 >> v1:10.20.193.123:6789/0 conn(0x7f1adc070c70 legacy=0x7f1adc0710b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:25.964 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.967+0000 7f1adb7fe640 1 -- 10.20.193.123:0/2950100619 --> v2:10.20.193.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1adc130090 con 0x7f1adc0717c0 2026-02-17T20:09:25.964 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.967+0000 7f1adaffd640 1 --2- 10.20.193.123:0/2950100619 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f1adc1304e0 0x7f1adc1308c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:25.964 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.967+0000 7f7e9ef9f640 1 -- start start 2026-02-17T20:09:25.964 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.968+0000 7f7e9ef9f640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f7e9812cb80 0x7f7e9812cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:25.964 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.968+0000 7f7e9ef9f640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f7e98135460 0x7f7e98137850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:25.964 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.968+0000 7f1adb7fe640 1 --2- 10.20.193.123:0/2950100619 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f1adc0717c0 0x7f1adc138430 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1acc009d90 tx=0x7f1acc02f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=258a0125f87b70ca server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:25.964 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.968+0000 7f7e9ef9f640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e98074070 con 0x7f7e98073890 2026-02-17T20:09:25.964 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.968+0000 7f7e9ef9f640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f7e98072e70 con 0x7f7e98135460 2026-02-17T20:09:25.964 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.968+0000 7f7e9ef9f640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f7e98073070 con 0x7f7e9812cb80 2026-02-17T20:09:25.964 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.968+0000 7f7e9cd14640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f7e9812cb80 0x7f7e9812cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:25.964 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.968+0000 7f7e8ffff640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7f7e98073890 0x7f7e9812d4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:37328/0 (socket says 10.20.193.123:37328) 2026-02-17T20:09:25.964 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.968+0000 7f7e9cd14640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f7e9812cb80 0x7f7e9812cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:38130/0 (socket says 10.20.193.123:38130) 2026-02-17T20:09:25.964 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.968+0000 7f7e8ffff640 1 -- 10.20.193.123:0/4130221219 learned_addr learned my addr 10.20.193.123:0/4130221219 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:09:25.965 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.968+0000 7f1ad9ffb640 1 -- 10.20.193.123:0/2950100619 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1acc03c070 con 0x7f1adc0717c0 2026-02-17T20:09:25.965 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.968+0000 7f7e9d515640 1 --2- 10.20.193.123:0/4130221219 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f7e98135460 0x7f7e98137850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:25.965 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.968+0000 7f1ad9ffb640 1 -- 10.20.193.123:0/2950100619 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1acc037440 con 0x7f1adc0717c0 2026-02-17T20:09:25.965 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.968+0000 7f1ad9ffb640 1 -- 10.20.193.123:0/2950100619 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1acc037810 con 0x7f1adc0717c0 2026-02-17T20:09:25.965 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.968+0000 7f7e8f7fe640 1 -- 10.20.193.123:0/4130221219 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 802269361 0 0) 0x7f7e98074070 con 0x7f7e98073890 2026-02-17T20:09:25.965 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.968+0000 7f7e9cd14640 1 -- 10.20.193.123:0/4130221219 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f7e98135460 msgr2=0x7f7e98137850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:25.965 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.968+0000 7f7e9cd14640 1 --2- 10.20.193.123:0/4130221219 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f7e98135460 0x7f7e98137850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:25.965 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.968+0000 7f7e9cd14640 1 -- 10.20.193.123:0/4130221219 >> v1:10.20.193.123:6789/0 conn(0x7f7e98073890 legacy=0x7f7e9812d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:25.965 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.968+0000 7f7e9cd14640 1 -- 10.20.193.123:0/4130221219 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e98138da0 con 0x7f7e9812cb80 2026-02-17T20:09:25.966 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.968+0000 7f1ae17e6640 1 -- 10.20.193.123:0/2950100619 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f1adc0717c0 msgr2=0x7f1adc138430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:25.966 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.968+0000 7f1ae17e6640 1 --2- 10.20.193.123:0/2950100619 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f1adc0717c0 0x7f1adc138430 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1acc009d90 tx=0x7f1acc02f1f0 comp rx=0 tx=0).stop 2026-02-17T20:09:25.966 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.968+0000 7f1ae17e6640 1 -- 10.20.193.123:0/2950100619 shutdown_connections 2026-02-17T20:09:25.966 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.968+0000 7f1ae17e6640 1 --2- 10.20.193.123:0/2950100619 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f1adc0717c0 0x7f1adc138430 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:25.966 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.968+0000 7f1ae17e6640 1 --2- 10.20.193.123:0/2950100619 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f1adc1304e0 0x7f1adc1308c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:25.966 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.968+0000 7f1ae17e6640 1 -- 10.20.193.123:0/2950100619 >> 10.20.193.123:0/2950100619 conn(0x7f1adc09cb30 msgr2=0x7f1adc06f550 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:25.966 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.968+0000 7f1ae17e6640 1 -- 10.20.193.123:0/2950100619 shutdown_connections 2026-02-17T20:09:25.966 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.968+0000 7f1ae17e6640 1 -- 10.20.193.123:0/2950100619 wait complete. 2026-02-17T20:09:25.966 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.969+0000 7f7e9cd14640 1 --2- 10.20.193.123:0/4130221219 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f7e9812cb80 0x7f7e9812cf60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7e880098d0 tx=0x7f7e8802ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c222f4c80182ce6 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:25.966 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.969+0000 7f7e8f7fe640 1 -- 10.20.193.123:0/4130221219 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e8803c070 con 0x7f7e9812cb80 2026-02-17T20:09:25.966 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.969+0000 7f7e8f7fe640 1 -- 10.20.193.123:0/4130221219 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e8802fab0 con 0x7f7e9812cb80 2026-02-17T20:09:25.966 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.969+0000 7f7e8f7fe640 1 -- 10.20.193.123:0/4130221219 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e88037440 con 0x7f7e9812cb80 2026-02-17T20:09:25.966 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.969+0000 7f7e9ef9f640 1 -- 10.20.193.123:0/4130221219 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f7e9812cb80 msgr2=0x7f7e9812cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:25.966 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.969+0000 7f7e9ef9f640 1 --2- 10.20.193.123:0/4130221219 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f7e9812cb80 0x7f7e9812cf60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7e880098d0 tx=0x7f7e8802ee80 comp rx=0 tx=0).stop 2026-02-17T20:09:25.967 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.969+0000 7f7e9ef9f640 1 -- 10.20.193.123:0/4130221219 shutdown_connections 2026-02-17T20:09:25.967 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.969+0000 7f7e9ef9f640 1 --2- 10.20.193.123:0/4130221219 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f7e98135460 0x7f7e98137850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:25.967 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.969+0000 7f7e9ef9f640 1 --2- 10.20.193.123:0/4130221219 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f7e9812cb80 0x7f7e9812cf60 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:25.967 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.969+0000 7f1ae17e6640 1 Processor -- start 2026-02-17T20:09:25.967 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.969+0000 7f7e9ef9f640 1 -- 10.20.193.123:0/4130221219 >> 10.20.193.123:0/4130221219 conn(0x7f7e980a30f0 msgr2=0x7f7e980a3500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:25.967 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.969+0000 7f7e9ef9f640 1 -- 10.20.193.123:0/4130221219 shutdown_connections 2026-02-17T20:09:25.967 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.969+0000 7f7e9ef9f640 1 -- 10.20.193.123:0/4130221219 wait complete. 2026-02-17T20:09:25.967 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.969+0000 7f1ae17e6640 1 -- start start 2026-02-17T20:09:25.968 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.969+0000 7f1ae17e6640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f1adc070c70 0x7f1adc1c79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:25.968 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.969+0000 7f1ae17e6640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f1adc0717c0 0x7f1adc1c7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:25.968 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.969+0000 7f1ae17e6640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f1adc1304e0 0x7f1adc135ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:25.968 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.969+0000 7f1ae17e6640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1adc130e00 con 0x7f1adc0717c0 2026-02-17T20:09:25.968 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.969+0000 7f1ae17e6640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f1adc072fe0 con 0x7f1adc070c70 2026-02-17T20:09:25.968 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.969+0000 7f1ae17e6640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f1adc130f80 con 0x7f1adc1304e0 2026-02-17T20:09:25.968 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.969+0000 7f1adb7fe640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f1adc1304e0 0x7f1adc135ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:25.968 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.969+0000 7f1ada7fc640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f1adc0717c0 0x7f1adc1c7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:25.968 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.969+0000 7f1adaffd640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f1adc070c70 0x7f1adc1c79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:25.968 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.969+0000 7f1adb7fe640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f1adc1304e0 0x7f1adc135ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:38134/0 (socket says 10.20.193.123:38134) 2026-02-17T20:09:25.968 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.969+0000 7f1adb7fe640 1 -- 10.20.193.123:0/844352195 learned_addr learned my addr 10.20.193.123:0/844352195 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:25.968 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.970+0000 7f1adb7fe640 1 -- 10.20.193.123:0/844352195 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f1adc070c70 msgr2=0x7f1adc1c79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:25.968 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.970+0000 7f1adb7fe640 1 --2- 10.20.193.123:0/844352195 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f1adc070c70 0x7f1adc1c79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:25.968 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.970+0000 7f1adb7fe640 1 -- 10.20.193.123:0/844352195 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f1adc0717c0 msgr2=0x7f1adc1c7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:25.968 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.970+0000 7f1adb7fe640 1 --2- 10.20.193.123:0/844352195 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f1adc0717c0 0x7f1adc1c7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:25.968 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.970+0000 7f1adb7fe640 1 -- 10.20.193.123:0/844352195 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1adc137a40 con 0x7f1adc1304e0 2026-02-17T20:09:25.968 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.970+0000 7f1ada7fc640 1 --2- 10.20.193.123:0/844352195 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f1adc0717c0 0x7f1adc1c7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:25.968 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.970+0000 7f7e9ef9f640 1 Processor -- start 2026-02-17T20:09:25.968 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.970+0000 7f1adb7fe640 1 --2- 10.20.193.123:0/844352195 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f1adc1304e0 0x7f1adc135ed0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1acc009d90 tx=0x7f1acc004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:25.968 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.970+0000 7f7e9ef9f640 1 -- start start 2026-02-17T20:09:25.969 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.970+0000 7f1abb7fe640 1 -- 10.20.193.123:0/844352195 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1acc03c050 con 0x7f1adc1304e0 2026-02-17T20:09:25.969 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.970+0000 7f1abb7fe640 1 -- 10.20.193.123:0/844352195 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1acc048070 con 0x7f1adc1304e0 2026-02-17T20:09:25.969 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.970+0000 7f1ae17e6640 1 -- 10.20.193.123:0/844352195 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1adc11b9a0 con 0x7f1adc1304e0 2026-02-17T20:09:25.969 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.970+0000 7f1abb7fe640 1 -- 10.20.193.123:0/844352195 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1acc035a90 con 0x7f1adc1304e0 2026-02-17T20:09:25.969 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.970+0000 7f1ae17e6640 1 -- 10.20.193.123:0/844352195 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f1adc11ae80 con 0x7f1adc1304e0 2026-02-17T20:09:25.970 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.970+0000 7f7e9ef9f640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f7e98073890 0x7f7e98131190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:25.970 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.970+0000 7f7e9ef9f640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f7e9812cb80 0x7f7e981316d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:25.970 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.970+0000 7f7e9ef9f640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f7e98135460 0x7f7e98131c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:25.970 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.970+0000 7f7e9ef9f640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7e981382c0 con 0x7f7e9812cb80 2026-02-17T20:09:25.970 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.970+0000 7f7e9ef9f640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f7e98138140 con 0x7f7e98135460 2026-02-17T20:09:25.970 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.970+0000 7f7e9ef9f640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f7e98138440 con 0x7f7e98073890 2026-02-17T20:09:25.970 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.970+0000 7f7e9cd14640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f7e98073890 0x7f7e98131190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:25.970 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.970+0000 7f7e9cd14640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f7e98073890 0x7f7e98131190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:38148/0 (socket says 10.20.193.123:38148) 2026-02-17T20:09:25.970 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.970+0000 7f7e9cd14640 1 -- 10.20.193.123:0/1401108378 learned_addr learned my addr 10.20.193.123:0/1401108378 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:25.970 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.970+0000 7f7e9d515640 1 --2- 10.20.193.123:0/1401108378 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f7e98135460 0x7f7e98131c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:25.970 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.970+0000 7f7e8ffff640 1 --2- 10.20.193.123:0/1401108378 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f7e9812cb80 0x7f7e981316d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:25.970 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.970+0000 7f7e9cd14640 1 -- 10.20.193.123:0/1401108378 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f7e98135460 msgr2=0x7f7e98131c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:25.970 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.970+0000 7f7e9cd14640 1 --2- 10.20.193.123:0/1401108378 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f7e98135460 0x7f7e98131c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:25.970 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.970+0000 7f7e9cd14640 1 -- 10.20.193.123:0/1401108378 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f7e9812cb80 msgr2=0x7f7e981316d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:25.970 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.970+0000 7f7e9cd14640 1 --2- 10.20.193.123:0/1401108378 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f7e9812cb80 0x7f7e981316d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:25.970 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.970+0000 7f7e9cd14640 1 -- 10.20.193.123:0/1401108378 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e98134200 con 0x7f7e98073890 2026-02-17T20:09:25.970 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.970+0000 7f7e9cd14640 1 --2- 10.20.193.123:0/1401108378 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f7e98073890 0x7f7e98131190 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7e88009130 tx=0x7f7e880047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:25.970 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.970+0000 7f7e8d7fa640 1 -- 10.20.193.123:0/1401108378 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e88046020 con 0x7f7e98073890 2026-02-17T20:09:25.970 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.970+0000 7f7e8d7fa640 1 -- 10.20.193.123:0/1401108378 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e88042610 con 0x7f7e98073890 2026-02-17T20:09:25.970 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.970+0000 7f7e9ef9f640 1 -- 10.20.193.123:0/1401108378 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e98132e00 con 0x7f7e98073890 2026-02-17T20:09:25.970 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.970+0000 7f1ae17e6640 1 -- 10.20.193.123:0/844352195 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1adc1308c0 con 0x7f1adc1304e0 2026-02-17T20:09:25.970 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.970+0000 7f7e8d7fa640 1 -- 10.20.193.123:0/1401108378 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e8803c040 con 0x7f7e98073890 2026-02-17T20:09:25.971 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.970+0000 7f7e9ef9f640 1 -- 10.20.193.123:0/1401108378 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e981350b0 con 0x7f7e98073890 2026-02-17T20:09:25.971 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.971+0000 7f1abb7fe640 1 -- 10.20.193.123:0/844352195 <== mon.2 v2:10.20.193.123:3302/0 4 ==== mgrmap(e 8) ==== 61895+0+0 (secure 0 0 0) 0x7f1acc035c30 con 0x7f1adc1304e0 2026-02-17T20:09:25.971 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.971+0000 7f1abb7fe640 1 -- 10.20.193.123:0/844352195 <== mon.2 v2:10.20.193.123:3302/0 5 ==== osd_map(17..17 src has 1..17) ==== 3021+0+0 (secure 0 0 0) 0x7f1acc08c8a0 con 0x7f1adc1304e0 2026-02-17T20:09:25.971 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.971+0000 7f7e8d7fa640 1 -- 10.20.193.123:0/1401108378 <== mon.2 v2:10.20.193.123:3302/0 4 ==== mgrmap(e 8) ==== 61895+0+0 (secure 0 0 0) 0x7f7e880429e0 con 0x7f7e98073890 2026-02-17T20:09:25.971 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.971+0000 7f7e9ef9f640 1 -- 10.20.193.123:0/1401108378 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e9812c3b0 con 0x7f7e98073890 2026-02-17T20:09:25.971 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.971+0000 7f7e8d7fa640 1 -- 10.20.193.123:0/1401108378 <== mon.2 v2:10.20.193.123:3302/0 5 ==== osd_map(17..17 src has 1..17) ==== 3021+0+0 (secure 0 0 0) 0x7f7e8808ba40 con 0x7f7e98073890 2026-02-17T20:09:25.971 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.973+0000 7f1abb7fe640 1 -- 10.20.193.123:0/844352195 <== mon.2 v2:10.20.193.123:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f1acc08b6e0 con 0x7f1adc1304e0 2026-02-17T20:09:25.971 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:25.975+0000 7f7e8d7fa640 1 -- 10.20.193.123:0/1401108378 <== mon.2 v2:10.20.193.123:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f7e9812c3b0 con 0x7f7e98073890 2026-02-17T20:09:25.995 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:26.000+0000 7f9dd501a640 1 -- 10.20.193.123:0/2778382262 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f9dd0075010 con 0x7f9dd0071a40 2026-02-17T20:09:25.996 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:26.000+0000 7f9daf7fe640 1 -- 10.20.193.123:0/2778382262 <== mon.1 v2:10.20.193.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9dc4065670 con 0x7f9dd0071a40 2026-02-17T20:09:25.996 INFO:teuthology.orchestra.run.trial123.stdout:38654705674 2026-02-17T20:09:25.997 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:26.002+0000 7f9dd501a640 1 -- 10.20.193.123:0/2778382262 >> v1:10.20.193.123:6800/115662061 conn(0x7f9d9c04f5e0 legacy=0x7f9d9c051aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:25.997 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:26.002+0000 7f9dd501a640 1 -- 10.20.193.123:0/2778382262 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f9dd0071a40 msgr2=0x7f9dd01c71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:25.997 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:26.002+0000 7f9dd501a640 1 --2- 10.20.193.123:0/2778382262 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f9dd0071a40 0x7f9dd01c71b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9dc400e9b0 tx=0x7f9dc400ee80 comp rx=0 tx=0).stop 2026-02-17T20:09:25.997 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:26.002+0000 7f9dd501a640 1 -- 10.20.193.123:0/2778382262 shutdown_connections 2026-02-17T20:09:25.997 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:26.002+0000 7f9dd501a640 1 --2- 10.20.193.123:0/2778382262 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f9dd0130710 0x7f9dd011f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:25.997 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:26.002+0000 7f9dd501a640 1 --2- 10.20.193.123:0/2778382262 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f9dd012d150 0x7f9dd01c76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:25.997 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:26.002+0000 7f9dd501a640 1 --2- 10.20.193.123:0/2778382262 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f9dd0071a40 0x7f9dd01c71b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:25.997 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:26.002+0000 7f9dd501a640 1 -- 10.20.193.123:0/2778382262 >> 10.20.193.123:0/2778382262 conn(0x7f9dd009ec70 msgr2=0x7f9dd009be30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:25.997 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:26.002+0000 7f82a7bfd640 1 -- 10.20.193.123:0/4039439762 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f82a00770f0 con 0x7f82a012cb80 2026-02-17T20:09:25.998 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:26.002+0000 7f9dd501a640 1 -- 10.20.193.123:0/2778382262 shutdown_connections 2026-02-17T20:09:25.998 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:26.002+0000 7f9dd501a640 1 -- 10.20.193.123:0/2778382262 wait complete. 2026-02-17T20:09:25.998 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:26.002+0000 7f828e7fc640 1 -- 10.20.193.123:0/4039439762 <== mon.0 v2:10.20.193.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8294065770 con 0x7f82a012cb80 2026-02-17T20:09:25.998 INFO:teuthology.orchestra.run.trial123.stdout:38654705675 2026-02-17T20:09:25.999 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:26.004+0000 7f82a7bfd640 1 -- 10.20.193.123:0/4039439762 >> v1:10.20.193.123:6800/115662061 conn(0x7f827004f5e0 legacy=0x7f8270051aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:25.999 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:26.004+0000 7f82a7bfd640 1 -- 10.20.193.123:0/4039439762 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f82a012cb80 msgr2=0x7f82a0134330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:25.999 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:26.004+0000 7f82a7bfd640 1 --2- 10.20.193.123:0/4039439762 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f82a012cb80 0x7f82a0134330 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f829400ebe0 tx=0x7f829400c520 comp rx=0 tx=0).stop 2026-02-17T20:09:25.999 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:26.004+0000 7f82a7bfd640 1 -- 10.20.193.123:0/4039439762 shutdown_connections 2026-02-17T20:09:25.999 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:26.004+0000 7f82a7bfd640 1 --2- 10.20.193.123:0/4039439762 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f82a01300e0 0x7f82a0134870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:25.999 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:26.004+0000 7f82a7bfd640 1 --2- 10.20.193.123:0/4039439762 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f82a012cb80 0x7f82a0134330 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:25.999 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:26.004+0000 7f82a7bfd640 1 --2- 10.20.193.123:0/4039439762 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f82a0073890 0x7f82a0133df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:25.999 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:26.004+0000 7f82a7bfd640 1 -- 10.20.193.123:0/4039439762 >> 10.20.193.123:0/4039439762 conn(0x7f82a00a30f0 msgr2=0x7f82a012b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:25.999 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:26.004+0000 7f82a7bfd640 1 -- 10.20.193.123:0/4039439762 shutdown_connections 2026-02-17T20:09:25.999 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:26.004+0000 7f82a7bfd640 1 -- 10.20.193.123:0/4039439762 wait complete. 2026-02-17T20:09:26.005 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705675 got 38654705674 for osd.3 2026-02-17T20:09:26.006 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705676 got 38654705675 for osd.0 2026-02-17T20:09:26.038 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:26.042+0000 7f1ae17e6640 1 -- 10.20.193.123:0/844352195 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f1adc11b0b0 con 0x7f1adc1304e0 2026-02-17T20:09:26.038 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:26.042+0000 7f1abb7fe640 1 -- 10.20.193.123:0/844352195 <== mon.2 v2:10.20.193.123:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1acc069e00 con 0x7f1adc1304e0 2026-02-17T20:09:26.039 INFO:teuthology.orchestra.run.trial123.stdout:38654705675 2026-02-17T20:09:26.040 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:26.044+0000 7f1ae17e6640 1 -- 10.20.193.123:0/844352195 >> v1:10.20.193.123:6800/115662061 conn(0x7f1aa804f5e0 legacy=0x7f1aa8051aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:26.040 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:26.044+0000 7f1ae17e6640 1 -- 10.20.193.123:0/844352195 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f1adc1304e0 msgr2=0x7f1adc135ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:26.040 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:26.044+0000 7f1ae17e6640 1 --2- 10.20.193.123:0/844352195 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f1adc1304e0 0x7f1adc135ed0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1acc009d90 tx=0x7f1acc004b40 comp rx=0 tx=0).stop 2026-02-17T20:09:26.040 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:26.044+0000 7f1ae17e6640 1 -- 10.20.193.123:0/844352195 shutdown_connections 2026-02-17T20:09:26.040 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:26.044+0000 7f1ae17e6640 1 --2- 10.20.193.123:0/844352195 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f1adc1304e0 0x7f1adc135ed0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:26.040 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:26.044+0000 7f1ae17e6640 1 --2- 10.20.193.123:0/844352195 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f1adc0717c0 0x7f1adc1c7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:26.040 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:26.044+0000 7f1ae17e6640 1 --2- 10.20.193.123:0/844352195 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f1adc070c70 0x7f1adc1c79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:26.040 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:26.044+0000 7f1ae17e6640 1 -- 10.20.193.123:0/844352195 >> 10.20.193.123:0/844352195 conn(0x7f1adc09cb30 msgr2=0x7f1adc12ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:26.040 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:26.044+0000 7f1ae17e6640 1 -- 10.20.193.123:0/844352195 shutdown_connections 2026-02-17T20:09:26.041 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:26.044+0000 7f1ae17e6640 1 -- 10.20.193.123:0/844352195 wait complete. 2026-02-17T20:09:26.042 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:26.047+0000 7f7e9ef9f640 1 -- 10.20.193.123:0/1401108378 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f7e9812d980 con 0x7f7e98073890 2026-02-17T20:09:26.042 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:26.047+0000 7f7e8d7fa640 1 -- 10.20.193.123:0/1401108378 <== mon.2 v2:10.20.193.123:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7e9812d980 con 0x7f7e98073890 2026-02-17T20:09:26.043 INFO:teuthology.orchestra.run.trial123.stdout:38654705674 2026-02-17T20:09:26.044 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:26.048+0000 7f7e9ef9f640 1 -- 10.20.193.123:0/1401108378 >> v1:10.20.193.123:6800/115662061 conn(0x7f7e6804f5e0 legacy=0x7f7e68051aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:26.044 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:26.048+0000 7f7e9ef9f640 1 -- 10.20.193.123:0/1401108378 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f7e98073890 msgr2=0x7f7e98131190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:26.044 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:26.048+0000 7f7e9ef9f640 1 --2- 10.20.193.123:0/1401108378 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f7e98073890 0x7f7e98131190 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7e88009130 tx=0x7f7e880047c0 comp rx=0 tx=0).stop 2026-02-17T20:09:26.045 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:26.048+0000 7f7e9ef9f640 1 -- 10.20.193.123:0/1401108378 shutdown_connections 2026-02-17T20:09:26.045 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:26.048+0000 7f7e9ef9f640 1 --2- 10.20.193.123:0/1401108378 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f7e98135460 0x7f7e98131c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:26.045 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:26.048+0000 7f7e9ef9f640 1 --2- 10.20.193.123:0/1401108378 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f7e9812cb80 0x7f7e981316d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:26.045 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:26.048+0000 7f7e9ef9f640 1 --2- 10.20.193.123:0/1401108378 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f7e98073890 0x7f7e98131190 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:26.045 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:26.048+0000 7f7e9ef9f640 1 -- 10.20.193.123:0/1401108378 >> 10.20.193.123:0/1401108378 conn(0x7f7e980a30f0 msgr2=0x7f7e980705b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:26.045 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:26.048+0000 7f7e9ef9f640 1 -- 10.20.193.123:0/1401108378 shutdown_connections 2026-02-17T20:09:26.045 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:26.048+0000 7f7e9ef9f640 1 -- 10.20.193.123:0/1401108378 wait complete. 2026-02-17T20:09:26.047 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705676 got 38654705675 for osd.2 2026-02-17T20:09:26.051 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705675 got 38654705674 for osd.1 2026-02-17T20:09:27.006 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T20:09:27.007 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T20:09:27.048 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T20:09:27.052 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T20:09:27.076 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.080+0000 7fc62ea44640 1 Processor -- start 2026-02-17T20:09:27.076 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.080+0000 7f0defe20640 1 Processor -- start 2026-02-17T20:09:27.076 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.080+0000 7fc62ea44640 1 -- start start 2026-02-17T20:09:27.076 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.080+0000 7f0defe20640 1 -- start start 2026-02-17T20:09:27.076 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.081+0000 7f0defe20640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0de8071c00 0x7f0de81355c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:27.076 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.081+0000 7f0defe20640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f0de80710c0 0x7f0de8137b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:27.076 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.081+0000 7fc62ea44640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fc62812cb80 0x7fc62812cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:27.076 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.081+0000 7f0defe20640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0de8073a80 con 0x7f0de806f7c0 2026-02-17T20:09:27.077 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.081+0000 7f0defe20640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7f0de80702b0 con 0x7f0de80710c0 2026-02-17T20:09:27.077 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.081+0000 7f0defe20640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f0de8139060 con 0x7f0de8071c00 2026-02-17T20:09:27.077 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.081+0000 7fc62ea44640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fc628135460 0x7fc628137850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:27.077 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.081+0000 7fc62ea44640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc628074070 con 0x7fc628073890 2026-02-17T20:09:27.077 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.081+0000 7fc62ea44640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7fc628072e70 con 0x7fc628135460 2026-02-17T20:09:27.077 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.081+0000 7fc62ea44640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7fc628073020 con 0x7fc62812cb80 2026-02-17T20:09:27.077 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.081+0000 7f0ded394640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0de8071c00 0x7f0de81355c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:27.077 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.081+0000 7f0dee396640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f0de80710c0 0x7f0de8137b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:27.077 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.081+0000 7fc627fff640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fc62812cb80 0x7fc62812cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:27.077 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.081+0000 7fc627fff640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fc62812cb80 0x7fc62812cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:38198/0 (socket says 10.20.193.123:38198) 2026-02-17T20:09:27.077 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.081+0000 7f0ded394640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0de8071c00 0x7f0de81355c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:38184/0 (socket says 10.20.193.123:38184) 2026-02-17T20:09:27.077 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.081+0000 7f0dee396640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f0de80710c0 0x7f0de8137b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:42054/0 (socket says 10.20.193.123:42054) 2026-02-17T20:09:27.077 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.081+0000 7f0ded394640 1 -- 10.20.193.123:0/3590508959 learned_addr learned my addr 10.20.193.123:0/3590508959 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:27.077 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.081+0000 7fc627fff640 1 -- 10.20.193.123:0/1525703014 learned_addr learned my addr 10.20.193.123:0/1525703014 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:27.078 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.081+0000 7fc62cfba640 1 --2- 10.20.193.123:0/1525703014 >> v2:10.20.193.123:3300/0 conn(0x7fc628135460 0x7fc628137850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:27.078 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.081+0000 7f0dee396640 1 -- 10.20.193.123:0/3590508959 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0de8071c00 msgr2=0x7f0de81355c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:27.078 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.081+0000 7f0dee396640 1 --2- 10.20.193.123:0/3590508959 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0de8071c00 0x7f0de81355c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.078 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.081+0000 7f0dee396640 1 -- 10.20.193.123:0/3590508959 >> v1:10.20.193.123:6789/0 conn(0x7f0de806f7c0 legacy=0x7f0de806fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:27.078 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.081+0000 7fc627fff640 1 -- 10.20.193.123:0/1525703014 >> v2:10.20.193.123:3300/0 conn(0x7fc628135460 msgr2=0x7fc628137850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:27.078 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.081+0000 7fc627fff640 1 --2- 10.20.193.123:0/1525703014 >> v2:10.20.193.123:3300/0 conn(0x7fc628135460 0x7fc628137850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.078 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.081+0000 7fc627fff640 1 -- 10.20.193.123:0/1525703014 >> v1:10.20.193.123:6789/0 conn(0x7fc628073890 legacy=0x7fc62812d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:27.078 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.081+0000 7fc627fff640 1 -- 10.20.193.123:0/1525703014 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc628138da0 con 0x7fc62812cb80 2026-02-17T20:09:27.078 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.081+0000 7f0dee396640 1 -- 10.20.193.123:0/3590508959 --> v2:10.20.193.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0de81391e0 con 0x7f0de80710c0 2026-02-17T20:09:27.078 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.081+0000 7f0decb93640 1 -- 10.20.193.123:0/3590508959 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3942699779 0 0) 0x7f0de8073a80 con 0x7f0de806f7c0 2026-02-17T20:09:27.078 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.081+0000 7fc627fff640 1 --2- 10.20.193.123:0/1525703014 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fc62812cb80 0x7fc62812cf60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc614009970 tx=0x7fc61402eee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f3f9cee55b22c9e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:27.078 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.081+0000 7f0dee396640 1 --2- 10.20.193.123:0/3590508959 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0de80710c0 0x7f0de8137b10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0de4009d90 tx=0x7f0de402f190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a20ee867f93f197c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:27.078 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.081+0000 7fc626ffd640 1 -- 10.20.193.123:0/1525703014 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc61403c070 con 0x7fc62812cb80 2026-02-17T20:09:27.078 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.082+0000 7fc626ffd640 1 -- 10.20.193.123:0/1525703014 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc61402fba0 con 0x7fc62812cb80 2026-02-17T20:09:27.078 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.082+0000 7fc626ffd640 1 -- 10.20.193.123:0/1525703014 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc614037440 con 0x7fc62812cb80 2026-02-17T20:09:27.079 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.082+0000 7f0decb93640 1 -- 10.20.193.123:0/3590508959 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de403c070 con 0x7f0de80710c0 2026-02-17T20:09:27.079 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.082+0000 7f0decb93640 1 -- 10.20.193.123:0/3590508959 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0de402fe10 con 0x7f0de80710c0 2026-02-17T20:09:27.079 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.082+0000 7f0decb93640 1 -- 10.20.193.123:0/3590508959 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de4037660 con 0x7f0de80710c0 2026-02-17T20:09:27.079 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.082+0000 7f0defe20640 1 -- 10.20.193.123:0/3590508959 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0de80710c0 msgr2=0x7f0de8137b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:27.079 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.082+0000 7f0defe20640 1 --2- 10.20.193.123:0/3590508959 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0de80710c0 0x7f0de8137b10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0de4009d90 tx=0x7f0de402f190 comp rx=0 tx=0).stop 2026-02-17T20:09:27.079 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.082+0000 7f0defe20640 1 -- 10.20.193.123:0/3590508959 shutdown_connections 2026-02-17T20:09:27.079 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.082+0000 7f0defe20640 1 --2- 10.20.193.123:0/3590508959 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0de80710c0 0x7f0de8137b10 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.079 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.082+0000 7f0defe20640 1 --2- 10.20.193.123:0/3590508959 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0de8071c00 0x7f0de81355c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.079 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.082+0000 7f0defe20640 1 -- 10.20.193.123:0/3590508959 >> 10.20.193.123:0/3590508959 conn(0x7f0de809e9c0 msgr2=0x7f0de809edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:27.079 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.082+0000 7fc62ea44640 1 -- 10.20.193.123:0/1525703014 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fc62812cb80 msgr2=0x7fc62812cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:27.079 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.082+0000 7fc62ea44640 1 --2- 10.20.193.123:0/1525703014 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fc62812cb80 0x7fc62812cf60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc614009970 tx=0x7fc61402eee0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.079 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.082+0000 7f0defe20640 1 -- 10.20.193.123:0/3590508959 shutdown_connections 2026-02-17T20:09:27.079 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.082+0000 7f0defe20640 1 -- 10.20.193.123:0/3590508959 wait complete. 2026-02-17T20:09:27.080 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.082+0000 7fc62ea44640 1 -- 10.20.193.123:0/1525703014 shutdown_connections 2026-02-17T20:09:27.080 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.082+0000 7fc62ea44640 1 --2- 10.20.193.123:0/1525703014 >> v2:10.20.193.123:3300/0 conn(0x7fc628135460 0x7fc628137850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.080 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.082+0000 7fc62ea44640 1 --2- 10.20.193.123:0/1525703014 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fc62812cb80 0x7fc62812cf60 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.080 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.082+0000 7fc62ea44640 1 -- 10.20.193.123:0/1525703014 >> 10.20.193.123:0/1525703014 conn(0x7fc6280a30f0 msgr2=0x7fc6280a3500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:27.080 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.082+0000 7fc62ea44640 1 -- 10.20.193.123:0/1525703014 shutdown_connections 2026-02-17T20:09:27.080 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.082+0000 7fc62ea44640 1 -- 10.20.193.123:0/1525703014 wait complete. 2026-02-17T20:09:27.080 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.083+0000 7fc62ea44640 1 Processor -- start 2026-02-17T20:09:27.080 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.083+0000 7fc62ea44640 1 -- start start 2026-02-17T20:09:27.080 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.083+0000 7f0defe20640 1 Processor -- start 2026-02-17T20:09:27.080 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.083+0000 7f0defe20640 1 -- start start 2026-02-17T20:09:27.080 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.083+0000 7fc62ea44640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fc628073890 0x7fc6281311d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:27.080 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.083+0000 7fc62ea44640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fc62812cb80 0x7fc628131710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:27.080 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.083+0000 7fc62ea44640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc628135460 0x7fc628131c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:27.080 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.083+0000 7fc62ea44640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc628138220 con 0x7fc62812cb80 2026-02-17T20:09:27.080 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.083+0000 7fc62ea44640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7fc6281380a0 con 0x7fc628135460 2026-02-17T20:09:27.080 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.083+0000 7fc62ea44640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7fc6281383a0 con 0x7fc628073890 2026-02-17T20:09:27.080 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.083+0000 7fc627fff640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fc628073890 0x7fc6281311d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:27.080 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.083+0000 7fc627fff640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fc628073890 0x7fc6281311d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:38212/0 (socket says 10.20.193.123:38212) 2026-02-17T20:09:27.081 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.083+0000 7fc6277fe640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fc62812cb80 0x7fc628131710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:27.081 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.083+0000 7fc627fff640 1 -- 10.20.193.123:0/2005258730 learned_addr learned my addr 10.20.193.123:0/2005258730 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:27.081 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.083+0000 7fc62cfba640 1 --2- 10.20.193.123:0/2005258730 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc628135460 0x7fc628131c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:27.081 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.083+0000 7f0defe20640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0de806f7c0 0x7f0de811f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:27.081 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.083+0000 7f0defe20640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0de80710c0 0x7f0de811fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:27.081 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.083+0000 7f0defe20640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0de8071c00 0x7f0de81c70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:27.081 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.083+0000 7f0defe20640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0de81383e0 con 0x7f0de80710c0 2026-02-17T20:09:27.081 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.083+0000 7f0defe20640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f0de8138260 con 0x7f0de806f7c0 2026-02-17T20:09:27.081 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.083+0000 7f0defe20640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f0de8138560 con 0x7f0de8071c00 2026-02-17T20:09:27.081 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.083+0000 7f0dedb95640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0de806f7c0 0x7f0de811f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:27.081 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.083+0000 7f0ded394640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0de80710c0 0x7f0de811fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:27.081 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.083+0000 7fc627fff640 1 -- 10.20.193.123:0/2005258730 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc628135460 msgr2=0x7fc628131c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:27.081 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.083+0000 7fc627fff640 1 --2- 10.20.193.123:0/2005258730 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc628135460 0x7fc628131c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.081 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.083+0000 7fc627fff640 1 -- 10.20.193.123:0/2005258730 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fc62812cb80 msgr2=0x7fc628131710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:27.081 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.083+0000 7fc627fff640 1 --2- 10.20.193.123:0/2005258730 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fc62812cb80 0x7fc628131710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.081 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.083+0000 7f0dee396640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0de8071c00 0x7f0de81c70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:27.081 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.083+0000 7fc627fff640 1 -- 10.20.193.123:0/2005258730 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc628133000 con 0x7fc628073890 2026-02-17T20:09:27.082 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.083+0000 7f0ded394640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0de80710c0 0x7f0de811fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:42098/0 (socket says 10.20.193.123:42098) 2026-02-17T20:09:27.082 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.083+0000 7f0ded394640 1 -- 10.20.193.123:0/3222504181 learned_addr learned my addr 10.20.193.123:0/3222504181 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:27.082 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.083+0000 7f0dedb95640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0de806f7c0 0x7f0de811f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:45302/0 (socket says 10.20.193.123:45302) 2026-02-17T20:09:27.082 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.083+0000 7fc627fff640 1 --2- 10.20.193.123:0/2005258730 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fc628073890 0x7fc6281311d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc614002410 tx=0x7fc6140047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:27.082 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.083+0000 7f0dedb95640 1 -- 10.20.193.123:0/3222504181 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0de8071c00 msgr2=0x7f0de81c70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:27.082 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.083+0000 7f0dedb95640 1 --2- 10.20.193.123:0/3222504181 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0de8071c00 0x7f0de81c70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.082 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.083+0000 7f0dedb95640 1 -- 10.20.193.123:0/3222504181 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0de80710c0 msgr2=0x7f0de811fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:27.082 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.083+0000 7f0dedb95640 1 --2- 10.20.193.123:0/3222504181 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0de80710c0 0x7f0de811fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.082 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.083+0000 7f0dedb95640 1 -- 10.20.193.123:0/3222504181 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0de8073ff0 con 0x7f0de806f7c0 2026-02-17T20:09:27.082 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.083+0000 7fc624ff9640 1 -- 10.20.193.123:0/2005258730 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc61403c040 con 0x7fc628073890 2026-02-17T20:09:27.082 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.083+0000 7f0dee396640 1 --2- 10.20.193.123:0/3222504181 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0de8071c00 0x7f0de81c70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:27.082 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.083+0000 7fc624ff9640 1 -- 10.20.193.123:0/2005258730 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc61402f9a0 con 0x7fc628073890 2026-02-17T20:09:27.083 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.083+0000 7fc62ea44640 1 -- 10.20.193.123:0/2005258730 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6281335c0 con 0x7fc628073890 2026-02-17T20:09:27.083 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.083+0000 7fc624ff9640 1 -- 10.20.193.123:0/2005258730 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc614042670 con 0x7fc628073890 2026-02-17T20:09:27.083 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.083+0000 7f0dedb95640 1 --2- 10.20.193.123:0/3222504181 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0de806f7c0 0x7f0de811f8d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0dd80035b0 tx=0x7f0dd800a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:27.083 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.084+0000 7fc62ea44640 1 -- 10.20.193.123:0/2005258730 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fc628130750 con 0x7fc628073890 2026-02-17T20:09:27.083 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.084+0000 7f0dd67fc640 1 -- 10.20.193.123:0/3222504181 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dd8005270 con 0x7f0de806f7c0 2026-02-17T20:09:27.083 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.084+0000 7f0dd67fc640 1 -- 10.20.193.123:0/3222504181 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dd8005430 con 0x7f0de806f7c0 2026-02-17T20:09:27.083 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.084+0000 7f0defe20640 1 -- 10.20.193.123:0/3222504181 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0de8122b50 con 0x7f0de806f7c0 2026-02-17T20:09:27.083 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.084+0000 7f0dd67fc640 1 -- 10.20.193.123:0/3222504181 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dd80038f0 con 0x7f0de806f7c0 2026-02-17T20:09:27.083 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.084+0000 7f0defe20640 1 -- 10.20.193.123:0/3222504181 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0de81223c0 con 0x7f0de806f7c0 2026-02-17T20:09:27.083 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.084+0000 7fc62ea44640 1 -- 10.20.193.123:0/2005258730 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc628138800 con 0x7fc628073890 2026-02-17T20:09:27.083 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.084+0000 7fc624ff9640 1 -- 10.20.193.123:0/2005258730 <== mon.2 v2:10.20.193.123:3302/0 4 ==== mgrmap(e 8) ==== 61895+0+0 (secure 0 0 0) 0x7fc61404b410 con 0x7fc628073890 2026-02-17T20:09:27.083 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.084+0000 7f0defe20640 1 -- 10.20.193.123:0/3222504181 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0de81389c0 con 0x7f0de806f7c0 2026-02-17T20:09:27.083 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.084+0000 7f0dd67fc640 1 -- 10.20.193.123:0/3222504181 <== mon.1 v2:10.20.193.123:3301/0 4 ==== mgrmap(e 8) ==== 61895+0+0 (secure 0 0 0) 0x7f0dd801b070 con 0x7f0de806f7c0 2026-02-17T20:09:27.084 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.085+0000 7fc624ff9640 1 -- 10.20.193.123:0/2005258730 <== mon.2 v2:10.20.193.123:3302/0 5 ==== osd_map(17..17 src has 1..17) ==== 3021+0+0 (secure 0 0 0) 0x7fc61408b7f0 con 0x7fc628073890 2026-02-17T20:09:27.084 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.085+0000 7f0dd67fc640 1 -- 10.20.193.123:0/3222504181 <== mon.1 v2:10.20.193.123:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 3021+0+0 (secure 0 0 0) 0x7f0dd806e9b0 con 0x7f0de806f7c0 2026-02-17T20:09:27.084 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.087+0000 7f0dd67fc640 1 -- 10.20.193.123:0/3222504181 <== mon.1 v2:10.20.193.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f0dd8070e20 con 0x7f0de806f7c0 2026-02-17T20:09:27.084 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.087+0000 7fc624ff9640 1 -- 10.20.193.123:0/2005258730 <== mon.2 v2:10.20.193.123:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7fc614050020 con 0x7fc628073890 2026-02-17T20:09:27.118 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.122+0000 7ff932e1a640 1 Processor -- start 2026-02-17T20:09:27.118 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.122+0000 7ff932e1a640 1 -- start start 2026-02-17T20:09:27.118 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.123+0000 7fedf9d8c640 1 Processor -- start 2026-02-17T20:09:27.118 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.123+0000 7fedf9d8c640 1 -- start start 2026-02-17T20:09:27.118 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.123+0000 7ff932e1a640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7ff92c073890 0x7ff92c12d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:27.118 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.123+0000 7ff932e1a640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7ff92c135460 0x7ff92c137850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:27.119 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.123+0000 7ff932e1a640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff92c074070 con 0x7ff92c12cb80 2026-02-17T20:09:27.119 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.123+0000 7ff932e1a640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7ff92c072e70 con 0x7ff92c135460 2026-02-17T20:09:27.119 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.123+0000 7ff932e1a640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7ff92c073020 con 0x7ff92c073890 2026-02-17T20:09:27.119 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.123+0000 7ff930b8f640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7ff92c12cb80 0x7ff92c12cf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:37356/0 (socket says 10.20.193.123:37356) 2026-02-17T20:09:27.119 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.123+0000 7ff930b8f640 1 -- 10.20.193.123:0/1612043001 learned_addr learned my addr 10.20.193.123:0/1612043001 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:09:27.119 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.123+0000 7ff931390640 1 --2- 10.20.193.123:0/1612043001 >> v2:10.20.193.123:3300/0 conn(0x7ff92c135460 0x7ff92c137850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:27.119 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.123+0000 7ff923fff640 1 --2- 10.20.193.123:0/1612043001 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7ff92c073890 0x7ff92c12d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:27.119 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.123+0000 7fedf9d8c640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fedf4134d10 0x7fedf41350f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:27.119 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.123+0000 7fedf9d8c640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fedf4073830 0x7fedf4071880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:27.119 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.123+0000 7fedf9d8c640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fedf4071dc0 0x7fedf4072230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:27.119 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.123+0000 7fedf9d8c640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7fedf41347a0 con 0x7fedf4071dc0 2026-02-17T20:09:27.119 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.123+0000 7ff9237fe640 1 -- 10.20.193.123:0/1612043001 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 795867712 0 0) 0x7ff92c074070 con 0x7ff92c12cb80 2026-02-17T20:09:27.119 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.123+0000 7fedf9d8c640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7fedf4073f10 con 0x7fedf4134d10 2026-02-17T20:09:27.119 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.123+0000 7fedf9d8c640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7fedf4073110 con 0x7fedf4073830 2026-02-17T20:09:27.119 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.123+0000 7ff9237fe640 1 -- 10.20.193.123:0/1612043001 --> v1:10.20.193.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff918003620 con 0x7ff92c12cb80 2026-02-17T20:09:27.119 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.123+0000 7ff931390640 1 -- 10.20.193.123:0/1612043001 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7ff92c073890 msgr2=0x7ff92c12d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:27.119 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.123+0000 7ff931390640 1 --2- 10.20.193.123:0/1612043001 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7ff92c073890 0x7ff92c12d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.119 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.123+0000 7ff931390640 1 -- 10.20.193.123:0/1612043001 >> v1:10.20.193.123:6789/0 conn(0x7ff92c12cb80 legacy=0x7ff92c12cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:27.120 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.123+0000 7ff931390640 1 -- 10.20.193.123:0/1612043001 --> v2:10.20.193.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff92c138da0 con 0x7ff92c135460 2026-02-17T20:09:27.120 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.123+0000 7fedf3fff640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fedf4071dc0 0x7fedf4072230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:27.120 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.123+0000 7fedf37fe640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fedf4134d10 0x7fedf41350f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:27.120 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.123+0000 7fedf3fff640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fedf4071dc0 0x7fedf4072230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:42118/0 (socket says 10.20.193.123:42118) 2026-02-17T20:09:27.120 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.123+0000 7fedf3fff640 1 -- 10.20.193.123:0/2938497567 learned_addr learned my addr 10.20.193.123:0/2938497567 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:27.120 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.123+0000 7fedf2ffd640 1 --2- 10.20.193.123:0/2938497567 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fedf4073830 0x7fedf4071880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:27.120 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.123+0000 7fedf3fff640 1 -- 10.20.193.123:0/2938497567 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fedf4073830 msgr2=0x7fedf4071880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:27.120 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.123+0000 7fedf3fff640 1 --2- 10.20.193.123:0/2938497567 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fedf4073830 0x7fedf4071880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.120 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.123+0000 7fedf3fff640 1 -- 10.20.193.123:0/2938497567 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fedf4134d10 msgr2=0x7fedf41350f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:27.120 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.123+0000 7fedf3fff640 1 --2- 10.20.193.123:0/2938497567 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fedf4134d10 0x7fedf41350f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.120 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.123+0000 7fedf3fff640 1 -- 10.20.193.123:0/2938497567 --> v2:10.20.193.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf409f550 con 0x7fedf4071dc0 2026-02-17T20:09:27.120 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.123+0000 7fedf37fe640 1 --2- 10.20.193.123:0/2938497567 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fedf4134d10 0x7fedf41350f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:27.120 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.123+0000 7ff931390640 1 --2- 10.20.193.123:0/1612043001 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7ff92c135460 0x7ff92c137850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff928009dc0 tx=0x7ff92802f230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fe2f78bfc48e6e3 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:27.120 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.124+0000 7ff9237fe640 1 -- 10.20.193.123:0/1612043001 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff92803c070 con 0x7ff92c135460 2026-02-17T20:09:27.120 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.124+0000 7ff9237fe640 1 -- 10.20.193.123:0/1612043001 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff928037440 con 0x7ff92c135460 2026-02-17T20:09:27.120 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.124+0000 7ff9237fe640 1 -- 10.20.193.123:0/1612043001 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff928037810 con 0x7ff92c135460 2026-02-17T20:09:27.121 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.124+0000 7fedf3fff640 1 --2- 10.20.193.123:0/2938497567 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fedf4071dc0 0x7fedf4072230 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fede8009e50 tx=0x7fede802f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d59d1646a1d1ef7b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:27.121 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.124+0000 7fedf27fc640 1 -- 10.20.193.123:0/2938497567 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede802fc70 con 0x7fedf4071dc0 2026-02-17T20:09:27.121 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.124+0000 7fedf27fc640 1 -- 10.20.193.123:0/2938497567 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fede802fe10 con 0x7fedf4071dc0 2026-02-17T20:09:27.121 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.124+0000 7fedf27fc640 1 -- 10.20.193.123:0/2938497567 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede8037610 con 0x7fedf4071dc0 2026-02-17T20:09:27.121 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.124+0000 7ff932e1a640 1 -- 10.20.193.123:0/1612043001 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7ff92c135460 msgr2=0x7ff92c137850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:27.121 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.124+0000 7ff932e1a640 1 --2- 10.20.193.123:0/1612043001 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7ff92c135460 0x7ff92c137850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff928009dc0 tx=0x7ff92802f230 comp rx=0 tx=0).stop 2026-02-17T20:09:27.121 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.124+0000 7ff932e1a640 1 -- 10.20.193.123:0/1612043001 shutdown_connections 2026-02-17T20:09:27.121 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.124+0000 7ff932e1a640 1 --2- 10.20.193.123:0/1612043001 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7ff92c135460 0x7ff92c137850 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.121 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.124+0000 7ff932e1a640 1 --2- 10.20.193.123:0/1612043001 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7ff92c073890 0x7ff92c12d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.121 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.124+0000 7ff932e1a640 1 -- 10.20.193.123:0/1612043001 >> 10.20.193.123:0/1612043001 conn(0x7ff92c0a30f0 msgr2=0x7ff92c0a3500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:27.121 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.124+0000 7ff932e1a640 1 -- 10.20.193.123:0/1612043001 shutdown_connections 2026-02-17T20:09:27.121 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.124+0000 7ff932e1a640 1 -- 10.20.193.123:0/1612043001 wait complete. 2026-02-17T20:09:27.121 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.124+0000 7fedf9d8c640 1 -- 10.20.193.123:0/2938497567 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fedf4071dc0 msgr2=0x7fedf4072230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:27.121 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.124+0000 7fedf9d8c640 1 --2- 10.20.193.123:0/2938497567 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fedf4071dc0 0x7fedf4072230 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fede8009e50 tx=0x7fede802f210 comp rx=0 tx=0).stop 2026-02-17T20:09:27.121 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.124+0000 7fedf9d8c640 1 -- 10.20.193.123:0/2938497567 shutdown_connections 2026-02-17T20:09:27.121 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.124+0000 7fedf9d8c640 1 --2- 10.20.193.123:0/2938497567 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fedf4071dc0 0x7fedf4072230 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.121 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.124+0000 7fedf9d8c640 1 --2- 10.20.193.123:0/2938497567 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fedf4073830 0x7fedf4071880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.122 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.124+0000 7fedf9d8c640 1 --2- 10.20.193.123:0/2938497567 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fedf4134d10 0x7fedf41350f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.122 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.124+0000 7fedf9d8c640 1 -- 10.20.193.123:0/2938497567 >> 10.20.193.123:0/2938497567 conn(0x7fedf409e7c0 msgr2=0x7fedf409ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:27.122 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.124+0000 7fedf9d8c640 1 -- 10.20.193.123:0/2938497567 shutdown_connections 2026-02-17T20:09:27.122 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.124+0000 7fedf9d8c640 1 -- 10.20.193.123:0/2938497567 wait complete. 2026-02-17T20:09:27.122 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.125+0000 7ff932e1a640 1 Processor -- start 2026-02-17T20:09:27.122 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.125+0000 7fedf9d8c640 1 Processor -- start 2026-02-17T20:09:27.122 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.125+0000 7fedf9d8c640 1 -- start start 2026-02-17T20:09:27.122 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.125+0000 7ff932e1a640 1 -- start start 2026-02-17T20:09:27.122 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.125+0000 7ff932e1a640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7ff92c073890 0x7ff92c1c6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:27.122 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.125+0000 7ff932e1a640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7ff92c12cb80 0x7ff92c1c7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:27.122 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.125+0000 7ff932e1a640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7ff92c135460 0x7ff92c1c79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:27.122 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.125+0000 7ff932e1a640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff92c138220 con 0x7ff92c073890 2026-02-17T20:09:27.122 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.125+0000 7ff932e1a640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7ff92c1380a0 con 0x7ff92c12cb80 2026-02-17T20:09:27.122 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.125+0000 7ff932e1a640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7ff92c1383a0 con 0x7ff92c135460 2026-02-17T20:09:27.122 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.125+0000 7ff930b8f640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7ff92c073890 0x7ff92c1c6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:27.122 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.125+0000 7ff923fff640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7ff92c12cb80 0x7ff92c1c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:27.122 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.125+0000 7ff931390640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7ff92c135460 0x7ff92c1c79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:27.122 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.125+0000 7ff930b8f640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7ff92c073890 0x7ff92c1c6f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:42134/0 (socket says 10.20.193.123:42134) 2026-02-17T20:09:27.122 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.125+0000 7ff930b8f640 1 -- 10.20.193.123:0/3975410419 learned_addr learned my addr 10.20.193.123:0/3975410419 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:27.123 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.125+0000 7fedf9d8c640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fedf4071dc0 0x7fedf41cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:27.123 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.125+0000 7fedf9d8c640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fedf4073830 0x7fedf41cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:27.123 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.125+0000 7fedf9d8c640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fedf4134d10 0x7fedf4135870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:27.123 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.125+0000 7fedf9d8c640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7fedf413bad0 con 0x7fedf4073830 2026-02-17T20:09:27.123 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.125+0000 7fedf9d8c640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7fedf4072dc0 con 0x7fedf4071dc0 2026-02-17T20:09:27.123 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.125+0000 7fedf9d8c640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7fedf413bc50 con 0x7fedf4134d10 2026-02-17T20:09:27.123 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.125+0000 7fedf37fe640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fedf4071dc0 0x7fedf41cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:27.123 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.125+0000 7fedf37fe640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fedf4071dc0 0x7fedf41cbdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:45328/0 (socket says 10.20.193.123:45328) 2026-02-17T20:09:27.123 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.125+0000 7fedf37fe640 1 -- 10.20.193.123:0/1273713325 learned_addr learned my addr 10.20.193.123:0/1273713325 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:27.123 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.125+0000 7fedf2ffd640 1 --2- 10.20.193.123:0/1273713325 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fedf4073830 0x7fedf41cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:27.123 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.125+0000 7ff931390640 1 -- 10.20.193.123:0/3975410419 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7ff92c12cb80 msgr2=0x7ff92c1c7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:27.123 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.125+0000 7ff931390640 1 --2- 10.20.193.123:0/3975410419 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7ff92c12cb80 0x7ff92c1c7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.123 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.125+0000 7ff931390640 1 -- 10.20.193.123:0/3975410419 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7ff92c073890 msgr2=0x7ff92c1c6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:27.123 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.125+0000 7ff931390640 1 --2- 10.20.193.123:0/3975410419 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7ff92c073890 0x7ff92c1c6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.123 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.125+0000 7ff931390640 1 -- 10.20.193.123:0/3975410419 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff92c1302b0 con 0x7ff92c135460 2026-02-17T20:09:27.123 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.125+0000 7fedf3fff640 1 --2- 10.20.193.123:0/1273713325 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fedf4134d10 0x7fedf4135870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:27.124 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.125+0000 7ff931390640 1 --2- 10.20.193.123:0/3975410419 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7ff92c135460 0x7ff92c1c79a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff928036000 tx=0x7ff928004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:27.124 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.125+0000 7fedf2ffd640 1 -- 10.20.193.123:0/1273713325 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fedf4134d10 msgr2=0x7fedf4135870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:27.124 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.125+0000 7fedf2ffd640 1 --2- 10.20.193.123:0/1273713325 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fedf4134d10 0x7fedf4135870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.124 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.125+0000 7fedf2ffd640 1 -- 10.20.193.123:0/1273713325 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fedf4071dc0 msgr2=0x7fedf41cbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:27.124 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.125+0000 7fedf2ffd640 1 --2- 10.20.193.123:0/1273713325 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fedf4071dc0 0x7fedf41cbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.124 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.125+0000 7fedf2ffd640 1 -- 10.20.193.123:0/1273713325 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf4138a60 con 0x7fedf4073830 2026-02-17T20:09:27.124 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.125+0000 7fedf37fe640 1 --2- 10.20.193.123:0/1273713325 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fedf4071dc0 0x7fedf41cbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:27.124 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.126+0000 7ff9217fa640 1 -- 10.20.193.123:0/3975410419 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff92803c050 con 0x7ff92c135460 2026-02-17T20:09:27.124 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.126+0000 7ff9217fa640 1 -- 10.20.193.123:0/3975410419 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff928048070 con 0x7ff92c135460 2026-02-17T20:09:27.124 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.126+0000 7ff932e1a640 1 -- 10.20.193.123:0/3975410419 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff92c130d30 con 0x7ff92c135460 2026-02-17T20:09:27.124 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.126+0000 7ff9217fa640 1 -- 10.20.193.123:0/3975410419 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff928041a50 con 0x7ff92c135460 2026-02-17T20:09:27.124 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.126+0000 7fedf2ffd640 1 --2- 10.20.193.123:0/1273713325 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fedf4073830 0x7fedf41cc2f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fedf406df70 tx=0x7fede400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:27.124 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.126+0000 7ff932e1a640 1 -- 10.20.193.123:0/3975410419 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7ff92c1248e0 con 0x7ff92c135460 2026-02-17T20:09:27.125 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.126+0000 7fedcffff640 1 -- 10.20.193.123:0/1273713325 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede4017070 con 0x7fedf4073830 2026-02-17T20:09:27.125 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.126+0000 7fedcffff640 1 -- 10.20.193.123:0/1273713325 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fede400c910 con 0x7fedf4073830 2026-02-17T20:09:27.125 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.126+0000 7fedf9d8c640 1 -- 10.20.193.123:0/1273713325 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedf4138690 con 0x7fedf4073830 2026-02-17T20:09:27.125 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.126+0000 7fedcffff640 1 -- 10.20.193.123:0/1273713325 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede400ccc0 con 0x7fedf4073830 2026-02-17T20:09:27.125 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.126+0000 7fedf9d8c640 1 -- 10.20.193.123:0/1273713325 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedf41cc830 con 0x7fedf4073830 2026-02-17T20:09:27.125 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.126+0000 7ff932e1a640 1 -- 10.20.193.123:0/3975410419 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff92c138800 con 0x7ff92c135460 2026-02-17T20:09:27.125 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.126+0000 7ff9217fa640 1 -- 10.20.193.123:0/3975410419 <== mon.2 v2:10.20.193.123:3302/0 4 ==== mgrmap(e 8) ==== 61895+0+0 (secure 0 0 0) 0x7ff928041bf0 con 0x7ff92c135460 2026-02-17T20:09:27.125 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.126+0000 7fedf9d8c640 1 -- 10.20.193.123:0/1273713325 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedf4071880 con 0x7fedf4073830 2026-02-17T20:09:27.125 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.127+0000 7fedcffff640 1 -- 10.20.193.123:0/1273713325 <== mon.0 v2:10.20.193.123:3300/0 4 ==== mgrmap(e 8) ==== 61895+0+0 (secure 0 0 0) 0x7fede4024060 con 0x7fedf4073830 2026-02-17T20:09:27.125 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.127+0000 7ff9217fa640 1 -- 10.20.193.123:0/3975410419 <== mon.2 v2:10.20.193.123:3302/0 5 ==== osd_map(17..17 src has 1..17) ==== 3021+0+0 (secure 0 0 0) 0x7ff92808c880 con 0x7ff92c135460 2026-02-17T20:09:27.125 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.127+0000 7fedcffff640 1 -- 10.20.193.123:0/1273713325 <== mon.0 v2:10.20.193.123:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3021+0+0 (secure 0 0 0) 0x7fede4066780 con 0x7fedf4073830 2026-02-17T20:09:27.125 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.129+0000 7ff9217fa640 1 -- 10.20.193.123:0/3975410419 <== mon.2 v2:10.20.193.123:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7ff928051db0 con 0x7ff92c135460 2026-02-17T20:09:27.126 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.129+0000 7fedcffff640 1 -- 10.20.193.123:0/1273713325 <== mon.0 v2:10.20.193.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7fede40407c0 con 0x7fedf4073830 2026-02-17T20:09:27.152 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.156+0000 7f0defe20640 1 -- 10.20.193.123:0/3222504181 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f0de8075020 con 0x7f0de806f7c0 2026-02-17T20:09:27.152 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.156+0000 7f0dd67fc640 1 -- 10.20.193.123:0/3222504181 <== mon.1 v2:10.20.193.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0dd80489f0 con 0x7f0de806f7c0 2026-02-17T20:09:27.152 INFO:teuthology.orchestra.run.trial123.stdout:38654705676 2026-02-17T20:09:27.154 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.158+0000 7f0defe20640 1 -- 10.20.193.123:0/3222504181 >> v1:10.20.193.123:6800/115662061 conn(0x7f0db804f5e0 legacy=0x7f0db8051aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:27.154 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.158+0000 7f0defe20640 1 -- 10.20.193.123:0/3222504181 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0de806f7c0 msgr2=0x7f0de811f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:27.154 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.158+0000 7f0defe20640 1 --2- 10.20.193.123:0/3222504181 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0de806f7c0 0x7f0de811f8d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0dd80035b0 tx=0x7f0dd800a430 comp rx=0 tx=0).stop 2026-02-17T20:09:27.154 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.158+0000 7f0defe20640 1 -- 10.20.193.123:0/3222504181 shutdown_connections 2026-02-17T20:09:27.154 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.158+0000 7f0defe20640 1 --2- 10.20.193.123:0/3222504181 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0de8071c00 0x7f0de81c70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.154 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.158+0000 7f0defe20640 1 --2- 10.20.193.123:0/3222504181 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0de80710c0 0x7f0de811fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.154 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.158+0000 7f0defe20640 1 --2- 10.20.193.123:0/3222504181 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0de806f7c0 0x7f0de811f8d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.154 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.158+0000 7f0defe20640 1 -- 10.20.193.123:0/3222504181 >> 10.20.193.123:0/3222504181 conn(0x7f0de809e9c0 msgr2=0x7f0de8134a50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:27.154 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.158+0000 7f0defe20640 1 -- 10.20.193.123:0/3222504181 shutdown_connections 2026-02-17T20:09:27.154 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.158+0000 7f0defe20640 1 -- 10.20.193.123:0/3222504181 wait complete. 2026-02-17T20:09:27.155 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.159+0000 7fc62ea44640 1 -- 10.20.193.123:0/2005258730 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fc6280770f0 con 0x7fc628073890 2026-02-17T20:09:27.155 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.159+0000 7fc624ff9640 1 -- 10.20.193.123:0/2005258730 <== mon.2 v2:10.20.193.123:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc614065790 con 0x7fc628073890 2026-02-17T20:09:27.155 INFO:teuthology.orchestra.run.trial123.stdout:38654705677 2026-02-17T20:09:27.157 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.161+0000 7fc62ea44640 1 -- 10.20.193.123:0/2005258730 >> v1:10.20.193.123:6800/115662061 conn(0x7fc5f804f5e0 legacy=0x7fc5f8051aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:27.157 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.161+0000 7fc62ea44640 1 -- 10.20.193.123:0/2005258730 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fc628073890 msgr2=0x7fc6281311d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:27.157 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.161+0000 7fc62ea44640 1 --2- 10.20.193.123:0/2005258730 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fc628073890 0x7fc6281311d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc614002410 tx=0x7fc6140047c0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.157 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.161+0000 7fc62ea44640 1 -- 10.20.193.123:0/2005258730 shutdown_connections 2026-02-17T20:09:27.157 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.161+0000 7fc62ea44640 1 --2- 10.20.193.123:0/2005258730 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc628135460 0x7fc628131c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.157 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.161+0000 7fc62ea44640 1 --2- 10.20.193.123:0/2005258730 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fc62812cb80 0x7fc628131710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.157 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.161+0000 7fc62ea44640 1 --2- 10.20.193.123:0/2005258730 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fc628073890 0x7fc6281311d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.157 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.161+0000 7fc62ea44640 1 -- 10.20.193.123:0/2005258730 >> 10.20.193.123:0/2005258730 conn(0x7fc6280a30f0 msgr2=0x7fc6280705b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:27.157 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.161+0000 7fc62ea44640 1 -- 10.20.193.123:0/2005258730 shutdown_connections 2026-02-17T20:09:27.157 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.161+0000 7fc62ea44640 1 -- 10.20.193.123:0/2005258730 wait complete. 2026-02-17T20:09:27.162 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705675 got 38654705676 for osd.3 2026-02-17T20:09:27.162 DEBUG:teuthology.parallel:result is None 2026-02-17T20:09:27.165 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705676 got 38654705677 for osd.0 2026-02-17T20:09:27.165 DEBUG:teuthology.parallel:result is None 2026-02-17T20:09:27.196 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.201+0000 7fedf9d8c640 1 -- 10.20.193.123:0/1273713325 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fedf4068530 con 0x7fedf4073830 2026-02-17T20:09:27.197 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.201+0000 7ff932e1a640 1 -- 10.20.193.123:0/3975410419 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7ff92c068530 con 0x7ff92c135460 2026-02-17T20:09:27.197 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.201+0000 7fedcffff640 1 -- 10.20.193.123:0/1273713325 <== mon.0 v2:10.20.193.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fede40655c0 con 0x7fedf4073830 2026-02-17T20:09:27.197 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.201+0000 7ff9217fa640 1 -- 10.20.193.123:0/3975410419 <== mon.2 v2:10.20.193.123:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff92808b5f0 con 0x7ff92c135460 2026-02-17T20:09:27.197 INFO:teuthology.orchestra.run.trial123.stdout:38654705677 2026-02-17T20:09:27.197 INFO:teuthology.orchestra.run.trial123.stdout:38654705676 2026-02-17T20:09:27.198 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.203+0000 7fedf9d8c640 1 -- 10.20.193.123:0/1273713325 >> v1:10.20.193.123:6800/115662061 conn(0x7fedc404f5e0 legacy=0x7fedc4051aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:27.198 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.203+0000 7fedf9d8c640 1 -- 10.20.193.123:0/1273713325 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fedf4073830 msgr2=0x7fedf41cc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:27.198 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.203+0000 7fedf9d8c640 1 --2- 10.20.193.123:0/1273713325 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fedf4073830 0x7fedf41cc2f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fedf406df70 tx=0x7fede400ed70 comp rx=0 tx=0).stop 2026-02-17T20:09:27.198 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.203+0000 7fedf9d8c640 1 -- 10.20.193.123:0/1273713325 shutdown_connections 2026-02-17T20:09:27.198 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.203+0000 7fedf9d8c640 1 --2- 10.20.193.123:0/1273713325 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fedf4134d10 0x7fedf4135870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.198 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.203+0000 7fedf9d8c640 1 --2- 10.20.193.123:0/1273713325 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fedf4073830 0x7fedf41cc2f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.198 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.203+0000 7fedf9d8c640 1 --2- 10.20.193.123:0/1273713325 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fedf4071dc0 0x7fedf41cbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.198 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.203+0000 7fedf9d8c640 1 -- 10.20.193.123:0/1273713325 >> 10.20.193.123:0/1273713325 conn(0x7fedf409e7c0 msgr2=0x7fedf406f080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:27.198 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.203+0000 7fedf9d8c640 1 -- 10.20.193.123:0/1273713325 shutdown_connections 2026-02-17T20:09:27.199 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.203+0000 7ff932e1a640 1 -- 10.20.193.123:0/3975410419 >> v1:10.20.193.123:6800/115662061 conn(0x7ff8fc04f5e0 legacy=0x7ff8fc051aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:27.199 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.203+0000 7ff932e1a640 1 -- 10.20.193.123:0/3975410419 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7ff92c135460 msgr2=0x7ff92c1c79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:27.199 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.203+0000 7ff932e1a640 1 --2- 10.20.193.123:0/3975410419 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7ff92c135460 0x7ff92c1c79a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff928036000 tx=0x7ff928004b40 comp rx=0 tx=0).stop 2026-02-17T20:09:27.199 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.203+0000 7fedf9d8c640 1 -- 10.20.193.123:0/1273713325 wait complete. 2026-02-17T20:09:27.199 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.203+0000 7ff932e1a640 1 -- 10.20.193.123:0/3975410419 shutdown_connections 2026-02-17T20:09:27.199 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.203+0000 7ff932e1a640 1 --2- 10.20.193.123:0/3975410419 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7ff92c135460 0x7ff92c1c79a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.199 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.203+0000 7ff932e1a640 1 --2- 10.20.193.123:0/3975410419 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7ff92c12cb80 0x7ff92c1c7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.199 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.203+0000 7ff932e1a640 1 --2- 10.20.193.123:0/3975410419 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7ff92c073890 0x7ff92c1c6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.199 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.203+0000 7ff932e1a640 1 -- 10.20.193.123:0/3975410419 >> 10.20.193.123:0/3975410419 conn(0x7ff92c0a30f0 msgr2=0x7ff92c136a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:27.199 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.203+0000 7ff932e1a640 1 -- 10.20.193.123:0/3975410419 shutdown_connections 2026-02-17T20:09:27.199 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.203+0000 7ff932e1a640 1 -- 10.20.193.123:0/3975410419 wait complete. 2026-02-17T20:09:27.206 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705676 got 38654705677 for osd.2 2026-02-17T20:09:27.206 DEBUG:teuthology.parallel:result is None 2026-02-17T20:09:27.206 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705675 got 38654705676 for osd.1 2026-02-17T20:09:27.206 DEBUG:teuthology.parallel:result is None 2026-02-17T20:09:27.206 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-17T20:09:27.206 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T20:09:27.312 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.317+0000 7fabad510640 1 Processor -- start 2026-02-17T20:09:27.313 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.317+0000 7fabad510640 1 -- start start 2026-02-17T20:09:27.313 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.317+0000 7fabad510640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7faba806f7c0 0x7faba806fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:27.313 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.317+0000 7fabad510640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7faba80700e0 0x7faba8072920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:27.313 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.317+0000 7fabad510640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7faba8070f70 0x7faba8072e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:27.313 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.317+0000 7fabad510640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7faba8070b60 con 0x7faba80700e0 2026-02-17T20:09:27.313 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.317+0000 7fabad510640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7faba8071e20 con 0x7faba8070f70 2026-02-17T20:09:27.313 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.317+0000 7fabad510640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7faba80723c0 con 0x7faba806f7c0 2026-02-17T20:09:27.313 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.317+0000 7faba6ffd640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7faba806f7c0 0x7faba806fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:27.313 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.317+0000 7faba67fc640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7faba80700e0 0x7faba8072920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:27.313 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.317+0000 7faba77fe640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7faba8070f70 0x7faba8072e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:27.313 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.318+0000 7faba6ffd640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7faba806f7c0 0x7faba806fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:38254/0 (socket says 10.20.193.123:38254) 2026-02-17T20:09:27.313 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.318+0000 7faba6ffd640 1 -- 10.20.193.123:0/3668117837 learned_addr learned my addr 10.20.193.123:0/3668117837 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:27.313 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.318+0000 7faba6ffd640 1 -- 10.20.193.123:0/3668117837 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7faba8070f70 msgr2=0x7faba8072e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:27.313 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.318+0000 7faba6ffd640 1 --2- 10.20.193.123:0/3668117837 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7faba8070f70 0x7faba8072e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.313 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.318+0000 7faba6ffd640 1 -- 10.20.193.123:0/3668117837 >> v2:10.20.193.123:3300/0 conn(0x7faba80700e0 msgr2=0x7faba8072920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:27.313 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.318+0000 7faba6ffd640 1 --2- 10.20.193.123:0/3668117837 >> v2:10.20.193.123:3300/0 conn(0x7faba80700e0 0x7faba8072920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.314 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.318+0000 7faba6ffd640 1 -- 10.20.193.123:0/3668117837 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faba8072660 con 0x7faba806f7c0 2026-02-17T20:09:27.314 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.318+0000 7faba6ffd640 1 --2- 10.20.193.123:0/3668117837 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7faba806f7c0 0x7faba806fba0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fab9c009970 tx=0x7fab9c02ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a605c428710e24b2 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:27.314 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.318+0000 7faba5ffb640 1 -- 10.20.193.123:0/3668117837 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9c03c070 con 0x7faba806f7c0 2026-02-17T20:09:27.314 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.318+0000 7faba5ffb640 1 -- 10.20.193.123:0/3668117837 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab9c02fac0 con 0x7faba806f7c0 2026-02-17T20:09:27.314 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.318+0000 7faba5ffb640 1 -- 10.20.193.123:0/3668117837 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9c037440 con 0x7faba806f7c0 2026-02-17T20:09:27.314 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.318+0000 7fabad510640 1 -- 10.20.193.123:0/3668117837 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7faba806f7c0 msgr2=0x7faba806fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:27.314 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.318+0000 7fabad510640 1 --2- 10.20.193.123:0/3668117837 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7faba806f7c0 0x7faba806fba0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fab9c009970 tx=0x7fab9c02ee90 comp rx=0 tx=0).stop 2026-02-17T20:09:27.314 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.318+0000 7fabad510640 1 -- 10.20.193.123:0/3668117837 shutdown_connections 2026-02-17T20:09:27.314 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.318+0000 7fabad510640 1 --2- 10.20.193.123:0/3668117837 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7faba8070f70 0x7faba8072e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.314 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.318+0000 7fabad510640 1 --2- 10.20.193.123:0/3668117837 >> v2:10.20.193.123:3300/0 conn(0x7faba80700e0 0x7faba8072920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.314 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.318+0000 7fabad510640 1 --2- 10.20.193.123:0/3668117837 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7faba806f7c0 0x7faba806fba0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.314 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.318+0000 7fabad510640 1 -- 10.20.193.123:0/3668117837 >> 10.20.193.123:0/3668117837 conn(0x7faba809e9c0 msgr2=0x7faba809edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:27.314 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.318+0000 7fabad510640 1 -- 10.20.193.123:0/3668117837 shutdown_connections 2026-02-17T20:09:27.314 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.318+0000 7fabad510640 1 -- 10.20.193.123:0/3668117837 wait complete. 2026-02-17T20:09:27.315 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.319+0000 7fabad510640 1 Processor -- start 2026-02-17T20:09:27.315 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.319+0000 7fabad510640 1 -- start start 2026-02-17T20:09:27.315 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.319+0000 7fabad510640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7faba806f7c0 0x7faba812f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:27.315 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.319+0000 7fabad510640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7faba80700e0 0x7faba812f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:27.315 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.319+0000 7fabad510640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7faba8070f70 0x7faba811f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:27.315 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.319+0000 7fabad510640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7faba80737c0 con 0x7faba80700e0 2026-02-17T20:09:27.315 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.319+0000 7fabad510640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7faba8073640 con 0x7faba8070f70 2026-02-17T20:09:27.315 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.319+0000 7fabad510640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7faba8073940 con 0x7faba806f7c0 2026-02-17T20:09:27.315 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.319+0000 7faba6ffd640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7faba806f7c0 0x7faba812f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:27.315 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.319+0000 7faba6ffd640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7faba806f7c0 0x7faba812f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:38264/0 (socket says 10.20.193.123:38264) 2026-02-17T20:09:27.315 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.319+0000 7faba67fc640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7faba80700e0 0x7faba812f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:27.315 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.319+0000 7faba6ffd640 1 -- 10.20.193.123:0/4265006079 learned_addr learned my addr 10.20.193.123:0/4265006079 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:27.315 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.319+0000 7faba77fe640 1 --2- 10.20.193.123:0/4265006079 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7faba8070f70 0x7faba811f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:27.315 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.319+0000 7faba6ffd640 1 -- 10.20.193.123:0/4265006079 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7faba8070f70 msgr2=0x7faba811f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:27.315 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.319+0000 7faba6ffd640 1 --2- 10.20.193.123:0/4265006079 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7faba8070f70 0x7faba811f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.315 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.319+0000 7faba6ffd640 1 -- 10.20.193.123:0/4265006079 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7faba80700e0 msgr2=0x7faba812f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:27.315 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.319+0000 7faba6ffd640 1 --2- 10.20.193.123:0/4265006079 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7faba80700e0 0x7faba812f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.315 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.319+0000 7faba6ffd640 1 -- 10.20.193.123:0/4265006079 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faba8121690 con 0x7faba806f7c0 2026-02-17T20:09:27.315 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.319+0000 7faba67fc640 1 --2- 10.20.193.123:0/4265006079 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7faba80700e0 0x7faba812f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:27.315 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.319+0000 7faba6ffd640 1 --2- 10.20.193.123:0/4265006079 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7faba806f7c0 0x7faba812f390 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fab9c02f3a0 tx=0x7fab9c0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:27.316 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.319+0000 7fab877fe640 1 -- 10.20.193.123:0/4265006079 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9c047070 con 0x7faba806f7c0 2026-02-17T20:09:27.316 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.320+0000 7fab877fe640 1 -- 10.20.193.123:0/4265006079 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab9c042630 con 0x7faba806f7c0 2026-02-17T20:09:27.316 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.320+0000 7fabad510640 1 -- 10.20.193.123:0/4265006079 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faba8073e80 con 0x7faba806f7c0 2026-02-17T20:09:27.316 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.320+0000 7fab877fe640 1 -- 10.20.193.123:0/4265006079 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9c03c040 con 0x7faba806f7c0 2026-02-17T20:09:27.316 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.320+0000 7fabad510640 1 -- 10.20.193.123:0/4265006079 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7faba8122060 con 0x7faba806f7c0 2026-02-17T20:09:27.316 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.320+0000 7fabad510640 1 -- 10.20.193.123:0/4265006079 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faba811be70 con 0x7faba806f7c0 2026-02-17T20:09:27.316 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.320+0000 7fab877fe640 1 -- 10.20.193.123:0/4265006079 <== mon.2 v2:10.20.193.123:3302/0 4 ==== mgrmap(e 8) ==== 61895+0+0 (secure 0 0 0) 0x7fab9c02f940 con 0x7faba806f7c0 2026-02-17T20:09:27.316 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.321+0000 7fab877fe640 1 -- 10.20.193.123:0/4265006079 <== mon.2 v2:10.20.193.123:3302/0 5 ==== osd_map(17..17 src has 1..17) ==== 3021+0+0 (secure 0 0 0) 0x7fab9c08b3d0 con 0x7faba806f7c0 2026-02-17T20:09:27.319 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.324+0000 7fab877fe640 1 -- 10.20.193.123:0/4265006079 <== mon.2 v2:10.20.193.123:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7faba811be70 con 0x7faba806f7c0 2026-02-17T20:09:27.325 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.329+0000 7fab877fe640 1 -- 10.20.193.123:0/4265006079 <== mon.2 v2:10.20.193.123:3302/0 7 ==== mgrmap(e 9) ==== 62001+0+0 (secure 0 0 0) 0x7fab9c08a210 con 0x7faba806f7c0 2026-02-17T20:09:27.388 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.392+0000 7fabad510640 1 -- 10.20.193.123:0/4265006079 --> v1:10.20.193.123:6800/115662061 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faba806fba0 con 0x7fab7404f5e0 2026-02-17T20:09:27.388 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.393+0000 7fab877fe640 1 -- 10.20.193.123:0/4265006079 <== mgr.14107 v1:10.20.193.123:6800/115662061 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31972 (unknown 2965378022 0 3236197471) 0x7faba806fba0 con 0x7fab7404f5e0 2026-02-17T20:09:27.389 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:09:27.389 INFO:teuthology.orchestra.run.trial123.stderr:dumped all 2026-02-17T20:09:27.389 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.394+0000 7fabad510640 1 -- 10.20.193.123:0/4265006079 >> v1:10.20.193.123:6800/115662061 conn(0x7fab7404f5e0 legacy=0x7fab74051aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:27.389 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.394+0000 7fabad510640 1 -- 10.20.193.123:0/4265006079 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7faba806f7c0 msgr2=0x7faba812f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:27.389 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.394+0000 7fabad510640 1 --2- 10.20.193.123:0/4265006079 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7faba806f7c0 0x7faba812f390 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fab9c02f3a0 tx=0x7fab9c0047c0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.389 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.394+0000 7fabad510640 1 -- 10.20.193.123:0/4265006079 shutdown_connections 2026-02-17T20:09:27.389 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.394+0000 7fabad510640 1 --2- 10.20.193.123:0/4265006079 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7faba8070f70 0x7faba811f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.390 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.394+0000 7fabad510640 1 --2- 10.20.193.123:0/4265006079 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7faba80700e0 0x7faba812f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.390 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.394+0000 7fabad510640 1 --2- 10.20.193.123:0/4265006079 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7faba806f7c0 0x7faba812f390 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.390 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.394+0000 7fabad510640 1 -- 10.20.193.123:0/4265006079 >> 10.20.193.123:0/4265006079 conn(0x7faba809e9c0 msgr2=0x7faba8132970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:27.390 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.394+0000 7fabad510640 1 -- 10.20.193.123:0/4265006079 shutdown_connections 2026-02-17T20:09:27.390 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.394+0000 7fabad510640 1 -- 10.20.193.123:0/4265006079 wait complete. 2026-02-17T20:09:27.397 INFO:teuthology.orchestra.run.trial123.stdout:{"pg_ready":true,"pg_map":{"version":4,"stamp":"2026-02-17T20:09:26.322900+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1207792,"kb_used_data":1728,"kb_used_omap":6,"kb_used_meta":1206009,"kb_avail":376279568,"statfs":{"total":386547056640,"available":385310277632,"internally_reserved":0,"allocated":1769472,"data_stored":1347850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6812,"internal_metadata":1234953572},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.999334"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-17T20:09:20.507133+0000","last_change":"2026-02-17T20:08:30.690429+0000","last_active":"2026-02-17T20:09:20.507133+0000","last_peered":"2026-02-17T20:09:20.507133+0000","last_clean":"2026-02-17T20:09:20.507133+0000","last_became_active":"2026-02-17T20:08:28.684753+0000","last_became_peered":"2026-02-17T20:08:28.684753+0000","last_unstale":"2026-02-17T20:09:20.507133+0000","last_undegraded":"2026-02-17T20:09:20.507133+0000","last_fullsized":"2026-02-17T20:09:20.507133+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:08:20.381745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026193599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-17T20:09:19.259698+0000","last_change":"2026-02-17T20:08:30.690459+0000","last_active":"2026-02-17T20:09:19.259698+0000","last_peered":"2026-02-17T20:09:19.259698+0000","last_clean":"2026-02-17T20:09:19.259698+0000","last_became_active":"2026-02-17T20:08:28.686321+0000","last_became_peered":"2026-02-17T20:08:28.686321+0000","last_unstale":"2026-02-17T20:09:19.259698+0000","last_undegraded":"2026-02-17T20:09:19.259698+0000","last_fullsized":"2026-02-17T20:09:19.259698+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T00:54:43.830886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033416199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-17T20:09:22.838934+0000","last_change":"2026-02-17T20:08:30.978866+0000","last_active":"2026-02-17T20:09:22.838934+0000","last_peered":"2026-02-17T20:09:22.838934+0000","last_clean":"2026-02-17T20:09:22.838934+0000","last_became_active":"2026-02-17T20:08:28.686233+0000","last_became_peered":"2026-02-17T20:08:28.686233+0000","last_unstale":"2026-02-17T20:09:22.838934+0000","last_undegraded":"2026-02-17T20:09:22.838934+0000","last_fullsized":"2026-02-17T20:09:22.838934+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T00:46:35.006943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026693600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-17T20:09:19.259652+0000","last_change":"2026-02-17T20:08:30.690311+0000","last_active":"2026-02-17T20:09:19.259652+0000","last_peered":"2026-02-17T20:09:19.259652+0000","last_clean":"2026-02-17T20:09:19.259652+0000","last_became_active":"2026-02-17T20:08:28.686342+0000","last_became_peered":"2026-02-17T20:08:28.686342+0000","last_unstale":"2026-02-17T20:09:19.259652+0000","last_undegraded":"2026-02-17T20:09:19.259652+0000","last_fullsized":"2026-02-17T20:09:19.259652+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:08:20.381745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000242539,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'72","reported_seq":103,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-17T20:09:19.259715+0000","last_change":"2026-02-17T20:08:29.687945+0000","last_active":"2026-02-17T20:09:19.259715+0000","last_peered":"2026-02-17T20:09:19.259715+0000","last_clean":"2026-02-17T20:09:19.259715+0000","last_became_active":"2026-02-17T20:08:29.687535+0000","last_became_peered":"2026-02-17T20:08:29.687535+0000","last_unstale":"2026-02-17T20:09:19.259715+0000","last_undegraded":"2026-02-17T20:09:19.259715+0000","last_fullsized":"2026-02-17T20:09:19.259715+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:28.678564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:28.678564+0000","last_clean_scrub_stamp":"2026-02-17T20:08:28.678564+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:18:04.973223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"11'1","reported_seq":20,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-17T20:09:20.507124+0000","last_change":"2026-02-17T20:08:30.690362+0000","last_active":"2026-02-17T20:09:20.507124+0000","last_peered":"2026-02-17T20:09:20.507124+0000","last_clean":"2026-02-17T20:09:20.507124+0000","last_became_active":"2026-02-17T20:08:28.686114+0000","last_became_peered":"2026-02-17T20:08:28.686114+0000","last_unstale":"2026-02-17T20:09:20.507124+0000","last_undegraded":"2026-02-17T20:09:20.507124+0000","last_fullsized":"2026-02-17T20:09:20.507124+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T00:32:00.928743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000198235,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"13'2","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-17T20:09:22.074571+0000","last_change":"2026-02-17T20:08:30.691919+0000","last_active":"2026-02-17T20:09:22.074571+0000","last_peered":"2026-02-17T20:09:22.074571+0000","last_clean":"2026-02-17T20:09:22.074571+0000","last_became_active":"2026-02-17T20:08:28.686207+0000","last_became_peered":"2026-02-17T20:08:28.686207+0000","last_unstale":"2026-02-17T20:09:22.074571+0000","last_undegraded":"2026-02-17T20:09:22.074571+0000","last_fullsized":"2026-02-17T20:09:22.074571+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T00:46:35.006943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059736000000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-17T20:09:19.259671+0000","last_change":"2026-02-17T20:08:30.690309+0000","last_active":"2026-02-17T20:09:19.259671+0000","last_peered":"2026-02-17T20:09:19.259671+0000","last_clean":"2026-02-17T20:09:19.259671+0000","last_became_active":"2026-02-17T20:08:28.686245+0000","last_became_peered":"2026-02-17T20:08:28.686245+0000","last_unstale":"2026-02-17T20:09:19.259671+0000","last_undegraded":"2026-02-17T20:09:19.259671+0000","last_fullsized":"2026-02-17T20:09:19.259671+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T00:32:00.928743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00023917200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-17T20:09:20.507124+0000","last_change":"2026-02-17T20:08:30.690267+0000","last_active":"2026-02-17T20:09:20.507124+0000","last_peered":"2026-02-17T20:09:20.507124+0000","last_clean":"2026-02-17T20:09:20.507124+0000","last_became_active":"2026-02-17T20:08:28.686208+0000","last_became_peered":"2026-02-17T20:08:28.686208+0000","last_unstale":"2026-02-17T20:09:20.507124+0000","last_undegraded":"2026-02-17T20:09:20.507124+0000","last_fullsized":"2026-02-17T20:09:20.507124+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T00:54:43.830886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000175532,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705676,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302240,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069600,"statfs":{"total":96636764160,"available":96327270400,"internally_reserved":0,"allocated":741376,"data_stored":633283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1703,"internal_metadata":308738393},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705677,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301656,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070184,"statfs":{"total":96636764160,"available":96327868416,"internally_reserved":0,"allocated":143360,"data_stored":42337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1703,"internal_metadata":308738393},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705676,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302232,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069608,"statfs":{"total":96636764160,"available":96327278592,"internally_reserved":0,"allocated":733184,"data_stored":629296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1703,"internal_metadata":308738393},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705677,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301664,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070176,"statfs":{"total":96636764160,"available":96327860224,"internally_reserved":0,"allocated":151552,"data_stored":42934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1703,"internal_metadata":308738393},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T20:09:27.397 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T20:09:27.463 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.468+0000 7fc37e527640 1 Processor -- start 2026-02-17T20:09:27.463 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.468+0000 7fc37e527640 1 -- start start 2026-02-17T20:09:27.464 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.468+0000 7fc37e527640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc378130170 0x7fc378130550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:27.464 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.468+0000 7fc37e527640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fc37812d300 0x7fc378138510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:27.464 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.468+0000 7fc37e527640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc378071e90 con 0x7fc378130a90 2026-02-17T20:09:27.464 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.468+0000 7fc37e527640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7fc378071800 con 0x7fc37812d300 2026-02-17T20:09:27.464 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.468+0000 7fc37e527640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7fc378072260 con 0x7fc378130170 2026-02-17T20:09:27.464 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.468+0000 7fc377fff640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc378130170 0x7fc378130550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:27.464 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.468+0000 7fc37ca9d640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fc37812d300 0x7fc378138510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:27.464 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.468+0000 7fc377fff640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc378130170 0x7fc378130550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:45352/0 (socket says 10.20.193.123:45352) 2026-02-17T20:09:27.464 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.468+0000 7fc377fff640 1 -- 10.20.193.123:0/1160274804 learned_addr learned my addr 10.20.193.123:0/1160274804 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:27.464 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.468+0000 7fc377fff640 1 -- 10.20.193.123:0/1160274804 >> v2:10.20.193.123:3300/0 conn(0x7fc37812d300 msgr2=0x7fc378138510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:27.464 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.468+0000 7fc377fff640 1 --2- 10.20.193.123:0/1160274804 >> v2:10.20.193.123:3300/0 conn(0x7fc37812d300 0x7fc378138510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.464 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.468+0000 7fc377fff640 1 -- 10.20.193.123:0/1160274804 >> v1:10.20.193.123:6789/0 conn(0x7fc378130a90 legacy=0x7fc37812cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:27.464 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.468+0000 7fc377fff640 1 -- 10.20.193.123:0/1160274804 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc378116aa0 con 0x7fc378130170 2026-02-17T20:09:27.464 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.468+0000 7fc37ca9d640 1 --2- 10.20.193.123:0/1160274804 >> v2:10.20.193.123:3300/0 conn(0x7fc37812d300 0x7fc378138510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:27.464 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.469+0000 7fc377fff640 1 --2- 10.20.193.123:0/1160274804 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc378130170 0x7fc378130550 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc364009970 tx=0x7fc36402ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ac69cec9fb869b1 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:27.464 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.469+0000 7fc376ffd640 1 -- 10.20.193.123:0/1160274804 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36403c070 con 0x7fc378130170 2026-02-17T20:09:27.464 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.469+0000 7fc376ffd640 1 -- 10.20.193.123:0/1160274804 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc36402fb10 con 0x7fc378130170 2026-02-17T20:09:27.464 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.469+0000 7fc376ffd640 1 -- 10.20.193.123:0/1160274804 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc364037440 con 0x7fc378130170 2026-02-17T20:09:27.465 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.469+0000 7fc37e527640 1 -- 10.20.193.123:0/1160274804 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc378130170 msgr2=0x7fc378130550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:27.465 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.469+0000 7fc37e527640 1 --2- 10.20.193.123:0/1160274804 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc378130170 0x7fc378130550 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc364009970 tx=0x7fc36402ee90 comp rx=0 tx=0).stop 2026-02-17T20:09:27.465 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.469+0000 7fc37e527640 1 -- 10.20.193.123:0/1160274804 shutdown_connections 2026-02-17T20:09:27.465 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.469+0000 7fc37e527640 1 --2- 10.20.193.123:0/1160274804 >> v2:10.20.193.123:3300/0 conn(0x7fc37812d300 0x7fc378138510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.465 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.469+0000 7fc37e527640 1 --2- 10.20.193.123:0/1160274804 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc378130170 0x7fc378130550 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.465 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.469+0000 7fc37e527640 1 -- 10.20.193.123:0/1160274804 >> 10.20.193.123:0/1160274804 conn(0x7fc37809d6c0 msgr2=0x7fc37809dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:27.465 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.469+0000 7fc37e527640 1 -- 10.20.193.123:0/1160274804 shutdown_connections 2026-02-17T20:09:27.465 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.469+0000 7fc37e527640 1 -- 10.20.193.123:0/1160274804 wait complete. 2026-02-17T20:09:27.465 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.470+0000 7fc37e527640 1 Processor -- start 2026-02-17T20:09:27.465 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.470+0000 7fc37e527640 1 -- start start 2026-02-17T20:09:27.466 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.470+0000 7fc37e527640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fc37812d300 0x7fc3781354b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:27.466 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.470+0000 7fc37e527640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc378130170 0x7fc3781359f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:27.466 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.470+0000 7fc37e527640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fc378130a90 0x7fc378135f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:27.466 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.470+0000 7fc37e527640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc37812d8f0 con 0x7fc378130a90 2026-02-17T20:09:27.466 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.470+0000 7fc37e527640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7fc37812d770 con 0x7fc378130170 2026-02-17T20:09:27.466 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.470+0000 7fc37e527640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7fc378136db0 con 0x7fc37812d300 2026-02-17T20:09:27.466 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.470+0000 7fc3777fe640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc378130170 0x7fc3781359f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:27.466 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.470+0000 7fc377fff640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fc37812d300 0x7fc3781354b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:27.466 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.470+0000 7fc37ca9d640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fc378130a90 0x7fc378135f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:27.466 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.470+0000 7fc3777fe640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc378130170 0x7fc3781359f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:45354/0 (socket says 10.20.193.123:45354) 2026-02-17T20:09:27.466 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.470+0000 7fc3777fe640 1 -- 10.20.193.123:0/1288465252 learned_addr learned my addr 10.20.193.123:0/1288465252 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:27.466 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.470+0000 7fc37ca9d640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fc378130a90 0x7fc378135f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:42176/0 (socket says 10.20.193.123:42176) 2026-02-17T20:09:27.466 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.470+0000 7fc3777fe640 1 -- 10.20.193.123:0/1288465252 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fc37812d300 msgr2=0x7fc3781354b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:27.466 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.470+0000 7fc3777fe640 1 --2- 10.20.193.123:0/1288465252 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fc37812d300 0x7fc3781354b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.466 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.470+0000 7fc3777fe640 1 -- 10.20.193.123:0/1288465252 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fc378130a90 msgr2=0x7fc378135f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:27.466 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.470+0000 7fc3777fe640 1 --2- 10.20.193.123:0/1288465252 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fc378130a90 0x7fc378135f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.466 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.470+0000 7fc3777fe640 1 -- 10.20.193.123:0/1288465252 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc378136470 con 0x7fc378130170 2026-02-17T20:09:27.466 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.470+0000 7fc377fff640 1 --2- 10.20.193.123:0/1288465252 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fc37812d300 0x7fc3781354b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:27.466 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.470+0000 7fc37ca9d640 1 --2- 10.20.193.123:0/1288465252 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fc378130a90 0x7fc378135f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:27.466 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.470+0000 7fc3777fe640 1 --2- 10.20.193.123:0/1288465252 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc378130170 0x7fc3781359f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc36800c700 tx=0x7fc36800cbd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:27.466 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.470+0000 7fc374ff9640 1 -- 10.20.193.123:0/1288465252 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3680052d0 con 0x7fc378130170 2026-02-17T20:09:27.466 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.470+0000 7fc374ff9640 1 -- 10.20.193.123:0/1288465252 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc368005470 con 0x7fc378130170 2026-02-17T20:09:27.466 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.470+0000 7fc37e527640 1 -- 10.20.193.123:0/1288465252 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc378137440 con 0x7fc378130170 2026-02-17T20:09:27.466 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.470+0000 7fc374ff9640 1 -- 10.20.193.123:0/1288465252 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36800a860 con 0x7fc378130170 2026-02-17T20:09:27.466 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.470+0000 7fc37e527640 1 -- 10.20.193.123:0/1288465252 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc378138090 con 0x7fc378130170 2026-02-17T20:09:27.467 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.471+0000 7fc37e527640 1 -- 10.20.193.123:0/1288465252 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc378130550 con 0x7fc378130170 2026-02-17T20:09:27.467 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.471+0000 7fc374ff9640 1 -- 10.20.193.123:0/1288465252 <== mon.1 v2:10.20.193.123:3301/0 4 ==== mgrmap(e 9) ==== 62001+0+0 (secure 0 0 0) 0x7fc36800aa00 con 0x7fc378130170 2026-02-17T20:09:27.467 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.471+0000 7fc374ff9640 1 -- 10.20.193.123:0/1288465252 <== mon.1 v2:10.20.193.123:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 3021+0+0 (secure 0 0 0) 0x7fc368066630 con 0x7fc378130170 2026-02-17T20:09:27.468 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.473+0000 7fc374ff9640 1 -- 10.20.193.123:0/1288465252 <== mon.1 v2:10.20.193.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7fc3680404a0 con 0x7fc378130170 2026-02-17T20:09:27.536 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.540+0000 7fc37e527640 1 -- 10.20.193.123:0/1288465252 --> v1:10.20.193.123:6800/115662061 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc37811b640 con 0x7fc34804f700 2026-02-17T20:09:27.537 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.541+0000 7fc374ff9640 1 -- 10.20.193.123:0/1288465252 <== mgr.14107 v1:10.20.193.123:6800/115662061 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31972 (unknown 2965378022 0 3236197471) 0x7fc37811b640 con 0x7fc34804f700 2026-02-17T20:09:27.537 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:09:27.538 INFO:teuthology.orchestra.run.trial123.stderr:dumped all 2026-02-17T20:09:27.538 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.541+0000 7fc37e527640 1 -- 10.20.193.123:0/1288465252 >> v1:10.20.193.123:6800/115662061 conn(0x7fc34804f700 legacy=0x7fc348051bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:27.539 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.541+0000 7fc37e527640 1 -- 10.20.193.123:0/1288465252 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc378130170 msgr2=0x7fc3781359f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:27.539 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.541+0000 7fc37e527640 1 --2- 10.20.193.123:0/1288465252 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc378130170 0x7fc3781359f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc36800c700 tx=0x7fc36800cbd0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.539 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.541+0000 7fc37e527640 1 -- 10.20.193.123:0/1288465252 shutdown_connections 2026-02-17T20:09:27.539 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.541+0000 7fc37e527640 1 --2- 10.20.193.123:0/1288465252 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fc378130a90 0x7fc378135f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.539 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.541+0000 7fc37e527640 1 --2- 10.20.193.123:0/1288465252 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc378130170 0x7fc3781359f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.539 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.541+0000 7fc37e527640 1 --2- 10.20.193.123:0/1288465252 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fc37812d300 0x7fc3781354b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.539 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.542+0000 7fc37e527640 1 -- 10.20.193.123:0/1288465252 >> 10.20.193.123:0/1288465252 conn(0x7fc37809d6c0 msgr2=0x7fc37806e150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:27.539 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.542+0000 7fc37e527640 1 -- 10.20.193.123:0/1288465252 shutdown_connections 2026-02-17T20:09:27.539 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.542+0000 7fc37e527640 1 -- 10.20.193.123:0/1288465252 wait complete. 2026-02-17T20:09:27.545 INFO:teuthology.orchestra.run.trial123.stdout:{"pg_ready":true,"pg_map":{"version":4,"stamp":"2026-02-17T20:09:26.322900+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1207792,"kb_used_data":1728,"kb_used_omap":6,"kb_used_meta":1206009,"kb_avail":376279568,"statfs":{"total":386547056640,"available":385310277632,"internally_reserved":0,"allocated":1769472,"data_stored":1347850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6812,"internal_metadata":1234953572},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.999334"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-17T20:09:20.507133+0000","last_change":"2026-02-17T20:08:30.690429+0000","last_active":"2026-02-17T20:09:20.507133+0000","last_peered":"2026-02-17T20:09:20.507133+0000","last_clean":"2026-02-17T20:09:20.507133+0000","last_became_active":"2026-02-17T20:08:28.684753+0000","last_became_peered":"2026-02-17T20:08:28.684753+0000","last_unstale":"2026-02-17T20:09:20.507133+0000","last_undegraded":"2026-02-17T20:09:20.507133+0000","last_fullsized":"2026-02-17T20:09:20.507133+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:08:20.381745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026193599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-17T20:09:19.259698+0000","last_change":"2026-02-17T20:08:30.690459+0000","last_active":"2026-02-17T20:09:19.259698+0000","last_peered":"2026-02-17T20:09:19.259698+0000","last_clean":"2026-02-17T20:09:19.259698+0000","last_became_active":"2026-02-17T20:08:28.686321+0000","last_became_peered":"2026-02-17T20:08:28.686321+0000","last_unstale":"2026-02-17T20:09:19.259698+0000","last_undegraded":"2026-02-17T20:09:19.259698+0000","last_fullsized":"2026-02-17T20:09:19.259698+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T00:54:43.830886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033416199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-17T20:09:22.838934+0000","last_change":"2026-02-17T20:08:30.978866+0000","last_active":"2026-02-17T20:09:22.838934+0000","last_peered":"2026-02-17T20:09:22.838934+0000","last_clean":"2026-02-17T20:09:22.838934+0000","last_became_active":"2026-02-17T20:08:28.686233+0000","last_became_peered":"2026-02-17T20:08:28.686233+0000","last_unstale":"2026-02-17T20:09:22.838934+0000","last_undegraded":"2026-02-17T20:09:22.838934+0000","last_fullsized":"2026-02-17T20:09:22.838934+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T00:46:35.006943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026693600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-17T20:09:19.259652+0000","last_change":"2026-02-17T20:08:30.690311+0000","last_active":"2026-02-17T20:09:19.259652+0000","last_peered":"2026-02-17T20:09:19.259652+0000","last_clean":"2026-02-17T20:09:19.259652+0000","last_became_active":"2026-02-17T20:08:28.686342+0000","last_became_peered":"2026-02-17T20:08:28.686342+0000","last_unstale":"2026-02-17T20:09:19.259652+0000","last_undegraded":"2026-02-17T20:09:19.259652+0000","last_fullsized":"2026-02-17T20:09:19.259652+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:08:20.381745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000242539,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'72","reported_seq":103,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-17T20:09:19.259715+0000","last_change":"2026-02-17T20:08:29.687945+0000","last_active":"2026-02-17T20:09:19.259715+0000","last_peered":"2026-02-17T20:09:19.259715+0000","last_clean":"2026-02-17T20:09:19.259715+0000","last_became_active":"2026-02-17T20:08:29.687535+0000","last_became_peered":"2026-02-17T20:08:29.687535+0000","last_unstale":"2026-02-17T20:09:19.259715+0000","last_undegraded":"2026-02-17T20:09:19.259715+0000","last_fullsized":"2026-02-17T20:09:19.259715+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:28.678564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:28.678564+0000","last_clean_scrub_stamp":"2026-02-17T20:08:28.678564+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:18:04.973223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"11'1","reported_seq":20,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-17T20:09:20.507124+0000","last_change":"2026-02-17T20:08:30.690362+0000","last_active":"2026-02-17T20:09:20.507124+0000","last_peered":"2026-02-17T20:09:20.507124+0000","last_clean":"2026-02-17T20:09:20.507124+0000","last_became_active":"2026-02-17T20:08:28.686114+0000","last_became_peered":"2026-02-17T20:08:28.686114+0000","last_unstale":"2026-02-17T20:09:20.507124+0000","last_undegraded":"2026-02-17T20:09:20.507124+0000","last_fullsized":"2026-02-17T20:09:20.507124+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T00:32:00.928743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000198235,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"13'2","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-17T20:09:22.074571+0000","last_change":"2026-02-17T20:08:30.691919+0000","last_active":"2026-02-17T20:09:22.074571+0000","last_peered":"2026-02-17T20:09:22.074571+0000","last_clean":"2026-02-17T20:09:22.074571+0000","last_became_active":"2026-02-17T20:08:28.686207+0000","last_became_peered":"2026-02-17T20:08:28.686207+0000","last_unstale":"2026-02-17T20:09:22.074571+0000","last_undegraded":"2026-02-17T20:09:22.074571+0000","last_fullsized":"2026-02-17T20:09:22.074571+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T00:46:35.006943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059736000000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-17T20:09:19.259671+0000","last_change":"2026-02-17T20:08:30.690309+0000","last_active":"2026-02-17T20:09:19.259671+0000","last_peered":"2026-02-17T20:09:19.259671+0000","last_clean":"2026-02-17T20:09:19.259671+0000","last_became_active":"2026-02-17T20:08:28.686245+0000","last_became_peered":"2026-02-17T20:08:28.686245+0000","last_unstale":"2026-02-17T20:09:19.259671+0000","last_undegraded":"2026-02-17T20:09:19.259671+0000","last_fullsized":"2026-02-17T20:09:19.259671+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T00:32:00.928743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00023917200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-17T20:09:20.507124+0000","last_change":"2026-02-17T20:08:30.690267+0000","last_active":"2026-02-17T20:09:20.507124+0000","last_peered":"2026-02-17T20:09:20.507124+0000","last_clean":"2026-02-17T20:09:20.507124+0000","last_became_active":"2026-02-17T20:08:28.686208+0000","last_became_peered":"2026-02-17T20:08:28.686208+0000","last_unstale":"2026-02-17T20:09:20.507124+0000","last_undegraded":"2026-02-17T20:09:20.507124+0000","last_fullsized":"2026-02-17T20:09:20.507124+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T00:54:43.830886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000175532,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705676,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302240,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069600,"statfs":{"total":96636764160,"available":96327270400,"internally_reserved":0,"allocated":741376,"data_stored":633283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1703,"internal_metadata":308738393},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705677,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301656,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070184,"statfs":{"total":96636764160,"available":96327868416,"internally_reserved":0,"allocated":143360,"data_stored":42337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1703,"internal_metadata":308738393},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705676,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302232,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069608,"statfs":{"total":96636764160,"available":96327278592,"internally_reserved":0,"allocated":733184,"data_stored":629296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1703,"internal_metadata":308738393},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705677,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301664,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070176,"statfs":{"total":96636764160,"available":96327860224,"internally_reserved":0,"allocated":151552,"data_stored":42934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1703,"internal_metadata":308738393},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T20:09:27.546 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-17T20:09:27.546 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-17T20:09:27.546 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-17T20:09:27.546 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T20:09:27.616 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.616+0000 7f0af05cd640 1 Processor -- start 2026-02-17T20:09:27.616 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.616+0000 7f0af05cd640 1 -- start start 2026-02-17T20:09:27.616 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.617+0000 7f0af05cd640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0ae8071600 0x7f0ae80719e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:27.616 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.617+0000 7f0af05cd640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0ae8073910 0x7f0ae81347c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:27.617 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.617+0000 7f0af05cd640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ae8072940 con 0x7f0ae8071f20 2026-02-17T20:09:27.617 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.617+0000 7f0af05cd640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f0ae8074220 con 0x7f0ae8073910 2026-02-17T20:09:27.617 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.617+0000 7f0af05cd640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f0ae8072f40 con 0x7f0ae8071600 2026-02-17T20:09:27.617 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.617+0000 7f0aee342640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0ae8071600 0x7f0ae80719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:27.617 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.617+0000 7f0aee342640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0ae8071600 0x7f0ae80719e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:38286/0 (socket says 10.20.193.123:38286) 2026-02-17T20:09:27.617 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.617+0000 7f0aee342640 1 -- 10.20.193.123:0/1894221711 learned_addr learned my addr 10.20.193.123:0/1894221711 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:27.617 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.617+0000 7f0aedb41640 1 --2- 10.20.193.123:0/1894221711 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0ae8073910 0x7f0ae81347c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:27.617 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.617+0000 7f0aee342640 1 -- 10.20.193.123:0/1894221711 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0ae8073910 msgr2=0x7f0ae81347c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:27.617 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.617+0000 7f0aee342640 1 --2- 10.20.193.123:0/1894221711 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0ae8073910 0x7f0ae81347c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.617 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.617+0000 7f0aee342640 1 -- 10.20.193.123:0/1894221711 >> v1:10.20.193.123:6789/0 conn(0x7f0ae8071f20 legacy=0x7f0ae8134d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:27.618 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.617+0000 7f0aee342640 1 -- 10.20.193.123:0/1894221711 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ae8135410 con 0x7f0ae8071600 2026-02-17T20:09:27.618 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.617+0000 7f0aee342640 1 --2- 10.20.193.123:0/1894221711 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0ae8071600 0x7f0ae80719e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0ad80099d0 tx=0x7f0ad802eed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd081544c73b4409 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:27.618 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.617+0000 7f0aed340640 1 -- 10.20.193.123:0/1894221711 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad803c070 con 0x7f0ae8071600 2026-02-17T20:09:27.618 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.617+0000 7f0aed340640 1 -- 10.20.193.123:0/1894221711 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ad802fb00 con 0x7f0ae8071600 2026-02-17T20:09:27.618 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.617+0000 7f0aed340640 1 -- 10.20.193.123:0/1894221711 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad8037440 con 0x7f0ae8071600 2026-02-17T20:09:27.618 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.618+0000 7f0af05cd640 1 -- 10.20.193.123:0/1894221711 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0ae8071600 msgr2=0x7f0ae80719e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:27.618 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.618+0000 7f0af05cd640 1 --2- 10.20.193.123:0/1894221711 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0ae8071600 0x7f0ae80719e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0ad80099d0 tx=0x7f0ad802eed0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.618 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.618+0000 7f0af05cd640 1 -- 10.20.193.123:0/1894221711 shutdown_connections 2026-02-17T20:09:27.618 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.618+0000 7f0af05cd640 1 --2- 10.20.193.123:0/1894221711 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0ae8073910 0x7f0ae81347c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.618 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.618+0000 7f0af05cd640 1 --2- 10.20.193.123:0/1894221711 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0ae8071600 0x7f0ae80719e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.618 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.618+0000 7f0af05cd640 1 -- 10.20.193.123:0/1894221711 >> 10.20.193.123:0/1894221711 conn(0x7f0ae809d6c0 msgr2=0x7f0ae809dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:27.618 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.618+0000 7f0af05cd640 1 -- 10.20.193.123:0/1894221711 shutdown_connections 2026-02-17T20:09:27.619 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.618+0000 7f0af05cd640 1 -- 10.20.193.123:0/1894221711 wait complete. 2026-02-17T20:09:27.619 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.618+0000 7f0af05cd640 1 Processor -- start 2026-02-17T20:09:27.619 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.618+0000 7f0af05cd640 1 -- start start 2026-02-17T20:09:27.619 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.618+0000 7f0af05cd640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0ae8071600 0x7f0ae8135870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:27.619 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.618+0000 7f0af05cd640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0ae8071f20 0x7f0ae8135db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:27.619 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.618+0000 7f0af05cd640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0ae8073910 0x7f0ae81362f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:27.619 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.618+0000 7f0af05cd640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae813ce90 con 0x7f0ae8073910 2026-02-17T20:09:27.619 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.618+0000 7f0af05cd640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f0ae813cd10 con 0x7f0ae8071f20 2026-02-17T20:09:27.619 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.618+0000 7f0af05cd640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f0ae813d010 con 0x7f0ae8071600 2026-02-17T20:09:27.619 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.619+0000 7f0aeeb43640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0ae8073910 0x7f0ae81362f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:27.619 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.619+0000 7f0aee342640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0ae8071600 0x7f0ae8135870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:27.619 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.619+0000 7f0aedb41640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0ae8071f20 0x7f0ae8135db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:27.620 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.619+0000 7f0aeeb43640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0ae8073910 0x7f0ae81362f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:42178/0 (socket says 10.20.193.123:42178) 2026-02-17T20:09:27.620 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.619+0000 7f0aee342640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0ae8071600 0x7f0ae8135870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:38300/0 (socket says 10.20.193.123:38300) 2026-02-17T20:09:27.620 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.619+0000 7f0aeeb43640 1 -- 10.20.193.123:0/2061036402 learned_addr learned my addr 10.20.193.123:0/2061036402 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:27.620 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.619+0000 7f0aedb41640 1 -- 10.20.193.123:0/2061036402 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0ae8071600 msgr2=0x7f0ae8135870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:27.620 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.619+0000 7f0aedb41640 1 --2- 10.20.193.123:0/2061036402 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0ae8071600 0x7f0ae8135870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.620 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.619+0000 7f0aedb41640 1 -- 10.20.193.123:0/2061036402 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0ae8073910 msgr2=0x7f0ae81362f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:27.620 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.619+0000 7f0aedb41640 1 --2- 10.20.193.123:0/2061036402 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0ae8073910 0x7f0ae81362f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.620 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.619+0000 7f0aedb41640 1 -- 10.20.193.123:0/2061036402 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ae811ad10 con 0x7f0ae8071f20 2026-02-17T20:09:27.620 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.619+0000 7f0aedb41640 1 --2- 10.20.193.123:0/2061036402 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0ae8071f20 0x7f0ae8135db0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0adc00e980 tx=0x7f0adc00ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:27.620 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.619+0000 7f0aceffd640 1 -- 10.20.193.123:0/2061036402 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0adc017070 con 0x7f0ae8071f20 2026-02-17T20:09:27.620 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.619+0000 7f0aceffd640 1 -- 10.20.193.123:0/2061036402 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0adc00c9a0 con 0x7f0ae8071f20 2026-02-17T20:09:27.621 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.619+0000 7f0af05cd640 1 -- 10.20.193.123:0/2061036402 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ae8136e20 con 0x7f0ae8071f20 2026-02-17T20:09:27.621 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.619+0000 7f0aceffd640 1 -- 10.20.193.123:0/2061036402 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0adc00cd90 con 0x7f0ae8071f20 2026-02-17T20:09:27.621 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.619+0000 7f0af05cd640 1 -- 10.20.193.123:0/2061036402 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ae8138130 con 0x7f0ae8071f20 2026-02-17T20:09:27.621 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.619+0000 7f0af05cd640 1 -- 10.20.193.123:0/2061036402 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ae813c850 con 0x7f0ae8071f20 2026-02-17T20:09:27.621 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.620+0000 7f0aceffd640 1 -- 10.20.193.123:0/2061036402 <== mon.1 v2:10.20.193.123:3301/0 4 ==== mgrmap(e 9) ==== 62001+0+0 (secure 0 0 0) 0x7f0adc013470 con 0x7f0ae8071f20 2026-02-17T20:09:27.621 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.620+0000 7f0aceffd640 1 -- 10.20.193.123:0/2061036402 <== mon.1 v2:10.20.193.123:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 3021+0+0 (secure 0 0 0) 0x7f0adc0670d0 con 0x7f0ae8071f20 2026-02-17T20:09:27.621 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.622+0000 7f0aceffd640 1 -- 10.20.193.123:0/2061036402 <== mon.1 v2:10.20.193.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f0adc021030 con 0x7f0ae8071f20 2026-02-17T20:09:27.697 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.701+0000 7f0af05cd640 1 -- 10.20.193.123:0/2061036402 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0ae80719e0 con 0x7f0ae8071f20 2026-02-17T20:09:27.697 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.701+0000 7f0aceffd640 1 -- 10.20.193.123:0/2061036402 <== mon.1 v2:10.20.193.123:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f0adc040e40 con 0x7f0ae8071f20 2026-02-17T20:09:27.697 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:09:27.697 INFO:teuthology.orchestra.run.trial123.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-17T20:09:27.698 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.702+0000 7f0af05cd640 1 -- 10.20.193.123:0/2061036402 >> v1:10.20.193.123:6800/115662061 conn(0x7f0ab804f700 legacy=0x7f0ab8051bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:27.698 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.702+0000 7f0af05cd640 1 -- 10.20.193.123:0/2061036402 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0ae8071f20 msgr2=0x7f0ae8135db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:27.699 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.702+0000 7f0af05cd640 1 --2- 10.20.193.123:0/2061036402 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0ae8071f20 0x7f0ae8135db0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0adc00e980 tx=0x7f0adc00ee50 comp rx=0 tx=0).stop 2026-02-17T20:09:27.699 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.702+0000 7f0af05cd640 1 -- 10.20.193.123:0/2061036402 shutdown_connections 2026-02-17T20:09:27.699 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.702+0000 7f0af05cd640 1 --2- 10.20.193.123:0/2061036402 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0ae8073910 0x7f0ae81362f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.699 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.702+0000 7f0af05cd640 1 --2- 10.20.193.123:0/2061036402 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0ae8071f20 0x7f0ae8135db0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.699 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.702+0000 7f0af05cd640 1 --2- 10.20.193.123:0/2061036402 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0ae8071600 0x7f0ae8135870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.699 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.702+0000 7f0af05cd640 1 -- 10.20.193.123:0/2061036402 >> 10.20.193.123:0/2061036402 conn(0x7f0ae809d6c0 msgr2=0x7f0ae8070860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:27.699 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.702+0000 7f0af05cd640 1 -- 10.20.193.123:0/2061036402 shutdown_connections 2026-02-17T20:09:27.699 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.702+0000 7f0af05cd640 1 -- 10.20.193.123:0/2061036402 wait complete. 2026-02-17T20:09:27.705 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-17T20:09:27.705 INFO:teuthology.run_tasks:Running task ceph.restart... 2026-02-17T20:09:27.723 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-17T20:09:27.723 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T20:09:27.759 INFO:tasks.ceph.osd.0:Stopped 2026-02-17T20:09:27.760 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 0 2026-02-17T20:09:27.870 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.870+0000 7f5d028a9640 1 Processor -- start 2026-02-17T20:09:27.870 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.870+0000 7f5d028a9640 1 -- start start 2026-02-17T20:09:27.870 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.871+0000 7f5d028a9640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f5cfc130600 0x7f5cfc1309e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:27.870 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.871+0000 7f5d028a9640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f5cfc115920 0x7f5cfc1385e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:27.871 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.871+0000 7f5d028a9640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cfc09f550 con 0x7f5cfc114e10 2026-02-17T20:09:27.871 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.871+0000 7f5d028a9640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7f5cfc130240 con 0x7f5cfc115920 2026-02-17T20:09:27.871 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.871+0000 7f5d028a9640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f5cfc071c80 con 0x7f5cfc130600 2026-02-17T20:09:27.871 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.871+0000 7f5cfbfff640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f5cfc130600 0x7f5cfc1309e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:27.871 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.871+0000 7f5cfbfff640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f5cfc130600 0x7f5cfc1309e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:38314/0 (socket says 10.20.193.123:38314) 2026-02-17T20:09:27.871 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.871+0000 7f5cfbfff640 1 -- 10.20.193.123:0/3133154233 learned_addr learned my addr 10.20.193.123:0/3133154233 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:27.871 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.871+0000 7f5d00e1f640 1 --2- 10.20.193.123:0/3133154233 >> v2:10.20.193.123:3300/0 conn(0x7f5cfc115920 0x7f5cfc1385e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:27.871 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.871+0000 7f5cfbfff640 1 -- 10.20.193.123:0/3133154233 >> v2:10.20.193.123:3300/0 conn(0x7f5cfc115920 msgr2=0x7f5cfc1385e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:27.871 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.871+0000 7f5cfbfff640 1 --2- 10.20.193.123:0/3133154233 >> v2:10.20.193.123:3300/0 conn(0x7f5cfc115920 0x7f5cfc1385e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.871 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.871+0000 7f5cfaffd640 1 -- 10.20.193.123:0/3133154233 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3217575852 0 0) 0x7f5cfc09f550 con 0x7f5cfc114e10 2026-02-17T20:09:27.871 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.871+0000 7f5cfbfff640 1 -- 10.20.193.123:0/3133154233 >> v1:10.20.193.123:6789/0 conn(0x7f5cfc114e10 legacy=0x7f5cfc115210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:27.872 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.871+0000 7f5cfbfff640 1 -- 10.20.193.123:0/3133154233 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cfc072050 con 0x7f5cfc130600 2026-02-17T20:09:27.872 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.872+0000 7f5cfbfff640 1 --2- 10.20.193.123:0/3133154233 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f5cfc130600 0x7f5cfc1309e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8009970 tx=0x7f5ce802ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67d935abab41f8d7 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:27.872 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.872+0000 7f5cfaffd640 1 -- 10.20.193.123:0/3133154233 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce803c070 con 0x7f5cfc130600 2026-02-17T20:09:27.872 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.872+0000 7f5cfaffd640 1 -- 10.20.193.123:0/3133154233 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ce802fb10 con 0x7f5cfc130600 2026-02-17T20:09:27.872 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.872+0000 7f5cfaffd640 1 -- 10.20.193.123:0/3133154233 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce8037440 con 0x7f5cfc130600 2026-02-17T20:09:27.872 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.872+0000 7f5d028a9640 1 -- 10.20.193.123:0/3133154233 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f5cfc130600 msgr2=0x7f5cfc1309e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:27.872 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.872+0000 7f5d028a9640 1 --2- 10.20.193.123:0/3133154233 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f5cfc130600 0x7f5cfc1309e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8009970 tx=0x7f5ce802ee90 comp rx=0 tx=0).stop 2026-02-17T20:09:27.872 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.872+0000 7f5d028a9640 1 -- 10.20.193.123:0/3133154233 shutdown_connections 2026-02-17T20:09:27.872 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.872+0000 7f5d028a9640 1 --2- 10.20.193.123:0/3133154233 >> v2:10.20.193.123:3300/0 conn(0x7f5cfc115920 0x7f5cfc1385e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.872 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.872+0000 7f5d028a9640 1 --2- 10.20.193.123:0/3133154233 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f5cfc130600 0x7f5cfc1309e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.872 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.872+0000 7f5d028a9640 1 -- 10.20.193.123:0/3133154233 >> 10.20.193.123:0/3133154233 conn(0x7f5cfc09e7c0 msgr2=0x7f5cfc09ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:27.873 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.872+0000 7f5d028a9640 1 -- 10.20.193.123:0/3133154233 shutdown_connections 2026-02-17T20:09:27.873 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.872+0000 7f5d028a9640 1 -- 10.20.193.123:0/3133154233 wait complete. 2026-02-17T20:09:27.873 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.873+0000 7f5d028a9640 1 Processor -- start 2026-02-17T20:09:27.873 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.873+0000 7f5d028a9640 1 -- start start 2026-02-17T20:09:27.873 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.873+0000 7f5d028a9640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f5cfc114e10 0x7f5cfc132330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:27.873 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.873+0000 7f5d028a9640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f5cfc115920 0x7f5cfc132870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:27.873 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.873+0000 7f5d028a9640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f5cfc130600 0x7f5cfc132db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:27.873 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.873+0000 7f5d028a9640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5cfc130f20 con 0x7f5cfc130600 2026-02-17T20:09:27.873 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.873+0000 7f5d028a9640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f5cfc116cc0 con 0x7f5cfc115920 2026-02-17T20:09:27.873 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.873+0000 7f5d028a9640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f5cfc1310a0 con 0x7f5cfc114e10 2026-02-17T20:09:27.873 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.873+0000 7f5cfbfff640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f5cfc114e10 0x7f5cfc132330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:27.873 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.873+0000 7f5d00e1f640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f5cfc130600 0x7f5cfc132db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:27.874 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.873+0000 7f5cfb7fe640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f5cfc115920 0x7f5cfc132870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:27.874 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.873+0000 7f5d00e1f640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f5cfc130600 0x7f5cfc132db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:42196/0 (socket says 10.20.193.123:42196) 2026-02-17T20:09:27.874 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.873+0000 7f5d00e1f640 1 -- 10.20.193.123:0/909373323 learned_addr learned my addr 10.20.193.123:0/909373323 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:27.874 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.873+0000 7f5d00e1f640 1 -- 10.20.193.123:0/909373323 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f5cfc114e10 msgr2=0x7f5cfc132330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:27.874 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.873+0000 7f5d00e1f640 1 --2- 10.20.193.123:0/909373323 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f5cfc114e10 0x7f5cfc132330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.874 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.873+0000 7f5d00e1f640 1 -- 10.20.193.123:0/909373323 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f5cfc115920 msgr2=0x7f5cfc132870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:27.874 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.873+0000 7f5d00e1f640 1 --2- 10.20.193.123:0/909373323 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f5cfc115920 0x7f5cfc132870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:27.874 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.873+0000 7f5d00e1f640 1 -- 10.20.193.123:0/909373323 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cfc138800 con 0x7f5cfc130600 2026-02-17T20:09:27.874 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.873+0000 7f5cfbfff640 1 --2- 10.20.193.123:0/909373323 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f5cfc114e10 0x7f5cfc132330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:27.874 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.873+0000 7f5d00e1f640 1 --2- 10.20.193.123:0/909373323 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f5cfc130600 0x7f5cfc132db0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5cf000efc0 tx=0x7f5cf000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:27.874 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.873+0000 7f5cf8ff9640 1 -- 10.20.193.123:0/909373323 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf0018020 con 0x7f5cfc130600 2026-02-17T20:09:27.874 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.873+0000 7f5cf8ff9640 1 -- 10.20.193.123:0/909373323 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf0014480 con 0x7f5cfc130600 2026-02-17T20:09:27.875 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.873+0000 7f5d028a9640 1 -- 10.20.193.123:0/909373323 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cfc135930 con 0x7f5cfc130600 2026-02-17T20:09:27.875 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.873+0000 7f5cf8ff9640 1 -- 10.20.193.123:0/909373323 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf0014870 con 0x7f5cfc130600 2026-02-17T20:09:27.875 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.873+0000 7f5d028a9640 1 -- 10.20.193.123:0/909373323 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cfc134560 con 0x7f5cfc130600 2026-02-17T20:09:27.875 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.874+0000 7f5d028a9640 1 -- 10.20.193.123:0/909373323 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cfc1309e0 con 0x7f5cfc130600 2026-02-17T20:09:27.875 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.874+0000 7f5cf8ff9640 1 -- 10.20.193.123:0/909373323 <== mon.0 v2:10.20.193.123:3300/0 4 ==== mgrmap(e 9) ==== 62001+0+0 (secure 0 0 0) 0x7f5cf0014a10 con 0x7f5cfc130600 2026-02-17T20:09:27.875 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.874+0000 7f5cf8ff9640 1 -- 10.20.193.123:0/909373323 <== mon.0 v2:10.20.193.123:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3021+0+0 (secure 0 0 0) 0x7f5cf00677d0 con 0x7f5cfc130600 2026-02-17T20:09:27.875 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.876+0000 7f5cf8ff9640 1 -- 10.20.193.123:0/909373323 <== mon.0 v2:10.20.193.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f5cf0022070 con 0x7f5cfc130600 2026-02-17T20:09:27.946 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:27.950+0000 7f5d028a9640 1 -- 10.20.193.123:0/909373323 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "osd down", "ids": ["0"]} v 0) -- 0x7f5cfc068530 con 0x7f5cfc130600 2026-02-17T20:09:27.946 INFO:tasks.ceph.mon.a.trial123.stderr:2026-02-17T20:09:27.951+0000 7f79d6122640 -1 mon.a@0(leader).osd e17 definitely_dead 0 2026-02-17T20:09:28.364 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.369+0000 7f5cf8ff9640 1 -- 10.20.193.123:0/909373323 <== mon.0 v2:10.20.193.123:3300/0 7 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f5cf0066020 con 0x7f5cfc130600 2026-02-17T20:09:28.366 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.371+0000 7f5cf8ff9640 1 -- 10.20.193.123:0/909373323 <== mon.0 v2:10.20.193.123:3300/0 8 ==== mon_command_ack([{"prefix": "osd down", "ids": ["0"]}]=0 marked down osd.0. v18) ==== 89+0+0 (secure 0 0 0) 0x7f5cf0010040 con 0x7f5cfc130600 2026-02-17T20:09:28.367 INFO:teuthology.orchestra.run.trial123.stderr:marked down osd.0. 2026-02-17T20:09:28.369 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.372+0000 7f5d028a9640 1 -- 10.20.193.123:0/909373323 >> v1:10.20.193.123:6800/115662061 conn(0x7f5ccc04f700 legacy=0x7f5ccc051bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:28.369 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.372+0000 7f5d028a9640 1 -- 10.20.193.123:0/909373323 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f5cfc130600 msgr2=0x7f5cfc132db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:28.369 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.372+0000 7f5d028a9640 1 --2- 10.20.193.123:0/909373323 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f5cfc130600 0x7f5cfc132db0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5cf000efc0 tx=0x7f5cf000c490 comp rx=0 tx=0).stop 2026-02-17T20:09:28.369 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.373+0000 7f5d028a9640 1 -- 10.20.193.123:0/909373323 shutdown_connections 2026-02-17T20:09:28.369 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.373+0000 7f5d028a9640 1 --2- 10.20.193.123:0/909373323 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f5cfc130600 0x7f5cfc132db0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:28.369 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.373+0000 7f5d028a9640 1 --2- 10.20.193.123:0/909373323 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f5cfc115920 0x7f5cfc132870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:28.369 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.373+0000 7f5d028a9640 1 --2- 10.20.193.123:0/909373323 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f5cfc114e10 0x7f5cfc132330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:28.369 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.373+0000 7f5d028a9640 1 -- 10.20.193.123:0/909373323 >> 10.20.193.123:0/909373323 conn(0x7f5cfc09e7c0 msgr2=0x7f5cfc06e820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:28.369 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.373+0000 7f5d028a9640 1 -- 10.20.193.123:0/909373323 shutdown_connections 2026-02-17T20:09:28.370 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.373+0000 7f5d028a9640 1 -- 10.20.193.123:0/909373323 wait complete. 2026-02-17T20:09:28.377 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-17T20:09:28.377 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2026-02-17T20:09:28.380 INFO:tasks.ceph.osd.0:Started 2026-02-17T20:09:28.380 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-17T20:09:28.380 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T20:09:28.429 INFO:tasks.ceph.osd.1:Stopped 2026-02-17T20:09:28.429 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 1 2026-02-17T20:09:28.501 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.501+0000 7fdf56b39640 1 Processor -- start 2026-02-17T20:09:28.501 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.501+0000 7fdf56b39640 1 -- start start 2026-02-17T20:09:28.502 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.502+0000 7fdf56b39640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fdf50130600 0x7fdf501309e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:28.502 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.502+0000 7fdf56b39640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fdf50114e10 0x7fdf50115210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:28.502 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.502+0000 7fdf56b39640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fdf50115750 0x7fdf501375d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:28.502 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.502+0000 7fdf56b39640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7fdf50130240 con 0x7fdf50114e10 2026-02-17T20:09:28.502 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.502+0000 7fdf56b39640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7fdf5009f550 con 0x7fdf50115750 2026-02-17T20:09:28.502 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.502+0000 7fdf56b39640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7fdf50071c80 con 0x7fdf50130600 2026-02-17T20:09:28.502 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.502+0000 7fdf47fff640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fdf50114e10 0x7fdf50115210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:28.502 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.502+0000 7fdf548ae640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fdf50130600 0x7fdf501309e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:28.502 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.502+0000 7fdf47fff640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fdf50114e10 0x7fdf50115210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:54618/0 (socket says 10.20.193.123:54618) 2026-02-17T20:09:28.502 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.502+0000 7fdf47fff640 1 -- 10.20.193.123:0/2880882261 learned_addr learned my addr 10.20.193.123:0/2880882261 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:28.503 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.502+0000 7fdf550af640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fdf50115750 0x7fdf501375d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:28.503 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.502+0000 7fdf47fff640 1 -- 10.20.193.123:0/2880882261 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fdf50130600 msgr2=0x7fdf501309e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:28.503 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.502+0000 7fdf47fff640 1 --2- 10.20.193.123:0/2880882261 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fdf50130600 0x7fdf501309e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:28.503 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.502+0000 7fdf47fff640 1 -- 10.20.193.123:0/2880882261 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fdf50115750 msgr2=0x7fdf501375d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:28.503 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.502+0000 7fdf47fff640 1 --2- 10.20.193.123:0/2880882261 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fdf50115750 0x7fdf501375d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:28.503 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.502+0000 7fdf47fff640 1 -- 10.20.193.123:0/2880882261 --> v2:10.20.193.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf50072050 con 0x7fdf50114e10 2026-02-17T20:09:28.503 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.502+0000 7fdf47fff640 1 --2- 10.20.193.123:0/2880882261 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fdf50114e10 0x7fdf50115210 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fdf38009970 tx=0x7fdf3802ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b1015594d93b841 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:28.503 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.502+0000 7fdf477fe640 1 -- 10.20.193.123:0/2880882261 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf3803c070 con 0x7fdf50114e10 2026-02-17T20:09:28.503 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.502+0000 7fdf477fe640 1 -- 10.20.193.123:0/2880882261 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf3802fac0 con 0x7fdf50114e10 2026-02-17T20:09:28.503 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.502+0000 7fdf477fe640 1 -- 10.20.193.123:0/2880882261 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf38037440 con 0x7fdf50114e10 2026-02-17T20:09:28.503 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.503+0000 7fdf56b39640 1 -- 10.20.193.123:0/2880882261 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fdf50114e10 msgr2=0x7fdf50115210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:28.504 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.503+0000 7fdf56b39640 1 --2- 10.20.193.123:0/2880882261 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fdf50114e10 0x7fdf50115210 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fdf38009970 tx=0x7fdf3802ee90 comp rx=0 tx=0).stop 2026-02-17T20:09:28.504 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.503+0000 7fdf56b39640 1 -- 10.20.193.123:0/2880882261 shutdown_connections 2026-02-17T20:09:28.504 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.503+0000 7fdf56b39640 1 --2- 10.20.193.123:0/2880882261 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fdf50115750 0x7fdf501375d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:28.504 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.503+0000 7fdf56b39640 1 --2- 10.20.193.123:0/2880882261 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fdf50114e10 0x7fdf50115210 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:28.504 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.503+0000 7fdf56b39640 1 --2- 10.20.193.123:0/2880882261 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fdf50130600 0x7fdf501309e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:28.504 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.503+0000 7fdf56b39640 1 -- 10.20.193.123:0/2880882261 >> 10.20.193.123:0/2880882261 conn(0x7fdf5009e7c0 msgr2=0x7fdf5009ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:28.504 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.503+0000 7fdf56b39640 1 -- 10.20.193.123:0/2880882261 shutdown_connections 2026-02-17T20:09:28.504 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.503+0000 7fdf56b39640 1 -- 10.20.193.123:0/2880882261 wait complete. 2026-02-17T20:09:28.504 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.503+0000 7fdf56b39640 1 Processor -- start 2026-02-17T20:09:28.504 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.503+0000 7fdf56b39640 1 -- start start 2026-02-17T20:09:28.504 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.504+0000 7fdf56b39640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fdf50114e10 0x7fdf5011f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:28.504 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.504+0000 7fdf56b39640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fdf50115750 0x7fdf5011fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:28.504 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.504+0000 7fdf56b39640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fdf50130600 0x7fdf501202f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:28.505 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.504+0000 7fdf56b39640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdf50116cc0 con 0x7fdf50130600 2026-02-17T20:09:28.505 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.504+0000 7fdf56b39640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7fdf50115ca0 con 0x7fdf50115750 2026-02-17T20:09:28.505 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.504+0000 7fdf56b39640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7fdf50130f20 con 0x7fdf50114e10 2026-02-17T20:09:28.505 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.504+0000 7fdf47fff640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fdf50115750 0x7fdf5011fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:28.505 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.504+0000 7fdf548ae640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fdf50114e10 0x7fdf5011f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:28.505 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.504+0000 7fdf47fff640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fdf50115750 0x7fdf5011fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:46580/0 (socket says 10.20.193.123:46580) 2026-02-17T20:09:28.505 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.504+0000 7fdf47fff640 1 -- 10.20.193.123:0/2161312417 learned_addr learned my addr 10.20.193.123:0/2161312417 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:28.505 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.504+0000 7fdf550af640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fdf50130600 0x7fdf501202f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:28.505 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.504+0000 7fdf47fff640 1 -- 10.20.193.123:0/2161312417 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fdf50114e10 msgr2=0x7fdf5011f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:28.505 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.504+0000 7fdf47fff640 1 --2- 10.20.193.123:0/2161312417 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fdf50114e10 0x7fdf5011f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:28.505 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.504+0000 7fdf47fff640 1 -- 10.20.193.123:0/2161312417 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fdf50130600 msgr2=0x7fdf501202f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:28.506 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.504+0000 7fdf47fff640 1 --2- 10.20.193.123:0/2161312417 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fdf50130600 0x7fdf501202f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:28.506 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.504+0000 7fdf47fff640 1 -- 10.20.193.123:0/2161312417 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf50122ee0 con 0x7fdf50115750 2026-02-17T20:09:28.506 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.504+0000 7fdf47fff640 1 --2- 10.20.193.123:0/2161312417 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fdf50115750 0x7fdf5011fdb0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdf3802f3a0 tx=0x7fdf380047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:28.506 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.504+0000 7fdf457fa640 1 -- 10.20.193.123:0/2161312417 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf38047070 con 0x7fdf50115750 2026-02-17T20:09:28.506 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.504+0000 7fdf56b39640 1 -- 10.20.193.123:0/2161312417 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf50121ac0 con 0x7fdf50115750 2026-02-17T20:09:28.506 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.504+0000 7fdf457fa640 1 -- 10.20.193.123:0/2161312417 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf38042430 con 0x7fdf50115750 2026-02-17T20:09:28.506 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.504+0000 7fdf457fa640 1 -- 10.20.193.123:0/2161312417 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf3803c040 con 0x7fdf50115750 2026-02-17T20:09:28.506 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.504+0000 7fdf56b39640 1 -- 10.20.193.123:0/2161312417 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf501c7470 con 0x7fdf50115750 2026-02-17T20:09:28.506 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.504+0000 7fdf56b39640 1 -- 10.20.193.123:0/2161312417 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf50115210 con 0x7fdf50115750 2026-02-17T20:09:28.506 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.505+0000 7fdf457fa640 1 -- 10.20.193.123:0/2161312417 <== mon.1 v2:10.20.193.123:3301/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7fdf3803f3c0 con 0x7fdf50115750 2026-02-17T20:09:28.506 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.505+0000 7fdf457fa640 1 -- 10.20.193.123:0/2161312417 <== mon.1 v2:10.20.193.123:3301/0 5 ==== osd_map(18..18 src has 1..18) ==== 3021+0+0 (secure 0 0 0) 0x7fdf3808b6c0 con 0x7fdf50115750 2026-02-17T20:09:28.507 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.507+0000 7fdf457fa640 1 -- 10.20.193.123:0/2161312417 <== mon.1 v2:10.20.193.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7fdf38065570 con 0x7fdf50115750 2026-02-17T20:09:28.576 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:28.580+0000 7fdf56b39640 1 -- 10.20.193.123:0/2161312417 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command({"prefix": "osd down", "ids": ["1"]} v 0) -- 0x7fdf50068530 con 0x7fdf50115750 2026-02-17T20:09:28.576 INFO:tasks.ceph.mon.a.trial123.stderr:2026-02-17T20:09:28.580+0000 7f79d6122640 -1 mon.a@0(leader).osd e18 definitely_dead 0 2026-02-17T20:09:29.369 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.373+0000 7fdf457fa640 1 -- 10.20.193.123:0/2161312417 <== mon.1 v2:10.20.193.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["1"]}]=0 marked down osd.1. v19) ==== 89+0+0 (secure 0 0 0) 0x7fdf3808a780 con 0x7fdf50115750 2026-02-17T20:09:29.370 INFO:teuthology.orchestra.run.trial123.stderr:marked down osd.1. 2026-02-17T20:09:29.372 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.375+0000 7fdf56b39640 1 -- 10.20.193.123:0/2161312417 >> v1:10.20.193.123:6800/115662061 conn(0x7fdf2004f790 legacy=0x7fdf20051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:29.372 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.375+0000 7fdf56b39640 1 -- 10.20.193.123:0/2161312417 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fdf50115750 msgr2=0x7fdf5011fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:29.372 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.375+0000 7fdf56b39640 1 --2- 10.20.193.123:0/2161312417 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fdf50115750 0x7fdf5011fdb0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdf3802f3a0 tx=0x7fdf380047c0 comp rx=0 tx=0).stop 2026-02-17T20:09:29.372 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.375+0000 7fdf56b39640 1 -- 10.20.193.123:0/2161312417 shutdown_connections 2026-02-17T20:09:29.372 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.375+0000 7fdf56b39640 1 --2- 10.20.193.123:0/2161312417 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fdf50130600 0x7fdf501202f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:29.372 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.375+0000 7fdf56b39640 1 --2- 10.20.193.123:0/2161312417 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fdf50115750 0x7fdf5011fdb0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:29.372 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.375+0000 7fdf56b39640 1 --2- 10.20.193.123:0/2161312417 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fdf50114e10 0x7fdf5011f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:29.372 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.375+0000 7fdf56b39640 1 -- 10.20.193.123:0/2161312417 >> 10.20.193.123:0/2161312417 conn(0x7fdf5009e7c0 msgr2=0x7fdf5012aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:29.373 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.375+0000 7fdf56b39640 1 -- 10.20.193.123:0/2161312417 shutdown_connections 2026-02-17T20:09:29.373 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.375+0000 7fdf56b39640 1 -- 10.20.193.123:0/2161312417 wait complete. 2026-02-17T20:09:29.380 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-17T20:09:29.380 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2026-02-17T20:09:29.382 INFO:tasks.ceph.osd.1:Started 2026-02-17T20:09:29.383 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-17T20:09:29.383 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T20:09:29.424 INFO:tasks.ceph.osd.2:Stopped 2026-02-17T20:09:29.424 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 2 2026-02-17T20:09:29.496 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.495+0000 7f1593831640 1 Processor -- start 2026-02-17T20:09:29.496 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.495+0000 7f1593831640 1 -- start start 2026-02-17T20:09:29.496 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.496+0000 7f1593831640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f158c073890 0x7f158c12d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:29.496 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.496+0000 7f1593831640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f158c135460 0x7f158c137850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:29.496 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.496+0000 7f1593831640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f158c074070 con 0x7f158c12cb80 2026-02-17T20:09:29.496 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.496+0000 7f1593831640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7f158c072e70 con 0x7f158c135460 2026-02-17T20:09:29.496 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.496+0000 7f1593831640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f158c073020 con 0x7f158c073890 2026-02-17T20:09:29.496 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.496+0000 7f15915a6640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7f158c12cb80 0x7f158c12cf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:59650/0 (socket says 10.20.193.123:59650) 2026-02-17T20:09:29.497 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.496+0000 7f15915a6640 1 -- 10.20.193.123:0/2628184084 learned_addr learned my addr 10.20.193.123:0/2628184084 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:09:29.497 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.496+0000 7f1591da7640 1 --2- 10.20.193.123:0/2628184084 >> v2:10.20.193.123:3300/0 conn(0x7f158c135460 0x7f158c137850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:29.497 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.496+0000 7f1590da5640 1 --2- 10.20.193.123:0/2628184084 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f158c073890 0x7f158c12d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:29.497 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.496+0000 7f157bfff640 1 -- 10.20.193.123:0/2628184084 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1033572087 0 0) 0x7f158c074070 con 0x7f158c12cb80 2026-02-17T20:09:29.497 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.496+0000 7f157bfff640 1 -- 10.20.193.123:0/2628184084 --> v1:10.20.193.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1574003620 con 0x7f158c12cb80 2026-02-17T20:09:29.497 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.496+0000 7f1590da5640 1 -- 10.20.193.123:0/2628184084 >> v2:10.20.193.123:3300/0 conn(0x7f158c135460 msgr2=0x7f158c137850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:29.497 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.496+0000 7f1590da5640 1 --2- 10.20.193.123:0/2628184084 >> v2:10.20.193.123:3300/0 conn(0x7f158c135460 0x7f158c137850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:29.497 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.496+0000 7f1590da5640 1 -- 10.20.193.123:0/2628184084 >> v1:10.20.193.123:6789/0 conn(0x7f158c12cb80 legacy=0x7f158c12cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:29.497 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.496+0000 7f1590da5640 1 -- 10.20.193.123:0/2628184084 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f158c138da0 con 0x7f158c073890 2026-02-17T20:09:29.497 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.496+0000 7f1591da7640 1 --2- 10.20.193.123:0/2628184084 >> v2:10.20.193.123:3300/0 conn(0x7f158c135460 0x7f158c137850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:29.497 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.496+0000 7f1590da5640 1 --2- 10.20.193.123:0/2628184084 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f158c073890 0x7f158c12d670 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f15800098a0 tx=0x7f158002ee10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d32ea78feb5182c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:29.498 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.496+0000 7f157bfff640 1 -- 10.20.193.123:0/2628184084 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f158003c070 con 0x7f158c073890 2026-02-17T20:09:29.498 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.496+0000 7f157bfff640 1 -- 10.20.193.123:0/2628184084 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f158002fad0 con 0x7f158c073890 2026-02-17T20:09:29.498 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.496+0000 7f157bfff640 1 -- 10.20.193.123:0/2628184084 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1580037440 con 0x7f158c073890 2026-02-17T20:09:29.498 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.497+0000 7f1593831640 1 -- 10.20.193.123:0/2628184084 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f158c073890 msgr2=0x7f158c12d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:29.498 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.497+0000 7f1593831640 1 --2- 10.20.193.123:0/2628184084 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f158c073890 0x7f158c12d670 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f15800098a0 tx=0x7f158002ee10 comp rx=0 tx=0).stop 2026-02-17T20:09:29.498 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.497+0000 7f1593831640 1 -- 10.20.193.123:0/2628184084 shutdown_connections 2026-02-17T20:09:29.498 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.497+0000 7f1593831640 1 --2- 10.20.193.123:0/2628184084 >> v2:10.20.193.123:3300/0 conn(0x7f158c135460 0x7f158c137850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:29.498 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.497+0000 7f1593831640 1 --2- 10.20.193.123:0/2628184084 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f158c073890 0x7f158c12d670 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:29.498 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.497+0000 7f1593831640 1 -- 10.20.193.123:0/2628184084 >> 10.20.193.123:0/2628184084 conn(0x7f158c0a30f0 msgr2=0x7f158c0a3500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:29.498 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.497+0000 7f1593831640 1 -- 10.20.193.123:0/2628184084 shutdown_connections 2026-02-17T20:09:29.498 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.497+0000 7f1593831640 1 -- 10.20.193.123:0/2628184084 wait complete. 2026-02-17T20:09:29.499 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.497+0000 7f1593831640 1 Processor -- start 2026-02-17T20:09:29.499 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.497+0000 7f1593831640 1 -- start start 2026-02-17T20:09:29.499 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.497+0000 7f1593831640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f158c073890 0x7f158c1223b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:29.499 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.497+0000 7f1593831640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f158c12cb80 0x7f158c1228f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:29.499 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.497+0000 7f1593831640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f158c135460 0x7f158c122e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:29.499 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.497+0000 7f1593831640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7f158c138220 con 0x7f158c135460 2026-02-17T20:09:29.499 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.497+0000 7f1593831640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f158c1380a0 con 0x7f158c073890 2026-02-17T20:09:29.499 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.497+0000 7f1593831640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f158c1383a0 con 0x7f158c12cb80 2026-02-17T20:09:29.499 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.497+0000 7f1590da5640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f158c12cb80 0x7f158c1228f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:29.499 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.497+0000 7f1591da7640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f158c135460 0x7f158c122e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:29.499 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.497+0000 7f1590da5640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f158c12cb80 0x7f158c1228f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:42450/0 (socket says 10.20.193.123:42450) 2026-02-17T20:09:29.499 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.497+0000 7f1590da5640 1 -- 10.20.193.123:0/2292369283 learned_addr learned my addr 10.20.193.123:0/2292369283 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:29.500 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.497+0000 7f1591da7640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f158c135460 0x7f158c122e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:54652/0 (socket says 10.20.193.123:54652) 2026-02-17T20:09:29.500 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.497+0000 7f15915a6640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f158c073890 0x7f158c1223b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:29.500 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.498+0000 7f1591da7640 1 -- 10.20.193.123:0/2292369283 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f158c12cb80 msgr2=0x7f158c1228f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:29.500 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.498+0000 7f1591da7640 1 --2- 10.20.193.123:0/2292369283 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f158c12cb80 0x7f158c1228f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:29.500 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.498+0000 7f1591da7640 1 -- 10.20.193.123:0/2292369283 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f158c073890 msgr2=0x7f158c1223b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:29.500 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.498+0000 7f1591da7640 1 --2- 10.20.193.123:0/2292369283 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f158c073890 0x7f158c1223b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:29.500 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.498+0000 7f1591da7640 1 -- 10.20.193.123:0/2292369283 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f158c125b70 con 0x7f158c135460 2026-02-17T20:09:29.500 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.498+0000 7f1590da5640 1 --2- 10.20.193.123:0/2292369283 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f158c12cb80 0x7f158c1228f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:29.500 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.498+0000 7f1591da7640 1 --2- 10.20.193.123:0/2292369283 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f158c135460 0x7f158c122e30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f158800efc0 tx=0x7f158800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:29.500 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.498+0000 7f1579ffb640 1 -- 10.20.193.123:0/2292369283 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1588018030 con 0x7f158c135460 2026-02-17T20:09:29.500 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.498+0000 7f1579ffb640 1 -- 10.20.193.123:0/2292369283 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f158800ce00 con 0x7f158c135460 2026-02-17T20:09:29.500 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.498+0000 7f1579ffb640 1 -- 10.20.193.123:0/2292369283 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1588003cb0 con 0x7f158c135460 2026-02-17T20:09:29.501 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.498+0000 7f1593831640 1 -- 10.20.193.123:0/2292369283 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f158c125e80 con 0x7f158c135460 2026-02-17T20:09:29.501 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.498+0000 7f1593831640 1 -- 10.20.193.123:0/2292369283 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f158c125510 con 0x7f158c135460 2026-02-17T20:09:29.501 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.498+0000 7f1579ffb640 1 -- 10.20.193.123:0/2292369283 <== mon.0 v2:10.20.193.123:3300/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f1588014480 con 0x7f158c135460 2026-02-17T20:09:29.501 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.498+0000 7f1593831640 1 -- 10.20.193.123:0/2292369283 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f158c138800 con 0x7f158c135460 2026-02-17T20:09:29.501 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.499+0000 7f1579ffb640 1 -- 10.20.193.123:0/2292369283 <== mon.0 v2:10.20.193.123:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3021+0+0 (secure 0 0 0) 0x7f1588067760 con 0x7f158c135460 2026-02-17T20:09:29.501 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.501+0000 7f1579ffb640 1 -- 10.20.193.123:0/2292369283 <== mon.0 v2:10.20.193.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f1588022070 con 0x7f158c135460 2026-02-17T20:09:29.572 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:29.576+0000 7f1593831640 1 -- 10.20.193.123:0/2292369283 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "osd down", "ids": ["2"]} v 0) -- 0x7f158c0770f0 con 0x7f158c135460 2026-02-17T20:09:29.572 INFO:tasks.ceph.mon.a.trial123.stderr:2026-02-17T20:09:29.576+0000 7f79d6122640 -1 mon.a@0(leader).osd e19 definitely_dead 0 2026-02-17T20:09:30.279 INFO:tasks.ceph.osd.0.trial123.stderr:2026-02-17T20:09:30.283+0000 7f11a0430780 -1 Falling back to public interface 2026-02-17T20:09:30.372 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.376+0000 7f1579ffb640 1 -- 10.20.193.123:0/2292369283 <== mon.0 v2:10.20.193.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["2"]}]=0 marked down osd.2. v20) ==== 89+0+0 (secure 0 0 0) 0x7f1588010040 con 0x7f158c135460 2026-02-17T20:09:30.372 INFO:teuthology.orchestra.run.trial123.stderr:marked down osd.2. 2026-02-17T20:09:30.374 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.378+0000 7f1593831640 1 -- 10.20.193.123:0/2292369283 >> v1:10.20.193.123:6800/115662061 conn(0x7f155c04f790 legacy=0x7f155c051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:30.374 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.378+0000 7f1593831640 1 -- 10.20.193.123:0/2292369283 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f158c135460 msgr2=0x7f158c122e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:30.374 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.378+0000 7f1593831640 1 --2- 10.20.193.123:0/2292369283 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f158c135460 0x7f158c122e30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f158800efc0 tx=0x7f158800c490 comp rx=0 tx=0).stop 2026-02-17T20:09:30.375 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.378+0000 7f1593831640 1 -- 10.20.193.123:0/2292369283 shutdown_connections 2026-02-17T20:09:30.375 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.378+0000 7f1593831640 1 --2- 10.20.193.123:0/2292369283 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f158c135460 0x7f158c122e30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:30.375 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.378+0000 7f1593831640 1 --2- 10.20.193.123:0/2292369283 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f158c12cb80 0x7f158c1228f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:30.375 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.378+0000 7f1593831640 1 --2- 10.20.193.123:0/2292369283 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f158c073890 0x7f158c1223b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:30.375 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.378+0000 7f1593831640 1 -- 10.20.193.123:0/2292369283 >> 10.20.193.123:0/2292369283 conn(0x7f158c0a30f0 msgr2=0x7f158c136b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:30.375 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.378+0000 7f1593831640 1 -- 10.20.193.123:0/2292369283 shutdown_connections 2026-02-17T20:09:30.375 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.378+0000 7f1593831640 1 -- 10.20.193.123:0/2292369283 wait complete. 2026-02-17T20:09:30.382 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-17T20:09:30.383 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2026-02-17T20:09:30.385 INFO:tasks.ceph.osd.2:Started 2026-02-17T20:09:30.385 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-17T20:09:30.385 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T20:09:30.433 INFO:tasks.ceph.osd.3:Stopped 2026-02-17T20:09:30.433 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 3 2026-02-17T20:09:30.506 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.505+0000 7fc3b22df640 1 Processor -- start 2026-02-17T20:09:30.506 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.505+0000 7fc3b22df640 1 -- start start 2026-02-17T20:09:30.506 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.506+0000 7fc3b22df640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc3ac130600 0x7fc3ac1309e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:30.506 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.506+0000 7fc3b22df640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fc3ac114e10 0x7fc3ac115210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:30.506 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.506+0000 7fc3b22df640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fc3ac115750 0x7fc3ac1375d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:30.507 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.506+0000 7fc3b22df640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7fc3ac130240 con 0x7fc3ac115750 2026-02-17T20:09:30.507 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.506+0000 7fc3b22df640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7fc3ac09f550 con 0x7fc3ac130600 2026-02-17T20:09:30.507 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.506+0000 7fc3b22df640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7fc3ac071c80 con 0x7fc3ac114e10 2026-02-17T20:09:30.507 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.506+0000 7fc3abfff640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc3ac130600 0x7fc3ac1309e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:30.507 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.506+0000 7fc3abfff640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc3ac130600 0x7fc3ac1309e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:46610/0 (socket says 10.20.193.123:46610) 2026-02-17T20:09:30.507 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.506+0000 7fc3ab7fe640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fc3ac114e10 0x7fc3ac115210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:30.507 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.506+0000 7fc3abfff640 1 -- 10.20.193.123:0/2215820249 learned_addr learned my addr 10.20.193.123:0/2215820249 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:30.507 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.506+0000 7fc3b0855640 1 --2- 10.20.193.123:0/2215820249 >> v2:10.20.193.123:3300/0 conn(0x7fc3ac115750 0x7fc3ac1375d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:30.507 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.506+0000 7fc3abfff640 1 -- 10.20.193.123:0/2215820249 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fc3ac114e10 msgr2=0x7fc3ac115210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:30.507 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.506+0000 7fc3abfff640 1 --2- 10.20.193.123:0/2215820249 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fc3ac114e10 0x7fc3ac115210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:30.507 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.506+0000 7fc3abfff640 1 -- 10.20.193.123:0/2215820249 >> v2:10.20.193.123:3300/0 conn(0x7fc3ac115750 msgr2=0x7fc3ac1375d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:30.507 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.506+0000 7fc3abfff640 1 --2- 10.20.193.123:0/2215820249 >> v2:10.20.193.123:3300/0 conn(0x7fc3ac115750 0x7fc3ac1375d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:30.508 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.506+0000 7fc3abfff640 1 -- 10.20.193.123:0/2215820249 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3ac072050 con 0x7fc3ac130600 2026-02-17T20:09:30.508 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.506+0000 7fc3b0855640 1 --2- 10.20.193.123:0/2215820249 >> v2:10.20.193.123:3300/0 conn(0x7fc3ac115750 0x7fc3ac1375d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T20:09:30.508 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.506+0000 7fc3ab7fe640 1 --2- 10.20.193.123:0/2215820249 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fc3ac114e10 0x7fc3ac115210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:30.508 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.506+0000 7fc3abfff640 1 --2- 10.20.193.123:0/2215820249 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc3ac130600 0x7fc3ac1309e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc398009970 tx=0x7fc39802ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6786b765dccba646 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:30.508 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.506+0000 7fc3aaffd640 1 -- 10.20.193.123:0/2215820249 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc39803c070 con 0x7fc3ac130600 2026-02-17T20:09:30.508 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.506+0000 7fc3aaffd640 1 -- 10.20.193.123:0/2215820249 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc39802fac0 con 0x7fc3ac130600 2026-02-17T20:09:30.508 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.506+0000 7fc3aaffd640 1 -- 10.20.193.123:0/2215820249 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc398037440 con 0x7fc3ac130600 2026-02-17T20:09:30.508 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.507+0000 7fc3b22df640 1 -- 10.20.193.123:0/2215820249 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc3ac130600 msgr2=0x7fc3ac1309e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:30.508 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.507+0000 7fc3b22df640 1 --2- 10.20.193.123:0/2215820249 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc3ac130600 0x7fc3ac1309e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc398009970 tx=0x7fc39802ee90 comp rx=0 tx=0).stop 2026-02-17T20:09:30.508 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.507+0000 7fc3b22df640 1 -- 10.20.193.123:0/2215820249 shutdown_connections 2026-02-17T20:09:30.508 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.507+0000 7fc3b22df640 1 --2- 10.20.193.123:0/2215820249 >> v2:10.20.193.123:3300/0 conn(0x7fc3ac115750 0x7fc3ac1375d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:30.508 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.507+0000 7fc3b22df640 1 --2- 10.20.193.123:0/2215820249 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fc3ac114e10 0x7fc3ac115210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:30.509 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.507+0000 7fc3b22df640 1 --2- 10.20.193.123:0/2215820249 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc3ac130600 0x7fc3ac1309e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:30.509 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.507+0000 7fc3b22df640 1 -- 10.20.193.123:0/2215820249 >> 10.20.193.123:0/2215820249 conn(0x7fc3ac09e7c0 msgr2=0x7fc3ac09ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:30.509 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.507+0000 7fc3b22df640 1 -- 10.20.193.123:0/2215820249 shutdown_connections 2026-02-17T20:09:30.509 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.507+0000 7fc3b22df640 1 -- 10.20.193.123:0/2215820249 wait complete. 2026-02-17T20:09:30.509 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.507+0000 7fc3b22df640 1 Processor -- start 2026-02-17T20:09:30.509 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.507+0000 7fc3b22df640 1 -- start start 2026-02-17T20:09:30.509 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.507+0000 7fc3b22df640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc3ac114e10 0x7fc3ac11c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:30.509 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.507+0000 7fc3b22df640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fc3ac115750 0x7fc3ac11cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:30.509 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.507+0000 7fc3b22df640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fc3ac130600 0x7fc3ac11d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:30.509 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.507+0000 7fc3b22df640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc3ac130f20 con 0x7fc3ac130600 2026-02-17T20:09:30.509 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.507+0000 7fc3b22df640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7fc3ac116cc0 con 0x7fc3ac114e10 2026-02-17T20:09:30.509 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.507+0000 7fc3b22df640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7fc3ac1310a0 con 0x7fc3ac115750 2026-02-17T20:09:30.510 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.507+0000 7fc3abfff640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc3ac114e10 0x7fc3ac11c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:30.510 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.508+0000 7fc3ab7fe640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fc3ac115750 0x7fc3ac11cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:30.510 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.508+0000 7fc3abfff640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc3ac114e10 0x7fc3ac11c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:46614/0 (socket says 10.20.193.123:46614) 2026-02-17T20:09:30.510 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.508+0000 7fc3abfff640 1 -- 10.20.193.123:0/1418870604 learned_addr learned my addr 10.20.193.123:0/1418870604 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:30.510 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.508+0000 7fc3b0855640 1 --2- 10.20.193.123:0/1418870604 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fc3ac130600 0x7fc3ac11d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:30.510 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.508+0000 7fc3abfff640 1 -- 10.20.193.123:0/1418870604 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fc3ac115750 msgr2=0x7fc3ac11cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:30.510 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.508+0000 7fc3abfff640 1 --2- 10.20.193.123:0/1418870604 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fc3ac115750 0x7fc3ac11cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:30.510 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.508+0000 7fc3abfff640 1 -- 10.20.193.123:0/1418870604 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fc3ac130600 msgr2=0x7fc3ac11d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:30.510 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.508+0000 7fc3abfff640 1 --2- 10.20.193.123:0/1418870604 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fc3ac130600 0x7fc3ac11d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:30.510 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.508+0000 7fc3abfff640 1 -- 10.20.193.123:0/1418870604 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3ac11e170 con 0x7fc3ac114e10 2026-02-17T20:09:30.510 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.508+0000 7fc3abfff640 1 --2- 10.20.193.123:0/1418870604 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc3ac114e10 0x7fc3ac11c700 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc398009aa0 tx=0x7fc3980047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:30.511 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.508+0000 7fc3a8ff9640 1 -- 10.20.193.123:0/1418870604 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc39803c040 con 0x7fc3ac114e10 2026-02-17T20:09:30.511 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.508+0000 7fc3a8ff9640 1 -- 10.20.193.123:0/1418870604 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc398045070 con 0x7fc3ac114e10 2026-02-17T20:09:30.511 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.508+0000 7fc3b22df640 1 -- 10.20.193.123:0/1418870604 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3ac11f210 con 0x7fc3ac114e10 2026-02-17T20:09:30.511 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.508+0000 7fc3a8ff9640 1 -- 10.20.193.123:0/1418870604 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc398040890 con 0x7fc3ac114e10 2026-02-17T20:09:30.511 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.508+0000 7fc3b22df640 1 -- 10.20.193.123:0/1418870604 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3ac1c72b0 con 0x7fc3ac114e10 2026-02-17T20:09:30.511 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.508+0000 7fc3b22df640 1 -- 10.20.193.123:0/1418870604 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3ac115210 con 0x7fc3ac114e10 2026-02-17T20:09:30.511 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.509+0000 7fc3a8ff9640 1 -- 10.20.193.123:0/1418870604 <== mon.1 v2:10.20.193.123:3301/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7fc39803f070 con 0x7fc3ac114e10 2026-02-17T20:09:30.511 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.509+0000 7fc3a8ff9640 1 -- 10.20.193.123:0/1418870604 <== mon.1 v2:10.20.193.123:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 3021+0+0 (secure 0 0 0) 0x7fc39808b610 con 0x7fc3ac114e10 2026-02-17T20:09:30.512 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.511+0000 7fc3a8ff9640 1 -- 10.20.193.123:0/1418870604 <== mon.1 v2:10.20.193.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7fc398065560 con 0x7fc3ac114e10 2026-02-17T20:09:30.580 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:30.585+0000 7fc3b22df640 1 -- 10.20.193.123:0/1418870604 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command({"prefix": "osd down", "ids": ["3"]} v 0) -- 0x7fc3ac068530 con 0x7fc3ac114e10 2026-02-17T20:09:30.581 INFO:tasks.ceph.mon.a.trial123.stderr:2026-02-17T20:09:30.585+0000 7f79d6122640 -1 mon.a@0(leader).osd e20 definitely_dead 0 2026-02-17T20:09:31.287 INFO:tasks.ceph.osd.1.trial123.stderr:2026-02-17T20:09:31.291+0000 7feffba2e780 -1 Falling back to public interface 2026-02-17T20:09:31.374 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.378+0000 7fc3a8ff9640 1 -- 10.20.193.123:0/1418870604 <== mon.1 v2:10.20.193.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["3"]}]=0 marked down osd.3. v21) ==== 89+0+0 (secure 0 0 0) 0x7fc39808a6d0 con 0x7fc3ac114e10 2026-02-17T20:09:31.374 INFO:teuthology.orchestra.run.trial123.stderr:marked down osd.3. 2026-02-17T20:09:31.376 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.379+0000 7fc3b22df640 1 -- 10.20.193.123:0/1418870604 >> v1:10.20.193.123:6800/115662061 conn(0x7fc37c04f790 legacy=0x7fc37c051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:31.376 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.379+0000 7fc3b22df640 1 -- 10.20.193.123:0/1418870604 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc3ac114e10 msgr2=0x7fc3ac11c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:31.376 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.379+0000 7fc3b22df640 1 --2- 10.20.193.123:0/1418870604 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc3ac114e10 0x7fc3ac11c700 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc398009aa0 tx=0x7fc3980047c0 comp rx=0 tx=0).stop 2026-02-17T20:09:31.376 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.379+0000 7fc3b22df640 1 -- 10.20.193.123:0/1418870604 shutdown_connections 2026-02-17T20:09:31.376 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.379+0000 7fc3b22df640 1 --2- 10.20.193.123:0/1418870604 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fc3ac130600 0x7fc3ac11d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:31.376 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.379+0000 7fc3b22df640 1 --2- 10.20.193.123:0/1418870604 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fc3ac115750 0x7fc3ac11cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:31.376 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.379+0000 7fc3b22df640 1 --2- 10.20.193.123:0/1418870604 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fc3ac114e10 0x7fc3ac11c700 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:31.376 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.379+0000 7fc3b22df640 1 -- 10.20.193.123:0/1418870604 >> 10.20.193.123:0/1418870604 conn(0x7fc3ac09e7c0 msgr2=0x7fc3ac06e820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:31.376 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.379+0000 7fc3b22df640 1 -- 10.20.193.123:0/1418870604 shutdown_connections 2026-02-17T20:09:31.377 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.379+0000 7fc3b22df640 1 -- 10.20.193.123:0/1418870604 wait complete. 2026-02-17T20:09:31.384 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-17T20:09:31.384 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2026-02-17T20:09:31.386 INFO:tasks.ceph.osd.3:Started 2026-02-17T20:09:31.386 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-17T20:09:31.386 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T20:09:31.455 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.455+0000 7f54d5d27640 1 Processor -- start 2026-02-17T20:09:31.456 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.455+0000 7f54d5d27640 1 -- start start 2026-02-17T20:09:31.456 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.456+0000 7f54d5d27640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f54d0071600 0x7f54d00719e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:31.456 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.456+0000 7f54d5d27640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f54d0073910 0x7f54d01347c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:31.456 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.456+0000 7f54d5d27640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f54d0071f20 0x7f54d0134d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:31.456 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.456+0000 7f54d5d27640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7f54d0074220 con 0x7f54d0073910 2026-02-17T20:09:31.456 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.456+0000 7f54d5d27640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f54d0072940 con 0x7f54d0071f20 2026-02-17T20:09:31.456 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.456+0000 7f54d5d27640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f54d0072f40 con 0x7f54d0071600 2026-02-17T20:09:31.456 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.456+0000 7f54cf7fe640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f54d0071600 0x7f54d00719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:31.457 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.456+0000 7f54cf7fe640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f54d0071600 0x7f54d00719e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:42494/0 (socket says 10.20.193.123:42494) 2026-02-17T20:09:31.457 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.456+0000 7f54ceffd640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f54d0073910 0x7f54d01347c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:31.457 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.456+0000 7f54cf7fe640 1 -- 10.20.193.123:0/4294293906 learned_addr learned my addr 10.20.193.123:0/4294293906 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:31.457 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.456+0000 7f54cffff640 1 --2- 10.20.193.123:0/4294293906 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f54d0071f20 0x7f54d0134d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:31.457 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.456+0000 7f54cf7fe640 1 -- 10.20.193.123:0/4294293906 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f54d0071f20 msgr2=0x7f54d0134d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:31.457 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.456+0000 7f54cf7fe640 1 --2- 10.20.193.123:0/4294293906 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f54d0071f20 0x7f54d0134d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:31.457 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.456+0000 7f54cf7fe640 1 -- 10.20.193.123:0/4294293906 >> v2:10.20.193.123:3300/0 conn(0x7f54d0073910 msgr2=0x7f54d01347c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:31.457 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.456+0000 7f54cf7fe640 1 --2- 10.20.193.123:0/4294293906 >> v2:10.20.193.123:3300/0 conn(0x7f54d0073910 0x7f54d01347c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:31.457 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.456+0000 7f54cf7fe640 1 -- 10.20.193.123:0/4294293906 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54d0135240 con 0x7f54d0071600 2026-02-17T20:09:31.457 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.456+0000 7f54cf7fe640 1 --2- 10.20.193.123:0/4294293906 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f54d0071600 0x7f54d00719e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f54bc0099a0 tx=0x7f54bc02ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82dd88bd31044dd server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:31.457 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.457+0000 7f54ce7fc640 1 -- 10.20.193.123:0/4294293906 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54bc03c070 con 0x7f54d0071600 2026-02-17T20:09:31.457 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.457+0000 7f54ce7fc640 1 -- 10.20.193.123:0/4294293906 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54bc02fac0 con 0x7f54d0071600 2026-02-17T20:09:31.458 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.457+0000 7f54ce7fc640 1 -- 10.20.193.123:0/4294293906 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54bc037440 con 0x7f54d0071600 2026-02-17T20:09:31.458 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.457+0000 7f54d5d27640 1 -- 10.20.193.123:0/4294293906 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f54d0071600 msgr2=0x7f54d00719e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:31.458 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.457+0000 7f54d5d27640 1 --2- 10.20.193.123:0/4294293906 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f54d0071600 0x7f54d00719e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f54bc0099a0 tx=0x7f54bc02ee90 comp rx=0 tx=0).stop 2026-02-17T20:09:31.458 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.457+0000 7f54d5d27640 1 -- 10.20.193.123:0/4294293906 shutdown_connections 2026-02-17T20:09:31.458 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.457+0000 7f54d5d27640 1 --2- 10.20.193.123:0/4294293906 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f54d0071f20 0x7f54d0134d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:31.458 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.457+0000 7f54d5d27640 1 --2- 10.20.193.123:0/4294293906 >> v2:10.20.193.123:3300/0 conn(0x7f54d0073910 0x7f54d01347c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:31.458 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.457+0000 7f54d5d27640 1 --2- 10.20.193.123:0/4294293906 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f54d0071600 0x7f54d00719e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:31.458 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.457+0000 7f54d5d27640 1 -- 10.20.193.123:0/4294293906 >> 10.20.193.123:0/4294293906 conn(0x7f54d009d6c0 msgr2=0x7f54d009dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:31.458 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.457+0000 7f54d5d27640 1 -- 10.20.193.123:0/4294293906 shutdown_connections 2026-02-17T20:09:31.458 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.457+0000 7f54d5d27640 1 -- 10.20.193.123:0/4294293906 wait complete. 2026-02-17T20:09:31.458 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.457+0000 7f54d5d27640 1 Processor -- start 2026-02-17T20:09:31.458 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.457+0000 7f54d5d27640 1 -- start start 2026-02-17T20:09:31.459 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.458+0000 7f54d5d27640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f54d0071600 0x7f54d0135890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:31.459 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.458+0000 7f54d5d27640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f54d0071f20 0x7f54d0135dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:31.459 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.458+0000 7f54d5d27640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f54d0073910 0x7f54d0136310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:31.459 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.458+0000 7f54d5d27640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7f54d013bc70 con 0x7f54d0073910 2026-02-17T20:09:31.459 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.458+0000 7f54d5d27640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f54d013baf0 con 0x7f54d0071600 2026-02-17T20:09:31.459 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.458+0000 7f54d5d27640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f54d013bdf0 con 0x7f54d0071f20 2026-02-17T20:09:31.459 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.458+0000 7f54cf7fe640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f54d0071600 0x7f54d0135890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:31.459 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.458+0000 7f54ceffd640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f54d0071f20 0x7f54d0135dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:31.459 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.458+0000 7f54cf7fe640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f54d0071600 0x7f54d0135890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:46636/0 (socket says 10.20.193.123:46636) 2026-02-17T20:09:31.459 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.458+0000 7f54cffff640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f54d0073910 0x7f54d0136310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:31.459 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.458+0000 7f54cf7fe640 1 -- 10.20.193.123:0/2906860873 learned_addr learned my addr 10.20.193.123:0/2906860873 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:31.459 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.458+0000 7f54cf7fe640 1 -- 10.20.193.123:0/2906860873 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f54d0071f20 msgr2=0x7f54d0135dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:31.460 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.458+0000 7f54cf7fe640 1 --2- 10.20.193.123:0/2906860873 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f54d0071f20 0x7f54d0135dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:31.460 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.458+0000 7f54cf7fe640 1 -- 10.20.193.123:0/2906860873 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f54d0073910 msgr2=0x7f54d0136310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:31.460 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.458+0000 7f54cf7fe640 1 --2- 10.20.193.123:0/2906860873 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f54d0073910 0x7f54d0136310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:31.460 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.458+0000 7f54cf7fe640 1 -- 10.20.193.123:0/2906860873 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54d0138210 con 0x7f54d0071600 2026-02-17T20:09:31.460 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.458+0000 7f54cf7fe640 1 --2- 10.20.193.123:0/2906860873 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f54d0071600 0x7f54d0135890 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f54bc009ad0 tx=0x7f54bc0047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:31.460 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.458+0000 7f54abfff640 1 -- 10.20.193.123:0/2906860873 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54bc047070 con 0x7f54d0071600 2026-02-17T20:09:31.460 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.458+0000 7f54abfff640 1 -- 10.20.193.123:0/2906860873 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54bc042630 con 0x7f54d0071600 2026-02-17T20:09:31.460 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.458+0000 7f54d5d27640 1 -- 10.20.193.123:0/2906860873 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54d013b890 con 0x7f54d0071600 2026-02-17T20:09:31.460 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.458+0000 7f54abfff640 1 -- 10.20.193.123:0/2906860873 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54bc03c040 con 0x7f54d0071600 2026-02-17T20:09:31.460 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.458+0000 7f54d5d27640 1 -- 10.20.193.123:0/2906860873 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f54d0136850 con 0x7f54d0071600 2026-02-17T20:09:31.460 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.459+0000 7f54d5d27640 1 -- 10.20.193.123:0/2906860873 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54d00719e0 con 0x7f54d0071600 2026-02-17T20:09:31.460 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.459+0000 7f54abfff640 1 -- 10.20.193.123:0/2906860873 <== mon.1 v2:10.20.193.123:3301/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f54bc03f3c0 con 0x7f54d0071600 2026-02-17T20:09:31.460 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.459+0000 7f54abfff640 1 -- 10.20.193.123:0/2906860873 <== mon.1 v2:10.20.193.123:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 3021+0+0 (secure 0 0 0) 0x7f54bc08b700 con 0x7f54d0071600 2026-02-17T20:09:31.461 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.461+0000 7f54abfff640 1 -- 10.20.193.123:0/2906860873 <== mon.1 v2:10.20.193.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f54bc0656d0 con 0x7f54d0071600 2026-02-17T20:09:31.526 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.530+0000 7f54d5d27640 1 -- 10.20.193.123:0/2906860873 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f54d0068530 con 0x7f54d0071600 2026-02-17T20:09:31.527 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.531+0000 7f54abfff640 1 -- 10.20.193.123:0/2906860873 <== mon.1 v2:10.20.193.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+8530 (secure 0 0 0) 0x7f54bc08a7c0 con 0x7f54d0071600 2026-02-17T20:09:31.527 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:09:31.528 INFO:teuthology.orchestra.run.trial123.stdout:{"epoch":21,"fsid":"ddf342a7-b912-46f2-b373-84d7f3b75be2","created":"2026-02-17T20:08:19.090665+0000","modified":"2026-02-17T20:09:31.377910+0000","last_up_change":"2026-02-17T20:09:31.377910+0000","last_in_change":"2026-02-17T20:08:19.810884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"quincy","min_compat_client":"jewel","require_osd_release":"quincy","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-17T20:08:27.136671+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":13,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2026-02-17T20:08:28.174323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"5cfdb97e-5584-42e3-8c32-a9b4ace549f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":18,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6801","nonce":24324}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6802","nonce":24324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6804","nonce":24324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6803","nonce":24324}]},"public_addr":"10.20.193.123:6801/24324","cluster_addr":"10.20.193.123:6802/24324","heartbeat_back_addr":"10.20.193.123:6804/24324","heartbeat_front_addr":"10.20.193.123:6803/24324","state":["exists"]},{"osd":1,"uuid":"9b7f5906-8ae8-4a34-8e71-1ba7cf3eeda1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":19,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6805","nonce":24325}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6806","nonce":24325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6808","nonce":24325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6807","nonce":24325}]},"public_addr":"10.20.193.123:6805/24325","cluster_addr":"10.20.193.123:6806/24325","heartbeat_back_addr":"10.20.193.123:6808/24325","heartbeat_front_addr":"10.20.193.123:6807/24325","state":["exists"]},{"osd":2,"uuid":"db6be5e2-fdd2-460f-bf35-269d92577824","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":20,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6809","nonce":24326}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6810","nonce":24326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6812","nonce":24326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6811","nonce":24326}]},"public_addr":"10.20.193.123:6809/24326","cluster_addr":"10.20.193.123:6810/24326","heartbeat_back_addr":"10.20.193.123:6812/24326","heartbeat_front_addr":"10.20.193.123:6811/24326","state":["exists"]},{"osd":3,"uuid":"23275d01-0d57-497c-a600-d9aeef747af2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":20,"down_at":21,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6813","nonce":24327}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6814","nonce":24327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6816","nonce":24327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6815","nonce":24327}]},"public_addr":"10.20.193.123:6813/24327","cluster_addr":"10.20.193.123:6814/24327","heartbeat_back_addr":"10.20.193.123:6816/24327","heartbeat_front_addr":"10.20.193.123:6815/24327","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:08:24.897268+0000","dead_epoch":18},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:08:24.890530+0000","dead_epoch":19},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:08:24.941602+0000","dead_epoch":20},{"osd":3,"down_stamp":"2026-02-17T20:09:31.377910+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:08:24.897001+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.123:0/3994607579":"2026-02-18T20:09:24.315453+0000","10.20.193.123:0/1995254470":"2026-02-18T20:09:24.315453+0000","10.20.193.123:0/2996849897":"2026-02-18T20:09:24.315453+0000","10.20.193.123:6800/23720":"2026-02-18T20:09:24.315453+0000","10.20.193.123:0/1130446084":"2026-02-18T20:09:24.315453+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T20:09:31.529 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.532+0000 7f54d5d27640 1 -- 10.20.193.123:0/2906860873 >> v1:10.20.193.123:6800/115662061 conn(0x7f54a004f790 legacy=0x7f54a0051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:31.529 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.532+0000 7f54d5d27640 1 -- 10.20.193.123:0/2906860873 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f54d0071600 msgr2=0x7f54d0135890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:31.529 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.532+0000 7f54d5d27640 1 --2- 10.20.193.123:0/2906860873 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f54d0071600 0x7f54d0135890 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f54bc009ad0 tx=0x7f54bc0047c0 comp rx=0 tx=0).stop 2026-02-17T20:09:31.529 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.532+0000 7f54d5d27640 1 -- 10.20.193.123:0/2906860873 shutdown_connections 2026-02-17T20:09:31.529 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.532+0000 7f54d5d27640 1 --2- 10.20.193.123:0/2906860873 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f54d0073910 0x7f54d0136310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:31.529 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.532+0000 7f54d5d27640 1 --2- 10.20.193.123:0/2906860873 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f54d0071f20 0x7f54d0135dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:31.529 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.532+0000 7f54d5d27640 1 --2- 10.20.193.123:0/2906860873 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f54d0071600 0x7f54d0135890 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:31.529 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.532+0000 7f54d5d27640 1 -- 10.20.193.123:0/2906860873 >> 10.20.193.123:0/2906860873 conn(0x7f54d009d6c0 msgr2=0x7f54d012fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:31.529 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.532+0000 7f54d5d27640 1 -- 10.20.193.123:0/2906860873 shutdown_connections 2026-02-17T20:09:31.529 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:31.532+0000 7f54d5d27640 1 -- 10.20.193.123:0/2906860873 wait complete. 2026-02-17T20:09:32.270 INFO:tasks.ceph.osd.2.trial123.stderr:2026-02-17T20:09:32.274+0000 7fc82fc11780 -1 Falling back to public interface 2026-02-17T20:09:33.291 INFO:tasks.ceph.osd.3.trial123.stderr:2026-02-17T20:09:33.295+0000 7f50dca0c780 -1 Falling back to public interface 2026-02-17T20:09:34.536 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T20:09:34.610 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.609+0000 7f3a34ddc640 1 Processor -- start 2026-02-17T20:09:34.610 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.609+0000 7f3a34ddc640 1 -- start start 2026-02-17T20:09:34.610 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.610+0000 7f3a34ddc640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f3a3012aa00 0x7f3a3012ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:34.610 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.610+0000 7f3a34ddc640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3a3012b320 0x7f3a3012df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:34.610 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.610+0000 7f3a34ddc640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a30073910 con 0x7f3a3012e460 2026-02-17T20:09:34.610 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.610+0000 7f3a34ddc640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f3a30074290 con 0x7f3a3012aa00 2026-02-17T20:09:34.610 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.610+0000 7f3a34ddc640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f3a30072fa0 con 0x7f3a3012b320 2026-02-17T20:09:34.610 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.610+0000 7f3a2dd74640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3a3012b320 0x7f3a3012df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:34.611 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.610+0000 7f3a2e575640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f3a3012aa00 0x7f3a3012ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:34.611 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.610+0000 7f3a2ed76640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7f3a3012e460 0x7f3a301352b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:59666/0 (socket says 10.20.193.123:59666) 2026-02-17T20:09:34.611 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.610+0000 7f3a2ed76640 1 -- 10.20.193.123:0/2519649879 learned_addr learned my addr 10.20.193.123:0/2519649879 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:09:34.611 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.610+0000 7f3a2d573640 1 -- 10.20.193.123:0/2519649879 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1112993461 0 0) 0x7f3a30073910 con 0x7f3a3012e460 2026-02-17T20:09:34.611 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.610+0000 7f3a2d573640 1 -- 10.20.193.123:0/2519649879 --> v1:10.20.193.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a1c003620 con 0x7f3a3012e460 2026-02-17T20:09:34.611 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.610+0000 7f3a2dd74640 1 -- 10.20.193.123:0/2519649879 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f3a3012aa00 msgr2=0x7f3a3012ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:34.611 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.610+0000 7f3a2dd74640 1 --2- 10.20.193.123:0/2519649879 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f3a3012aa00 0x7f3a3012ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:34.611 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.610+0000 7f3a2dd74640 1 -- 10.20.193.123:0/2519649879 >> v1:10.20.193.123:6789/0 conn(0x7f3a3012e460 legacy=0x7f3a301352b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:34.611 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.610+0000 7f3a2dd74640 1 -- 10.20.193.123:0/2519649879 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a3012b760 con 0x7f3a3012b320 2026-02-17T20:09:34.611 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.610+0000 7f3a2e575640 1 --2- 10.20.193.123:0/2519649879 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f3a3012aa00 0x7f3a3012ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:34.611 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.610+0000 7f3a2dd74640 1 --2- 10.20.193.123:0/2519649879 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3a3012b320 0x7f3a3012df20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3a18009900 tx=0x7f3a1802edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34c0d2d76ba1f234 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:34.612 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.611+0000 7f3a2d573640 1 -- 10.20.193.123:0/2519649879 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1803c070 con 0x7f3a3012b320 2026-02-17T20:09:34.612 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.611+0000 7f3a2d573640 1 -- 10.20.193.123:0/2519649879 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a1802fa20 con 0x7f3a3012b320 2026-02-17T20:09:34.612 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.611+0000 7f3a2d573640 1 -- 10.20.193.123:0/2519649879 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1802fdf0 con 0x7f3a3012b320 2026-02-17T20:09:34.612 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.611+0000 7f3a34ddc640 1 -- 10.20.193.123:0/2519649879 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3a3012b320 msgr2=0x7f3a3012df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:34.612 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.611+0000 7f3a34ddc640 1 --2- 10.20.193.123:0/2519649879 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3a3012b320 0x7f3a3012df20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3a18009900 tx=0x7f3a1802edf0 comp rx=0 tx=0).stop 2026-02-17T20:09:34.612 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.611+0000 7f3a34ddc640 1 -- 10.20.193.123:0/2519649879 shutdown_connections 2026-02-17T20:09:34.612 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.611+0000 7f3a34ddc640 1 --2- 10.20.193.123:0/2519649879 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3a3012b320 0x7f3a3012df20 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:34.612 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.611+0000 7f3a34ddc640 1 --2- 10.20.193.123:0/2519649879 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f3a3012aa00 0x7f3a3012ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:34.612 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.611+0000 7f3a34ddc640 1 -- 10.20.193.123:0/2519649879 >> 10.20.193.123:0/2519649879 conn(0x7f3a3009d6c0 msgr2=0x7f3a3009dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:34.612 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.611+0000 7f3a34ddc640 1 -- 10.20.193.123:0/2519649879 shutdown_connections 2026-02-17T20:09:34.612 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.611+0000 7f3a34ddc640 1 -- 10.20.193.123:0/2519649879 wait complete. 2026-02-17T20:09:34.612 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.611+0000 7f3a34ddc640 1 Processor -- start 2026-02-17T20:09:34.613 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.611+0000 7f3a34ddc640 1 -- start start 2026-02-17T20:09:34.613 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.612+0000 7f3a34ddc640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3a3012aa00 0x7f3a30114ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:34.613 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.612+0000 7f3a34ddc640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f3a3012b320 0x7f3a301153e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:34.613 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.612+0000 7f3a34ddc640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f3a3012e460 0x7f3a30115920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:34.613 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.612+0000 7f3a34ddc640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3a3012eca0 con 0x7f3a3012b320 2026-02-17T20:09:34.613 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.612+0000 7f3a34ddc640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f3a3012eb20 con 0x7f3a3012e460 2026-02-17T20:09:34.613 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.612+0000 7f3a34ddc640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f3a301369d0 con 0x7f3a3012aa00 2026-02-17T20:09:34.613 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.612+0000 7f3a2e575640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3a3012aa00 0x7f3a30114ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:34.613 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.612+0000 7f3a2ed76640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f3a3012e460 0x7f3a30115920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:34.613 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.612+0000 7f3a2dd74640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f3a3012b320 0x7f3a301153e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:34.613 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.612+0000 7f3a2e575640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3a3012aa00 0x7f3a30114ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:42518/0 (socket says 10.20.193.123:42518) 2026-02-17T20:09:34.613 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.612+0000 7f3a2e575640 1 -- 10.20.193.123:0/229436200 learned_addr learned my addr 10.20.193.123:0/229436200 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:34.614 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.612+0000 7f3a2dd74640 1 -- 10.20.193.123:0/229436200 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3a3012aa00 msgr2=0x7f3a30114ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:34.614 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.612+0000 7f3a2dd74640 1 --2- 10.20.193.123:0/229436200 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3a3012aa00 0x7f3a30114ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:34.614 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.612+0000 7f3a2dd74640 1 -- 10.20.193.123:0/229436200 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f3a3012e460 msgr2=0x7f3a30115920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:34.614 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.612+0000 7f3a2dd74640 1 --2- 10.20.193.123:0/229436200 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f3a3012e460 0x7f3a30115920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:34.614 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.612+0000 7f3a2dd74640 1 -- 10.20.193.123:0/229436200 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a301163e0 con 0x7f3a3012b320 2026-02-17T20:09:34.614 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.612+0000 7f3a2ed76640 1 --2- 10.20.193.123:0/229436200 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f3a3012e460 0x7f3a30115920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:34.614 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.612+0000 7f3a2e575640 1 --2- 10.20.193.123:0/229436200 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3a3012aa00 0x7f3a30114ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:34.614 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.612+0000 7f3a2dd74640 1 --2- 10.20.193.123:0/229436200 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f3a3012b320 0x7f3a301153e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3a18036000 tx=0x7f3a180047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:34.614 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.612+0000 7f3a16ffd640 1 -- 10.20.193.123:0/229436200 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a18046020 con 0x7f3a3012b320 2026-02-17T20:09:34.614 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.612+0000 7f3a16ffd640 1 -- 10.20.193.123:0/229436200 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a18037dc0 con 0x7f3a3012b320 2026-02-17T20:09:34.614 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.612+0000 7f3a34ddc640 1 -- 10.20.193.123:0/229436200 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a301286f0 con 0x7f3a3012b320 2026-02-17T20:09:34.614 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.612+0000 7f3a16ffd640 1 -- 10.20.193.123:0/229436200 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1803c040 con 0x7f3a3012b320 2026-02-17T20:09:34.614 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.612+0000 7f3a34ddc640 1 -- 10.20.193.123:0/229436200 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a30117670 con 0x7f3a3012b320 2026-02-17T20:09:34.615 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.613+0000 7f3a34ddc640 1 -- 10.20.193.123:0/229436200 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a3012ade0 con 0x7f3a3012b320 2026-02-17T20:09:34.615 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.613+0000 7f3a16ffd640 1 -- 10.20.193.123:0/229436200 <== mon.0 v2:10.20.193.123:3300/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f3a18042670 con 0x7f3a3012b320 2026-02-17T20:09:34.615 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.613+0000 7f3a16ffd640 1 -- 10.20.193.123:0/229436200 <== mon.0 v2:10.20.193.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3021+0+0 (secure 0 0 0) 0x7f3a1808b760 con 0x7f3a3012b320 2026-02-17T20:09:34.615 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.615+0000 7f3a16ffd640 1 -- 10.20.193.123:0/229436200 <== mon.0 v2:10.20.193.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f3a18050020 con 0x7f3a3012b320 2026-02-17T20:09:34.680 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.684+0000 7f3a34ddc640 1 -- 10.20.193.123:0/229436200 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3a30118060 con 0x7f3a3012b320 2026-02-17T20:09:34.681 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.685+0000 7f3a16ffd640 1 -- 10.20.193.123:0/229436200 <== mon.0 v2:10.20.193.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+8530 (secure 0 0 0) 0x7f3a18065610 con 0x7f3a3012b320 2026-02-17T20:09:34.681 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:09:34.682 INFO:teuthology.orchestra.run.trial123.stdout:{"epoch":21,"fsid":"ddf342a7-b912-46f2-b373-84d7f3b75be2","created":"2026-02-17T20:08:19.090665+0000","modified":"2026-02-17T20:09:31.377910+0000","last_up_change":"2026-02-17T20:09:31.377910+0000","last_in_change":"2026-02-17T20:08:19.810884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"quincy","min_compat_client":"jewel","require_osd_release":"quincy","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-17T20:08:27.136671+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":13,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2026-02-17T20:08:28.174323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"5cfdb97e-5584-42e3-8c32-a9b4ace549f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":18,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6801","nonce":24324}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6802","nonce":24324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6804","nonce":24324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6803","nonce":24324}]},"public_addr":"10.20.193.123:6801/24324","cluster_addr":"10.20.193.123:6802/24324","heartbeat_back_addr":"10.20.193.123:6804/24324","heartbeat_front_addr":"10.20.193.123:6803/24324","state":["exists"]},{"osd":1,"uuid":"9b7f5906-8ae8-4a34-8e71-1ba7cf3eeda1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":19,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6805","nonce":24325}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6806","nonce":24325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6808","nonce":24325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6807","nonce":24325}]},"public_addr":"10.20.193.123:6805/24325","cluster_addr":"10.20.193.123:6806/24325","heartbeat_back_addr":"10.20.193.123:6808/24325","heartbeat_front_addr":"10.20.193.123:6807/24325","state":["exists"]},{"osd":2,"uuid":"db6be5e2-fdd2-460f-bf35-269d92577824","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":20,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6809","nonce":24326}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6810","nonce":24326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6812","nonce":24326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6811","nonce":24326}]},"public_addr":"10.20.193.123:6809/24326","cluster_addr":"10.20.193.123:6810/24326","heartbeat_back_addr":"10.20.193.123:6812/24326","heartbeat_front_addr":"10.20.193.123:6811/24326","state":["exists"]},{"osd":3,"uuid":"23275d01-0d57-497c-a600-d9aeef747af2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":20,"down_at":21,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6813","nonce":24327}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6814","nonce":24327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6816","nonce":24327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6815","nonce":24327}]},"public_addr":"10.20.193.123:6813/24327","cluster_addr":"10.20.193.123:6814/24327","heartbeat_back_addr":"10.20.193.123:6816/24327","heartbeat_front_addr":"10.20.193.123:6815/24327","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:08:24.897268+0000","dead_epoch":18},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:08:24.890530+0000","dead_epoch":19},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:08:24.941602+0000","dead_epoch":20},{"osd":3,"down_stamp":"2026-02-17T20:09:31.377910+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:08:24.897001+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.123:0/3994607579":"2026-02-18T20:09:24.315453+0000","10.20.193.123:0/1995254470":"2026-02-18T20:09:24.315453+0000","10.20.193.123:0/2996849897":"2026-02-18T20:09:24.315453+0000","10.20.193.123:6800/23720":"2026-02-18T20:09:24.315453+0000","10.20.193.123:0/1130446084":"2026-02-18T20:09:24.315453+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T20:09:34.683 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.686+0000 7f3a34ddc640 1 -- 10.20.193.123:0/229436200 >> v1:10.20.193.123:6800/115662061 conn(0x7f39fc04f790 legacy=0x7f39fc051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:34.683 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.686+0000 7f3a34ddc640 1 -- 10.20.193.123:0/229436200 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f3a3012b320 msgr2=0x7f3a301153e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:34.683 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.686+0000 7f3a34ddc640 1 --2- 10.20.193.123:0/229436200 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f3a3012b320 0x7f3a301153e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3a18036000 tx=0x7f3a180047c0 comp rx=0 tx=0).stop 2026-02-17T20:09:34.683 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.686+0000 7f3a34ddc640 1 -- 10.20.193.123:0/229436200 shutdown_connections 2026-02-17T20:09:34.683 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.686+0000 7f3a34ddc640 1 --2- 10.20.193.123:0/229436200 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f3a3012e460 0x7f3a30115920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:34.683 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.686+0000 7f3a34ddc640 1 --2- 10.20.193.123:0/229436200 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f3a3012b320 0x7f3a301153e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:34.683 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.686+0000 7f3a34ddc640 1 --2- 10.20.193.123:0/229436200 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3a3012aa00 0x7f3a30114ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:34.683 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.686+0000 7f3a34ddc640 1 -- 10.20.193.123:0/229436200 >> 10.20.193.123:0/229436200 conn(0x7f3a3009d6c0 msgr2=0x7f3a3012c520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:34.683 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.686+0000 7f3a34ddc640 1 -- 10.20.193.123:0/229436200 shutdown_connections 2026-02-17T20:09:34.683 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:34.686+0000 7f3a34ddc640 1 -- 10.20.193.123:0/229436200 wait complete. 2026-02-17T20:09:34.912 INFO:tasks.ceph.osd.0.trial123.stderr:2026-02-17T20:09:34.916+0000 7f11a0430780 -1 osd.0 17 log_to_monitors true 2026-02-17T20:09:35.381 INFO:tasks.ceph.osd.0.trial123.stderr:2026-02-17T20:09:35.385+0000 7f119377b640 -1 osd.0 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T20:09:35.964 INFO:tasks.ceph.osd.1.trial123.stderr:2026-02-17T20:09:35.968+0000 7feffba2e780 -1 osd.1 18 log_to_monitors true 2026-02-17T20:09:36.386 INFO:tasks.ceph.osd.1.trial123.stderr:2026-02-17T20:09:36.390+0000 7fefeed7b640 -1 osd.1 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T20:09:36.930 INFO:tasks.ceph.osd.2.trial123.stderr:2026-02-17T20:09:36.934+0000 7fc82fc11780 -1 osd.2 18 log_to_monitors true 2026-02-17T20:09:37.384 INFO:tasks.ceph.osd.2.trial123.stderr:2026-02-17T20:09:37.387+0000 7fc8233e6640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T20:09:37.691 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T20:09:37.760 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.764+0000 7f3ade38d640 1 Processor -- start 2026-02-17T20:09:37.760 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.764+0000 7f3ade38d640 1 -- start start 2026-02-17T20:09:37.760 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.764+0000 7f3ade38d640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f3ad8130170 0x7f3ad8130550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:37.760 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.764+0000 7f3ade38d640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3ad812d300 0x7f3ad8138510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:37.760 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.764+0000 7f3ade38d640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ad8071e90 con 0x7f3ad8130a90 2026-02-17T20:09:37.760 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.764+0000 7f3ade38d640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7f3ad8071800 con 0x7f3ad8130170 2026-02-17T20:09:37.760 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.764+0000 7f3ade38d640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f3ad8072260 con 0x7f3ad812d300 2026-02-17T20:09:37.760 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.764+0000 7f3ad7fff640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f3ad8130170 0x7f3ad8130550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:37.760 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.764+0000 7f3adc903640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3ad812d300 0x7f3ad8138510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:37.760 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.764+0000 7f3ad7fff640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f3ad8130170 0x7f3ad8130550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:54710/0 (socket says 10.20.193.123:54710) 2026-02-17T20:09:37.761 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.764+0000 7f3ad7fff640 1 -- 10.20.193.123:0/3867044844 learned_addr learned my addr 10.20.193.123:0/3867044844 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:37.761 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.764+0000 7f3adc903640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3ad812d300 0x7f3ad8138510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:42524/0 (socket says 10.20.193.123:42524) 2026-02-17T20:09:37.761 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.764+0000 7f3ad77fe640 1 --1- 10.20.193.123:0/3867044844 >> v1:10.20.193.123:6789/0 conn(0x7f3ad8130a90 0x7f3ad812cbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:59706/0 (socket says 10.20.193.123:59706) 2026-02-17T20:09:37.761 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.764+0000 7f3ad7fff640 1 -- 10.20.193.123:0/3867044844 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3ad812d300 msgr2=0x7f3ad8138510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:37.761 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.764+0000 7f3ad7fff640 1 --2- 10.20.193.123:0/3867044844 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3ad812d300 0x7f3ad8138510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:37.761 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.764+0000 7f3ad7fff640 1 -- 10.20.193.123:0/3867044844 >> v1:10.20.193.123:6789/0 conn(0x7f3ad8130a90 legacy=0x7f3ad812cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:37.761 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.764+0000 7f3ad6ffd640 1 -- 10.20.193.123:0/3867044844 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2929366666 0 0) 0x7f3ad8071e90 con 0x7f3ad8130a90 2026-02-17T20:09:37.761 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.764+0000 7f3ad7fff640 1 -- 10.20.193.123:0/3867044844 --> v2:10.20.193.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ad8116aa0 con 0x7f3ad8130170 2026-02-17T20:09:37.761 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.765+0000 7f3ad7fff640 1 --2- 10.20.193.123:0/3867044844 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f3ad8130170 0x7f3ad8130550 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3ac4009970 tx=0x7f3ac402ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72165fbb6d765bf8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:37.761 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.765+0000 7f3ad6ffd640 1 -- 10.20.193.123:0/3867044844 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac403c070 con 0x7f3ad8130170 2026-02-17T20:09:37.761 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.765+0000 7f3ad6ffd640 1 -- 10.20.193.123:0/3867044844 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ac402fb10 con 0x7f3ad8130170 2026-02-17T20:09:37.761 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.765+0000 7f3ad6ffd640 1 -- 10.20.193.123:0/3867044844 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac4037440 con 0x7f3ad8130170 2026-02-17T20:09:37.761 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.765+0000 7f3ade38d640 1 -- 10.20.193.123:0/3867044844 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f3ad8130170 msgr2=0x7f3ad8130550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:37.761 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.765+0000 7f3ade38d640 1 --2- 10.20.193.123:0/3867044844 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f3ad8130170 0x7f3ad8130550 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3ac4009970 tx=0x7f3ac402ee90 comp rx=0 tx=0).stop 2026-02-17T20:09:37.761 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.765+0000 7f3ade38d640 1 -- 10.20.193.123:0/3867044844 shutdown_connections 2026-02-17T20:09:37.761 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.765+0000 7f3ade38d640 1 --2- 10.20.193.123:0/3867044844 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3ad812d300 0x7f3ad8138510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:37.762 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.765+0000 7f3ade38d640 1 --2- 10.20.193.123:0/3867044844 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f3ad8130170 0x7f3ad8130550 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:37.762 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.765+0000 7f3ade38d640 1 -- 10.20.193.123:0/3867044844 >> 10.20.193.123:0/3867044844 conn(0x7f3ad809d6c0 msgr2=0x7f3ad809dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:37.762 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.765+0000 7f3ade38d640 1 -- 10.20.193.123:0/3867044844 shutdown_connections 2026-02-17T20:09:37.762 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.765+0000 7f3ade38d640 1 -- 10.20.193.123:0/3867044844 wait complete. 2026-02-17T20:09:37.762 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.766+0000 7f3ade38d640 1 Processor -- start 2026-02-17T20:09:37.762 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.766+0000 7f3ade38d640 1 -- start start 2026-02-17T20:09:37.762 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.766+0000 7f3ade38d640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f3ad812d300 0x7f3ad81c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:37.762 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.766+0000 7f3ade38d640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f3ad8130170 0x7f3ad81c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:37.762 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.766+0000 7f3ade38d640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3ad8130a90 0x7f3ad8134d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:37.762 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.766+0000 7f3ade38d640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad812d8d0 con 0x7f3ad8130170 2026-02-17T20:09:37.763 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.766+0000 7f3ade38d640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f3ad812d750 con 0x7f3ad812d300 2026-02-17T20:09:37.763 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.766+0000 7f3ade38d640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f3ad812da50 con 0x7f3ad8130a90 2026-02-17T20:09:37.763 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.766+0000 7f3adc903640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3ad8130a90 0x7f3ad8134d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:37.763 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.766+0000 7f3ad77fe640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f3ad8130170 0x7f3ad81c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:37.763 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.766+0000 7f3adc903640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3ad8130a90 0x7f3ad8134d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:42530/0 (socket says 10.20.193.123:42530) 2026-02-17T20:09:37.763 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.766+0000 7f3ad7fff640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f3ad812d300 0x7f3ad81c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:37.763 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.766+0000 7f3adc903640 1 -- 10.20.193.123:0/1908149129 learned_addr learned my addr 10.20.193.123:0/1908149129 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:37.763 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.767+0000 7f3adc903640 1 -- 10.20.193.123:0/1908149129 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f3ad812d300 msgr2=0x7f3ad81c7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:37.763 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.767+0000 7f3adc903640 1 --2- 10.20.193.123:0/1908149129 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f3ad812d300 0x7f3ad81c7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:37.763 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.767+0000 7f3adc903640 1 -- 10.20.193.123:0/1908149129 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f3ad8130170 msgr2=0x7f3ad81c80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:37.763 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.767+0000 7f3adc903640 1 --2- 10.20.193.123:0/1908149129 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f3ad8130170 0x7f3ad81c80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:37.763 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.767+0000 7f3adc903640 1 -- 10.20.193.123:0/1908149129 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ad8136d40 con 0x7f3ad8130a90 2026-02-17T20:09:37.763 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.767+0000 7f3adc903640 1 --2- 10.20.193.123:0/1908149129 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3ad8130a90 0x7f3ad8134d30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3acc009d30 tx=0x7f3acc00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:37.763 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.767+0000 7f3ad4ff9640 1 -- 10.20.193.123:0/1908149129 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3acc018020 con 0x7f3ad8130a90 2026-02-17T20:09:37.763 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.767+0000 7f3ad4ff9640 1 -- 10.20.193.123:0/1908149129 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3acc014480 con 0x7f3ad8130a90 2026-02-17T20:09:37.763 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.767+0000 7f3ade38d640 1 -- 10.20.193.123:0/1908149129 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ad81c8610 con 0x7f3ad8130a90 2026-02-17T20:09:37.763 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.767+0000 7f3ad4ff9640 1 -- 10.20.193.123:0/1908149129 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3acc014870 con 0x7f3ad8130a90 2026-02-17T20:09:37.763 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.767+0000 7f3ade38d640 1 -- 10.20.193.123:0/1908149129 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ad8137b60 con 0x7f3ad8130a90 2026-02-17T20:09:37.763 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.767+0000 7f3ade38d640 1 -- 10.20.193.123:0/1908149129 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ad8130550 con 0x7f3ad8130a90 2026-02-17T20:09:37.763 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.767+0000 7f3ad4ff9640 1 -- 10.20.193.123:0/1908149129 <== mon.2 v2:10.20.193.123:3302/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f3acc014a10 con 0x7f3ad8130a90 2026-02-17T20:09:37.764 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.768+0000 7f3ad4ff9640 1 -- 10.20.193.123:0/1908149129 <== mon.2 v2:10.20.193.123:3302/0 5 ==== osd_map(24..24 src has 1..24) ==== 3021+0+0 (secure 0 0 0) 0x7f3acc067a10 con 0x7f3ad8130a90 2026-02-17T20:09:37.765 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.770+0000 7f3ad4ff9640 1 -- 10.20.193.123:0/1908149129 <== mon.2 v2:10.20.193.123:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f3ad8137b60 con 0x7f3ad8130a90 2026-02-17T20:09:37.835 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.839+0000 7f3ade38d640 1 -- 10.20.193.123:0/1908149129 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3ad8068530 con 0x7f3ad8130a90 2026-02-17T20:09:37.836 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.840+0000 7f3ad4ff9640 1 -- 10.20.193.123:0/1908149129 <== mon.2 v2:10.20.193.123:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+9050 (secure 0 0 0) 0x7f3acc022030 con 0x7f3ad8130a90 2026-02-17T20:09:37.836 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:09:37.837 INFO:teuthology.orchestra.run.trial123.stdout:{"epoch":24,"fsid":"ddf342a7-b912-46f2-b373-84d7f3b75be2","created":"2026-02-17T20:08:19.090665+0000","modified":"2026-02-17T20:09:37.383975+0000","last_up_change":"2026-02-17T20:09:37.383975+0000","last_in_change":"2026-02-17T20:08:19.810884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"quincy","min_compat_client":"jewel","require_osd_release":"quincy","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-17T20:08:27.136671+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":13,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"error_message":"pool 1 has some PGs where all OSDs are with primary_affinity 0 (at least pg 1.5), read balance score may not be reliable","score_acting":0,"score_stable":0}},{"pool":2,"pool_name":".mgr","create_time":"2026-02-17T20:08:28.174323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.25,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5cfdb97e-5584-42e3-8c32-a9b4ace549f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":17,"up_from":23,"up_thru":23,"down_at":18,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6801","nonce":458007068}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6802","nonce":458007068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6804","nonce":458007068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6803","nonce":458007068}]},"public_addr":"10.20.193.123:6801/458007068","cluster_addr":"10.20.193.123:6802/458007068","heartbeat_back_addr":"10.20.193.123:6804/458007068","heartbeat_front_addr":"10.20.193.123:6803/458007068","state":["exists","up"]},{"osd":1,"uuid":"9b7f5906-8ae8-4a34-8e71-1ba7cf3eeda1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":18,"up_from":24,"up_thru":18,"down_at":19,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6805","nonce":2594724968}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6806","nonce":2594724968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6808","nonce":2594724968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6807","nonce":2594724968}]},"public_addr":"10.20.193.123:6805/2594724968","cluster_addr":"10.20.193.123:6806/2594724968","heartbeat_back_addr":"10.20.193.123:6808/2594724968","heartbeat_front_addr":"10.20.193.123:6807/2594724968","state":["exists","up"]},{"osd":2,"uuid":"db6be5e2-fdd2-460f-bf35-269d92577824","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":20,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6809","nonce":24326}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6810","nonce":24326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6812","nonce":24326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6811","nonce":24326}]},"public_addr":"10.20.193.123:6809/24326","cluster_addr":"10.20.193.123:6810/24326","heartbeat_back_addr":"10.20.193.123:6812/24326","heartbeat_front_addr":"10.20.193.123:6811/24326","state":["exists"]},{"osd":3,"uuid":"23275d01-0d57-497c-a600-d9aeef747af2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":20,"down_at":21,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6813","nonce":24327}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6814","nonce":24327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6816","nonce":24327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6815","nonce":24327}]},"public_addr":"10.20.193.123:6813/24327","cluster_addr":"10.20.193.123:6814/24327","heartbeat_back_addr":"10.20.193.123:6816/24327","heartbeat_front_addr":"10.20.193.123:6815/24327","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:08:24.897268+0000","dead_epoch":18},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:08:24.890530+0000","dead_epoch":19},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:08:24.941602+0000","dead_epoch":20},{"osd":3,"down_stamp":"2026-02-17T20:09:31.377910+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:08:24.897001+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.123:0/3994607579":"2026-02-18T20:09:24.315453+0000","10.20.193.123:0/1995254470":"2026-02-18T20:09:24.315453+0000","10.20.193.123:0/2996849897":"2026-02-18T20:09:24.315453+0000","10.20.193.123:6800/23720":"2026-02-18T20:09:24.315453+0000","10.20.193.123:0/1130446084":"2026-02-18T20:09:24.315453+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T20:09:37.837 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.840+0000 7f3ade38d640 1 -- 10.20.193.123:0/1908149129 >> v1:10.20.193.123:6800/115662061 conn(0x7f3aa804f790 legacy=0x7f3aa8051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:37.838 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.840+0000 7f3ade38d640 1 -- 10.20.193.123:0/1908149129 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3ad8130a90 msgr2=0x7f3ad8134d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:37.838 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.840+0000 7f3ade38d640 1 --2- 10.20.193.123:0/1908149129 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3ad8130a90 0x7f3ad8134d30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3acc009d30 tx=0x7f3acc00c490 comp rx=0 tx=0).stop 2026-02-17T20:09:37.838 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.841+0000 7f3ade38d640 1 -- 10.20.193.123:0/1908149129 shutdown_connections 2026-02-17T20:09:37.838 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.841+0000 7f3ade38d640 1 --2- 10.20.193.123:0/1908149129 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3ad8130a90 0x7f3ad8134d30 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:37.838 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.841+0000 7f3ade38d640 1 --2- 10.20.193.123:0/1908149129 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f3ad8130170 0x7f3ad81c80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:37.838 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.841+0000 7f3ade38d640 1 --2- 10.20.193.123:0/1908149129 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f3ad812d300 0x7f3ad81c7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:37.838 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.841+0000 7f3ade38d640 1 -- 10.20.193.123:0/1908149129 >> 10.20.193.123:0/1908149129 conn(0x7f3ad809d6c0 msgr2=0x7f3ad812bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:37.838 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.841+0000 7f3ade38d640 1 -- 10.20.193.123:0/1908149129 shutdown_connections 2026-02-17T20:09:37.838 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:37.841+0000 7f3ade38d640 1 -- 10.20.193.123:0/1908149129 wait complete. 2026-02-17T20:09:37.989 INFO:tasks.ceph.osd.3.trial123.stderr:2026-02-17T20:09:37.993+0000 7f50dca0c780 -1 osd.3 20 log_to_monitors true 2026-02-17T20:09:38.386 INFO:tasks.ceph.osd.3.trial123.stderr:2026-02-17T20:09:38.389+0000 7f50d0109640 -1 osd.3 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T20:09:40.845 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T20:09:40.915 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.918+0000 7f45a8db4640 1 Processor -- start 2026-02-17T20:09:40.915 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.918+0000 7f45a8db4640 1 -- start start 2026-02-17T20:09:40.919 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.918+0000 7f45a8db4640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f45a4130170 0x7f45a4130550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:40.919 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.918+0000 7f45a8db4640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f45a4130a90 0x7f45a412cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:40.919 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.918+0000 7f45a8db4640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45a4071e90 con 0x7f45a412d130 2026-02-17T20:09:40.919 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.918+0000 7f45a8db4640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f45a4071800 con 0x7f45a4130a90 2026-02-17T20:09:40.919 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.918+0000 7f45a8db4640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f45a4072260 con 0x7f45a4130170 2026-02-17T20:09:40.919 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.918+0000 7f45a2575640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f45a4130170 0x7f45a4130550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:40.919 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.918+0000 7f45a1d74640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f45a4130a90 0x7f45a412cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:40.920 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.918+0000 7f45a2d76640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7f45a412d130 0x7f45a4137500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:54342/0 (socket says 10.20.193.123:54342) 2026-02-17T20:09:40.920 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.918+0000 7f45a2d76640 1 -- 10.20.193.123:0/1307366040 learned_addr learned my addr 10.20.193.123:0/1307366040 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:09:40.920 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.918+0000 7f45a1573640 1 -- 10.20.193.123:0/1307366040 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 684103997 0 0) 0x7f45a4071e90 con 0x7f45a412d130 2026-02-17T20:09:40.920 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.918+0000 7f45a1573640 1 -- 10.20.193.123:0/1307366040 --> v1:10.20.193.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4590003620 con 0x7f45a412d130 2026-02-17T20:09:40.920 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.918+0000 7f45a2575640 1 -- 10.20.193.123:0/1307366040 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f45a4130a90 msgr2=0x7f45a412cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:40.920 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.918+0000 7f45a2575640 1 --2- 10.20.193.123:0/1307366040 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f45a4130a90 0x7f45a412cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:40.920 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.918+0000 7f45a2575640 1 -- 10.20.193.123:0/1307366040 >> v1:10.20.193.123:6789/0 conn(0x7f45a412d130 legacy=0x7f45a4137500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:40.920 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.918+0000 7f45a2575640 1 -- 10.20.193.123:0/1307366040 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45a4116aa0 con 0x7f45a4130170 2026-02-17T20:09:40.920 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.918+0000 7f45a1d74640 1 --2- 10.20.193.123:0/1307366040 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f45a4130a90 0x7f45a412cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:40.920 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.919+0000 7f45a2575640 1 --2- 10.20.193.123:0/1307366040 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f45a4130170 0x7f45a4130550 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4598009900 tx=0x7f459802ede0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2416c8f9176e2b4b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:40.920 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.919+0000 7f45a1573640 1 -- 10.20.193.123:0/1307366040 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f459803c070 con 0x7f45a4130170 2026-02-17T20:09:40.920 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.919+0000 7f45a1573640 1 -- 10.20.193.123:0/1307366040 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f459802fa10 con 0x7f45a4130170 2026-02-17T20:09:40.920 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.919+0000 7f45a1573640 1 -- 10.20.193.123:0/1307366040 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f459802fde0 con 0x7f45a4130170 2026-02-17T20:09:40.921 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.919+0000 7f45a8db4640 1 -- 10.20.193.123:0/1307366040 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f45a4130170 msgr2=0x7f45a4130550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:40.921 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.919+0000 7f45a8db4640 1 --2- 10.20.193.123:0/1307366040 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f45a4130170 0x7f45a4130550 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4598009900 tx=0x7f459802ede0 comp rx=0 tx=0).stop 2026-02-17T20:09:40.921 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.919+0000 7f45a8db4640 1 -- 10.20.193.123:0/1307366040 shutdown_connections 2026-02-17T20:09:40.921 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.919+0000 7f45a8db4640 1 --2- 10.20.193.123:0/1307366040 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f45a4130a90 0x7f45a412cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:40.921 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.919+0000 7f45a8db4640 1 --2- 10.20.193.123:0/1307366040 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f45a4130170 0x7f45a4130550 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:40.921 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.919+0000 7f45a8db4640 1 -- 10.20.193.123:0/1307366040 >> 10.20.193.123:0/1307366040 conn(0x7f45a409d6c0 msgr2=0x7f45a409dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:40.921 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.919+0000 7f45a8db4640 1 -- 10.20.193.123:0/1307366040 shutdown_connections 2026-02-17T20:09:40.921 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.919+0000 7f45a8db4640 1 -- 10.20.193.123:0/1307366040 wait complete. 2026-02-17T20:09:40.921 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.920+0000 7f45a8db4640 1 Processor -- start 2026-02-17T20:09:40.921 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.920+0000 7f45a8db4640 1 -- start start 2026-02-17T20:09:40.921 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.920+0000 7f45a8db4640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f45a412d130 0x7f45a4135300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:40.921 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.920+0000 7f45a8db4640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f45a4130170 0x7f45a4135840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:40.921 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.920+0000 7f45a8db4640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f45a4130a90 0x7f45a4135d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:40.922 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.920+0000 7f45a8db4640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7f45a412d760 con 0x7f45a4130170 2026-02-17T20:09:40.922 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.920+0000 7f45a8db4640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f45a412d5e0 con 0x7f45a412d130 2026-02-17T20:09:40.922 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.920+0000 7f45a8db4640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f45a412d8e0 con 0x7f45a4130a90 2026-02-17T20:09:40.922 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.920+0000 7f45a1d74640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f45a4130170 0x7f45a4135840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:40.922 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.920+0000 7f45a2575640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f45a412d130 0x7f45a4135300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:40.922 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.920+0000 7f45a2d76640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f45a4130a90 0x7f45a4135d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:40.922 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.920+0000 7f45a1d74640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f45a4130170 0x7f45a4135840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:58056/0 (socket says 10.20.193.123:58056) 2026-02-17T20:09:40.922 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.920+0000 7f45a1d74640 1 -- 10.20.193.123:0/2416862670 learned_addr learned my addr 10.20.193.123:0/2416862670 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:40.922 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.920+0000 7f45a2575640 1 -- 10.20.193.123:0/2416862670 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f45a4130a90 msgr2=0x7f45a4135d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:40.922 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.920+0000 7f45a2575640 1 --2- 10.20.193.123:0/2416862670 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f45a4130a90 0x7f45a4135d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:40.922 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.920+0000 7f45a2575640 1 -- 10.20.193.123:0/2416862670 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f45a4130170 msgr2=0x7f45a4135840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:40.922 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.920+0000 7f45a2575640 1 --2- 10.20.193.123:0/2416862670 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f45a4130170 0x7f45a4135840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:40.923 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.920+0000 7f45a2575640 1 -- 10.20.193.123:0/2416862670 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45a4137d70 con 0x7f45a412d130 2026-02-17T20:09:40.923 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.920+0000 7f45a1d74640 1 --2- 10.20.193.123:0/2416862670 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f45a4130170 0x7f45a4135840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:40.923 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.920+0000 7f45a2575640 1 --2- 10.20.193.123:0/2416862670 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f45a412d130 0x7f45a4135300 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4598036000 tx=0x7f45980047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:40.923 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.920+0000 7f458affd640 1 -- 10.20.193.123:0/2416862670 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4598046020 con 0x7f45a412d130 2026-02-17T20:09:40.923 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.920+0000 7f458affd640 1 -- 10.20.193.123:0/2416862670 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4598037cc0 con 0x7f45a412d130 2026-02-17T20:09:40.923 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.920+0000 7f45a8db4640 1 -- 10.20.193.123:0/2416862670 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45a41373e0 con 0x7f45a412d130 2026-02-17T20:09:40.923 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.920+0000 7f458affd640 1 -- 10.20.193.123:0/2416862670 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f459803c040 con 0x7f45a412d130 2026-02-17T20:09:40.923 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.921+0000 7f45a8db4640 1 -- 10.20.193.123:0/2416862670 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f45a412a360 con 0x7f45a412d130 2026-02-17T20:09:40.923 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.921+0000 7f45a8db4640 1 -- 10.20.193.123:0/2416862670 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45a4130550 con 0x7f45a412d130 2026-02-17T20:09:40.923 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.921+0000 7f458affd640 1 -- 10.20.193.123:0/2416862670 <== mon.1 v2:10.20.193.123:3301/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f4598042670 con 0x7f45a412d130 2026-02-17T20:09:40.923 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.922+0000 7f458affd640 1 -- 10.20.193.123:0/2416862670 <== mon.1 v2:10.20.193.123:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 3021+0+0 (secure 0 0 0) 0x7f459808b740 con 0x7f45a412d130 2026-02-17T20:09:40.924 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.924+0000 7f458affd640 1 -- 10.20.193.123:0/2416862670 <== mon.1 v2:10.20.193.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f4598050020 con 0x7f45a412d130 2026-02-17T20:09:40.992 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.996+0000 7f45a8db4640 1 -- 10.20.193.123:0/2416862670 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f45a41389d0 con 0x7f45a412d130 2026-02-17T20:09:40.993 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.996+0000 7f458affd640 1 -- 10.20.193.123:0/2416862670 <== mon.1 v2:10.20.193.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+9202 (secure 0 0 0) 0x7f4598065650 con 0x7f45a412d130 2026-02-17T20:09:40.993 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:09:40.993 INFO:teuthology.orchestra.run.trial123.stdout:{"epoch":27,"fsid":"ddf342a7-b912-46f2-b373-84d7f3b75be2","created":"2026-02-17T20:08:19.090665+0000","modified":"2026-02-17T20:09:40.386461+0000","last_up_change":"2026-02-17T20:09:39.385739+0000","last_in_change":"2026-02-17T20:08:19.810884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"quincy","min_compat_client":"jewel","require_osd_release":"quincy","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-17T20:08:27.136671+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":13,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2026-02-17T20:08:28.174323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5cfdb97e-5584-42e3-8c32-a9b4ace549f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":17,"up_from":23,"up_thru":24,"down_at":18,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6801","nonce":458007068}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6802","nonce":458007068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6804","nonce":458007068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6803","nonce":458007068}]},"public_addr":"10.20.193.123:6801/458007068","cluster_addr":"10.20.193.123:6802/458007068","heartbeat_back_addr":"10.20.193.123:6804/458007068","heartbeat_front_addr":"10.20.193.123:6803/458007068","state":["exists","up"]},{"osd":1,"uuid":"9b7f5906-8ae8-4a34-8e71-1ba7cf3eeda1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":18,"up_from":24,"up_thru":26,"down_at":19,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6805","nonce":2594724968}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6806","nonce":2594724968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6808","nonce":2594724968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6807","nonce":2594724968}]},"public_addr":"10.20.193.123:6805/2594724968","cluster_addr":"10.20.193.123:6806/2594724968","heartbeat_back_addr":"10.20.193.123:6808/2594724968","heartbeat_front_addr":"10.20.193.123:6807/2594724968","state":["exists","up"]},{"osd":2,"uuid":"db6be5e2-fdd2-460f-bf35-269d92577824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":18,"up_from":25,"up_thru":26,"down_at":20,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6809","nonce":3596569166}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6810","nonce":3596569166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6812","nonce":3596569166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6811","nonce":3596569166}]},"public_addr":"10.20.193.123:6809/3596569166","cluster_addr":"10.20.193.123:6810/3596569166","heartbeat_back_addr":"10.20.193.123:6812/3596569166","heartbeat_front_addr":"10.20.193.123:6811/3596569166","state":["exists","up"]},{"osd":3,"uuid":"23275d01-0d57-497c-a600-d9aeef747af2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":20,"up_from":26,"up_thru":26,"down_at":21,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6813","nonce":2610635322}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6814","nonce":2610635322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6816","nonce":2610635322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6815","nonce":2610635322}]},"public_addr":"10.20.193.123:6813/2610635322","cluster_addr":"10.20.193.123:6814/2610635322","heartbeat_back_addr":"10.20.193.123:6816/2610635322","heartbeat_front_addr":"10.20.193.123:6815/2610635322","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:08:24.897268+0000","dead_epoch":18},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:08:24.890530+0000","dead_epoch":19},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:08:24.941602+0000","dead_epoch":20},{"osd":3,"down_stamp":"2026-02-17T20:09:31.377910+0000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:08:24.897001+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.123:0/3994607579":"2026-02-18T20:09:24.315453+0000","10.20.193.123:0/1995254470":"2026-02-18T20:09:24.315453+0000","10.20.193.123:0/2996849897":"2026-02-18T20:09:24.315453+0000","10.20.193.123:6800/23720":"2026-02-18T20:09:24.315453+0000","10.20.193.123:0/1130446084":"2026-02-18T20:09:24.315453+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T20:09:40.994 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.997+0000 7f45a8db4640 1 -- 10.20.193.123:0/2416862670 >> v1:10.20.193.123:6800/115662061 conn(0x7f457004f790 legacy=0x7f4570051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:40.994 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.997+0000 7f45a8db4640 1 -- 10.20.193.123:0/2416862670 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f45a412d130 msgr2=0x7f45a4135300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:40.995 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.997+0000 7f45a8db4640 1 --2- 10.20.193.123:0/2416862670 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f45a412d130 0x7f45a4135300 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4598036000 tx=0x7f45980047c0 comp rx=0 tx=0).stop 2026-02-17T20:09:40.995 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.997+0000 7f45a8db4640 1 -- 10.20.193.123:0/2416862670 shutdown_connections 2026-02-17T20:09:40.995 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.997+0000 7f45a8db4640 1 --2- 10.20.193.123:0/2416862670 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f45a4130a90 0x7f45a4135d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:40.995 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.997+0000 7f45a8db4640 1 --2- 10.20.193.123:0/2416862670 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f45a4130170 0x7f45a4135840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:40.995 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.997+0000 7f45a8db4640 1 --2- 10.20.193.123:0/2416862670 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f45a412d130 0x7f45a4135300 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:40.995 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.997+0000 7f45a8db4640 1 -- 10.20.193.123:0/2416862670 >> 10.20.193.123:0/2416862670 conn(0x7f45a409d6c0 msgr2=0x7f45a406e150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:40.995 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.997+0000 7f45a8db4640 1 -- 10.20.193.123:0/2416862670 shutdown_connections 2026-02-17T20:09:40.995 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:40.997+0000 7f45a8db4640 1 -- 10.20.193.123:0/2416862670 wait complete. 2026-02-17T20:09:41.002 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-17T20:09:41.002 INFO:teuthology.run_tasks:Running task exec... 2026-02-17T20:09:41.018 INFO:teuthology.task.exec:Executing custom commands... 2026-02-17T20:09:41.019 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@trial123.front.sepia.ceph.com 2026-02-17T20:09:41.019 DEBUG:teuthology.orchestra.run.trial123:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph versions' 2026-02-17T20:09:41.089 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.087+0000 7f81265b4640 1 Processor -- start 2026-02-17T20:09:41.089 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.087+0000 7f81265b4640 1 -- start start 2026-02-17T20:09:41.089 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.088+0000 7f81265b4640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f81200741b0 0x7f812008e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:41.089 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.088+0000 7f81265b4640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f8120135b00 0x7f8120137ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:41.089 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.088+0000 7f81265b4640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f812008fbc0 con 0x7f8120070b30 2026-02-17T20:09:41.089 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.088+0000 7f81265b4640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7f81200716e0 con 0x7f8120135b00 2026-02-17T20:09:41.089 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.088+0000 7f81265b4640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f812008f030 con 0x7f81200741b0 2026-02-17T20:09:41.090 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.088+0000 7f811ffff640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f81200741b0 0x7f812008e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:41.090 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.088+0000 7f8124b2a640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f8120135b00 0x7f8120137ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:41.090 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.088+0000 7f811f7fe640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7f8120070b30 0x7f812008e920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:54354/0 (socket says 10.20.193.123:54354) 2026-02-17T20:09:41.090 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.088+0000 7f811f7fe640 1 -- 10.20.193.123:0/1434113725 learned_addr learned my addr 10.20.193.123:0/1434113725 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:09:41.090 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.088+0000 7f811effd640 1 -- 10.20.193.123:0/1434113725 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1686814122 0 0) 0x7f812008fbc0 con 0x7f8120070b30 2026-02-17T20:09:41.090 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.088+0000 7f811effd640 1 -- 10.20.193.123:0/1434113725 --> v1:10.20.193.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8104003620 con 0x7f8120070b30 2026-02-17T20:09:41.090 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.088+0000 7f811ffff640 1 -- 10.20.193.123:0/1434113725 >> v2:10.20.193.123:3300/0 conn(0x7f8120135b00 msgr2=0x7f8120137ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:41.090 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.088+0000 7f811ffff640 1 --2- 10.20.193.123:0/1434113725 >> v2:10.20.193.123:3300/0 conn(0x7f8120135b00 0x7f8120137ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:41.090 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.088+0000 7f811ffff640 1 -- 10.20.193.123:0/1434113725 >> v1:10.20.193.123:6789/0 conn(0x7f8120070b30 legacy=0x7f812008e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:41.090 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.088+0000 7f811ffff640 1 -- 10.20.193.123:0/1434113725 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8120139440 con 0x7f81200741b0 2026-02-17T20:09:41.090 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.088+0000 7f8124b2a640 1 --2- 10.20.193.123:0/1434113725 >> v2:10.20.193.123:3300/0 conn(0x7f8120135b00 0x7f8120137ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:41.090 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.088+0000 7f811ffff640 1 --2- 10.20.193.123:0/1434113725 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f81200741b0 0x7f812008e3e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f810c009900 tx=0x7f810c02edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de5ddd814f7ec084 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:41.091 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.089+0000 7f811effd640 1 -- 10.20.193.123:0/1434113725 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f810c03c070 con 0x7f81200741b0 2026-02-17T20:09:41.091 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.089+0000 7f811effd640 1 -- 10.20.193.123:0/1434113725 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f810c02fa70 con 0x7f81200741b0 2026-02-17T20:09:41.091 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.089+0000 7f811effd640 1 -- 10.20.193.123:0/1434113725 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f810c02fe40 con 0x7f81200741b0 2026-02-17T20:09:41.091 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.089+0000 7f81265b4640 1 -- 10.20.193.123:0/1434113725 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f81200741b0 msgr2=0x7f812008e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:41.091 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.089+0000 7f81265b4640 1 --2- 10.20.193.123:0/1434113725 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f81200741b0 0x7f812008e3e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f810c009900 tx=0x7f810c02edf0 comp rx=0 tx=0).stop 2026-02-17T20:09:41.091 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.089+0000 7f81265b4640 1 -- 10.20.193.123:0/1434113725 shutdown_connections 2026-02-17T20:09:41.091 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.089+0000 7f81265b4640 1 --2- 10.20.193.123:0/1434113725 >> v2:10.20.193.123:3300/0 conn(0x7f8120135b00 0x7f8120137ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:41.091 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.089+0000 7f81265b4640 1 --2- 10.20.193.123:0/1434113725 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f81200741b0 0x7f812008e3e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:41.091 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.089+0000 7f81265b4640 1 -- 10.20.193.123:0/1434113725 >> 10.20.193.123:0/1434113725 conn(0x7f812009eb20 msgr2=0x7f812009ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:41.091 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.089+0000 7f81265b4640 1 -- 10.20.193.123:0/1434113725 shutdown_connections 2026-02-17T20:09:41.091 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.089+0000 7f81265b4640 1 -- 10.20.193.123:0/1434113725 wait complete. 2026-02-17T20:09:41.091 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.089+0000 7f81265b4640 1 Processor -- start 2026-02-17T20:09:41.092 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.089+0000 7f81265b4640 1 -- start start 2026-02-17T20:09:41.092 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.089+0000 7f81265b4640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f8120070b30 0x7f81201c7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:41.092 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.089+0000 7f81265b4640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f81200741b0 0x7f81201c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:41.092 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.090+0000 7f81265b4640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f8120135b00 0x7f812009a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:41.092 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.090+0000 7f81265b4640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7f81201387c0 con 0x7f8120070b30 2026-02-17T20:09:41.092 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.090+0000 7f81265b4640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f8120138640 con 0x7f81200741b0 2026-02-17T20:09:41.092 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.090+0000 7f81265b4640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f8120138940 con 0x7f8120135b00 2026-02-17T20:09:41.092 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.090+0000 7f811ffff640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f8120070b30 0x7f81201c7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:41.092 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.090+0000 7f8124b2a640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f8120135b00 0x7f812009a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:41.092 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.090+0000 7f811f7fe640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f81200741b0 0x7f81201c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:41.092 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.090+0000 7f8124b2a640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f8120135b00 0x7f812009a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:52120/0 (socket says 10.20.193.123:52120) 2026-02-17T20:09:41.093 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.090+0000 7f8124b2a640 1 -- 10.20.193.123:0/1999920890 learned_addr learned my addr 10.20.193.123:0/1999920890 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:41.093 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.090+0000 7f8124b2a640 1 -- 10.20.193.123:0/1999920890 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f81200741b0 msgr2=0x7f81201c7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:41.093 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.090+0000 7f8124b2a640 1 --2- 10.20.193.123:0/1999920890 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f81200741b0 0x7f81201c7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:41.093 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.090+0000 7f8124b2a640 1 -- 10.20.193.123:0/1999920890 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f8120070b30 msgr2=0x7f81201c7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:41.093 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.090+0000 7f8124b2a640 1 --2- 10.20.193.123:0/1999920890 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f8120070b30 0x7f81201c7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:41.093 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.090+0000 7f8124b2a640 1 -- 10.20.193.123:0/1999920890 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81201c7fc0 con 0x7f8120135b00 2026-02-17T20:09:41.093 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.090+0000 7f8124b2a640 1 --2- 10.20.193.123:0/1999920890 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f8120135b00 0x7f812009a660 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f811400efc0 tx=0x7f811400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:41.093 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.090+0000 7f811cff9640 1 -- 10.20.193.123:0/1999920890 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8114018030 con 0x7f8120135b00 2026-02-17T20:09:41.093 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.090+0000 7f811cff9640 1 -- 10.20.193.123:0/1999920890 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f811400ce00 con 0x7f8120135b00 2026-02-17T20:09:41.093 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.090+0000 7f81265b4640 1 -- 10.20.193.123:0/1999920890 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81201250c0 con 0x7f8120135b00 2026-02-17T20:09:41.093 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.090+0000 7f811cff9640 1 -- 10.20.193.123:0/1999920890 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8114003cb0 con 0x7f8120135b00 2026-02-17T20:09:41.093 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.090+0000 7f81265b4640 1 -- 10.20.193.123:0/1999920890 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f812009ad80 con 0x7f8120135b00 2026-02-17T20:09:41.094 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.090+0000 7f81265b4640 1 -- 10.20.193.123:0/1999920890 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8120138da0 con 0x7f8120135b00 2026-02-17T20:09:41.094 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.091+0000 7f811cff9640 1 -- 10.20.193.123:0/1999920890 <== mon.2 v2:10.20.193.123:3302/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f8114014480 con 0x7f8120135b00 2026-02-17T20:09:41.094 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.091+0000 7f811cff9640 1 -- 10.20.193.123:0/1999920890 <== mon.2 v2:10.20.193.123:3302/0 5 ==== osd_map(27..27 src has 1..27) ==== 3021+0+0 (secure 0 0 0) 0x7f8114067690 con 0x7f8120135b00 2026-02-17T20:09:41.094 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.093+0000 7f811cff9640 1 -- 10.20.193.123:0/1999920890 <== mon.2 v2:10.20.193.123:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f8114022070 con 0x7f8120135b00 2026-02-17T20:09:41.183 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.187+0000 7f81265b4640 1 -- 10.20.193.123:0/1999920890 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f8120069f10 con 0x7f8120135b00 2026-02-17T20:09:41.183 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.187+0000 7f811cff9640 1 -- 10.20.193.123:0/1999920890 <== mon.2 v2:10.20.193.123:3302/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+507 (secure 0 0 0) 0x7f8114010040 con 0x7f8120135b00 2026-02-17T20:09:41.184 INFO:teuthology.orchestra.run.trial123.stdout:{ 2026-02-17T20:09:41.184 INFO:teuthology.orchestra.run.trial123.stdout: "mon": { 2026-02-17T20:09:41.184 INFO:teuthology.orchestra.run.trial123.stdout: "ceph version 19.2.3-694-g0a9403ad (0a9403ad6667fb8ffa43f11d9a5d3062d3558d8e) squid (stable)": 3 2026-02-17T20:09:41.184 INFO:teuthology.orchestra.run.trial123.stdout: }, 2026-02-17T20:09:41.184 INFO:teuthology.orchestra.run.trial123.stdout: "mgr": { 2026-02-17T20:09:41.184 INFO:teuthology.orchestra.run.trial123.stdout: "ceph version 19.2.3-694-g0a9403ad (0a9403ad6667fb8ffa43f11d9a5d3062d3558d8e) squid (stable)": 2 2026-02-17T20:09:41.184 INFO:teuthology.orchestra.run.trial123.stdout: }, 2026-02-17T20:09:41.184 INFO:teuthology.orchestra.run.trial123.stdout: "osd": { 2026-02-17T20:09:41.185 INFO:teuthology.orchestra.run.trial123.stdout: "ceph version 19.2.3-694-g0a9403ad (0a9403ad6667fb8ffa43f11d9a5d3062d3558d8e) squid (stable)": 4 2026-02-17T20:09:41.185 INFO:teuthology.orchestra.run.trial123.stdout: }, 2026-02-17T20:09:41.185 INFO:teuthology.orchestra.run.trial123.stdout: "overall": { 2026-02-17T20:09:41.185 INFO:teuthology.orchestra.run.trial123.stdout: "ceph version 19.2.3-694-g0a9403ad (0a9403ad6667fb8ffa43f11d9a5d3062d3558d8e) squid (stable)": 9 2026-02-17T20:09:41.185 INFO:teuthology.orchestra.run.trial123.stdout: } 2026-02-17T20:09:41.185 INFO:teuthology.orchestra.run.trial123.stdout:} 2026-02-17T20:09:41.186 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.187+0000 7f81265b4640 1 -- 10.20.193.123:0/1999920890 >> v1:10.20.193.123:6800/115662061 conn(0x7f80f004f7c0 legacy=0x7f80f0051c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:41.186 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.187+0000 7f81265b4640 1 -- 10.20.193.123:0/1999920890 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f8120135b00 msgr2=0x7f812009a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:41.186 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.187+0000 7f81265b4640 1 --2- 10.20.193.123:0/1999920890 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f8120135b00 0x7f812009a660 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f811400efc0 tx=0x7f811400c490 comp rx=0 tx=0).stop 2026-02-17T20:09:41.186 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.187+0000 7f81265b4640 1 -- 10.20.193.123:0/1999920890 shutdown_connections 2026-02-17T20:09:41.186 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.187+0000 7f81265b4640 1 --2- 10.20.193.123:0/1999920890 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f8120135b00 0x7f812009a660 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:41.186 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.187+0000 7f81265b4640 1 --2- 10.20.193.123:0/1999920890 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f81200741b0 0x7f81201c7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:41.186 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.187+0000 7f81265b4640 1 --2- 10.20.193.123:0/1999920890 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f8120070b30 0x7f81201c7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:41.187 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.187+0000 7f81265b4640 1 -- 10.20.193.123:0/1999920890 >> 10.20.193.123:0/1999920890 conn(0x7f812009eb20 msgr2=0x7f812006f980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:41.187 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.187+0000 7f81265b4640 1 -- 10.20.193.123:0/1999920890 shutdown_connections 2026-02-17T20:09:41.187 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.187+0000 7f81265b4640 1 -- 10.20.193.123:0/1999920890 wait complete. 2026-02-17T20:09:41.192 DEBUG:teuthology.orchestra.run.trial123:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd dump -f json-pretty' 2026-02-17T20:09:41.262 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.262+0000 7fe82edef640 1 Processor -- start 2026-02-17T20:09:41.262 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.262+0000 7fe82edef640 1 -- start start 2026-02-17T20:09:41.262 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.262+0000 7fe82edef640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fe828072f90 0x7fe828135630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:41.263 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.262+0000 7fe82edef640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe828135b70 0x7fe828137f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:41.263 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.262+0000 7fe82edef640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe828072a50 con 0x7fe828071600 2026-02-17T20:09:41.263 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.262+0000 7fe82edef640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7fe828073830 con 0x7fe828072f90 2026-02-17T20:09:41.263 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.262+0000 7fe82edef640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7fe828073ad0 con 0x7fe828135b70 2026-02-17T20:09:41.263 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.262+0000 7fe82d365640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe828135b70 0x7fe828137f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:41.263 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.262+0000 7fe82cb64640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7fe828071600 0x7fe8280719e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:54356/0 (socket says 10.20.193.123:54356) 2026-02-17T20:09:41.263 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.262+0000 7fe82cb64640 1 -- 10.20.193.123:0/1953973183 learned_addr learned my addr 10.20.193.123:0/1953973183 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:09:41.263 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.262+0000 7fe81ffff640 1 --2- 10.20.193.123:0/1953973183 >> v2:10.20.193.123:3300/0 conn(0x7fe828072f90 0x7fe828135630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:41.263 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.262+0000 7fe82d365640 1 -- 10.20.193.123:0/1953973183 >> v2:10.20.193.123:3300/0 conn(0x7fe828072f90 msgr2=0x7fe828135630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:41.263 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.262+0000 7fe82d365640 1 --2- 10.20.193.123:0/1953973183 >> v2:10.20.193.123:3300/0 conn(0x7fe828072f90 0x7fe828135630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:41.263 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.262+0000 7fe82d365640 1 -- 10.20.193.123:0/1953973183 >> v1:10.20.193.123:6789/0 conn(0x7fe828071600 legacy=0x7fe8280719e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:41.264 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.262+0000 7fe82d365640 1 -- 10.20.193.123:0/1953973183 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8280720f0 con 0x7fe828135b70 2026-02-17T20:09:41.264 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.262+0000 7fe81f7fe640 1 -- 10.20.193.123:0/1953973183 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3467965094 0 0) 0x7fe828072a50 con 0x7fe828071600 2026-02-17T20:09:41.264 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.262+0000 7fe82d365640 1 --2- 10.20.193.123:0/1953973183 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe828135b70 0x7fe828137f60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe824009d90 tx=0x7fe82402f190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=805e9b1104b4d522 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:41.264 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.262+0000 7fe81f7fe640 1 -- 10.20.193.123:0/1953973183 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe82403c070 con 0x7fe828135b70 2026-02-17T20:09:41.264 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.262+0000 7fe81f7fe640 1 -- 10.20.193.123:0/1953973183 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe82402fe10 con 0x7fe828135b70 2026-02-17T20:09:41.264 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.262+0000 7fe81f7fe640 1 -- 10.20.193.123:0/1953973183 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe824037660 con 0x7fe828135b70 2026-02-17T20:09:41.264 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.262+0000 7fe82edef640 1 -- 10.20.193.123:0/1953973183 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe828135b70 msgr2=0x7fe828137f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:41.264 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.262+0000 7fe82edef640 1 --2- 10.20.193.123:0/1953973183 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe828135b70 0x7fe828137f60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe824009d90 tx=0x7fe82402f190 comp rx=0 tx=0).stop 2026-02-17T20:09:41.264 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.262+0000 7fe82edef640 1 -- 10.20.193.123:0/1953973183 shutdown_connections 2026-02-17T20:09:41.264 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.262+0000 7fe82edef640 1 --2- 10.20.193.123:0/1953973183 >> v2:10.20.193.123:3300/0 conn(0x7fe828072f90 0x7fe828135630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:41.264 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.262+0000 7fe82edef640 1 --2- 10.20.193.123:0/1953973183 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe828135b70 0x7fe828137f60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:41.264 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.262+0000 7fe82edef640 1 -- 10.20.193.123:0/1953973183 >> 10.20.193.123:0/1953973183 conn(0x7fe82806d5d0 msgr2=0x7fe82806f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:41.265 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.262+0000 7fe82edef640 1 -- 10.20.193.123:0/1953973183 shutdown_connections 2026-02-17T20:09:41.265 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.263+0000 7fe82edef640 1 -- 10.20.193.123:0/1953973183 wait complete. 2026-02-17T20:09:41.265 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.263+0000 7fe82edef640 1 Processor -- start 2026-02-17T20:09:41.265 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.263+0000 7fe82edef640 1 -- start start 2026-02-17T20:09:41.265 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.263+0000 7fe82edef640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fe828071600 0x7fe828129500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:41.265 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.263+0000 7fe82edef640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fe828072f90 0x7fe828129a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:41.265 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.263+0000 7fe82edef640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe828135b70 0x7fe828129f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:41.265 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.263+0000 7fe82edef640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe828138830 con 0x7fe828071600 2026-02-17T20:09:41.265 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.263+0000 7fe82edef640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7fe8281386b0 con 0x7fe828135b70 2026-02-17T20:09:41.265 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.263+0000 7fe82edef640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7fe8281389b0 con 0x7fe828072f90 2026-02-17T20:09:41.265 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.263+0000 7fe82cb64640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fe828071600 0x7fe828129500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:41.265 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.263+0000 7fe82cb64640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fe828071600 0x7fe828129500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:58092/0 (socket says 10.20.193.123:58092) 2026-02-17T20:09:41.265 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.263+0000 7fe81ffff640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fe828072f90 0x7fe828129a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:41.266 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.263+0000 7fe82cb64640 1 -- 10.20.193.123:0/1679254094 learned_addr learned my addr 10.20.193.123:0/1679254094 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:41.266 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.263+0000 7fe82d365640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe828135b70 0x7fe828129f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:41.266 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.263+0000 7fe82d365640 1 -- 10.20.193.123:0/1679254094 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fe828072f90 msgr2=0x7fe828129a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:41.266 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.263+0000 7fe82d365640 1 --2- 10.20.193.123:0/1679254094 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fe828072f90 0x7fe828129a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:41.266 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.263+0000 7fe82d365640 1 -- 10.20.193.123:0/1679254094 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fe828071600 msgr2=0x7fe828129500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:41.266 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.263+0000 7fe82d365640 1 --2- 10.20.193.123:0/1679254094 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fe828071600 0x7fe828129500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:41.266 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.263+0000 7fe82d365640 1 -- 10.20.193.123:0/1679254094 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8280741e0 con 0x7fe828135b70 2026-02-17T20:09:41.266 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.263+0000 7fe82cb64640 1 --2- 10.20.193.123:0/1679254094 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fe828071600 0x7fe828129500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:41.266 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.264+0000 7fe82d365640 1 --2- 10.20.193.123:0/1679254094 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe828135b70 0x7fe828129f80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe824036000 tx=0x7fe824004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:41.266 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.264+0000 7fe81d7fa640 1 -- 10.20.193.123:0/1679254094 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe824046070 con 0x7fe828135b70 2026-02-17T20:09:41.266 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.264+0000 7fe81d7fa640 1 -- 10.20.193.123:0/1679254094 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe824041460 con 0x7fe828135b70 2026-02-17T20:09:41.267 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.264+0000 7fe82edef640 1 -- 10.20.193.123:0/1679254094 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe82812bc70 con 0x7fe828135b70 2026-02-17T20:09:41.267 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.264+0000 7fe81d7fa640 1 -- 10.20.193.123:0/1679254094 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe82403c040 con 0x7fe828135b70 2026-02-17T20:09:41.267 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.264+0000 7fe82edef640 1 -- 10.20.193.123:0/1679254094 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe82812dbb0 con 0x7fe828135b70 2026-02-17T20:09:41.267 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.264+0000 7fe82edef640 1 -- 10.20.193.123:0/1679254094 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8280719e0 con 0x7fe828135b70 2026-02-17T20:09:41.267 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.264+0000 7fe81d7fa640 1 -- 10.20.193.123:0/1679254094 <== mon.1 v2:10.20.193.123:3301/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7fe824052060 con 0x7fe828135b70 2026-02-17T20:09:41.267 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.265+0000 7fe81d7fa640 1 -- 10.20.193.123:0/1679254094 <== mon.1 v2:10.20.193.123:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 3021+0+0 (secure 0 0 0) 0x7fe82408bcf0 con 0x7fe828135b70 2026-02-17T20:09:41.267 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.268+0000 7fe81d7fa640 1 -- 10.20.193.123:0/1679254094 <== mon.1 v2:10.20.193.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7fe824090070 con 0x7fe828135b70 2026-02-17T20:09:41.334 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.338+0000 7fe82edef640 1 -- 10.20.193.123:0/1679254094 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7fe828069f10 con 0x7fe828135b70 2026-02-17T20:09:41.334 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.338+0000 7fe81d7fa640 1 -- 10.20.193.123:0/1679254094 <== mon.1 v2:10.20.193.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v27) ==== 81+0+16866 (secure 0 0 0) 0x7fe824065af0 con 0x7fe828135b70 2026-02-17T20:09:41.335 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:09:41.335 INFO:teuthology.orchestra.run.trial123.stdout:{ 2026-02-17T20:09:41.335 INFO:teuthology.orchestra.run.trial123.stdout: "epoch": 27, 2026-02-17T20:09:41.335 INFO:teuthology.orchestra.run.trial123.stdout: "fsid": "ddf342a7-b912-46f2-b373-84d7f3b75be2", 2026-02-17T20:09:41.335 INFO:teuthology.orchestra.run.trial123.stdout: "created": "2026-02-17T20:08:19.090665+0000", 2026-02-17T20:09:41.335 INFO:teuthology.orchestra.run.trial123.stdout: "modified": "2026-02-17T20:09:40.386461+0000", 2026-02-17T20:09:41.335 INFO:teuthology.orchestra.run.trial123.stdout: "last_up_change": "2026-02-17T20:09:39.385739+0000", 2026-02-17T20:09:41.335 INFO:teuthology.orchestra.run.trial123.stdout: "last_in_change": "2026-02-17T20:08:19.810884+0000", 2026-02-17T20:09:41.335 INFO:teuthology.orchestra.run.trial123.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-17T20:09:41.335 INFO:teuthology.orchestra.run.trial123.stdout: "flags_num": 5799936, 2026-02-17T20:09:41.336 INFO:teuthology.orchestra.run.trial123.stdout: "flags_set": [ 2026-02-17T20:09:41.336 INFO:teuthology.orchestra.run.trial123.stdout: "pglog_hardlimit", 2026-02-17T20:09:41.336 INFO:teuthology.orchestra.run.trial123.stdout: "purged_snapdirs", 2026-02-17T20:09:41.336 INFO:teuthology.orchestra.run.trial123.stdout: "recovery_deletes", 2026-02-17T20:09:41.336 INFO:teuthology.orchestra.run.trial123.stdout: "sortbitwise" 2026-02-17T20:09:41.336 INFO:teuthology.orchestra.run.trial123.stdout: ], 2026-02-17T20:09:41.336 INFO:teuthology.orchestra.run.trial123.stdout: "crush_version": 8, 2026-02-17T20:09:41.336 INFO:teuthology.orchestra.run.trial123.stdout: "full_ratio": 0.94999998807907104, 2026-02-17T20:09:41.336 INFO:teuthology.orchestra.run.trial123.stdout: "backfillfull_ratio": 0.89999997615814209, 2026-02-17T20:09:41.336 INFO:teuthology.orchestra.run.trial123.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-17T20:09:41.336 INFO:teuthology.orchestra.run.trial123.stdout: "cluster_snapshot": "", 2026-02-17T20:09:41.336 INFO:teuthology.orchestra.run.trial123.stdout: "pool_max": 2, 2026-02-17T20:09:41.337 INFO:teuthology.orchestra.run.trial123.stdout: "max_osd": 4, 2026-02-17T20:09:41.337 INFO:teuthology.orchestra.run.trial123.stdout: "require_min_compat_client": "quincy", 2026-02-17T20:09:41.337 INFO:teuthology.orchestra.run.trial123.stdout: "min_compat_client": "jewel", 2026-02-17T20:09:41.337 INFO:teuthology.orchestra.run.trial123.stdout: "require_osd_release": "quincy", 2026-02-17T20:09:41.337 INFO:teuthology.orchestra.run.trial123.stdout: "allow_crimson": false, 2026-02-17T20:09:41.337 INFO:teuthology.orchestra.run.trial123.stdout: "pools": [ 2026-02-17T20:09:41.337 INFO:teuthology.orchestra.run.trial123.stdout: { 2026-02-17T20:09:41.337 INFO:teuthology.orchestra.run.trial123.stdout: "pool": 1, 2026-02-17T20:09:41.337 INFO:teuthology.orchestra.run.trial123.stdout: "pool_name": "rbd", 2026-02-17T20:09:41.337 INFO:teuthology.orchestra.run.trial123.stdout: "create_time": "2026-02-17T20:08:27.136671+0000", 2026-02-17T20:09:41.337 INFO:teuthology.orchestra.run.trial123.stdout: "flags": 8193, 2026-02-17T20:09:41.337 INFO:teuthology.orchestra.run.trial123.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2026-02-17T20:09:41.338 INFO:teuthology.orchestra.run.trial123.stdout: "type": 1, 2026-02-17T20:09:41.338 INFO:teuthology.orchestra.run.trial123.stdout: "size": 2, 2026-02-17T20:09:41.338 INFO:teuthology.orchestra.run.trial123.stdout: "min_size": 1, 2026-02-17T20:09:41.338 INFO:teuthology.orchestra.run.trial123.stdout: "crush_rule": 0, 2026-02-17T20:09:41.338 INFO:teuthology.orchestra.run.trial123.stdout: "peering_crush_bucket_count": 0, 2026-02-17T20:09:41.338 INFO:teuthology.orchestra.run.trial123.stdout: "peering_crush_bucket_target": 0, 2026-02-17T20:09:41.338 INFO:teuthology.orchestra.run.trial123.stdout: "peering_crush_bucket_barrier": 0, 2026-02-17T20:09:41.338 INFO:teuthology.orchestra.run.trial123.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-17T20:09:41.338 INFO:teuthology.orchestra.run.trial123.stdout: "is_stretch_pool": false, 2026-02-17T20:09:41.338 INFO:teuthology.orchestra.run.trial123.stdout: "object_hash": 2, 2026-02-17T20:09:41.338 INFO:teuthology.orchestra.run.trial123.stdout: "pg_autoscale_mode": "off", 2026-02-17T20:09:41.338 INFO:teuthology.orchestra.run.trial123.stdout: "pg_num": 8, 2026-02-17T20:09:41.339 INFO:teuthology.orchestra.run.trial123.stdout: "pg_placement_num": 8, 2026-02-17T20:09:41.339 INFO:teuthology.orchestra.run.trial123.stdout: "pg_placement_num_target": 8, 2026-02-17T20:09:41.339 INFO:teuthology.orchestra.run.trial123.stdout: "pg_num_target": 8, 2026-02-17T20:09:41.339 INFO:teuthology.orchestra.run.trial123.stdout: "pg_num_pending": 8, 2026-02-17T20:09:41.339 INFO:teuthology.orchestra.run.trial123.stdout: "last_pg_merge_meta": { 2026-02-17T20:09:41.339 INFO:teuthology.orchestra.run.trial123.stdout: "source_pgid": "0.0", 2026-02-17T20:09:41.339 INFO:teuthology.orchestra.run.trial123.stdout: "ready_epoch": 0, 2026-02-17T20:09:41.339 INFO:teuthology.orchestra.run.trial123.stdout: "last_epoch_started": 0, 2026-02-17T20:09:41.339 INFO:teuthology.orchestra.run.trial123.stdout: "last_epoch_clean": 0, 2026-02-17T20:09:41.339 INFO:teuthology.orchestra.run.trial123.stdout: "source_version": "0'0", 2026-02-17T20:09:41.339 INFO:teuthology.orchestra.run.trial123.stdout: "target_version": "0'0" 2026-02-17T20:09:41.339 INFO:teuthology.orchestra.run.trial123.stdout: }, 2026-02-17T20:09:41.339 INFO:teuthology.orchestra.run.trial123.stdout: "last_change": "13", 2026-02-17T20:09:41.340 INFO:teuthology.orchestra.run.trial123.stdout: "last_force_op_resend": "0", 2026-02-17T20:09:41.340 INFO:teuthology.orchestra.run.trial123.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-17T20:09:41.340 INFO:teuthology.orchestra.run.trial123.stdout: "last_force_op_resend_preluminous": "0", 2026-02-17T20:09:41.340 INFO:teuthology.orchestra.run.trial123.stdout: "auid": 0, 2026-02-17T20:09:41.340 INFO:teuthology.orchestra.run.trial123.stdout: "snap_mode": "selfmanaged", 2026-02-17T20:09:41.340 INFO:teuthology.orchestra.run.trial123.stdout: "snap_seq": 3, 2026-02-17T20:09:41.340 INFO:teuthology.orchestra.run.trial123.stdout: "snap_epoch": 13, 2026-02-17T20:09:41.340 INFO:teuthology.orchestra.run.trial123.stdout: "pool_snaps": [], 2026-02-17T20:09:41.340 INFO:teuthology.orchestra.run.trial123.stdout: "removed_snaps": "[]", 2026-02-17T20:09:41.340 INFO:teuthology.orchestra.run.trial123.stdout: "quota_max_bytes": 0, 2026-02-17T20:09:41.340 INFO:teuthology.orchestra.run.trial123.stdout: "quota_max_objects": 0, 2026-02-17T20:09:41.340 INFO:teuthology.orchestra.run.trial123.stdout: "tiers": [], 2026-02-17T20:09:41.340 INFO:teuthology.orchestra.run.trial123.stdout: "tier_of": -1, 2026-02-17T20:09:41.340 INFO:teuthology.orchestra.run.trial123.stdout: "read_tier": -1, 2026-02-17T20:09:41.341 INFO:teuthology.orchestra.run.trial123.stdout: "write_tier": -1, 2026-02-17T20:09:41.341 INFO:teuthology.orchestra.run.trial123.stdout: "cache_mode": "none", 2026-02-17T20:09:41.341 INFO:teuthology.orchestra.run.trial123.stdout: "target_max_bytes": 0, 2026-02-17T20:09:41.341 INFO:teuthology.orchestra.run.trial123.stdout: "target_max_objects": 0, 2026-02-17T20:09:41.341 INFO:teuthology.orchestra.run.trial123.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-17T20:09:41.341 INFO:teuthology.orchestra.run.trial123.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-17T20:09:41.341 INFO:teuthology.orchestra.run.trial123.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-17T20:09:41.341 INFO:teuthology.orchestra.run.trial123.stdout: "cache_min_flush_age": 0, 2026-02-17T20:09:41.341 INFO:teuthology.orchestra.run.trial123.stdout: "cache_min_evict_age": 0, 2026-02-17T20:09:41.341 INFO:teuthology.orchestra.run.trial123.stdout: "erasure_code_profile": "", 2026-02-17T20:09:41.341 INFO:teuthology.orchestra.run.trial123.stdout: "hit_set_params": { 2026-02-17T20:09:41.341 INFO:teuthology.orchestra.run.trial123.stdout: "type": "none" 2026-02-17T20:09:41.341 INFO:teuthology.orchestra.run.trial123.stdout: }, 2026-02-17T20:09:41.342 INFO:teuthology.orchestra.run.trial123.stdout: "hit_set_period": 0, 2026-02-17T20:09:41.342 INFO:teuthology.orchestra.run.trial123.stdout: "hit_set_count": 0, 2026-02-17T20:09:41.342 INFO:teuthology.orchestra.run.trial123.stdout: "use_gmt_hitset": true, 2026-02-17T20:09:41.342 INFO:teuthology.orchestra.run.trial123.stdout: "min_read_recency_for_promote": 0, 2026-02-17T20:09:41.342 INFO:teuthology.orchestra.run.trial123.stdout: "min_write_recency_for_promote": 0, 2026-02-17T20:09:41.342 INFO:teuthology.orchestra.run.trial123.stdout: "hit_set_grade_decay_rate": 0, 2026-02-17T20:09:41.342 INFO:teuthology.orchestra.run.trial123.stdout: "hit_set_search_last_n": 0, 2026-02-17T20:09:41.342 INFO:teuthology.orchestra.run.trial123.stdout: "grade_table": [], 2026-02-17T20:09:41.342 INFO:teuthology.orchestra.run.trial123.stdout: "stripe_width": 0, 2026-02-17T20:09:41.342 INFO:teuthology.orchestra.run.trial123.stdout: "expected_num_objects": 0, 2026-02-17T20:09:41.342 INFO:teuthology.orchestra.run.trial123.stdout: "fast_read": false, 2026-02-17T20:09:41.342 INFO:teuthology.orchestra.run.trial123.stdout: "options": {}, 2026-02-17T20:09:41.342 INFO:teuthology.orchestra.run.trial123.stdout: "application_metadata": { 2026-02-17T20:09:41.343 INFO:teuthology.orchestra.run.trial123.stdout: "rbd": {} 2026-02-17T20:09:41.343 INFO:teuthology.orchestra.run.trial123.stdout: }, 2026-02-17T20:09:41.343 INFO:teuthology.orchestra.run.trial123.stdout: "read_balance": { 2026-02-17T20:09:41.343 INFO:teuthology.orchestra.run.trial123.stdout: "score_type": "Fair distribution", 2026-02-17T20:09:41.343 INFO:teuthology.orchestra.run.trial123.stdout: "score_acting": 1.5, 2026-02-17T20:09:41.343 INFO:teuthology.orchestra.run.trial123.stdout: "score_stable": 1.5, 2026-02-17T20:09:41.343 INFO:teuthology.orchestra.run.trial123.stdout: "optimal_score": 1, 2026-02-17T20:09:41.343 INFO:teuthology.orchestra.run.trial123.stdout: "raw_score_acting": 1.5, 2026-02-17T20:09:41.343 INFO:teuthology.orchestra.run.trial123.stdout: "raw_score_stable": 1.5, 2026-02-17T20:09:41.343 INFO:teuthology.orchestra.run.trial123.stdout: "primary_affinity_weighted": 1, 2026-02-17T20:09:41.343 INFO:teuthology.orchestra.run.trial123.stdout: "average_primary_affinity": 1, 2026-02-17T20:09:41.343 INFO:teuthology.orchestra.run.trial123.stdout: "average_primary_affinity_weighted": 1 2026-02-17T20:09:41.343 INFO:teuthology.orchestra.run.trial123.stdout: } 2026-02-17T20:09:41.344 INFO:teuthology.orchestra.run.trial123.stdout: }, 2026-02-17T20:09:41.344 INFO:teuthology.orchestra.run.trial123.stdout: { 2026-02-17T20:09:41.344 INFO:teuthology.orchestra.run.trial123.stdout: "pool": 2, 2026-02-17T20:09:41.344 INFO:teuthology.orchestra.run.trial123.stdout: "pool_name": ".mgr", 2026-02-17T20:09:41.344 INFO:teuthology.orchestra.run.trial123.stdout: "create_time": "2026-02-17T20:08:28.174323+0000", 2026-02-17T20:09:41.344 INFO:teuthology.orchestra.run.trial123.stdout: "flags": 1, 2026-02-17T20:09:41.344 INFO:teuthology.orchestra.run.trial123.stdout: "flags_names": "hashpspool", 2026-02-17T20:09:41.344 INFO:teuthology.orchestra.run.trial123.stdout: "type": 1, 2026-02-17T20:09:41.344 INFO:teuthology.orchestra.run.trial123.stdout: "size": 2, 2026-02-17T20:09:41.344 INFO:teuthology.orchestra.run.trial123.stdout: "min_size": 1, 2026-02-17T20:09:41.344 INFO:teuthology.orchestra.run.trial123.stdout: "crush_rule": 0, 2026-02-17T20:09:41.344 INFO:teuthology.orchestra.run.trial123.stdout: "peering_crush_bucket_count": 0, 2026-02-17T20:09:41.344 INFO:teuthology.orchestra.run.trial123.stdout: "peering_crush_bucket_target": 0, 2026-02-17T20:09:41.345 INFO:teuthology.orchestra.run.trial123.stdout: "peering_crush_bucket_barrier": 0, 2026-02-17T20:09:41.345 INFO:teuthology.orchestra.run.trial123.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-17T20:09:41.345 INFO:teuthology.orchestra.run.trial123.stdout: "is_stretch_pool": false, 2026-02-17T20:09:41.345 INFO:teuthology.orchestra.run.trial123.stdout: "object_hash": 2, 2026-02-17T20:09:41.345 INFO:teuthology.orchestra.run.trial123.stdout: "pg_autoscale_mode": "off", 2026-02-17T20:09:41.345 INFO:teuthology.orchestra.run.trial123.stdout: "pg_num": 1, 2026-02-17T20:09:41.345 INFO:teuthology.orchestra.run.trial123.stdout: "pg_placement_num": 1, 2026-02-17T20:09:41.345 INFO:teuthology.orchestra.run.trial123.stdout: "pg_placement_num_target": 1, 2026-02-17T20:09:41.345 INFO:teuthology.orchestra.run.trial123.stdout: "pg_num_target": 1, 2026-02-17T20:09:41.345 INFO:teuthology.orchestra.run.trial123.stdout: "pg_num_pending": 1, 2026-02-17T20:09:41.345 INFO:teuthology.orchestra.run.trial123.stdout: "last_pg_merge_meta": { 2026-02-17T20:09:41.345 INFO:teuthology.orchestra.run.trial123.stdout: "source_pgid": "0.0", 2026-02-17T20:09:41.345 INFO:teuthology.orchestra.run.trial123.stdout: "ready_epoch": 0, 2026-02-17T20:09:41.346 INFO:teuthology.orchestra.run.trial123.stdout: "last_epoch_started": 0, 2026-02-17T20:09:41.346 INFO:teuthology.orchestra.run.trial123.stdout: "last_epoch_clean": 0, 2026-02-17T20:09:41.346 INFO:teuthology.orchestra.run.trial123.stdout: "source_version": "0'0", 2026-02-17T20:09:41.346 INFO:teuthology.orchestra.run.trial123.stdout: "target_version": "0'0" 2026-02-17T20:09:41.346 INFO:teuthology.orchestra.run.trial123.stdout: }, 2026-02-17T20:09:41.346 INFO:teuthology.orchestra.run.trial123.stdout: "last_change": "13", 2026-02-17T20:09:41.346 INFO:teuthology.orchestra.run.trial123.stdout: "last_force_op_resend": "0", 2026-02-17T20:09:41.346 INFO:teuthology.orchestra.run.trial123.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-17T20:09:41.346 INFO:teuthology.orchestra.run.trial123.stdout: "last_force_op_resend_preluminous": "0", 2026-02-17T20:09:41.346 INFO:teuthology.orchestra.run.trial123.stdout: "auid": 0, 2026-02-17T20:09:41.346 INFO:teuthology.orchestra.run.trial123.stdout: "snap_mode": "selfmanaged", 2026-02-17T20:09:41.346 INFO:teuthology.orchestra.run.trial123.stdout: "snap_seq": 0, 2026-02-17T20:09:41.346 INFO:teuthology.orchestra.run.trial123.stdout: "snap_epoch": 0, 2026-02-17T20:09:41.347 INFO:teuthology.orchestra.run.trial123.stdout: "pool_snaps": [], 2026-02-17T20:09:41.347 INFO:teuthology.orchestra.run.trial123.stdout: "removed_snaps": "[]", 2026-02-17T20:09:41.347 INFO:teuthology.orchestra.run.trial123.stdout: "quota_max_bytes": 0, 2026-02-17T20:09:41.347 INFO:teuthology.orchestra.run.trial123.stdout: "quota_max_objects": 0, 2026-02-17T20:09:41.347 INFO:teuthology.orchestra.run.trial123.stdout: "tiers": [], 2026-02-17T20:09:41.347 INFO:teuthology.orchestra.run.trial123.stdout: "tier_of": -1, 2026-02-17T20:09:41.347 INFO:teuthology.orchestra.run.trial123.stdout: "read_tier": -1, 2026-02-17T20:09:41.347 INFO:teuthology.orchestra.run.trial123.stdout: "write_tier": -1, 2026-02-17T20:09:41.347 INFO:teuthology.orchestra.run.trial123.stdout: "cache_mode": "none", 2026-02-17T20:09:41.347 INFO:teuthology.orchestra.run.trial123.stdout: "target_max_bytes": 0, 2026-02-17T20:09:41.347 INFO:teuthology.orchestra.run.trial123.stdout: "target_max_objects": 0, 2026-02-17T20:09:41.347 INFO:teuthology.orchestra.run.trial123.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-17T20:09:41.347 INFO:teuthology.orchestra.run.trial123.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-17T20:09:41.348 INFO:teuthology.orchestra.run.trial123.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-17T20:09:41.348 INFO:teuthology.orchestra.run.trial123.stdout: "cache_min_flush_age": 0, 2026-02-17T20:09:41.348 INFO:teuthology.orchestra.run.trial123.stdout: "cache_min_evict_age": 0, 2026-02-17T20:09:41.348 INFO:teuthology.orchestra.run.trial123.stdout: "erasure_code_profile": "", 2026-02-17T20:09:41.348 INFO:teuthology.orchestra.run.trial123.stdout: "hit_set_params": { 2026-02-17T20:09:41.348 INFO:teuthology.orchestra.run.trial123.stdout: "type": "none" 2026-02-17T20:09:41.348 INFO:teuthology.orchestra.run.trial123.stdout: }, 2026-02-17T20:09:41.348 INFO:teuthology.orchestra.run.trial123.stdout: "hit_set_period": 0, 2026-02-17T20:09:41.348 INFO:teuthology.orchestra.run.trial123.stdout: "hit_set_count": 0, 2026-02-17T20:09:41.348 INFO:teuthology.orchestra.run.trial123.stdout: "use_gmt_hitset": true, 2026-02-17T20:09:41.348 INFO:teuthology.orchestra.run.trial123.stdout: "min_read_recency_for_promote": 0, 2026-02-17T20:09:41.348 INFO:teuthology.orchestra.run.trial123.stdout: "min_write_recency_for_promote": 0, 2026-02-17T20:09:41.348 INFO:teuthology.orchestra.run.trial123.stdout: "hit_set_grade_decay_rate": 0, 2026-02-17T20:09:41.349 INFO:teuthology.orchestra.run.trial123.stdout: "hit_set_search_last_n": 0, 2026-02-17T20:09:41.349 INFO:teuthology.orchestra.run.trial123.stdout: "grade_table": [], 2026-02-17T20:09:41.349 INFO:teuthology.orchestra.run.trial123.stdout: "stripe_width": 0, 2026-02-17T20:09:41.349 INFO:teuthology.orchestra.run.trial123.stdout: "expected_num_objects": 0, 2026-02-17T20:09:41.349 INFO:teuthology.orchestra.run.trial123.stdout: "fast_read": false, 2026-02-17T20:09:41.349 INFO:teuthology.orchestra.run.trial123.stdout: "options": { 2026-02-17T20:09:41.349 INFO:teuthology.orchestra.run.trial123.stdout: "pg_num_max": 32, 2026-02-17T20:09:41.349 INFO:teuthology.orchestra.run.trial123.stdout: "pg_num_min": 1 2026-02-17T20:09:41.349 INFO:teuthology.orchestra.run.trial123.stdout: }, 2026-02-17T20:09:41.349 INFO:teuthology.orchestra.run.trial123.stdout: "application_metadata": { 2026-02-17T20:09:41.349 INFO:teuthology.orchestra.run.trial123.stdout: "mgr": {} 2026-02-17T20:09:41.349 INFO:teuthology.orchestra.run.trial123.stdout: }, 2026-02-17T20:09:41.349 INFO:teuthology.orchestra.run.trial123.stdout: "read_balance": { 2026-02-17T20:09:41.349 INFO:teuthology.orchestra.run.trial123.stdout: "score_type": "Fair distribution", 2026-02-17T20:09:41.350 INFO:teuthology.orchestra.run.trial123.stdout: "score_acting": 4, 2026-02-17T20:09:41.350 INFO:teuthology.orchestra.run.trial123.stdout: "score_stable": 4, 2026-02-17T20:09:41.350 INFO:teuthology.orchestra.run.trial123.stdout: "optimal_score": 0.5, 2026-02-17T20:09:41.350 INFO:teuthology.orchestra.run.trial123.stdout: "raw_score_acting": 2, 2026-02-17T20:09:41.350 INFO:teuthology.orchestra.run.trial123.stdout: "raw_score_stable": 2, 2026-02-17T20:09:41.350 INFO:teuthology.orchestra.run.trial123.stdout: "primary_affinity_weighted": 1, 2026-02-17T20:09:41.350 INFO:teuthology.orchestra.run.trial123.stdout: "average_primary_affinity": 1, 2026-02-17T20:09:41.350 INFO:teuthology.orchestra.run.trial123.stdout: "average_primary_affinity_weighted": 1 2026-02-17T20:09:41.350 INFO:teuthology.orchestra.run.trial123.stdout: } 2026-02-17T20:09:41.350 INFO:teuthology.orchestra.run.trial123.stdout: } 2026-02-17T20:09:41.350 INFO:teuthology.orchestra.run.trial123.stdout: ], 2026-02-17T20:09:41.350 INFO:teuthology.orchestra.run.trial123.stdout: "osds": [ 2026-02-17T20:09:41.350 INFO:teuthology.orchestra.run.trial123.stdout: { 2026-02-17T20:09:41.351 INFO:teuthology.orchestra.run.trial123.stdout: "osd": 0, 2026-02-17T20:09:41.351 INFO:teuthology.orchestra.run.trial123.stdout: "uuid": "5cfdb97e-5584-42e3-8c32-a9b4ace549f6", 2026-02-17T20:09:41.351 INFO:teuthology.orchestra.run.trial123.stdout: "up": 1, 2026-02-17T20:09:41.351 INFO:teuthology.orchestra.run.trial123.stdout: "in": 1, 2026-02-17T20:09:41.351 INFO:teuthology.orchestra.run.trial123.stdout: "weight": 1, 2026-02-17T20:09:41.351 INFO:teuthology.orchestra.run.trial123.stdout: "primary_affinity": 1, 2026-02-17T20:09:41.351 INFO:teuthology.orchestra.run.trial123.stdout: "last_clean_begin": 9, 2026-02-17T20:09:41.351 INFO:teuthology.orchestra.run.trial123.stdout: "last_clean_end": 17, 2026-02-17T20:09:41.351 INFO:teuthology.orchestra.run.trial123.stdout: "up_from": 23, 2026-02-17T20:09:41.351 INFO:teuthology.orchestra.run.trial123.stdout: "up_thru": 24, 2026-02-17T20:09:41.351 INFO:teuthology.orchestra.run.trial123.stdout: "down_at": 18, 2026-02-17T20:09:41.351 INFO:teuthology.orchestra.run.trial123.stdout: "lost_at": 0, 2026-02-17T20:09:41.351 INFO:teuthology.orchestra.run.trial123.stdout: "public_addrs": { 2026-02-17T20:09:41.352 INFO:teuthology.orchestra.run.trial123.stdout: "addrvec": [ 2026-02-17T20:09:41.352 INFO:teuthology.orchestra.run.trial123.stdout: { 2026-02-17T20:09:41.352 INFO:teuthology.orchestra.run.trial123.stdout: "type": "v1", 2026-02-17T20:09:41.352 INFO:teuthology.orchestra.run.trial123.stdout: "addr": "10.20.193.123:6801", 2026-02-17T20:09:41.352 INFO:teuthology.orchestra.run.trial123.stdout: "nonce": 458007068 2026-02-17T20:09:41.352 INFO:teuthology.orchestra.run.trial123.stdout: } 2026-02-17T20:09:41.352 INFO:teuthology.orchestra.run.trial123.stdout: ] 2026-02-17T20:09:41.352 INFO:teuthology.orchestra.run.trial123.stdout: }, 2026-02-17T20:09:41.352 INFO:teuthology.orchestra.run.trial123.stdout: "cluster_addrs": { 2026-02-17T20:09:41.352 INFO:teuthology.orchestra.run.trial123.stdout: "addrvec": [ 2026-02-17T20:09:41.352 INFO:teuthology.orchestra.run.trial123.stdout: { 2026-02-17T20:09:41.352 INFO:teuthology.orchestra.run.trial123.stdout: "type": "v1", 2026-02-17T20:09:41.352 INFO:teuthology.orchestra.run.trial123.stdout: "addr": "10.20.193.123:6802", 2026-02-17T20:09:41.352 INFO:teuthology.orchestra.run.trial123.stdout: "nonce": 458007068 2026-02-17T20:09:41.353 INFO:teuthology.orchestra.run.trial123.stdout: } 2026-02-17T20:09:41.353 INFO:teuthology.orchestra.run.trial123.stdout: ] 2026-02-17T20:09:41.353 INFO:teuthology.orchestra.run.trial123.stdout: }, 2026-02-17T20:09:41.353 INFO:teuthology.orchestra.run.trial123.stdout: "heartbeat_back_addrs": { 2026-02-17T20:09:41.353 INFO:teuthology.orchestra.run.trial123.stdout: "addrvec": [ 2026-02-17T20:09:41.353 INFO:teuthology.orchestra.run.trial123.stdout: { 2026-02-17T20:09:41.353 INFO:teuthology.orchestra.run.trial123.stdout: "type": "v1", 2026-02-17T20:09:41.353 INFO:teuthology.orchestra.run.trial123.stdout: "addr": "10.20.193.123:6804", 2026-02-17T20:09:41.353 INFO:teuthology.orchestra.run.trial123.stdout: "nonce": 458007068 2026-02-17T20:09:41.353 INFO:teuthology.orchestra.run.trial123.stdout: } 2026-02-17T20:09:41.353 INFO:teuthology.orchestra.run.trial123.stdout: ] 2026-02-17T20:09:41.353 INFO:teuthology.orchestra.run.trial123.stdout: }, 2026-02-17T20:09:41.354 INFO:teuthology.orchestra.run.trial123.stdout: "heartbeat_front_addrs": { 2026-02-17T20:09:41.354 INFO:teuthology.orchestra.run.trial123.stdout: "addrvec": [ 2026-02-17T20:09:41.354 INFO:teuthology.orchestra.run.trial123.stdout: { 2026-02-17T20:09:41.354 INFO:teuthology.orchestra.run.trial123.stdout: "type": "v1", 2026-02-17T20:09:41.354 INFO:teuthology.orchestra.run.trial123.stdout: "addr": "10.20.193.123:6803", 2026-02-17T20:09:41.354 INFO:teuthology.orchestra.run.trial123.stdout: "nonce": 458007068 2026-02-17T20:09:41.354 INFO:teuthology.orchestra.run.trial123.stdout: } 2026-02-17T20:09:41.354 INFO:teuthology.orchestra.run.trial123.stdout: ] 2026-02-17T20:09:41.354 INFO:teuthology.orchestra.run.trial123.stdout: }, 2026-02-17T20:09:41.354 INFO:teuthology.orchestra.run.trial123.stdout: "public_addr": "10.20.193.123:6801/458007068", 2026-02-17T20:09:41.354 INFO:teuthology.orchestra.run.trial123.stdout: "cluster_addr": "10.20.193.123:6802/458007068", 2026-02-17T20:09:41.354 INFO:teuthology.orchestra.run.trial123.stdout: "heartbeat_back_addr": "10.20.193.123:6804/458007068", 2026-02-17T20:09:41.354 INFO:teuthology.orchestra.run.trial123.stdout: "heartbeat_front_addr": "10.20.193.123:6803/458007068", 2026-02-17T20:09:41.355 INFO:teuthology.orchestra.run.trial123.stdout: "state": [ 2026-02-17T20:09:41.355 INFO:teuthology.orchestra.run.trial123.stdout: "exists", 2026-02-17T20:09:41.355 INFO:teuthology.orchestra.run.trial123.stdout: "up" 2026-02-17T20:09:41.355 INFO:teuthology.orchestra.run.trial123.stdout: ] 2026-02-17T20:09:41.355 INFO:teuthology.orchestra.run.trial123.stdout: }, 2026-02-17T20:09:41.355 INFO:teuthology.orchestra.run.trial123.stdout: { 2026-02-17T20:09:41.355 INFO:teuthology.orchestra.run.trial123.stdout: "osd": 1, 2026-02-17T20:09:41.355 INFO:teuthology.orchestra.run.trial123.stdout: "uuid": "9b7f5906-8ae8-4a34-8e71-1ba7cf3eeda1", 2026-02-17T20:09:41.355 INFO:teuthology.orchestra.run.trial123.stdout: "up": 1, 2026-02-17T20:09:41.355 INFO:teuthology.orchestra.run.trial123.stdout: "in": 1, 2026-02-17T20:09:41.355 INFO:teuthology.orchestra.run.trial123.stdout: "weight": 1, 2026-02-17T20:09:41.355 INFO:teuthology.orchestra.run.trial123.stdout: "primary_affinity": 1, 2026-02-17T20:09:41.355 INFO:teuthology.orchestra.run.trial123.stdout: "last_clean_begin": 9, 2026-02-17T20:09:41.356 INFO:teuthology.orchestra.run.trial123.stdout: "last_clean_end": 18, 2026-02-17T20:09:41.356 INFO:teuthology.orchestra.run.trial123.stdout: "up_from": 24, 2026-02-17T20:09:41.356 INFO:teuthology.orchestra.run.trial123.stdout: "up_thru": 26, 2026-02-17T20:09:41.356 INFO:teuthology.orchestra.run.trial123.stdout: "down_at": 19, 2026-02-17T20:09:41.356 INFO:teuthology.orchestra.run.trial123.stdout: "lost_at": 0, 2026-02-17T20:09:41.356 INFO:teuthology.orchestra.run.trial123.stdout: "public_addrs": { 2026-02-17T20:09:41.356 INFO:teuthology.orchestra.run.trial123.stdout: "addrvec": [ 2026-02-17T20:09:41.356 INFO:teuthology.orchestra.run.trial123.stdout: { 2026-02-17T20:09:41.356 INFO:teuthology.orchestra.run.trial123.stdout: "type": "v1", 2026-02-17T20:09:41.356 INFO:teuthology.orchestra.run.trial123.stdout: "addr": "10.20.193.123:6805", 2026-02-17T20:09:41.356 INFO:teuthology.orchestra.run.trial123.stdout: "nonce": 2594724968 2026-02-17T20:09:41.356 INFO:teuthology.orchestra.run.trial123.stdout: } 2026-02-17T20:09:41.356 INFO:teuthology.orchestra.run.trial123.stdout: ] 2026-02-17T20:09:41.357 INFO:teuthology.orchestra.run.trial123.stdout: }, 2026-02-17T20:09:41.357 INFO:teuthology.orchestra.run.trial123.stdout: "cluster_addrs": { 2026-02-17T20:09:41.357 INFO:teuthology.orchestra.run.trial123.stdout: "addrvec": [ 2026-02-17T20:09:41.357 INFO:teuthology.orchestra.run.trial123.stdout: { 2026-02-17T20:09:41.357 INFO:teuthology.orchestra.run.trial123.stdout: "type": "v1", 2026-02-17T20:09:41.357 INFO:teuthology.orchestra.run.trial123.stdout: "addr": "10.20.193.123:6806", 2026-02-17T20:09:41.357 INFO:teuthology.orchestra.run.trial123.stdout: "nonce": 2594724968 2026-02-17T20:09:41.357 INFO:teuthology.orchestra.run.trial123.stdout: } 2026-02-17T20:09:41.357 INFO:teuthology.orchestra.run.trial123.stdout: ] 2026-02-17T20:09:41.357 INFO:teuthology.orchestra.run.trial123.stdout: }, 2026-02-17T20:09:41.357 INFO:teuthology.orchestra.run.trial123.stdout: "heartbeat_back_addrs": { 2026-02-17T20:09:41.357 INFO:teuthology.orchestra.run.trial123.stdout: "addrvec": [ 2026-02-17T20:09:41.357 INFO:teuthology.orchestra.run.trial123.stdout: { 2026-02-17T20:09:41.358 INFO:teuthology.orchestra.run.trial123.stdout: "type": "v1", 2026-02-17T20:09:41.358 INFO:teuthology.orchestra.run.trial123.stdout: "addr": "10.20.193.123:6808", 2026-02-17T20:09:41.358 INFO:teuthology.orchestra.run.trial123.stdout: "nonce": 2594724968 2026-02-17T20:09:41.358 INFO:teuthology.orchestra.run.trial123.stdout: } 2026-02-17T20:09:41.358 INFO:teuthology.orchestra.run.trial123.stdout: ] 2026-02-17T20:09:41.358 INFO:teuthology.orchestra.run.trial123.stdout: }, 2026-02-17T20:09:41.358 INFO:teuthology.orchestra.run.trial123.stdout: "heartbeat_front_addrs": { 2026-02-17T20:09:41.358 INFO:teuthology.orchestra.run.trial123.stdout: "addrvec": [ 2026-02-17T20:09:41.358 INFO:teuthology.orchestra.run.trial123.stdout: { 2026-02-17T20:09:41.358 INFO:teuthology.orchestra.run.trial123.stdout: "type": "v1", 2026-02-17T20:09:41.358 INFO:teuthology.orchestra.run.trial123.stdout: "addr": "10.20.193.123:6807", 2026-02-17T20:09:41.358 INFO:teuthology.orchestra.run.trial123.stdout: "nonce": 2594724968 2026-02-17T20:09:41.358 INFO:teuthology.orchestra.run.trial123.stdout: } 2026-02-17T20:09:41.359 INFO:teuthology.orchestra.run.trial123.stdout: ] 2026-02-17T20:09:41.359 INFO:teuthology.orchestra.run.trial123.stdout: }, 2026-02-17T20:09:41.359 INFO:teuthology.orchestra.run.trial123.stdout: "public_addr": "10.20.193.123:6805/2594724968", 2026-02-17T20:09:41.359 INFO:teuthology.orchestra.run.trial123.stdout: "cluster_addr": "10.20.193.123:6806/2594724968", 2026-02-17T20:09:41.359 INFO:teuthology.orchestra.run.trial123.stdout: "heartbeat_back_addr": "10.20.193.123:6808/2594724968", 2026-02-17T20:09:41.359 INFO:teuthology.orchestra.run.trial123.stdout: "heartbeat_front_addr": "10.20.193.123:6807/2594724968", 2026-02-17T20:09:41.359 INFO:teuthology.orchestra.run.trial123.stdout: "state": [ 2026-02-17T20:09:41.359 INFO:teuthology.orchestra.run.trial123.stdout: "exists", 2026-02-17T20:09:41.359 INFO:teuthology.orchestra.run.trial123.stdout: "up" 2026-02-17T20:09:41.359 INFO:teuthology.orchestra.run.trial123.stdout: ] 2026-02-17T20:09:41.359 INFO:teuthology.orchestra.run.trial123.stdout: }, 2026-02-17T20:09:41.359 INFO:teuthology.orchestra.run.trial123.stdout: { 2026-02-17T20:09:41.359 INFO:teuthology.orchestra.run.trial123.stdout: "osd": 2, 2026-02-17T20:09:41.360 INFO:teuthology.orchestra.run.trial123.stdout: "uuid": "db6be5e2-fdd2-460f-bf35-269d92577824", 2026-02-17T20:09:41.360 INFO:teuthology.orchestra.run.trial123.stdout: "up": 1, 2026-02-17T20:09:41.360 INFO:teuthology.orchestra.run.trial123.stdout: "in": 1, 2026-02-17T20:09:41.360 INFO:teuthology.orchestra.run.trial123.stdout: "weight": 1, 2026-02-17T20:09:41.360 INFO:teuthology.orchestra.run.trial123.stdout: "primary_affinity": 1, 2026-02-17T20:09:41.360 INFO:teuthology.orchestra.run.trial123.stdout: "last_clean_begin": 9, 2026-02-17T20:09:41.360 INFO:teuthology.orchestra.run.trial123.stdout: "last_clean_end": 18, 2026-02-17T20:09:41.360 INFO:teuthology.orchestra.run.trial123.stdout: "up_from": 25, 2026-02-17T20:09:41.360 INFO:teuthology.orchestra.run.trial123.stdout: "up_thru": 26, 2026-02-17T20:09:41.360 INFO:teuthology.orchestra.run.trial123.stdout: "down_at": 20, 2026-02-17T20:09:41.360 INFO:teuthology.orchestra.run.trial123.stdout: "lost_at": 0, 2026-02-17T20:09:41.360 INFO:teuthology.orchestra.run.trial123.stdout: "public_addrs": { 2026-02-17T20:09:41.361 INFO:teuthology.orchestra.run.trial123.stdout: "addrvec": [ 2026-02-17T20:09:41.361 INFO:teuthology.orchestra.run.trial123.stdout: { 2026-02-17T20:09:41.361 INFO:teuthology.orchestra.run.trial123.stdout: "type": "v1", 2026-02-17T20:09:41.361 INFO:teuthology.orchestra.run.trial123.stdout: "addr": "10.20.193.123:6809", 2026-02-17T20:09:41.361 INFO:teuthology.orchestra.run.trial123.stdout: "nonce": 3596569166 2026-02-17T20:09:41.361 INFO:teuthology.orchestra.run.trial123.stdout: } 2026-02-17T20:09:41.361 INFO:teuthology.orchestra.run.trial123.stdout: ] 2026-02-17T20:09:41.361 INFO:teuthology.orchestra.run.trial123.stdout: }, 2026-02-17T20:09:41.361 INFO:teuthology.orchestra.run.trial123.stdout: "cluster_addrs": { 2026-02-17T20:09:41.361 INFO:teuthology.orchestra.run.trial123.stdout: "addrvec": [ 2026-02-17T20:09:41.361 INFO:teuthology.orchestra.run.trial123.stdout: { 2026-02-17T20:09:41.361 INFO:teuthology.orchestra.run.trial123.stdout: "type": "v1", 2026-02-17T20:09:41.361 INFO:teuthology.orchestra.run.trial123.stdout: "addr": "10.20.193.123:6810", 2026-02-17T20:09:41.362 INFO:teuthology.orchestra.run.trial123.stdout: "nonce": 3596569166 2026-02-17T20:09:41.362 INFO:teuthology.orchestra.run.trial123.stdout: } 2026-02-17T20:09:41.362 INFO:teuthology.orchestra.run.trial123.stdout: ] 2026-02-17T20:09:41.362 INFO:teuthology.orchestra.run.trial123.stdout: }, 2026-02-17T20:09:41.362 INFO:teuthology.orchestra.run.trial123.stdout: "heartbeat_back_addrs": { 2026-02-17T20:09:41.362 INFO:teuthology.orchestra.run.trial123.stdout: "addrvec": [ 2026-02-17T20:09:41.362 INFO:teuthology.orchestra.run.trial123.stdout: { 2026-02-17T20:09:41.362 INFO:teuthology.orchestra.run.trial123.stdout: "type": "v1", 2026-02-17T20:09:41.362 INFO:teuthology.orchestra.run.trial123.stdout: "addr": "10.20.193.123:6812", 2026-02-17T20:09:41.362 INFO:teuthology.orchestra.run.trial123.stdout: "nonce": 3596569166 2026-02-17T20:09:41.362 INFO:teuthology.orchestra.run.trial123.stdout: } 2026-02-17T20:09:41.362 INFO:teuthology.orchestra.run.trial123.stdout: ] 2026-02-17T20:09:41.362 INFO:teuthology.orchestra.run.trial123.stdout: }, 2026-02-17T20:09:41.363 INFO:teuthology.orchestra.run.trial123.stdout: "heartbeat_front_addrs": { 2026-02-17T20:09:41.363 INFO:teuthology.orchestra.run.trial123.stdout: "addrvec": [ 2026-02-17T20:09:41.363 INFO:teuthology.orchestra.run.trial123.stdout: { 2026-02-17T20:09:41.363 INFO:teuthology.orchestra.run.trial123.stdout: "type": "v1", 2026-02-17T20:09:41.363 INFO:teuthology.orchestra.run.trial123.stdout: "addr": "10.20.193.123:6811", 2026-02-17T20:09:41.363 INFO:teuthology.orchestra.run.trial123.stdout: "nonce": 3596569166 2026-02-17T20:09:41.363 INFO:teuthology.orchestra.run.trial123.stdout: } 2026-02-17T20:09:41.363 INFO:teuthology.orchestra.run.trial123.stdout: ] 2026-02-17T20:09:41.363 INFO:teuthology.orchestra.run.trial123.stdout: }, 2026-02-17T20:09:41.363 INFO:teuthology.orchestra.run.trial123.stdout: "public_addr": "10.20.193.123:6809/3596569166", 2026-02-17T20:09:41.363 INFO:teuthology.orchestra.run.trial123.stdout: "cluster_addr": "10.20.193.123:6810/3596569166", 2026-02-17T20:09:41.363 INFO:teuthology.orchestra.run.trial123.stdout: "heartbeat_back_addr": "10.20.193.123:6812/3596569166", 2026-02-17T20:09:41.363 INFO:teuthology.orchestra.run.trial123.stdout: "heartbeat_front_addr": "10.20.193.123:6811/3596569166", 2026-02-17T20:09:41.364 INFO:teuthology.orchestra.run.trial123.stdout: "state": [ 2026-02-17T20:09:41.364 INFO:teuthology.orchestra.run.trial123.stdout: "exists", 2026-02-17T20:09:41.364 INFO:teuthology.orchestra.run.trial123.stdout: "up" 2026-02-17T20:09:41.364 INFO:teuthology.orchestra.run.trial123.stdout: ] 2026-02-17T20:09:41.364 INFO:teuthology.orchestra.run.trial123.stdout: }, 2026-02-17T20:09:41.364 INFO:teuthology.orchestra.run.trial123.stdout: { 2026-02-17T20:09:41.364 INFO:teuthology.orchestra.run.trial123.stdout: "osd": 3, 2026-02-17T20:09:41.364 INFO:teuthology.orchestra.run.trial123.stdout: "uuid": "23275d01-0d57-497c-a600-d9aeef747af2", 2026-02-17T20:09:41.364 INFO:teuthology.orchestra.run.trial123.stdout: "up": 1, 2026-02-17T20:09:41.364 INFO:teuthology.orchestra.run.trial123.stdout: "in": 1, 2026-02-17T20:09:41.364 INFO:teuthology.orchestra.run.trial123.stdout: "weight": 1, 2026-02-17T20:09:41.364 INFO:teuthology.orchestra.run.trial123.stdout: "primary_affinity": 1, 2026-02-17T20:09:41.365 INFO:teuthology.orchestra.run.trial123.stdout: "last_clean_begin": 9, 2026-02-17T20:09:41.365 INFO:teuthology.orchestra.run.trial123.stdout: "last_clean_end": 20, 2026-02-17T20:09:41.365 INFO:teuthology.orchestra.run.trial123.stdout: "up_from": 26, 2026-02-17T20:09:41.365 INFO:teuthology.orchestra.run.trial123.stdout: "up_thru": 26, 2026-02-17T20:09:41.365 INFO:teuthology.orchestra.run.trial123.stdout: "down_at": 21, 2026-02-17T20:09:41.365 INFO:teuthology.orchestra.run.trial123.stdout: "lost_at": 0, 2026-02-17T20:09:41.365 INFO:teuthology.orchestra.run.trial123.stdout: "public_addrs": { 2026-02-17T20:09:41.365 INFO:teuthology.orchestra.run.trial123.stdout: "addrvec": [ 2026-02-17T20:09:41.365 INFO:teuthology.orchestra.run.trial123.stdout: { 2026-02-17T20:09:41.365 INFO:teuthology.orchestra.run.trial123.stdout: "type": "v1", 2026-02-17T20:09:41.365 INFO:teuthology.orchestra.run.trial123.stdout: "addr": "10.20.193.123:6813", 2026-02-17T20:09:41.365 INFO:teuthology.orchestra.run.trial123.stdout: "nonce": 2610635322 2026-02-17T20:09:41.365 INFO:teuthology.orchestra.run.trial123.stdout: } 2026-02-17T20:09:41.366 INFO:teuthology.orchestra.run.trial123.stdout: ] 2026-02-17T20:09:41.366 INFO:teuthology.orchestra.run.trial123.stdout: }, 2026-02-17T20:09:41.366 INFO:teuthology.orchestra.run.trial123.stdout: "cluster_addrs": { 2026-02-17T20:09:41.366 INFO:teuthology.orchestra.run.trial123.stdout: "addrvec": [ 2026-02-17T20:09:41.366 INFO:teuthology.orchestra.run.trial123.stdout: { 2026-02-17T20:09:41.366 INFO:teuthology.orchestra.run.trial123.stdout: "type": "v1", 2026-02-17T20:09:41.366 INFO:teuthology.orchestra.run.trial123.stdout: "addr": "10.20.193.123:6814", 2026-02-17T20:09:41.366 INFO:teuthology.orchestra.run.trial123.stdout: "nonce": 2610635322 2026-02-17T20:09:41.366 INFO:teuthology.orchestra.run.trial123.stdout: } 2026-02-17T20:09:41.366 INFO:teuthology.orchestra.run.trial123.stdout: ] 2026-02-17T20:09:41.366 INFO:teuthology.orchestra.run.trial123.stdout: }, 2026-02-17T20:09:41.366 INFO:teuthology.orchestra.run.trial123.stdout: "heartbeat_back_addrs": { 2026-02-17T20:09:41.366 INFO:teuthology.orchestra.run.trial123.stdout: "addrvec": [ 2026-02-17T20:09:41.366 INFO:teuthology.orchestra.run.trial123.stdout: { 2026-02-17T20:09:41.366 INFO:teuthology.orchestra.run.trial123.stdout: "type": "v1", 2026-02-17T20:09:41.367 INFO:teuthology.orchestra.run.trial123.stdout: "addr": "10.20.193.123:6816", 2026-02-17T20:09:41.367 INFO:teuthology.orchestra.run.trial123.stdout: "nonce": 2610635322 2026-02-17T20:09:41.367 INFO:teuthology.orchestra.run.trial123.stdout: } 2026-02-17T20:09:41.367 INFO:teuthology.orchestra.run.trial123.stdout: ] 2026-02-17T20:09:41.367 INFO:teuthology.orchestra.run.trial123.stdout: }, 2026-02-17T20:09:41.367 INFO:teuthology.orchestra.run.trial123.stdout: "heartbeat_front_addrs": { 2026-02-17T20:09:41.367 INFO:teuthology.orchestra.run.trial123.stdout: "addrvec": [ 2026-02-17T20:09:41.367 INFO:teuthology.orchestra.run.trial123.stdout: { 2026-02-17T20:09:41.367 INFO:teuthology.orchestra.run.trial123.stdout: "type": "v1", 2026-02-17T20:09:41.367 INFO:teuthology.orchestra.run.trial123.stdout: "addr": "10.20.193.123:6815", 2026-02-17T20:09:41.367 INFO:teuthology.orchestra.run.trial123.stdout: "nonce": 2610635322 2026-02-17T20:09:41.367 INFO:teuthology.orchestra.run.trial123.stdout: } 2026-02-17T20:09:41.367 INFO:teuthology.orchestra.run.trial123.stdout: ] 2026-02-17T20:09:41.367 INFO:teuthology.orchestra.run.trial123.stdout: }, 2026-02-17T20:09:41.368 INFO:teuthology.orchestra.run.trial123.stdout: "public_addr": "10.20.193.123:6813/2610635322", 2026-02-17T20:09:41.368 INFO:teuthology.orchestra.run.trial123.stdout: "cluster_addr": "10.20.193.123:6814/2610635322", 2026-02-17T20:09:41.368 INFO:teuthology.orchestra.run.trial123.stdout: "heartbeat_back_addr": "10.20.193.123:6816/2610635322", 2026-02-17T20:09:41.368 INFO:teuthology.orchestra.run.trial123.stdout: "heartbeat_front_addr": "10.20.193.123:6815/2610635322", 2026-02-17T20:09:41.368 INFO:teuthology.orchestra.run.trial123.stdout: "state": [ 2026-02-17T20:09:41.368 INFO:teuthology.orchestra.run.trial123.stdout: "exists", 2026-02-17T20:09:41.368 INFO:teuthology.orchestra.run.trial123.stdout: "up" 2026-02-17T20:09:41.368 INFO:teuthology.orchestra.run.trial123.stdout: ] 2026-02-17T20:09:41.368 INFO:teuthology.orchestra.run.trial123.stdout: } 2026-02-17T20:09:41.368 INFO:teuthology.orchestra.run.trial123.stdout: ], 2026-02-17T20:09:41.368 INFO:teuthology.orchestra.run.trial123.stdout: "osd_xinfo": [ 2026-02-17T20:09:41.368 INFO:teuthology.orchestra.run.trial123.stdout: { 2026-02-17T20:09:41.368 INFO:teuthology.orchestra.run.trial123.stdout: "osd": 0, 2026-02-17T20:09:41.368 INFO:teuthology.orchestra.run.trial123.stdout: "down_stamp": "0.000000", 2026-02-17T20:09:41.368 INFO:teuthology.orchestra.run.trial123.stdout: "laggy_probability": 0, 2026-02-17T20:09:41.369 INFO:teuthology.orchestra.run.trial123.stdout: "laggy_interval": 0, 2026-02-17T20:09:41.369 INFO:teuthology.orchestra.run.trial123.stdout: "features": 4540701547738038271, 2026-02-17T20:09:41.369 INFO:teuthology.orchestra.run.trial123.stdout: "old_weight": 0, 2026-02-17T20:09:41.369 INFO:teuthology.orchestra.run.trial123.stdout: "last_purged_snaps_scrub": "2026-02-17T20:08:24.897268+0000", 2026-02-17T20:09:41.369 INFO:teuthology.orchestra.run.trial123.stdout: "dead_epoch": 18 2026-02-17T20:09:41.369 INFO:teuthology.orchestra.run.trial123.stdout: }, 2026-02-17T20:09:41.369 INFO:teuthology.orchestra.run.trial123.stdout: { 2026-02-17T20:09:41.369 INFO:teuthology.orchestra.run.trial123.stdout: "osd": 1, 2026-02-17T20:09:41.369 INFO:teuthology.orchestra.run.trial123.stdout: "down_stamp": "0.000000", 2026-02-17T20:09:41.369 INFO:teuthology.orchestra.run.trial123.stdout: "laggy_probability": 0, 2026-02-17T20:09:41.369 INFO:teuthology.orchestra.run.trial123.stdout: "laggy_interval": 0, 2026-02-17T20:09:41.369 INFO:teuthology.orchestra.run.trial123.stdout: "features": 4540701547738038271, 2026-02-17T20:09:41.369 INFO:teuthology.orchestra.run.trial123.stdout: "old_weight": 0, 2026-02-17T20:09:41.369 INFO:teuthology.orchestra.run.trial123.stdout: "last_purged_snaps_scrub": "2026-02-17T20:08:24.890530+0000", 2026-02-17T20:09:41.369 INFO:teuthology.orchestra.run.trial123.stdout: "dead_epoch": 19 2026-02-17T20:09:41.370 INFO:teuthology.orchestra.run.trial123.stdout: }, 2026-02-17T20:09:41.370 INFO:teuthology.orchestra.run.trial123.stdout: { 2026-02-17T20:09:41.370 INFO:teuthology.orchestra.run.trial123.stdout: "osd": 2, 2026-02-17T20:09:41.370 INFO:teuthology.orchestra.run.trial123.stdout: "down_stamp": "0.000000", 2026-02-17T20:09:41.370 INFO:teuthology.orchestra.run.trial123.stdout: "laggy_probability": 0, 2026-02-17T20:09:41.370 INFO:teuthology.orchestra.run.trial123.stdout: "laggy_interval": 0, 2026-02-17T20:09:41.370 INFO:teuthology.orchestra.run.trial123.stdout: "features": 4540701547738038271, 2026-02-17T20:09:41.370 INFO:teuthology.orchestra.run.trial123.stdout: "old_weight": 0, 2026-02-17T20:09:41.370 INFO:teuthology.orchestra.run.trial123.stdout: "last_purged_snaps_scrub": "2026-02-17T20:08:24.941602+0000", 2026-02-17T20:09:41.370 INFO:teuthology.orchestra.run.trial123.stdout: "dead_epoch": 20 2026-02-17T20:09:41.370 INFO:teuthology.orchestra.run.trial123.stdout: }, 2026-02-17T20:09:41.370 INFO:teuthology.orchestra.run.trial123.stdout: { 2026-02-17T20:09:41.370 INFO:teuthology.orchestra.run.trial123.stdout: "osd": 3, 2026-02-17T20:09:41.370 INFO:teuthology.orchestra.run.trial123.stdout: "down_stamp": "2026-02-17T20:09:31.377910+0000", 2026-02-17T20:09:41.370 INFO:teuthology.orchestra.run.trial123.stdout: "laggy_probability": 0, 2026-02-17T20:09:41.371 INFO:teuthology.orchestra.run.trial123.stdout: "laggy_interval": 0, 2026-02-17T20:09:41.371 INFO:teuthology.orchestra.run.trial123.stdout: "features": 4540701547738038271, 2026-02-17T20:09:41.371 INFO:teuthology.orchestra.run.trial123.stdout: "old_weight": 0, 2026-02-17T20:09:41.371 INFO:teuthology.orchestra.run.trial123.stdout: "last_purged_snaps_scrub": "2026-02-17T20:08:24.897001+0000", 2026-02-17T20:09:41.371 INFO:teuthology.orchestra.run.trial123.stdout: "dead_epoch": 0 2026-02-17T20:09:41.371 INFO:teuthology.orchestra.run.trial123.stdout: } 2026-02-17T20:09:41.371 INFO:teuthology.orchestra.run.trial123.stdout: ], 2026-02-17T20:09:41.371 INFO:teuthology.orchestra.run.trial123.stdout: "pg_upmap": [], 2026-02-17T20:09:41.371 INFO:teuthology.orchestra.run.trial123.stdout: "pg_upmap_items": [], 2026-02-17T20:09:41.371 INFO:teuthology.orchestra.run.trial123.stdout: "pg_upmap_primaries": [], 2026-02-17T20:09:41.371 INFO:teuthology.orchestra.run.trial123.stdout: "pg_temp": [], 2026-02-17T20:09:41.371 INFO:teuthology.orchestra.run.trial123.stdout: "primary_temp": [], 2026-02-17T20:09:41.371 INFO:teuthology.orchestra.run.trial123.stdout: "blocklist": { 2026-02-17T20:09:41.371 INFO:teuthology.orchestra.run.trial123.stdout: "10.20.193.123:0/3994607579": "2026-02-18T20:09:24.315453+0000", 2026-02-17T20:09:41.371 INFO:teuthology.orchestra.run.trial123.stdout: "10.20.193.123:0/1995254470": "2026-02-18T20:09:24.315453+0000", 2026-02-17T20:09:41.372 INFO:teuthology.orchestra.run.trial123.stdout: "10.20.193.123:0/2996849897": "2026-02-18T20:09:24.315453+0000", 2026-02-17T20:09:41.372 INFO:teuthology.orchestra.run.trial123.stdout: "10.20.193.123:6800/23720": "2026-02-18T20:09:24.315453+0000", 2026-02-17T20:09:41.372 INFO:teuthology.orchestra.run.trial123.stdout: "10.20.193.123:0/1130446084": "2026-02-18T20:09:24.315453+0000" 2026-02-17T20:09:41.372 INFO:teuthology.orchestra.run.trial123.stdout: }, 2026-02-17T20:09:41.372 INFO:teuthology.orchestra.run.trial123.stdout: "range_blocklist": {}, 2026-02-17T20:09:41.372 INFO:teuthology.orchestra.run.trial123.stdout: "erasure_code_profiles": { 2026-02-17T20:09:41.372 INFO:teuthology.orchestra.run.trial123.stdout: "default": { 2026-02-17T20:09:41.372 INFO:teuthology.orchestra.run.trial123.stdout: "crush-failure-domain": "osd", 2026-02-17T20:09:41.372 INFO:teuthology.orchestra.run.trial123.stdout: "k": "2", 2026-02-17T20:09:41.372 INFO:teuthology.orchestra.run.trial123.stdout: "m": "1", 2026-02-17T20:09:41.372 INFO:teuthology.orchestra.run.trial123.stdout: "plugin": "jerasure", 2026-02-17T20:09:41.372 INFO:teuthology.orchestra.run.trial123.stdout: "technique": "reed_sol_van" 2026-02-17T20:09:41.372 INFO:teuthology.orchestra.run.trial123.stdout: } 2026-02-17T20:09:41.372 INFO:teuthology.orchestra.run.trial123.stdout: }, 2026-02-17T20:09:41.373 INFO:teuthology.orchestra.run.trial123.stdout: "removed_snaps_queue": [], 2026-02-17T20:09:41.373 INFO:teuthology.orchestra.run.trial123.stdout: "new_removed_snaps": [], 2026-02-17T20:09:41.373 INFO:teuthology.orchestra.run.trial123.stdout: "new_purged_snaps": [], 2026-02-17T20:09:41.373 INFO:teuthology.orchestra.run.trial123.stdout: "crush_node_flags": {}, 2026-02-17T20:09:41.373 INFO:teuthology.orchestra.run.trial123.stdout: "device_class_flags": {}, 2026-02-17T20:09:41.373 INFO:teuthology.orchestra.run.trial123.stdout: "stretch_mode": { 2026-02-17T20:09:41.373 INFO:teuthology.orchestra.run.trial123.stdout: "stretch_mode_enabled": false, 2026-02-17T20:09:41.373 INFO:teuthology.orchestra.run.trial123.stdout: "stretch_bucket_count": 0, 2026-02-17T20:09:41.373 INFO:teuthology.orchestra.run.trial123.stdout: "degraded_stretch_mode": 0, 2026-02-17T20:09:41.373 INFO:teuthology.orchestra.run.trial123.stdout: "recovering_stretch_mode": 0, 2026-02-17T20:09:41.373 INFO:teuthology.orchestra.run.trial123.stdout: "stretch_mode_bucket": 0 2026-02-17T20:09:41.373 INFO:teuthology.orchestra.run.trial123.stdout: } 2026-02-17T20:09:41.373 INFO:teuthology.orchestra.run.trial123.stdout:} 2026-02-17T20:09:41.375 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.339+0000 7fe82edef640 1 -- 10.20.193.123:0/1679254094 >> v1:10.20.193.123:6800/115662061 conn(0x7fe7f804f790 legacy=0x7fe7f8051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:41.375 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.339+0000 7fe82edef640 1 -- 10.20.193.123:0/1679254094 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe828135b70 msgr2=0x7fe828129f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:41.375 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.339+0000 7fe82edef640 1 --2- 10.20.193.123:0/1679254094 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe828135b70 0x7fe828129f80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe824036000 tx=0x7fe824004b40 comp rx=0 tx=0).stop 2026-02-17T20:09:41.375 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.339+0000 7fe82edef640 1 -- 10.20.193.123:0/1679254094 shutdown_connections 2026-02-17T20:09:41.375 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.339+0000 7fe82edef640 1 --2- 10.20.193.123:0/1679254094 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe828135b70 0x7fe828129f80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:41.375 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.339+0000 7fe82edef640 1 --2- 10.20.193.123:0/1679254094 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fe828072f90 0x7fe828129a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:41.375 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.339+0000 7fe82edef640 1 --2- 10.20.193.123:0/1679254094 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fe828071600 0x7fe828129500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:41.375 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.339+0000 7fe82edef640 1 -- 10.20.193.123:0/1679254094 >> 10.20.193.123:0/1679254094 conn(0x7fe82806d5d0 msgr2=0x7fe82812e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:41.375 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.339+0000 7fe82edef640 1 -- 10.20.193.123:0/1679254094 shutdown_connections 2026-02-17T20:09:41.375 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.339+0000 7fe82edef640 1 -- 10.20.193.123:0/1679254094 wait complete. 2026-02-17T20:09:41.376 DEBUG:teuthology.orchestra.run.trial123:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs dump' 2026-02-17T20:09:41.441 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.444+0000 7f9c2c8e9640 1 Processor -- start 2026-02-17T20:09:41.441 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.444+0000 7f9c2c8e9640 1 -- start start 2026-02-17T20:09:41.442 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.444+0000 7f9c2c8e9640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f9c24070b30 0x7f9c2408eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:41.442 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.444+0000 7f9c2c8e9640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f9c24135b00 0x7f9c24137ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:41.442 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.444+0000 7f9c2c8e9640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c2408fbc0 con 0x7f9c240741b0 2026-02-17T20:09:41.442 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.444+0000 7f9c2c8e9640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7f9c240716e0 con 0x7f9c24070b30 2026-02-17T20:09:41.442 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.444+0000 7f9c2c8e9640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f9c2408f030 con 0x7f9c24135b00 2026-02-17T20:09:41.442 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.444+0000 7f9c29e5d640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f9c24070b30 0x7f9c2408eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:41.442 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.444+0000 7f9c2ae5f640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f9c24135b00 0x7f9c24137ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:41.442 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.444+0000 7f9c29e5d640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f9c24070b30 0x7f9c2408eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:58098/0 (socket says 10.20.193.123:58098) 2026-02-17T20:09:41.442 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.444+0000 7f9c2a65e640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7f9c240741b0 0x7f9c2408e3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:54358/0 (socket says 10.20.193.123:54358) 2026-02-17T20:09:41.442 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.444+0000 7f9c29e5d640 1 -- 10.20.193.123:0/3092439161 learned_addr learned my addr 10.20.193.123:0/3092439161 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:41.442 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.444+0000 7f9c29e5d640 1 -- 10.20.193.123:0/3092439161 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f9c24135b00 msgr2=0x7f9c24137ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:41.442 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.444+0000 7f9c29e5d640 1 --2- 10.20.193.123:0/3092439161 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f9c24135b00 0x7f9c24137ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:41.442 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.444+0000 7f9c29e5d640 1 -- 10.20.193.123:0/3092439161 >> v1:10.20.193.123:6789/0 conn(0x7f9c240741b0 legacy=0x7f9c2408e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:41.443 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.444+0000 7f9c2965c640 1 -- 10.20.193.123:0/3092439161 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3193618532 0 0) 0x7f9c2408fbc0 con 0x7f9c240741b0 2026-02-17T20:09:41.443 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.444+0000 7f9c29e5d640 1 -- 10.20.193.123:0/3092439161 --> v2:10.20.193.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c24139440 con 0x7f9c24070b30 2026-02-17T20:09:41.443 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.445+0000 7f9c29e5d640 1 --2- 10.20.193.123:0/3092439161 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f9c24070b30 0x7f9c2408eaf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9c10009970 tx=0x7f9c1002ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=359580dcfe291125 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:41.443 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.445+0000 7f9c2965c640 1 -- 10.20.193.123:0/3092439161 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c1003c070 con 0x7f9c24070b30 2026-02-17T20:09:41.443 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.445+0000 7f9c2965c640 1 -- 10.20.193.123:0/3092439161 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c1002fb10 con 0x7f9c24070b30 2026-02-17T20:09:41.443 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.445+0000 7f9c2965c640 1 -- 10.20.193.123:0/3092439161 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c10037440 con 0x7f9c24070b30 2026-02-17T20:09:41.443 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.445+0000 7f9c2c8e9640 1 -- 10.20.193.123:0/3092439161 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f9c24070b30 msgr2=0x7f9c2408eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:41.443 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.445+0000 7f9c2c8e9640 1 --2- 10.20.193.123:0/3092439161 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f9c24070b30 0x7f9c2408eaf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9c10009970 tx=0x7f9c1002ee90 comp rx=0 tx=0).stop 2026-02-17T20:09:41.443 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.445+0000 7f9c2c8e9640 1 -- 10.20.193.123:0/3092439161 shutdown_connections 2026-02-17T20:09:41.443 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.445+0000 7f9c2c8e9640 1 --2- 10.20.193.123:0/3092439161 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f9c24070b30 0x7f9c2408eaf0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:41.443 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.445+0000 7f9c2c8e9640 1 --2- 10.20.193.123:0/3092439161 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f9c24135b00 0x7f9c24137ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:41.443 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.445+0000 7f9c2c8e9640 1 -- 10.20.193.123:0/3092439161 >> 10.20.193.123:0/3092439161 conn(0x7f9c2409eb20 msgr2=0x7f9c2409ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:41.443 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.445+0000 7f9c2c8e9640 1 -- 10.20.193.123:0/3092439161 shutdown_connections 2026-02-17T20:09:41.443 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.445+0000 7f9c2c8e9640 1 -- 10.20.193.123:0/3092439161 wait complete. 2026-02-17T20:09:41.443 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.445+0000 7f9c2c8e9640 1 Processor -- start 2026-02-17T20:09:41.445 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.446+0000 7f9c2c8e9640 1 -- start start 2026-02-17T20:09:41.446 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.446+0000 7f9c2c8e9640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f9c24070b30 0x7f9c241c7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:41.446 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.446+0000 7f9c2c8e9640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f9c240741b0 0x7f9c241c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:41.446 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.446+0000 7f9c2c8e9640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f9c24135b00 0x7f9c2409a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:41.446 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.446+0000 7f9c2c8e9640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9c241387c0 con 0x7f9c24070b30 2026-02-17T20:09:41.446 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.446+0000 7f9c2c8e9640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f9c24138640 con 0x7f9c24135b00 2026-02-17T20:09:41.446 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.446+0000 7f9c2c8e9640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f9c24138940 con 0x7f9c240741b0 2026-02-17T20:09:41.446 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.446+0000 7f9c2a65e640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f9c24070b30 0x7f9c241c7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:41.446 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.446+0000 7f9c2ae5f640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f9c24135b00 0x7f9c2409a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:41.446 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.446+0000 7f9c2ae5f640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f9c24135b00 0x7f9c2409a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:57722/0 (socket says 10.20.193.123:57722) 2026-02-17T20:09:41.446 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.446+0000 7f9c2ae5f640 1 -- 10.20.193.123:0/2462950283 learned_addr learned my addr 10.20.193.123:0/2462950283 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:41.446 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.446+0000 7f9c2a65e640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f9c24070b30 0x7f9c241c7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:58112/0 (socket says 10.20.193.123:58112) 2026-02-17T20:09:41.446 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.446+0000 7f9c29e5d640 1 --2- 10.20.193.123:0/2462950283 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f9c240741b0 0x7f9c241c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:41.446 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.446+0000 7f9c2ae5f640 1 -- 10.20.193.123:0/2462950283 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f9c240741b0 msgr2=0x7f9c241c7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:41.447 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.446+0000 7f9c2ae5f640 1 --2- 10.20.193.123:0/2462950283 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f9c240741b0 0x7f9c241c7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:41.447 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.446+0000 7f9c2ae5f640 1 -- 10.20.193.123:0/2462950283 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f9c24070b30 msgr2=0x7f9c241c7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:41.447 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.446+0000 7f9c2ae5f640 1 --2- 10.20.193.123:0/2462950283 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f9c24070b30 0x7f9c241c7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:41.447 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.446+0000 7f9c2ae5f640 1 -- 10.20.193.123:0/2462950283 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c24125080 con 0x7f9c24135b00 2026-02-17T20:09:41.447 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.446+0000 7f9c2ae5f640 1 --2- 10.20.193.123:0/2462950283 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f9c24135b00 0x7f9c2409a6c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9c1800efc0 tx=0x7f9c1800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:41.447 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.446+0000 7f9c0effd640 1 -- 10.20.193.123:0/2462950283 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c18018020 con 0x7f9c24135b00 2026-02-17T20:09:41.447 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.446+0000 7f9c0effd640 1 -- 10.20.193.123:0/2462950283 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c18009b10 con 0x7f9c24135b00 2026-02-17T20:09:41.447 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.446+0000 7f9c2c8e9640 1 -- 10.20.193.123:0/2462950283 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c241c7fc0 con 0x7f9c24135b00 2026-02-17T20:09:41.447 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.446+0000 7f9c0effd640 1 -- 10.20.193.123:0/2462950283 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c180146c0 con 0x7f9c24135b00 2026-02-17T20:09:41.447 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.446+0000 7f9c2c8e9640 1 -- 10.20.193.123:0/2462950283 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c2409ac00 con 0x7f9c24135b00 2026-02-17T20:09:41.447 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.447+0000 7f9c2c8e9640 1 -- 10.20.193.123:0/2462950283 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c24138cf0 con 0x7f9c24135b00 2026-02-17T20:09:41.447 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.447+0000 7f9c0effd640 1 -- 10.20.193.123:0/2462950283 <== mon.1 v2:10.20.193.123:3301/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f9c18014860 con 0x7f9c24135b00 2026-02-17T20:09:41.447 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.447+0000 7f9c0effd640 1 -- 10.20.193.123:0/2462950283 <== mon.1 v2:10.20.193.123:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 3021+0+0 (secure 0 0 0) 0x7f9c18067a50 con 0x7f9c24135b00 2026-02-17T20:09:41.447 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.449+0000 7f9c0effd640 1 -- 10.20.193.123:0/2462950283 <== mon.1 v2:10.20.193.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f9c18022030 con 0x7f9c24135b00 2026-02-17T20:09:41.525 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.529+0000 7f9c2c8e9640 1 -- 10.20.193.123:0/2462950283 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f9c24069f10 con 0x7f9c24135b00 2026-02-17T20:09:41.525 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.529+0000 7f9c0effd640 1 -- 10.20.193.123:0/2462950283 <== mon.1 v2:10.20.193.123:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 1 v1) ==== 75+0+396 (secure 0 0 0) 0x7f9c18010040 con 0x7f9c24135b00 2026-02-17T20:09:41.525 INFO:teuthology.orchestra.run.trial123.stdout:e1 2026-02-17T20:09:41.525 INFO:teuthology.orchestra.run.trial123.stdout:btime 1970-01-01T00:00:00:000000+0000 2026-02-17T20:09:41.526 INFO:teuthology.orchestra.run.trial123.stdout:enable_multiple, ever_enabled_multiple: 1,1 2026-02-17T20:09:41.526 INFO:teuthology.orchestra.run.trial123.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2026-02-17T20:09:41.526 INFO:teuthology.orchestra.run.trial123.stdout:legacy client fscid: -1 2026-02-17T20:09:41.526 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:09:41.526 INFO:teuthology.orchestra.run.trial123.stdout:No filesystems configured 2026-02-17T20:09:41.527 INFO:teuthology.orchestra.run.trial123.stderr:dumped fsmap epoch 1 2026-02-17T20:09:41.527 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.529+0000 7f9c2c8e9640 1 -- 10.20.193.123:0/2462950283 >> v1:10.20.193.123:6800/115662061 conn(0x7f9bf404f790 legacy=0x7f9bf4051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:41.527 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.530+0000 7f9c2c8e9640 1 -- 10.20.193.123:0/2462950283 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f9c24135b00 msgr2=0x7f9c2409a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:41.527 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.530+0000 7f9c2c8e9640 1 --2- 10.20.193.123:0/2462950283 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f9c24135b00 0x7f9c2409a6c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9c1800efc0 tx=0x7f9c1800c490 comp rx=0 tx=0).stop 2026-02-17T20:09:41.527 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.530+0000 7f9c2c8e9640 1 -- 10.20.193.123:0/2462950283 shutdown_connections 2026-02-17T20:09:41.528 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.530+0000 7f9c2c8e9640 1 --2- 10.20.193.123:0/2462950283 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f9c24135b00 0x7f9c2409a6c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:41.528 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.530+0000 7f9c2c8e9640 1 --2- 10.20.193.123:0/2462950283 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f9c240741b0 0x7f9c241c7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:41.528 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.530+0000 7f9c2c8e9640 1 --2- 10.20.193.123:0/2462950283 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f9c24070b30 0x7f9c241c7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:41.528 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.530+0000 7f9c2c8e9640 1 -- 10.20.193.123:0/2462950283 >> 10.20.193.123:0/2462950283 conn(0x7f9c2409eb20 msgr2=0x7f9c2406f980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:41.528 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.530+0000 7f9c2c8e9640 1 -- 10.20.193.123:0/2462950283 shutdown_connections 2026-02-17T20:09:41.528 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.530+0000 7f9c2c8e9640 1 -- 10.20.193.123:0/2462950283 wait complete. 2026-02-17T20:09:41.533 DEBUG:teuthology.orchestra.run.trial123:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd require-osd-release squid' 2026-02-17T20:09:41.601 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.605+0000 7f2932b20640 1 Processor -- start 2026-02-17T20:09:41.601 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.605+0000 7f2932b20640 1 -- start start 2026-02-17T20:09:41.601 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.605+0000 7f2932b20640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f292c0741b0 0x7f292c08e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:41.601 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.605+0000 7f2932b20640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f292c070b30 0x7f292c08e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:41.601 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.605+0000 7f2932b20640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f292c08fbc0 con 0x7f292c08ee60 2026-02-17T20:09:41.601 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.605+0000 7f2932b20640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f292c0716e0 con 0x7f292c0741b0 2026-02-17T20:09:41.601 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.605+0000 7f2932b20640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f292c139230 con 0x7f292c070b30 2026-02-17T20:09:41.601 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.605+0000 7f2930895640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f292c0741b0 0x7f292c08e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:41.601 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.605+0000 7f2931096640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7f292c08ee60 0x7f292c136b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:54362/0 (socket says 10.20.193.123:54362) 2026-02-17T20:09:41.601 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.605+0000 7f2930895640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f292c0741b0 0x7f292c08e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:57724/0 (socket says 10.20.193.123:57724) 2026-02-17T20:09:41.601 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.605+0000 7f2931096640 1 -- 10.20.193.123:0/3746557801 learned_addr learned my addr 10.20.193.123:0/3746557801 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:09:41.602 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.605+0000 7f2923fff640 1 --2- 10.20.193.123:0/3746557801 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f292c070b30 0x7f292c08e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:41.602 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.605+0000 7f29237fe640 1 -- 10.20.193.123:0/3746557801 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2788854815 0 0) 0x7f292c08fbc0 con 0x7f292c08ee60 2026-02-17T20:09:41.602 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.605+0000 7f29237fe640 1 -- 10.20.193.123:0/3746557801 --> v1:10.20.193.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2918003620 con 0x7f292c08ee60 2026-02-17T20:09:41.602 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.605+0000 7f2923fff640 1 -- 10.20.193.123:0/3746557801 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f292c0741b0 msgr2=0x7f292c08e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:41.602 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.605+0000 7f2923fff640 1 --2- 10.20.193.123:0/3746557801 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f292c0741b0 0x7f292c08e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:41.602 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.605+0000 7f2923fff640 1 -- 10.20.193.123:0/3746557801 >> v1:10.20.193.123:6789/0 conn(0x7f292c08ee60 legacy=0x7f292c136b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:41.602 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.605+0000 7f2923fff640 1 -- 10.20.193.123:0/3746557801 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f292c1393b0 con 0x7f292c070b30 2026-02-17T20:09:41.602 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.605+0000 7f2930895640 1 --2- 10.20.193.123:0/3746557801 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f292c0741b0 0x7f292c08e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:41.602 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.606+0000 7f2923fff640 1 --2- 10.20.193.123:0/3746557801 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f292c070b30 0x7f292c08e920 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f29140098d0 tx=0x7f291402edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=692174ff028c02cb server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:41.602 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.606+0000 7f29237fe640 1 -- 10.20.193.123:0/3746557801 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f291403c070 con 0x7f292c070b30 2026-02-17T20:09:41.602 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.606+0000 7f29237fe640 1 -- 10.20.193.123:0/3746557801 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f291402fa30 con 0x7f292c070b30 2026-02-17T20:09:41.602 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.606+0000 7f29237fe640 1 -- 10.20.193.123:0/3746557801 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f291402fe00 con 0x7f292c070b30 2026-02-17T20:09:41.602 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.606+0000 7f2932b20640 1 -- 10.20.193.123:0/3746557801 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f292c070b30 msgr2=0x7f292c08e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:41.602 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.606+0000 7f2932b20640 1 --2- 10.20.193.123:0/3746557801 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f292c070b30 0x7f292c08e920 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f29140098d0 tx=0x7f291402edc0 comp rx=0 tx=0).stop 2026-02-17T20:09:41.602 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.606+0000 7f2932b20640 1 -- 10.20.193.123:0/3746557801 shutdown_connections 2026-02-17T20:09:41.602 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.606+0000 7f2932b20640 1 --2- 10.20.193.123:0/3746557801 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f292c070b30 0x7f292c08e920 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:41.602 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.606+0000 7f2932b20640 1 --2- 10.20.193.123:0/3746557801 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f292c0741b0 0x7f292c08e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:41.602 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.606+0000 7f2932b20640 1 -- 10.20.193.123:0/3746557801 >> 10.20.193.123:0/3746557801 conn(0x7f292c09eb20 msgr2=0x7f292c09ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:41.602 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.606+0000 7f2932b20640 1 -- 10.20.193.123:0/3746557801 shutdown_connections 2026-02-17T20:09:41.602 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.606+0000 7f2932b20640 1 -- 10.20.193.123:0/3746557801 wait complete. 2026-02-17T20:09:41.603 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.607+0000 7f2932b20640 1 Processor -- start 2026-02-17T20:09:41.603 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.607+0000 7f2932b20640 1 -- start start 2026-02-17T20:09:41.603 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.607+0000 7f2932b20640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f292c070b30 0x7f292c136a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:41.603 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.607+0000 7f2932b20640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f292c0741b0 0x7f292c136f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:41.603 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.607+0000 7f2932b20640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f292c08ee60 0x7f292c124d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:41.603 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.607+0000 7f2932b20640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7f292c1385b0 con 0x7f292c070b30 2026-02-17T20:09:41.603 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.607+0000 7f2932b20640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f292c138430 con 0x7f292c0741b0 2026-02-17T20:09:41.604 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.607+0000 7f2932b20640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f292c138730 con 0x7f292c08ee60 2026-02-17T20:09:41.604 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.607+0000 7f2930895640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f292c070b30 0x7f292c136a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:41.604 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.607+0000 7f2931096640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f292c08ee60 0x7f292c124d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:41.604 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.607+0000 7f2923fff640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f292c0741b0 0x7f292c136f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:41.604 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.607+0000 7f2930895640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f292c070b30 0x7f292c136a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:58120/0 (socket says 10.20.193.123:58120) 2026-02-17T20:09:41.604 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.607+0000 7f2931096640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f292c08ee60 0x7f292c124d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:52166/0 (socket says 10.20.193.123:52166) 2026-02-17T20:09:41.604 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.607+0000 7f2930895640 1 -- 10.20.193.123:0/259244715 learned_addr learned my addr 10.20.193.123:0/259244715 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:41.604 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.607+0000 7f2930895640 1 -- 10.20.193.123:0/259244715 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f292c08ee60 msgr2=0x7f292c124d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:41.604 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.607+0000 7f2930895640 1 --2- 10.20.193.123:0/259244715 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f292c08ee60 0x7f292c124d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:41.604 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.607+0000 7f2930895640 1 -- 10.20.193.123:0/259244715 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f292c0741b0 msgr2=0x7f292c136f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:41.604 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.607+0000 7f2930895640 1 --2- 10.20.193.123:0/259244715 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f292c0741b0 0x7f292c136f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:41.604 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.607+0000 7f2930895640 1 -- 10.20.193.123:0/259244715 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f292c126f40 con 0x7f292c070b30 2026-02-17T20:09:41.604 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.607+0000 7f2930895640 1 --2- 10.20.193.123:0/259244715 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f292c070b30 0x7f292c136a20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f291c00ebe0 tx=0x7f291c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:41.604 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.607+0000 7f29217fa640 1 -- 10.20.193.123:0/259244715 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f291c017070 con 0x7f292c070b30 2026-02-17T20:09:41.604 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.607+0000 7f29217fa640 1 -- 10.20.193.123:0/259244715 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f291c00cc40 con 0x7f292c070b30 2026-02-17T20:09:41.604 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.607+0000 7f2932b20640 1 -- 10.20.193.123:0/259244715 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f292c09bf40 con 0x7f292c070b30 2026-02-17T20:09:41.604 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.607+0000 7f29217fa640 1 -- 10.20.193.123:0/259244715 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f291c013470 con 0x7f292c070b30 2026-02-17T20:09:41.604 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.607+0000 7f2932b20640 1 -- 10.20.193.123:0/259244715 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f292c1374a0 con 0x7f292c070b30 2026-02-17T20:09:41.604 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.608+0000 7f2932b20640 1 -- 10.20.193.123:0/259244715 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f292c138b90 con 0x7f292c070b30 2026-02-17T20:09:41.604 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.608+0000 7f29217fa640 1 -- 10.20.193.123:0/259244715 <== mon.0 v2:10.20.193.123:3300/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f291c024060 con 0x7f292c070b30 2026-02-17T20:09:41.604 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.608+0000 7f29217fa640 1 -- 10.20.193.123:0/259244715 <== mon.0 v2:10.20.193.123:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3021+0+0 (secure 0 0 0) 0x7f291c066ae0 con 0x7f292c070b30 2026-02-17T20:09:41.606 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.610+0000 7f29217fa640 1 -- 10.20.193.123:0/259244715 <== mon.0 v2:10.20.193.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f291c0408e0 con 0x7f292c070b30 2026-02-17T20:09:41.679 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:41.683+0000 7f2932b20640 1 -- 10.20.193.123:0/259244715 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "osd require-osd-release", "release": "squid"} v 0) -- 0x7f292c069f10 con 0x7f292c070b30 2026-02-17T20:09:42.385 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.389+0000 7f29217fa640 1 -- 10.20.193.123:0/259244715 <== mon.0 v2:10.20.193.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd require-osd-release", "release": "squid"}]=0 v28) ==== 91+0+0 (secure 0 0 0) 0x7f291c065ba0 con 0x7f292c070b30 2026-02-17T20:09:42.387 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.390+0000 7f2932b20640 1 -- 10.20.193.123:0/259244715 >> v1:10.20.193.123:6800/115662061 conn(0x7f28fc04f7c0 legacy=0x7f28fc051c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:42.387 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.390+0000 7f2932b20640 1 -- 10.20.193.123:0/259244715 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f292c070b30 msgr2=0x7f292c136a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:42.387 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.390+0000 7f2932b20640 1 --2- 10.20.193.123:0/259244715 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f292c070b30 0x7f292c136a20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f291c00ebe0 tx=0x7f291c00c520 comp rx=0 tx=0).stop 2026-02-17T20:09:42.387 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.390+0000 7f2932b20640 1 -- 10.20.193.123:0/259244715 shutdown_connections 2026-02-17T20:09:42.387 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.390+0000 7f2932b20640 1 --2- 10.20.193.123:0/259244715 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f292c08ee60 0x7f292c124d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:42.387 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.390+0000 7f2932b20640 1 --2- 10.20.193.123:0/259244715 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f292c0741b0 0x7f292c136f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:42.387 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.390+0000 7f2932b20640 1 --2- 10.20.193.123:0/259244715 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f292c070b30 0x7f292c136a20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:42.388 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.390+0000 7f2932b20640 1 -- 10.20.193.123:0/259244715 >> 10.20.193.123:0/259244715 conn(0x7f292c09eb20 msgr2=0x7f292c06f360 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:42.388 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.390+0000 7f2932b20640 1 -- 10.20.193.123:0/259244715 shutdown_connections 2026-02-17T20:09:42.388 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.390+0000 7f2932b20640 1 -- 10.20.193.123:0/259244715 wait complete. 2026-02-17T20:09:42.394 DEBUG:teuthology.orchestra.run.trial123:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done' 2026-02-17T20:09:42.464 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.464+0000 7f4fcdd5d640 1 Processor -- start 2026-02-17T20:09:42.465 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.464+0000 7f4fcdd5d640 1 -- start start 2026-02-17T20:09:42.465 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.464+0000 7f4fcdd5d640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f4fc8070a90 0x7f4fc8070e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:42.465 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.464+0000 7f4fcdd5d640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f4fc80713b0 0x7f4fc80717b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:42.465 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.464+0000 7f4fcdd5d640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fc806d8a0 con 0x7f4fc8132ad0 2026-02-17T20:09:42.465 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.464+0000 7f4fcdd5d640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f4fc8072db0 con 0x7f4fc80713b0 2026-02-17T20:09:42.465 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.464+0000 7f4fcdd5d640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f4fc8073960 con 0x7f4fc8070a90 2026-02-17T20:09:42.465 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.464+0000 7f4fc77fe640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f4fc8070a90 0x7f4fc8070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:42.466 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.464+0000 7f4fc6ffd640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f4fc80713b0 0x7f4fc80717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:42.466 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.464+0000 7f4fc7fff640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7f4fc8132ad0 0x7f4fc8134ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:54368/0 (socket says 10.20.193.123:54368) 2026-02-17T20:09:42.466 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.464+0000 7f4fc7fff640 1 -- 10.20.193.123:0/1488475813 learned_addr learned my addr 10.20.193.123:0/1488475813 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:09:42.466 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.464+0000 7f4fc77fe640 1 -- 10.20.193.123:0/1488475813 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f4fc80713b0 msgr2=0x7f4fc80717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:42.466 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.464+0000 7f4fc77fe640 1 --2- 10.20.193.123:0/1488475813 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f4fc80713b0 0x7f4fc80717b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:42.466 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.464+0000 7f4fc77fe640 1 -- 10.20.193.123:0/1488475813 >> v1:10.20.193.123:6789/0 conn(0x7f4fc8132ad0 legacy=0x7f4fc8134ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:42.466 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.464+0000 7f4fc77fe640 1 -- 10.20.193.123:0/1488475813 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fc809bfd0 con 0x7f4fc8070a90 2026-02-17T20:09:42.466 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.464+0000 7f4fc67fc640 1 -- 10.20.193.123:0/1488475813 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2885222801 0 0) 0x7f4fc806d8a0 con 0x7f4fc8132ad0 2026-02-17T20:09:42.466 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.465+0000 7f4fc77fe640 1 --2- 10.20.193.123:0/1488475813 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f4fc8070a90 0x7f4fc8070e70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4fb4009900 tx=0x7f4fb402ede0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cea09bb3ea1d8278 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:42.466 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.465+0000 7f4fc67fc640 1 -- 10.20.193.123:0/1488475813 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb403c070 con 0x7f4fc8070a90 2026-02-17T20:09:42.467 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.465+0000 7f4fc67fc640 1 -- 10.20.193.123:0/1488475813 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fb402fa10 con 0x7f4fc8070a90 2026-02-17T20:09:42.467 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.465+0000 7f4fc67fc640 1 -- 10.20.193.123:0/1488475813 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb402fde0 con 0x7f4fc8070a90 2026-02-17T20:09:42.467 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.465+0000 7f4fcdd5d640 1 -- 10.20.193.123:0/1488475813 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f4fc8070a90 msgr2=0x7f4fc8070e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:42.467 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.465+0000 7f4fcdd5d640 1 --2- 10.20.193.123:0/1488475813 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f4fc8070a90 0x7f4fc8070e70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4fb4009900 tx=0x7f4fb402ede0 comp rx=0 tx=0).stop 2026-02-17T20:09:42.467 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.465+0000 7f4fcdd5d640 1 -- 10.20.193.123:0/1488475813 shutdown_connections 2026-02-17T20:09:42.467 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.465+0000 7f4fcdd5d640 1 --2- 10.20.193.123:0/1488475813 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f4fc80713b0 0x7f4fc80717b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:42.467 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.465+0000 7f4fcdd5d640 1 --2- 10.20.193.123:0/1488475813 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f4fc8070a90 0x7f4fc8070e70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:42.467 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.465+0000 7f4fcdd5d640 1 -- 10.20.193.123:0/1488475813 >> 10.20.193.123:0/1488475813 conn(0x7f4fc809eb20 msgr2=0x7f4fc809ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:42.467 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.465+0000 7f4fcdd5d640 1 -- 10.20.193.123:0/1488475813 shutdown_connections 2026-02-17T20:09:42.467 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.465+0000 7f4fcdd5d640 1 -- 10.20.193.123:0/1488475813 wait complete. 2026-02-17T20:09:42.468 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.466+0000 7f4fcdd5d640 1 Processor -- start 2026-02-17T20:09:42.468 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.466+0000 7f4fcdd5d640 1 -- start start 2026-02-17T20:09:42.468 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.466+0000 7f4fcdd5d640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f4fc8070a90 0x7f4fc81284e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:42.468 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.466+0000 7f4fcdd5d640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f4fc80713b0 0x7f4fc8128a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:42.468 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.466+0000 7f4fcdd5d640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f4fc8132ad0 0x7f4fc8128f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:42.468 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.466+0000 7f4fcdd5d640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc80723b0 con 0x7f4fc8132ad0 2026-02-17T20:09:42.468 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.466+0000 7f4fcdd5d640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f4fc8072230 con 0x7f4fc80713b0 2026-02-17T20:09:42.468 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.466+0000 7f4fcdd5d640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f4fc81365e0 con 0x7f4fc8070a90 2026-02-17T20:09:42.468 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.466+0000 7f4fc77fe640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f4fc8070a90 0x7f4fc81284e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:42.468 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.466+0000 7f4fc77fe640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f4fc8070a90 0x7f4fc81284e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:52184/0 (socket says 10.20.193.123:52184) 2026-02-17T20:09:42.468 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.466+0000 7f4fc77fe640 1 -- 10.20.193.123:0/3137325713 learned_addr learned my addr 10.20.193.123:0/3137325713 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:42.469 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.466+0000 7f4fc6ffd640 1 --2- 10.20.193.123:0/3137325713 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f4fc80713b0 0x7f4fc8128a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:42.469 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.466+0000 7f4fc7fff640 1 --2- 10.20.193.123:0/3137325713 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f4fc8132ad0 0x7f4fc8128f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:42.469 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.466+0000 7f4fc77fe640 1 -- 10.20.193.123:0/3137325713 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f4fc80713b0 msgr2=0x7f4fc8128a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:42.469 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.466+0000 7f4fc77fe640 1 --2- 10.20.193.123:0/3137325713 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f4fc80713b0 0x7f4fc8128a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:42.469 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.466+0000 7f4fc77fe640 1 -- 10.20.193.123:0/3137325713 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f4fc8132ad0 msgr2=0x7f4fc8128f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:42.469 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.466+0000 7f4fc77fe640 1 --2- 10.20.193.123:0/3137325713 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f4fc8132ad0 0x7f4fc8128f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:42.469 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.466+0000 7f4fc77fe640 1 -- 10.20.193.123:0/3137325713 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fc812b040 con 0x7f4fc8070a90 2026-02-17T20:09:42.469 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.466+0000 7f4fc77fe640 1 --2- 10.20.193.123:0/3137325713 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f4fc8070a90 0x7f4fc81284e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4fb403a040 tx=0x7f4fb40047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:42.469 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.466+0000 7f4fa3fff640 1 -- 10.20.193.123:0/3137325713 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb4046020 con 0x7f4fc8070a90 2026-02-17T20:09:42.469 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.466+0000 7f4fa3fff640 1 -- 10.20.193.123:0/3137325713 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fb4037d70 con 0x7f4fc8070a90 2026-02-17T20:09:42.470 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.466+0000 7f4fcdd5d640 1 -- 10.20.193.123:0/3137325713 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fc8074190 con 0x7f4fc8070a90 2026-02-17T20:09:42.470 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.466+0000 7f4fa3fff640 1 -- 10.20.193.123:0/3137325713 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb403c040 con 0x7f4fc8070a90 2026-02-17T20:09:42.470 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.466+0000 7f4fcdd5d640 1 -- 10.20.193.123:0/3137325713 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fc812a790 con 0x7f4fc8070a90 2026-02-17T20:09:42.470 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.467+0000 7f4fcdd5d640 1 -- 10.20.193.123:0/3137325713 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fc8070e70 con 0x7f4fc8070a90 2026-02-17T20:09:42.470 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.467+0000 7f4fa3fff640 1 -- 10.20.193.123:0/3137325713 <== mon.2 v2:10.20.193.123:3302/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f4fb4042670 con 0x7f4fc8070a90 2026-02-17T20:09:42.470 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.467+0000 7f4fa3fff640 1 -- 10.20.193.123:0/3137325713 <== mon.2 v2:10.20.193.123:3302/0 5 ==== osd_map(28..28 src has 1..28) ==== 3025+0+0 (secure 0 0 0) 0x7f4fb408b900 con 0x7f4fc8070a90 2026-02-17T20:09:42.471 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.469+0000 7f4fa3fff640 1 -- 10.20.193.123:0/3137325713 <== mon.2 v2:10.20.193.123:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f4fb4050020 con 0x7f4fc8070a90 2026-02-17T20:09:42.537 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.540+0000 7f4fcdd5d640 1 -- 10.20.193.123:0/3137325713 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_command({"prefix": "osd pool ls"} v 0) -- 0x7f4fc806bd40 con 0x7f4fc8070a90 2026-02-17T20:09:42.537 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.541+0000 7f4fa3fff640 1 -- 10.20.193.123:0/3137325713 <== mon.2 v2:10.20.193.123:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool ls"}]=0 v28) ==== 59+0+9 (secure 0 0 0) 0x7f4fc812b040 con 0x7f4fc8070a90 2026-02-17T20:09:42.539 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.542+0000 7f4fcdd5d640 1 -- 10.20.193.123:0/3137325713 >> v1:10.20.193.123:6800/115662061 conn(0x7f4f9804f790 legacy=0x7f4f98051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:42.539 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.542+0000 7f4fcdd5d640 1 -- 10.20.193.123:0/3137325713 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f4fc8070a90 msgr2=0x7f4fc81284e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:42.539 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.542+0000 7f4fcdd5d640 1 --2- 10.20.193.123:0/3137325713 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f4fc8070a90 0x7f4fc81284e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4fb403a040 tx=0x7f4fb40047c0 comp rx=0 tx=0).stop 2026-02-17T20:09:42.539 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.542+0000 7f4fcdd5d640 1 -- 10.20.193.123:0/3137325713 shutdown_connections 2026-02-17T20:09:42.539 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.542+0000 7f4fcdd5d640 1 --2- 10.20.193.123:0/3137325713 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f4fc8132ad0 0x7f4fc8128f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:42.539 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.542+0000 7f4fcdd5d640 1 --2- 10.20.193.123:0/3137325713 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f4fc80713b0 0x7f4fc8128a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:42.539 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.542+0000 7f4fcdd5d640 1 --2- 10.20.193.123:0/3137325713 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f4fc8070a90 0x7f4fc81284e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:42.539 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.542+0000 7f4fcdd5d640 1 -- 10.20.193.123:0/3137325713 >> 10.20.193.123:0/3137325713 conn(0x7f4fc809eb20 msgr2=0x7f4fc812cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:42.540 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.542+0000 7f4fcdd5d640 1 -- 10.20.193.123:0/3137325713 shutdown_connections 2026-02-17T20:09:42.540 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.542+0000 7f4fcdd5d640 1 -- 10.20.193.123:0/3137325713 wait complete. 2026-02-17T20:09:42.593 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.592+0000 7f02208fb640 1 Processor -- start 2026-02-17T20:09:42.593 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.592+0000 7f02208fb640 1 -- start start 2026-02-17T20:09:42.593 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.592+0000 7f02208fb640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f0218070a10 0x7f0218070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:42.593 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.592+0000 7f02208fb640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0218072ec0 0x7f0218071330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:42.594 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.592+0000 7f02208fb640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0218072940 con 0x7f0218071870 2026-02-17T20:09:42.594 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.592+0000 7f02208fb640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7f0218073a70 con 0x7f0218070a10 2026-02-17T20:09:42.594 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.592+0000 7f02208fb640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f0218071cc0 con 0x7f0218072ec0 2026-02-17T20:09:42.594 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.592+0000 7f021e670640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f0218070a10 0x7f0218070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:42.594 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.592+0000 7f021ee71640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7f0218071870 0x7f0218136b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:54372/0 (socket says 10.20.193.123:54372) 2026-02-17T20:09:42.594 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.592+0000 7f021ee71640 1 -- 10.20.193.123:0/2471065057 learned_addr learned my addr 10.20.193.123:0/2471065057 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:09:42.594 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.592+0000 7f021de6f640 1 --2- 10.20.193.123:0/2471065057 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0218072ec0 0x7f0218071330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:42.594 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.592+0000 7f021d66e640 1 -- 10.20.193.123:0/2471065057 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 807175542 0 0) 0x7f0218072940 con 0x7f0218071870 2026-02-17T20:09:42.594 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.592+0000 7f021d66e640 1 -- 10.20.193.123:0/2471065057 --> v1:10.20.193.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0208003620 con 0x7f0218071870 2026-02-17T20:09:42.594 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.592+0000 7f021e670640 1 -- 10.20.193.123:0/2471065057 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0218072ec0 msgr2=0x7f0218071330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:42.595 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.592+0000 7f021e670640 1 --2- 10.20.193.123:0/2471065057 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0218072ec0 0x7f0218071330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:42.595 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.592+0000 7f021e670640 1 -- 10.20.193.123:0/2471065057 >> v1:10.20.193.123:6789/0 conn(0x7f0218071870 legacy=0x7f0218136b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:42.595 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.592+0000 7f021e670640 1 -- 10.20.193.123:0/2471065057 --> v2:10.20.193.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0218071ec0 con 0x7f0218070a10 2026-02-17T20:09:42.595 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.593+0000 7f021e670640 1 --2- 10.20.193.123:0/2471065057 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0218070a10 0x7f0218070df0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f02100098a0 tx=0x7f021002ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af3644f1eafa84de server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:42.595 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.593+0000 7f021d66e640 1 -- 10.20.193.123:0/2471065057 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f021003c070 con 0x7f0218070a10 2026-02-17T20:09:42.595 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.593+0000 7f021d66e640 1 -- 10.20.193.123:0/2471065057 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f021002fa40 con 0x7f0218070a10 2026-02-17T20:09:42.595 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.593+0000 7f021d66e640 1 -- 10.20.193.123:0/2471065057 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f021002fdf0 con 0x7f0218070a10 2026-02-17T20:09:42.595 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.593+0000 7f02208fb640 1 -- 10.20.193.123:0/2471065057 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0218070a10 msgr2=0x7f0218070df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:42.595 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.593+0000 7f02208fb640 1 --2- 10.20.193.123:0/2471065057 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0218070a10 0x7f0218070df0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f02100098a0 tx=0x7f021002ed80 comp rx=0 tx=0).stop 2026-02-17T20:09:42.595 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.593+0000 7f02208fb640 1 -- 10.20.193.123:0/2471065057 shutdown_connections 2026-02-17T20:09:42.595 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.593+0000 7f02208fb640 1 --2- 10.20.193.123:0/2471065057 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0218072ec0 0x7f0218071330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:42.596 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.593+0000 7f02208fb640 1 --2- 10.20.193.123:0/2471065057 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0218070a10 0x7f0218070df0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:42.596 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.593+0000 7f02208fb640 1 -- 10.20.193.123:0/2471065057 >> 10.20.193.123:0/2471065057 conn(0x7f021809dc60 msgr2=0x7f021809e070 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:42.596 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.593+0000 7f02208fb640 1 -- 10.20.193.123:0/2471065057 shutdown_connections 2026-02-17T20:09:42.596 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.593+0000 7f02208fb640 1 -- 10.20.193.123:0/2471065057 wait complete. 2026-02-17T20:09:42.596 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.594+0000 7f02208fb640 1 Processor -- start 2026-02-17T20:09:42.596 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.594+0000 7f02208fb640 1 -- start start 2026-02-17T20:09:42.596 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.594+0000 7f02208fb640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0218070a10 0x7f02181255e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:42.596 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.594+0000 7f02208fb640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0218071870 0x7f0218125b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:42.596 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.594+0000 7f02208fb640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0218072ec0 0x7f0218126060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:42.596 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.594+0000 7f02208fb640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7f02181385b0 con 0x7f0218071870 2026-02-17T20:09:42.597 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.594+0000 7f02208fb640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f0218138430 con 0x7f0218070a10 2026-02-17T20:09:42.597 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.594+0000 7f02208fb640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f0218138730 con 0x7f0218072ec0 2026-02-17T20:09:42.597 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.594+0000 7f021de6f640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0218071870 0x7f0218125b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:42.597 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.594+0000 7f021e670640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0218070a10 0x7f02181255e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:42.597 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.594+0000 7f021de6f640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0218071870 0x7f0218125b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:58140/0 (socket says 10.20.193.123:58140) 2026-02-17T20:09:42.597 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.594+0000 7f021de6f640 1 -- 10.20.193.123:0/2154613134 learned_addr learned my addr 10.20.193.123:0/2154613134 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:42.597 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.594+0000 7f021ee71640 1 --2- 10.20.193.123:0/2154613134 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0218072ec0 0x7f0218126060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:42.597 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.594+0000 7f021e670640 1 -- 10.20.193.123:0/2154613134 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0218072ec0 msgr2=0x7f0218126060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:42.597 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.594+0000 7f021e670640 1 --2- 10.20.193.123:0/2154613134 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0218072ec0 0x7f0218126060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:42.597 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.594+0000 7f021e670640 1 -- 10.20.193.123:0/2154613134 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0218071870 msgr2=0x7f0218125b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:42.597 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.594+0000 7f021e670640 1 --2- 10.20.193.123:0/2154613134 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0218071870 0x7f0218125b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:42.598 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.594+0000 7f021e670640 1 -- 10.20.193.123:0/2154613134 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02180742a0 con 0x7f0218070a10 2026-02-17T20:09:42.598 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.595+0000 7f021e670640 1 --2- 10.20.193.123:0/2154613134 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0218070a10 0x7f02181255e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f021809bdd0 tx=0x7f02100047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:42.598 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.595+0000 7f0202ffd640 1 -- 10.20.193.123:0/2154613134 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0210044020 con 0x7f0218070a10 2026-02-17T20:09:42.598 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.595+0000 7f0202ffd640 1 -- 10.20.193.123:0/2154613134 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0210003b40 con 0x7f0218070a10 2026-02-17T20:09:42.598 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.595+0000 7f02208fb640 1 -- 10.20.193.123:0/2154613134 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0218127860 con 0x7f0218070a10 2026-02-17T20:09:42.598 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.595+0000 7f0202ffd640 1 -- 10.20.193.123:0/2154613134 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f021003c040 con 0x7f0218070a10 2026-02-17T20:09:42.598 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.595+0000 7f02208fb640 1 -- 10.20.193.123:0/2154613134 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f02181283d0 con 0x7f0218070a10 2026-02-17T20:09:42.598 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.595+0000 7f02208fb640 1 -- 10.20.193.123:0/2154613134 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0218070df0 con 0x7f0218070a10 2026-02-17T20:09:42.598 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.595+0000 7f0202ffd640 1 -- 10.20.193.123:0/2154613134 <== mon.1 v2:10.20.193.123:3301/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f021003f030 con 0x7f0218070a10 2026-02-17T20:09:42.598 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.596+0000 7f0202ffd640 1 -- 10.20.193.123:0/2154613134 <== mon.1 v2:10.20.193.123:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 3025+0+0 (secure 0 0 0) 0x7f021008b7a0 con 0x7f0218070a10 2026-02-17T20:09:42.599 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.598+0000 7f0202ffd640 1 -- 10.20.193.123:0/2154613134 <== mon.1 v2:10.20.193.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f021004e030 con 0x7f0218070a10 2026-02-17T20:09:42.663 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:42.667+0000 7f02208fb640 1 -- 10.20.193.123:0/2154613134 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command({"prefix": "osd pool set", "pool": "rbd", "var": "pg_autoscale_mode", "val": "off"} v 0) -- 0x7f0218069f10 con 0x7f0218070a10 2026-02-17T20:09:43.390 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.394+0000 7f0202ffd640 1 -- 10.20.193.123:0/2154613134 <== mon.1 v2:10.20.193.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "rbd", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 1 pg_autoscale_mode to off v29) ==== 152+0+0 (secure 0 0 0) 0x7f02100655a0 con 0x7f0218070a10 2026-02-17T20:09:43.391 INFO:teuthology.orchestra.run.trial123.stderr:set pool 1 pg_autoscale_mode to off 2026-02-17T20:09:43.392 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.395+0000 7f02208fb640 1 -- 10.20.193.123:0/2154613134 >> v1:10.20.193.123:6800/115662061 conn(0x7f01e804f790 legacy=0x7f01e8051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:43.392 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.395+0000 7f02208fb640 1 -- 10.20.193.123:0/2154613134 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0218070a10 msgr2=0x7f02181255e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:43.392 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.395+0000 7f02208fb640 1 --2- 10.20.193.123:0/2154613134 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0218070a10 0x7f02181255e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f021809bdd0 tx=0x7f02100047c0 comp rx=0 tx=0).stop 2026-02-17T20:09:43.393 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.395+0000 7f02208fb640 1 -- 10.20.193.123:0/2154613134 shutdown_connections 2026-02-17T20:09:43.393 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.395+0000 7f02208fb640 1 --2- 10.20.193.123:0/2154613134 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0218072ec0 0x7f0218126060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:43.393 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.395+0000 7f02208fb640 1 --2- 10.20.193.123:0/2154613134 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0218071870 0x7f0218125b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:43.393 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.395+0000 7f02208fb640 1 --2- 10.20.193.123:0/2154613134 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0218070a10 0x7f02181255e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:43.393 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.395+0000 7f02208fb640 1 -- 10.20.193.123:0/2154613134 >> 10.20.193.123:0/2154613134 conn(0x7f021809dc60 msgr2=0x7f021806e580 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:43.393 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.395+0000 7f02208fb640 1 -- 10.20.193.123:0/2154613134 shutdown_connections 2026-02-17T20:09:43.393 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.395+0000 7f02208fb640 1 -- 10.20.193.123:0/2154613134 wait complete. 2026-02-17T20:09:43.440 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.444+0000 7f8545849640 1 Processor -- start 2026-02-17T20:09:43.440 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.444+0000 7f8545849640 1 -- start start 2026-02-17T20:09:43.440 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.444+0000 7f8545849640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f8540070a10 0x7f8540070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:43.440 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.444+0000 7f8545849640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f8540072ec0 0x7f8540071330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:43.440 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.444+0000 7f8545849640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8540072940 con 0x7f8540071870 2026-02-17T20:09:43.440 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.444+0000 7f8545849640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7f8540073a70 con 0x7f8540070a10 2026-02-17T20:09:43.441 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.444+0000 7f8545849640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f8540071cc0 con 0x7f8540072ec0 2026-02-17T20:09:43.441 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.444+0000 7f853effd640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f8540070a10 0x7f8540070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:43.441 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.444+0000 7f853f7fe640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7f8540071870 0x7f8540136b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:54378/0 (socket says 10.20.193.123:54378) 2026-02-17T20:09:43.441 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.444+0000 7f853e7fc640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f8540072ec0 0x7f8540071330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:43.441 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.444+0000 7f853f7fe640 1 -- 10.20.193.123:0/2552622327 learned_addr learned my addr 10.20.193.123:0/2552622327 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:09:43.441 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.445+0000 7f853effd640 1 -- 10.20.193.123:0/2552622327 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f8540072ec0 msgr2=0x7f8540071330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:43.441 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.445+0000 7f853effd640 1 --2- 10.20.193.123:0/2552622327 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f8540072ec0 0x7f8540071330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:43.441 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.445+0000 7f853effd640 1 -- 10.20.193.123:0/2552622327 >> v1:10.20.193.123:6789/0 conn(0x7f8540071870 legacy=0x7f8540136b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:43.441 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.445+0000 7f853effd640 1 -- 10.20.193.123:0/2552622327 --> v2:10.20.193.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8540071ec0 con 0x7f8540070a10 2026-02-17T20:09:43.441 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.445+0000 7f853dffb640 1 -- 10.20.193.123:0/2552622327 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 606783746 0 0) 0x7f8540072940 con 0x7f8540071870 2026-02-17T20:09:43.441 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.445+0000 7f853e7fc640 1 --2- 10.20.193.123:0/2552622327 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f8540072ec0 0x7f8540071330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:43.441 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.445+0000 7f853effd640 1 --2- 10.20.193.123:0/2552622327 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f8540070a10 0x7f8540070df0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f85340098a0 tx=0x7f853402ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3001a6bcb90b29d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:43.441 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.445+0000 7f853dffb640 1 -- 10.20.193.123:0/2552622327 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853403c070 con 0x7f8540070a10 2026-02-17T20:09:43.441 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.445+0000 7f853dffb640 1 -- 10.20.193.123:0/2552622327 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f853402fa40 con 0x7f8540070a10 2026-02-17T20:09:43.441 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.445+0000 7f853dffb640 1 -- 10.20.193.123:0/2552622327 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853402fe10 con 0x7f8540070a10 2026-02-17T20:09:43.442 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.445+0000 7f8545849640 1 -- 10.20.193.123:0/2552622327 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f8540070a10 msgr2=0x7f8540070df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:43.442 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.445+0000 7f8545849640 1 --2- 10.20.193.123:0/2552622327 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f8540070a10 0x7f8540070df0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f85340098a0 tx=0x7f853402ed80 comp rx=0 tx=0).stop 2026-02-17T20:09:43.442 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.446+0000 7f8545849640 1 -- 10.20.193.123:0/2552622327 shutdown_connections 2026-02-17T20:09:43.442 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.446+0000 7f8545849640 1 --2- 10.20.193.123:0/2552622327 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f8540072ec0 0x7f8540071330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:43.442 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.446+0000 7f8545849640 1 --2- 10.20.193.123:0/2552622327 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f8540070a10 0x7f8540070df0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:43.442 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.446+0000 7f8545849640 1 -- 10.20.193.123:0/2552622327 >> 10.20.193.123:0/2552622327 conn(0x7f854009dc60 msgr2=0x7f854009e070 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:43.442 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.446+0000 7f8545849640 1 -- 10.20.193.123:0/2552622327 shutdown_connections 2026-02-17T20:09:43.442 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.446+0000 7f8545849640 1 -- 10.20.193.123:0/2552622327 wait complete. 2026-02-17T20:09:43.442 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.446+0000 7f8545849640 1 Processor -- start 2026-02-17T20:09:43.442 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.446+0000 7f8545849640 1 -- start start 2026-02-17T20:09:43.442 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.446+0000 7f8545849640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f8540070a10 0x7f85401256b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:43.442 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.446+0000 7f8545849640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f8540071870 0x7f8540125bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:43.442 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.446+0000 7f8545849640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f8540072ec0 0x7f8540126130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:43.442 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.446+0000 7f8545849640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7f85401385b0 con 0x7f8540071870 2026-02-17T20:09:43.442 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.446+0000 7f8545849640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f8540138430 con 0x7f8540070a10 2026-02-17T20:09:43.442 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.446+0000 7f8545849640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f8540138730 con 0x7f8540072ec0 2026-02-17T20:09:43.442 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.446+0000 7f853e7fc640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f8540071870 0x7f8540125bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:43.442 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.446+0000 7f853effd640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f8540070a10 0x7f85401256b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:43.443 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.446+0000 7f853effd640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f8540070a10 0x7f85401256b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:57794/0 (socket says 10.20.193.123:57794) 2026-02-17T20:09:43.443 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.447+0000 7f853effd640 1 -- 10.20.193.123:0/1075869199 learned_addr learned my addr 10.20.193.123:0/1075869199 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:43.443 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.446+0000 7f853e7fc640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f8540071870 0x7f8540125bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:58156/0 (socket says 10.20.193.123:58156) 2026-02-17T20:09:43.443 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.447+0000 7f853f7fe640 1 --2- 10.20.193.123:0/1075869199 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f8540072ec0 0x7f8540126130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:43.443 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.447+0000 7f853e7fc640 1 -- 10.20.193.123:0/1075869199 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f8540072ec0 msgr2=0x7f8540126130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:43.443 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.447+0000 7f853e7fc640 1 --2- 10.20.193.123:0/1075869199 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f8540072ec0 0x7f8540126130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:43.443 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.447+0000 7f853e7fc640 1 -- 10.20.193.123:0/1075869199 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f8540070a10 msgr2=0x7f85401256b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:43.443 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.447+0000 7f853e7fc640 1 --2- 10.20.193.123:0/1075869199 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f8540070a10 0x7f85401256b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:43.443 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.447+0000 7f853e7fc640 1 -- 10.20.193.123:0/1075869199 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8540127a10 con 0x7f8540071870 2026-02-17T20:09:43.443 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.447+0000 7f853effd640 1 --2- 10.20.193.123:0/1075869199 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f8540070a10 0x7f85401256b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:43.443 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.447+0000 7f853e7fc640 1 --2- 10.20.193.123:0/1075869199 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f8540071870 0x7f8540125bf0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f852800ebe0 tx=0x7f852800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:43.443 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.447+0000 7f8517fff640 1 -- 10.20.193.123:0/1075869199 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8528017070 con 0x7f8540071870 2026-02-17T20:09:43.443 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.447+0000 7f8517fff640 1 -- 10.20.193.123:0/1075869199 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f852800cc40 con 0x7f8540071870 2026-02-17T20:09:43.443 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.447+0000 7f8545849640 1 -- 10.20.193.123:0/1075869199 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85400742a0 con 0x7f8540071870 2026-02-17T20:09:43.443 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.447+0000 7f8517fff640 1 -- 10.20.193.123:0/1075869199 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8528013470 con 0x7f8540071870 2026-02-17T20:09:43.443 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.447+0000 7f8545849640 1 -- 10.20.193.123:0/1075869199 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8540128550 con 0x7f8540071870 2026-02-17T20:09:43.443 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.447+0000 7f8545849640 1 -- 10.20.193.123:0/1075869199 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8540070df0 con 0x7f8540071870 2026-02-17T20:09:43.443 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.448+0000 7f8517fff640 1 -- 10.20.193.123:0/1075869199 <== mon.0 v2:10.20.193.123:3300/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f8528024060 con 0x7f8540071870 2026-02-17T20:09:43.444 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.448+0000 7f8517fff640 1 -- 10.20.193.123:0/1075869199 <== mon.0 v2:10.20.193.123:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 3025+0+0 (secure 0 0 0) 0x7f8528066ac0 con 0x7f8540071870 2026-02-17T20:09:43.445 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.450+0000 7f8517fff640 1 -- 10.20.193.123:0/1075869199 <== mon.0 v2:10.20.193.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f85280408b0 con 0x7f8540071870 2026-02-17T20:09:43.519 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:43.523+0000 7f8545849640 1 -- 10.20.193.123:0/1075869199 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "osd pool set", "pool": ".mgr", "var": "pg_autoscale_mode", "val": "off"} v 0) -- 0x7f854006bd40 con 0x7f8540071870 2026-02-17T20:09:44.391 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.395+0000 7f8517fff640 1 -- 10.20.193.123:0/1075869199 <== mon.0 v2:10.20.193.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": ".mgr", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 2 pg_autoscale_mode to off v30) ==== 153+0+0 (secure 0 0 0) 0x7f8528065b70 con 0x7f8540071870 2026-02-17T20:09:44.391 INFO:teuthology.orchestra.run.trial123.stderr:set pool 2 pg_autoscale_mode to off 2026-02-17T20:09:44.393 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.397+0000 7f8545849640 1 -- 10.20.193.123:0/1075869199 >> v1:10.20.193.123:6800/115662061 conn(0x7f851004f790 legacy=0x7f8510051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:44.393 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.397+0000 7f8545849640 1 -- 10.20.193.123:0/1075869199 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f8540071870 msgr2=0x7f8540125bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:44.393 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.397+0000 7f8545849640 1 --2- 10.20.193.123:0/1075869199 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f8540071870 0x7f8540125bf0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f852800ebe0 tx=0x7f852800c520 comp rx=0 tx=0).stop 2026-02-17T20:09:44.393 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.397+0000 7f8545849640 1 -- 10.20.193.123:0/1075869199 shutdown_connections 2026-02-17T20:09:44.393 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.397+0000 7f8545849640 1 --2- 10.20.193.123:0/1075869199 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f8540072ec0 0x7f8540126130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:44.393 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.397+0000 7f8545849640 1 --2- 10.20.193.123:0/1075869199 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f8540071870 0x7f8540125bf0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:44.394 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.397+0000 7f8545849640 1 --2- 10.20.193.123:0/1075869199 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f8540070a10 0x7f85401256b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:44.394 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.397+0000 7f8545849640 1 -- 10.20.193.123:0/1075869199 >> 10.20.193.123:0/1075869199 conn(0x7f854009dc60 msgr2=0x7f854006e670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:44.394 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.397+0000 7f8545849640 1 -- 10.20.193.123:0/1075869199 shutdown_connections 2026-02-17T20:09:44.394 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.397+0000 7f8545849640 1 -- 10.20.193.123:0/1075869199 wait complete. 2026-02-17T20:09:44.402 INFO:teuthology.run_tasks:Running task ceph.healthy... 2026-02-17T20:09:44.419 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-17T20:09:44.419 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-17T20:09:44.419 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-17T20:09:44.492 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.492+0000 7f5d535bf640 1 Processor -- start 2026-02-17T20:09:44.492 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.492+0000 7f5d535bf640 1 -- start start 2026-02-17T20:09:44.492 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.492+0000 7f5d535bf640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f5d4c1333c0 0x7f5d4c1357b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:44.492 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.492+0000 7f5d535bf640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f5d4c135cf0 0x7f5d4c1380e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:44.492 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.492+0000 7f5d535bf640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d4c06e6a0 con 0x7f5d4c12d020 2026-02-17T20:09:44.493 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.492+0000 7f5d535bf640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7f5d4c071cc0 con 0x7f5d4c135cf0 2026-02-17T20:09:44.493 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.492+0000 7f5d535bf640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f5d4c12cbd0 con 0x7f5d4c1333c0 2026-02-17T20:09:44.493 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.492+0000 7f5d51334640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7f5d4c12d020 0x7f5d4c12d400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:54380/0 (socket says 10.20.193.123:54380) 2026-02-17T20:09:44.493 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.492+0000 7f5d51334640 1 -- 10.20.193.123:0/3877737374 learned_addr learned my addr 10.20.193.123:0/3877737374 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:09:44.493 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.492+0000 7f5d50b33640 1 --2- 10.20.193.123:0/3877737374 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f5d4c1333c0 0x7f5d4c1357b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:44.493 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.492+0000 7f5d51b35640 1 --2- 10.20.193.123:0/3877737374 >> v2:10.20.193.123:3300/0 conn(0x7f5d4c135cf0 0x7f5d4c1380e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:44.493 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.492+0000 7f5d3bfff640 1 -- 10.20.193.123:0/3877737374 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3125377818 0 0) 0x7f5d4c06e6a0 con 0x7f5d4c12d020 2026-02-17T20:09:44.493 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.492+0000 7f5d3bfff640 1 -- 10.20.193.123:0/3877737374 --> v1:10.20.193.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d34003620 con 0x7f5d4c12d020 2026-02-17T20:09:44.493 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.492+0000 7f5d50b33640 1 -- 10.20.193.123:0/3877737374 >> v2:10.20.193.123:3300/0 conn(0x7f5d4c135cf0 msgr2=0x7f5d4c1380e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:44.493 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.492+0000 7f5d50b33640 1 --2- 10.20.193.123:0/3877737374 >> v2:10.20.193.123:3300/0 conn(0x7f5d4c135cf0 0x7f5d4c1380e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:44.493 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.492+0000 7f5d50b33640 1 -- 10.20.193.123:0/3877737374 >> v1:10.20.193.123:6789/0 conn(0x7f5d4c12d020 legacy=0x7f5d4c12d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:44.494 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.492+0000 7f5d50b33640 1 -- 10.20.193.123:0/3877737374 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d4c072fe0 con 0x7f5d4c1333c0 2026-02-17T20:09:44.494 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.492+0000 7f5d51b35640 1 --2- 10.20.193.123:0/3877737374 >> v2:10.20.193.123:3300/0 conn(0x7f5d4c135cf0 0x7f5d4c1380e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:44.494 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.493+0000 7f5d50b33640 1 --2- 10.20.193.123:0/3877737374 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f5d4c1333c0 0x7f5d4c1357b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5d400098a0 tx=0x7f5d4002ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29ef8a55330829e2 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:44.494 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.493+0000 7f5d3bfff640 1 -- 10.20.193.123:0/3877737374 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d4003c070 con 0x7f5d4c1333c0 2026-02-17T20:09:44.494 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.493+0000 7f5d3bfff640 1 -- 10.20.193.123:0/3877737374 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d4002fa40 con 0x7f5d4c1333c0 2026-02-17T20:09:44.494 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.493+0000 7f5d3bfff640 1 -- 10.20.193.123:0/3877737374 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d4002fe10 con 0x7f5d4c1333c0 2026-02-17T20:09:44.494 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.493+0000 7f5d535bf640 1 -- 10.20.193.123:0/3877737374 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f5d4c1333c0 msgr2=0x7f5d4c1357b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:44.494 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.493+0000 7f5d535bf640 1 --2- 10.20.193.123:0/3877737374 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f5d4c1333c0 0x7f5d4c1357b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5d400098a0 tx=0x7f5d4002ed80 comp rx=0 tx=0).stop 2026-02-17T20:09:44.494 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.493+0000 7f5d535bf640 1 -- 10.20.193.123:0/3877737374 shutdown_connections 2026-02-17T20:09:44.494 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.493+0000 7f5d535bf640 1 --2- 10.20.193.123:0/3877737374 >> v2:10.20.193.123:3300/0 conn(0x7f5d4c135cf0 0x7f5d4c1380e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:44.494 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.493+0000 7f5d535bf640 1 --2- 10.20.193.123:0/3877737374 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f5d4c1333c0 0x7f5d4c1357b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:44.494 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.493+0000 7f5d535bf640 1 -- 10.20.193.123:0/3877737374 >> 10.20.193.123:0/3877737374 conn(0x7f5d4c09cb30 msgr2=0x7f5d4c06f550 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:44.495 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.493+0000 7f5d535bf640 1 -- 10.20.193.123:0/3877737374 shutdown_connections 2026-02-17T20:09:44.495 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.493+0000 7f5d535bf640 1 -- 10.20.193.123:0/3877737374 wait complete. 2026-02-17T20:09:44.495 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.494+0000 7f5d535bf640 1 Processor -- start 2026-02-17T20:09:44.495 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.494+0000 7f5d535bf640 1 -- start start 2026-02-17T20:09:44.495 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.494+0000 7f5d535bf640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f5d4c12d020 0x7f5d4c130630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:44.495 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.494+0000 7f5d535bf640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f5d4c1333c0 0x7f5d4c130b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:44.495 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.494+0000 7f5d535bf640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f5d4c135cf0 0x7f5d4c1310b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:44.495 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.494+0000 7f5d535bf640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5d4c1389b0 con 0x7f5d4c1333c0 2026-02-17T20:09:44.495 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.494+0000 7f5d535bf640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f5d4c138830 con 0x7f5d4c12d020 2026-02-17T20:09:44.495 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.494+0000 7f5d535bf640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f5d4c138b30 con 0x7f5d4c135cf0 2026-02-17T20:09:44.495 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.494+0000 7f5d50b33640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f5d4c1333c0 0x7f5d4c130b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:44.495 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.494+0000 7f5d50b33640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f5d4c1333c0 0x7f5d4c130b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:58186/0 (socket says 10.20.193.123:58186) 2026-02-17T20:09:44.495 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.494+0000 7f5d51334640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f5d4c12d020 0x7f5d4c130630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:44.496 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.494+0000 7f5d50b33640 1 -- 10.20.193.123:0/1637870288 learned_addr learned my addr 10.20.193.123:0/1637870288 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:44.496 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.494+0000 7f5d51b35640 1 --2- 10.20.193.123:0/1637870288 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f5d4c135cf0 0x7f5d4c1310b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:44.496 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.494+0000 7f5d50b33640 1 -- 10.20.193.123:0/1637870288 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f5d4c135cf0 msgr2=0x7f5d4c1310b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:44.496 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.494+0000 7f5d50b33640 1 --2- 10.20.193.123:0/1637870288 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f5d4c135cf0 0x7f5d4c1310b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:44.496 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.494+0000 7f5d50b33640 1 -- 10.20.193.123:0/1637870288 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f5d4c12d020 msgr2=0x7f5d4c130630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:44.496 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.494+0000 7f5d50b33640 1 --2- 10.20.193.123:0/1637870288 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f5d4c12d020 0x7f5d4c130630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:44.496 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.494+0000 7f5d50b33640 1 -- 10.20.193.123:0/1637870288 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d4c12a4c0 con 0x7f5d4c1333c0 2026-02-17T20:09:44.496 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.494+0000 7f5d50b33640 1 --2- 10.20.193.123:0/1637870288 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f5d4c1333c0 0x7f5d4c130b70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5d40009130 tx=0x7f5d400047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:44.496 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.494+0000 7f5d39ffb640 1 -- 10.20.193.123:0/1637870288 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d4003c040 con 0x7f5d4c1333c0 2026-02-17T20:09:44.496 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.494+0000 7f5d39ffb640 1 -- 10.20.193.123:0/1637870288 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d4002f840 con 0x7f5d4c1333c0 2026-02-17T20:09:44.496 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.494+0000 7f5d535bf640 1 -- 10.20.193.123:0/1637870288 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d4c132150 con 0x7f5d4c1333c0 2026-02-17T20:09:44.497 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.494+0000 7f5d39ffb640 1 -- 10.20.193.123:0/1637870288 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d40042670 con 0x7f5d4c1333c0 2026-02-17T20:09:44.497 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.494+0000 7f5d535bf640 1 -- 10.20.193.123:0/1637870288 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d4c11a9a0 con 0x7f5d4c1333c0 2026-02-17T20:09:44.497 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.495+0000 7f5d535bf640 1 -- 10.20.193.123:0/1637870288 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d4c12d400 con 0x7f5d4c1333c0 2026-02-17T20:09:44.497 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.495+0000 7f5d39ffb640 1 -- 10.20.193.123:0/1637870288 <== mon.0 v2:10.20.193.123:3300/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f5d4004b410 con 0x7f5d4c1333c0 2026-02-17T20:09:44.497 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.495+0000 7f5d39ffb640 1 -- 10.20.193.123:0/1637870288 <== mon.0 v2:10.20.193.123:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3025+0+0 (secure 0 0 0) 0x7f5d4008b8f0 con 0x7f5d4c1333c0 2026-02-17T20:09:44.497 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.497+0000 7f5d39ffb640 1 -- 10.20.193.123:0/1637870288 <== mon.0 v2:10.20.193.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f5d40050020 con 0x7f5d4c1333c0 2026-02-17T20:09:44.576 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.580+0000 7f5d535bf640 1 -- 10.20.193.123:0/1637870288 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f5d4c068530 con 0x7f5d4c1333c0 2026-02-17T20:09:44.577 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.581+0000 7f5d39ffb640 1 -- 10.20.193.123:0/1637870288 <== mon.0 v2:10.20.193.123:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v10) ==== 74+0+121460 (secure 0 0 0) 0x7f5d40065790 con 0x7f5d4c1333c0 2026-02-17T20:09:44.579 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:09:44.581 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.582+0000 7f5d535bf640 1 -- 10.20.193.123:0/1637870288 >> v1:10.20.193.123:6800/115662061 conn(0x7f5d1c04f790 legacy=0x7f5d1c051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:44.581 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.582+0000 7f5d535bf640 1 -- 10.20.193.123:0/1637870288 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f5d4c1333c0 msgr2=0x7f5d4c130b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:44.581 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.582+0000 7f5d535bf640 1 --2- 10.20.193.123:0/1637870288 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f5d4c1333c0 0x7f5d4c130b70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5d40009130 tx=0x7f5d400047c0 comp rx=0 tx=0).stop 2026-02-17T20:09:44.581 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.582+0000 7f5d535bf640 1 -- 10.20.193.123:0/1637870288 shutdown_connections 2026-02-17T20:09:44.581 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.582+0000 7f5d535bf640 1 --2- 10.20.193.123:0/1637870288 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f5d4c135cf0 0x7f5d4c1310b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:44.581 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.582+0000 7f5d535bf640 1 --2- 10.20.193.123:0/1637870288 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f5d4c1333c0 0x7f5d4c130b70 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:44.581 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.582+0000 7f5d535bf640 1 --2- 10.20.193.123:0/1637870288 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f5d4c12d020 0x7f5d4c130630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:44.581 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.582+0000 7f5d535bf640 1 -- 10.20.193.123:0/1637870288 >> 10.20.193.123:0/1637870288 conn(0x7f5d4c09cb30 msgr2=0x7f5d4c09d810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:44.581 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.582+0000 7f5d535bf640 1 -- 10.20.193.123:0/1637870288 shutdown_connections 2026-02-17T20:09:44.581 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.582+0000 7f5d535bf640 1 -- 10.20.193.123:0/1637870288 wait complete. 2026-02-17T20:09:44.586 INFO:teuthology.orchestra.run.trial123.stdout:{"epoch":10,"flags":0,"active_gid":14107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6800","nonce":115662061}]},"active_addr":"10.20.193.123:6800/115662061","active_change":"2026-02-17T20:09:24.315515+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":14100,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":17,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.123:0","nonce":1587130660}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.123:0","nonce":1083457194}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.123:0","nonce":3814449433}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.123:0","nonce":655993150}]}]} 2026-02-17T20:09:44.594 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-17T20:09:44.594 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-17T20:09:44.595 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T20:09:44.666 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.665+0000 7f70aa338640 1 Processor -- start 2026-02-17T20:09:44.666 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.665+0000 7f70aa338640 1 -- start start 2026-02-17T20:09:44.666 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.666+0000 7f70aa338640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f70a4073910 0x7f70a4139ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:44.666 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.666+0000 7f70aa338640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f70a413a020 0x7f70a413c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:44.666 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.666+0000 7f70aa338640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70a4072940 con 0x7f70a4071600 2026-02-17T20:09:44.667 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.666+0000 7f70aa338640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7f70a4074220 con 0x7f70a413a020 2026-02-17T20:09:44.667 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.666+0000 7f70aa338640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f70a40720f0 con 0x7f70a4073910 2026-02-17T20:09:44.667 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.666+0000 7f70a3fff640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7f70a4071600 0x7f70a40719e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:54382/0 (socket says 10.20.193.123:54382) 2026-02-17T20:09:44.667 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.666+0000 7f70a3fff640 1 -- 10.20.193.123:0/3455298614 learned_addr learned my addr 10.20.193.123:0/3455298614 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:09:44.667 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.666+0000 7f70a37fe640 1 --2- 10.20.193.123:0/3455298614 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f70a4073910 0x7f70a4139ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:44.667 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.666+0000 7f70a88ae640 1 --2- 10.20.193.123:0/3455298614 >> v2:10.20.193.123:3300/0 conn(0x7f70a413a020 0x7f70a413c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:44.667 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.666+0000 7f70a2ffd640 1 -- 10.20.193.123:0/3455298614 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1224526931 0 0) 0x7f70a4072940 con 0x7f70a4071600 2026-02-17T20:09:44.667 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.666+0000 7f70a2ffd640 1 -- 10.20.193.123:0/3455298614 --> v1:10.20.193.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7088003620 con 0x7f70a4071600 2026-02-17T20:09:44.667 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.666+0000 7f70a37fe640 1 -- 10.20.193.123:0/3455298614 >> v2:10.20.193.123:3300/0 conn(0x7f70a413a020 msgr2=0x7f70a413c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:44.667 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.666+0000 7f70a37fe640 1 --2- 10.20.193.123:0/3455298614 >> v2:10.20.193.123:3300/0 conn(0x7f70a413a020 0x7f70a413c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:44.667 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.666+0000 7f70a37fe640 1 -- 10.20.193.123:0/3455298614 >> v1:10.20.193.123:6789/0 conn(0x7f70a4071600 legacy=0x7f70a40719e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:44.667 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.666+0000 7f70a37fe640 1 -- 10.20.193.123:0/3455298614 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70a4072f40 con 0x7f70a4073910 2026-02-17T20:09:44.668 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.666+0000 7f70a88ae640 1 --2- 10.20.193.123:0/3455298614 >> v2:10.20.193.123:3300/0 conn(0x7f70a413a020 0x7f70a413c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:44.668 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.666+0000 7f70a37fe640 1 --2- 10.20.193.123:0/3455298614 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f70a4073910 0x7f70a4139ae0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f70940098a0 tx=0x7f709402ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1d38cfe485012ba server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:44.668 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.667+0000 7f70a2ffd640 1 -- 10.20.193.123:0/3455298614 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f709403c070 con 0x7f70a4073910 2026-02-17T20:09:44.668 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.667+0000 7f70a2ffd640 1 -- 10.20.193.123:0/3455298614 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f709402fa40 con 0x7f70a4073910 2026-02-17T20:09:44.668 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.667+0000 7f70a2ffd640 1 -- 10.20.193.123:0/3455298614 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f709402fdf0 con 0x7f70a4073910 2026-02-17T20:09:44.668 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.667+0000 7f70aa338640 1 -- 10.20.193.123:0/3455298614 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f70a4073910 msgr2=0x7f70a4139ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:44.668 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.667+0000 7f70aa338640 1 --2- 10.20.193.123:0/3455298614 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f70a4073910 0x7f70a4139ae0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f70940098a0 tx=0x7f709402ed80 comp rx=0 tx=0).stop 2026-02-17T20:09:44.668 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.667+0000 7f70aa338640 1 -- 10.20.193.123:0/3455298614 shutdown_connections 2026-02-17T20:09:44.668 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.667+0000 7f70aa338640 1 --2- 10.20.193.123:0/3455298614 >> v2:10.20.193.123:3300/0 conn(0x7f70a413a020 0x7f70a413c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:44.668 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.667+0000 7f70aa338640 1 --2- 10.20.193.123:0/3455298614 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f70a4073910 0x7f70a4139ae0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:44.668 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.667+0000 7f70aa338640 1 -- 10.20.193.123:0/3455298614 >> 10.20.193.123:0/3455298614 conn(0x7f70a409d6c0 msgr2=0x7f70a409dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:44.669 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.667+0000 7f70aa338640 1 -- 10.20.193.123:0/3455298614 shutdown_connections 2026-02-17T20:09:44.669 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.667+0000 7f70aa338640 1 -- 10.20.193.123:0/3455298614 wait complete. 2026-02-17T20:09:44.669 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.667+0000 7f70aa338640 1 Processor -- start 2026-02-17T20:09:44.669 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.667+0000 7f70aa338640 1 -- start start 2026-02-17T20:09:44.669 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.668+0000 7f70aa338640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f70a4071600 0x7f70a4114ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:44.669 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.668+0000 7f70aa338640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f70a4073910 0x7f70a41153e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:44.669 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.668+0000 7f70aa338640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f70a413a020 0x7f70a4115920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:44.669 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.668+0000 7f70aa338640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7f70a413cce0 con 0x7f70a413a020 2026-02-17T20:09:44.669 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.668+0000 7f70aa338640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f70a413cb60 con 0x7f70a4073910 2026-02-17T20:09:44.669 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.668+0000 7f70aa338640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f70a413ce60 con 0x7f70a4071600 2026-02-17T20:09:44.669 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.668+0000 7f70a3fff640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f70a4071600 0x7f70a4114ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:44.669 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.668+0000 7f70a88ae640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f70a413a020 0x7f70a4115920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:44.669 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.668+0000 7f70a3fff640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f70a4071600 0x7f70a4114ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:52242/0 (socket says 10.20.193.123:52242) 2026-02-17T20:09:44.670 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.668+0000 7f70a3fff640 1 -- 10.20.193.123:0/429202966 learned_addr learned my addr 10.20.193.123:0/429202966 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:44.670 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.668+0000 7f70a37fe640 1 --2- 10.20.193.123:0/429202966 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f70a4073910 0x7f70a41153e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:44.670 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.668+0000 7f70a3fff640 1 -- 10.20.193.123:0/429202966 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f70a4073910 msgr2=0x7f70a41153e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:44.670 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.668+0000 7f70a3fff640 1 --2- 10.20.193.123:0/429202966 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f70a4073910 0x7f70a41153e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:44.670 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.668+0000 7f70a3fff640 1 -- 10.20.193.123:0/429202966 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f70a413a020 msgr2=0x7f70a4115920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:44.670 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.668+0000 7f70a3fff640 1 --2- 10.20.193.123:0/429202966 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f70a413a020 0x7f70a4115920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:44.670 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.668+0000 7f70a3fff640 1 -- 10.20.193.123:0/429202966 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70a4116590 con 0x7f70a4071600 2026-02-17T20:09:44.670 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.668+0000 7f70a88ae640 1 --2- 10.20.193.123:0/429202966 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f70a413a020 0x7f70a4115920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:44.670 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.668+0000 7f70a3fff640 1 --2- 10.20.193.123:0/429202966 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f70a4071600 0x7f70a4114ea0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f709000c730 tx=0x7f709000cc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:44.670 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.668+0000 7f70a0ff9640 1 -- 10.20.193.123:0/429202966 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7090017070 con 0x7f70a4071600 2026-02-17T20:09:44.670 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.668+0000 7f70a0ff9640 1 -- 10.20.193.123:0/429202966 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7090005bb0 con 0x7f70a4071600 2026-02-17T20:09:44.671 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.668+0000 7f70aa338640 1 -- 10.20.193.123:0/429202966 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70a41160b0 con 0x7f70a4071600 2026-02-17T20:09:44.671 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.668+0000 7f70a0ff9640 1 -- 10.20.193.123:0/429202966 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7090007070 con 0x7f70a4071600 2026-02-17T20:09:44.671 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.668+0000 7f70aa338640 1 -- 10.20.193.123:0/429202966 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f70a4138c40 con 0x7f70a4071600 2026-02-17T20:09:44.671 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.669+0000 7f70aa338640 1 -- 10.20.193.123:0/429202966 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70a41168c0 con 0x7f70a4071600 2026-02-17T20:09:44.671 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.669+0000 7f70a0ff9640 1 -- 10.20.193.123:0/429202966 <== mon.2 v2:10.20.193.123:3302/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f7090007210 con 0x7f70a4071600 2026-02-17T20:09:44.671 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.669+0000 7f70a0ff9640 1 -- 10.20.193.123:0/429202966 <== mon.2 v2:10.20.193.123:3302/0 5 ==== osd_map(30..30 src has 1..30) ==== 3025+0+0 (secure 0 0 0) 0x7f70900661f0 con 0x7f70a4071600 2026-02-17T20:09:44.671 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.671+0000 7f70a0ff9640 1 -- 10.20.193.123:0/429202966 <== mon.2 v2:10.20.193.123:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f70a4116590 con 0x7f70a4071600 2026-02-17T20:09:44.738 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.742+0000 7f70aa338640 1 -- 10.20.193.123:0/429202966 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f70a40719e0 con 0x7f70a4071600 2026-02-17T20:09:44.739 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.742+0000 7f70a0ff9640 1 -- 10.20.193.123:0/429202966 <== mon.2 v2:10.20.193.123:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+9201 (secure 0 0 0) 0x7f709003ff40 con 0x7f70a4071600 2026-02-17T20:09:44.739 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:09:44.739 INFO:teuthology.orchestra.run.trial123.stdout:{"epoch":30,"fsid":"ddf342a7-b912-46f2-b373-84d7f3b75be2","created":"2026-02-17T20:08:19.090665+0000","modified":"2026-02-17T20:09:44.394074+0000","last_up_change":"2026-02-17T20:09:39.385739+0000","last_in_change":"2026-02-17T20:08:19.810884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"quincy","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-17T20:08:27.136671+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":13,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2026-02-17T20:08:28.174323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5cfdb97e-5584-42e3-8c32-a9b4ace549f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":17,"up_from":23,"up_thru":24,"down_at":18,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6801","nonce":458007068}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6802","nonce":458007068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6804","nonce":458007068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6803","nonce":458007068}]},"public_addr":"10.20.193.123:6801/458007068","cluster_addr":"10.20.193.123:6802/458007068","heartbeat_back_addr":"10.20.193.123:6804/458007068","heartbeat_front_addr":"10.20.193.123:6803/458007068","state":["exists","up"]},{"osd":1,"uuid":"9b7f5906-8ae8-4a34-8e71-1ba7cf3eeda1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":18,"up_from":24,"up_thru":26,"down_at":19,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6805","nonce":2594724968}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6806","nonce":2594724968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6808","nonce":2594724968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6807","nonce":2594724968}]},"public_addr":"10.20.193.123:6805/2594724968","cluster_addr":"10.20.193.123:6806/2594724968","heartbeat_back_addr":"10.20.193.123:6808/2594724968","heartbeat_front_addr":"10.20.193.123:6807/2594724968","state":["exists","up"]},{"osd":2,"uuid":"db6be5e2-fdd2-460f-bf35-269d92577824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":18,"up_from":25,"up_thru":26,"down_at":20,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6809","nonce":3596569166}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6810","nonce":3596569166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6812","nonce":3596569166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6811","nonce":3596569166}]},"public_addr":"10.20.193.123:6809/3596569166","cluster_addr":"10.20.193.123:6810/3596569166","heartbeat_back_addr":"10.20.193.123:6812/3596569166","heartbeat_front_addr":"10.20.193.123:6811/3596569166","state":["exists","up"]},{"osd":3,"uuid":"23275d01-0d57-497c-a600-d9aeef747af2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":20,"up_from":26,"up_thru":26,"down_at":21,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6813","nonce":2610635322}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6814","nonce":2610635322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6816","nonce":2610635322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6815","nonce":2610635322}]},"public_addr":"10.20.193.123:6813/2610635322","cluster_addr":"10.20.193.123:6814/2610635322","heartbeat_back_addr":"10.20.193.123:6816/2610635322","heartbeat_front_addr":"10.20.193.123:6815/2610635322","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:08:24.897268+0000","dead_epoch":18},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:08:24.890530+0000","dead_epoch":19},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:08:24.941602+0000","dead_epoch":20},{"osd":3,"down_stamp":"2026-02-17T20:09:31.377910+0000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:08:24.897001+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.123:0/3994607579":"2026-02-18T20:09:24.315453+0000","10.20.193.123:0/1995254470":"2026-02-18T20:09:24.315453+0000","10.20.193.123:0/2996849897":"2026-02-18T20:09:24.315453+0000","10.20.193.123:6800/23720":"2026-02-18T20:09:24.315453+0000","10.20.193.123:0/1130446084":"2026-02-18T20:09:24.315453+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T20:09:44.740 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.743+0000 7f70aa338640 1 -- 10.20.193.123:0/429202966 >> v1:10.20.193.123:6800/115662061 conn(0x7f707404f790 legacy=0x7f7074051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:44.740 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.743+0000 7f70aa338640 1 -- 10.20.193.123:0/429202966 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f70a4071600 msgr2=0x7f70a4114ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:44.740 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.743+0000 7f70aa338640 1 --2- 10.20.193.123:0/429202966 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f70a4071600 0x7f70a4114ea0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f709000c730 tx=0x7f709000cc00 comp rx=0 tx=0).stop 2026-02-17T20:09:44.740 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.743+0000 7f70aa338640 1 -- 10.20.193.123:0/429202966 shutdown_connections 2026-02-17T20:09:44.740 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.743+0000 7f70aa338640 1 --2- 10.20.193.123:0/429202966 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f70a413a020 0x7f70a4115920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:44.741 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.743+0000 7f70aa338640 1 --2- 10.20.193.123:0/429202966 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f70a4073910 0x7f70a41153e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:44.741 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.743+0000 7f70aa338640 1 --2- 10.20.193.123:0/429202966 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f70a4071600 0x7f70a4114ea0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:44.741 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.743+0000 7f70aa338640 1 -- 10.20.193.123:0/429202966 >> 10.20.193.123:0/429202966 conn(0x7f70a409d6c0 msgr2=0x7f70a4070160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:44.741 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.743+0000 7f70aa338640 1 -- 10.20.193.123:0/429202966 shutdown_connections 2026-02-17T20:09:44.741 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.743+0000 7f70aa338640 1 -- 10.20.193.123:0/429202966 wait complete. 2026-02-17T20:09:44.747 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-17T20:09:44.748 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T20:09:44.819 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.818+0000 7f4045038640 1 Processor -- start 2026-02-17T20:09:44.819 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.819+0000 7f4045038640 1 -- start start 2026-02-17T20:09:44.819 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.819+0000 7f4045038640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f4040071600 0x7f40400719e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:44.819 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.819+0000 7f4045038640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f4040073910 0x7f40401347c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:44.819 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.819+0000 7f4045038640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f4040071f20 0x7f4040134d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:44.819 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.819+0000 7f4045038640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7f4040074220 con 0x7f4040071f20 2026-02-17T20:09:44.820 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.819+0000 7f4045038640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f4040072940 con 0x7f4040073910 2026-02-17T20:09:44.820 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.819+0000 7f4045038640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f4040072f40 con 0x7f4040071600 2026-02-17T20:09:44.820 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.819+0000 7f403f577640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f4040071f20 0x7f4040134d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:44.820 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.819+0000 7f403ed76640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f4040071600 0x7f40400719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:44.820 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.819+0000 7f403e575640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f4040073910 0x7f40401347c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:44.820 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.819+0000 7f403f577640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f4040071f20 0x7f4040134d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:58218/0 (socket says 10.20.193.123:58218) 2026-02-17T20:09:44.820 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.819+0000 7f403ed76640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f4040071600 0x7f40400719e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:52246/0 (socket says 10.20.193.123:52246) 2026-02-17T20:09:44.820 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.819+0000 7f403f577640 1 -- 10.20.193.123:0/1943093977 learned_addr learned my addr 10.20.193.123:0/1943093977 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:44.820 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.819+0000 7f403f577640 1 -- 10.20.193.123:0/1943093977 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f4040071600 msgr2=0x7f40400719e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:44.820 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.819+0000 7f403f577640 1 --2- 10.20.193.123:0/1943093977 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f4040071600 0x7f40400719e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:44.820 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.819+0000 7f403f577640 1 -- 10.20.193.123:0/1943093977 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f4040073910 msgr2=0x7f40401347c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:44.821 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.819+0000 7f403f577640 1 --2- 10.20.193.123:0/1943093977 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f4040073910 0x7f40401347c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:44.821 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.819+0000 7f403f577640 1 -- 10.20.193.123:0/1943093977 --> v2:10.20.193.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4040135240 con 0x7f4040071f20 2026-02-17T20:09:44.821 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.819+0000 7f403ed76640 1 --2- 10.20.193.123:0/1943093977 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f4040071600 0x7f40400719e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:44.821 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.820+0000 7f403f577640 1 --2- 10.20.193.123:0/1943093977 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f4040071f20 0x7f4040134d00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4030009e80 tx=0x7f403002f280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=191f11c62914124d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:44.821 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.820+0000 7f403dd74640 1 -- 10.20.193.123:0/1943093977 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f403002fca0 con 0x7f4040071f20 2026-02-17T20:09:44.821 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.820+0000 7f403dd74640 1 -- 10.20.193.123:0/1943093977 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f403002fe40 con 0x7f4040071f20 2026-02-17T20:09:44.821 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.820+0000 7f403dd74640 1 -- 10.20.193.123:0/1943093977 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4030037610 con 0x7f4040071f20 2026-02-17T20:09:44.821 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.820+0000 7f4045038640 1 -- 10.20.193.123:0/1943093977 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f4040071f20 msgr2=0x7f4040134d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:44.821 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.820+0000 7f4045038640 1 --2- 10.20.193.123:0/1943093977 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f4040071f20 0x7f4040134d00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4030009e80 tx=0x7f403002f280 comp rx=0 tx=0).stop 2026-02-17T20:09:44.821 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.820+0000 7f4045038640 1 -- 10.20.193.123:0/1943093977 shutdown_connections 2026-02-17T20:09:44.821 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.820+0000 7f4045038640 1 --2- 10.20.193.123:0/1943093977 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f4040071f20 0x7f4040134d00 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:44.821 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.820+0000 7f4045038640 1 --2- 10.20.193.123:0/1943093977 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f4040073910 0x7f40401347c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:44.822 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.820+0000 7f4045038640 1 --2- 10.20.193.123:0/1943093977 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f4040071600 0x7f40400719e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:44.822 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.820+0000 7f4045038640 1 -- 10.20.193.123:0/1943093977 >> 10.20.193.123:0/1943093977 conn(0x7f404009d6c0 msgr2=0x7f404009dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:44.822 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.820+0000 7f4045038640 1 -- 10.20.193.123:0/1943093977 shutdown_connections 2026-02-17T20:09:44.822 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.820+0000 7f4045038640 1 -- 10.20.193.123:0/1943093977 wait complete. 2026-02-17T20:09:44.822 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.820+0000 7f4045038640 1 Processor -- start 2026-02-17T20:09:44.822 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.820+0000 7f4045038640 1 -- start start 2026-02-17T20:09:44.822 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.821+0000 7f4045038640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f4040071600 0x7f4040114ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:44.822 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.821+0000 7f4045038640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f4040071f20 0x7f40401153e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:44.822 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.821+0000 7f4045038640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f4040073910 0x7f4040115920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:44.822 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.821+0000 7f4045038640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7f404013bc70 con 0x7f4040073910 2026-02-17T20:09:44.822 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.821+0000 7f4045038640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f404013baf0 con 0x7f4040071600 2026-02-17T20:09:44.822 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.821+0000 7f4045038640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f404013bdf0 con 0x7f4040071f20 2026-02-17T20:09:44.823 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.821+0000 7f403ed76640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f4040071600 0x7f4040114ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:44.823 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.821+0000 7f403e575640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f4040071f20 0x7f40401153e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:44.823 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.821+0000 7f403ed76640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f4040071600 0x7f4040114ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:57832/0 (socket says 10.20.193.123:57832) 2026-02-17T20:09:44.823 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.821+0000 7f403ed76640 1 -- 10.20.193.123:0/2747699996 learned_addr learned my addr 10.20.193.123:0/2747699996 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:44.823 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.821+0000 7f403f577640 1 --2- 10.20.193.123:0/2747699996 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f4040073910 0x7f4040115920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:44.823 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.821+0000 7f403e575640 1 -- 10.20.193.123:0/2747699996 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f4040071600 msgr2=0x7f4040114ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:44.823 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.821+0000 7f403e575640 1 --2- 10.20.193.123:0/2747699996 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f4040071600 0x7f4040114ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:44.823 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.821+0000 7f403e575640 1 -- 10.20.193.123:0/2747699996 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f4040073910 msgr2=0x7f4040115920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:44.823 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.821+0000 7f403e575640 1 --2- 10.20.193.123:0/2747699996 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f4040073910 0x7f4040115920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:44.823 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.821+0000 7f403e575640 1 -- 10.20.193.123:0/2747699996 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f404013b3c0 con 0x7f4040071f20 2026-02-17T20:09:44.823 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.821+0000 7f403ed76640 1 --2- 10.20.193.123:0/2747699996 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f4040071600 0x7f4040114ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:44.824 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.821+0000 7f403f577640 1 --2- 10.20.193.123:0/2747699996 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f4040073910 0x7f4040115920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:44.824 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.821+0000 7f403e575640 1 --2- 10.20.193.123:0/2747699996 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f4040071f20 0x7f40401153e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f402800e980 tx=0x7f402800ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:44.824 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.821+0000 7f401f7fe640 1 -- 10.20.193.123:0/2747699996 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4028017070 con 0x7f4040071f20 2026-02-17T20:09:44.824 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.821+0000 7f401f7fe640 1 -- 10.20.193.123:0/2747699996 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f402800c9a0 con 0x7f4040071f20 2026-02-17T20:09:44.824 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.821+0000 7f4045038640 1 -- 10.20.193.123:0/2747699996 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40401169d0 con 0x7f4040071f20 2026-02-17T20:09:44.824 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.821+0000 7f401f7fe640 1 -- 10.20.193.123:0/2747699996 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f402800cd90 con 0x7f4040071f20 2026-02-17T20:09:44.824 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.821+0000 7f4045038640 1 -- 10.20.193.123:0/2747699996 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f40401d1c80 con 0x7f4040071f20 2026-02-17T20:09:44.824 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.822+0000 7f4045038640 1 -- 10.20.193.123:0/2747699996 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40400719e0 con 0x7f4040071f20 2026-02-17T20:09:44.824 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.822+0000 7f401f7fe640 1 -- 10.20.193.123:0/2747699996 <== mon.2 v2:10.20.193.123:3302/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f4028013470 con 0x7f4040071f20 2026-02-17T20:09:44.824 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.822+0000 7f401f7fe640 1 -- 10.20.193.123:0/2747699996 <== mon.2 v2:10.20.193.123:3302/0 5 ==== osd_map(30..30 src has 1..30) ==== 3025+0+0 (secure 0 0 0) 0x7f40280670f0 con 0x7f4040071f20 2026-02-17T20:09:44.825 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.824+0000 7f401f7fe640 1 -- 10.20.193.123:0/2747699996 <== mon.2 v2:10.20.193.123:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f4028021030 con 0x7f4040071f20 2026-02-17T20:09:44.891 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.895+0000 7f4045038640 1 -- 10.20.193.123:0/2747699996 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4040068530 con 0x7f4040071f20 2026-02-17T20:09:44.891 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.895+0000 7f401f7fe640 1 -- 10.20.193.123:0/2747699996 <== mon.2 v2:10.20.193.123:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+9201 (secure 0 0 0) 0x7f4028040e80 con 0x7f4040071f20 2026-02-17T20:09:44.891 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:09:44.891 INFO:teuthology.orchestra.run.trial123.stdout:{"epoch":30,"fsid":"ddf342a7-b912-46f2-b373-84d7f3b75be2","created":"2026-02-17T20:08:19.090665+0000","modified":"2026-02-17T20:09:44.394074+0000","last_up_change":"2026-02-17T20:09:39.385739+0000","last_in_change":"2026-02-17T20:08:19.810884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"quincy","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-17T20:08:27.136671+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":13,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2026-02-17T20:08:28.174323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5cfdb97e-5584-42e3-8c32-a9b4ace549f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":17,"up_from":23,"up_thru":24,"down_at":18,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6801","nonce":458007068}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6802","nonce":458007068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6804","nonce":458007068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6803","nonce":458007068}]},"public_addr":"10.20.193.123:6801/458007068","cluster_addr":"10.20.193.123:6802/458007068","heartbeat_back_addr":"10.20.193.123:6804/458007068","heartbeat_front_addr":"10.20.193.123:6803/458007068","state":["exists","up"]},{"osd":1,"uuid":"9b7f5906-8ae8-4a34-8e71-1ba7cf3eeda1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":18,"up_from":24,"up_thru":26,"down_at":19,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6805","nonce":2594724968}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6806","nonce":2594724968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6808","nonce":2594724968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6807","nonce":2594724968}]},"public_addr":"10.20.193.123:6805/2594724968","cluster_addr":"10.20.193.123:6806/2594724968","heartbeat_back_addr":"10.20.193.123:6808/2594724968","heartbeat_front_addr":"10.20.193.123:6807/2594724968","state":["exists","up"]},{"osd":2,"uuid":"db6be5e2-fdd2-460f-bf35-269d92577824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":18,"up_from":25,"up_thru":26,"down_at":20,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6809","nonce":3596569166}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6810","nonce":3596569166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6812","nonce":3596569166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6811","nonce":3596569166}]},"public_addr":"10.20.193.123:6809/3596569166","cluster_addr":"10.20.193.123:6810/3596569166","heartbeat_back_addr":"10.20.193.123:6812/3596569166","heartbeat_front_addr":"10.20.193.123:6811/3596569166","state":["exists","up"]},{"osd":3,"uuid":"23275d01-0d57-497c-a600-d9aeef747af2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":20,"up_from":26,"up_thru":26,"down_at":21,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6813","nonce":2610635322}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6814","nonce":2610635322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6816","nonce":2610635322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6815","nonce":2610635322}]},"public_addr":"10.20.193.123:6813/2610635322","cluster_addr":"10.20.193.123:6814/2610635322","heartbeat_back_addr":"10.20.193.123:6816/2610635322","heartbeat_front_addr":"10.20.193.123:6815/2610635322","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:08:24.897268+0000","dead_epoch":18},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:08:24.890530+0000","dead_epoch":19},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:08:24.941602+0000","dead_epoch":20},{"osd":3,"down_stamp":"2026-02-17T20:09:31.377910+0000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:08:24.897001+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.123:0/3994607579":"2026-02-18T20:09:24.315453+0000","10.20.193.123:0/1995254470":"2026-02-18T20:09:24.315453+0000","10.20.193.123:0/2996849897":"2026-02-18T20:09:24.315453+0000","10.20.193.123:6800/23720":"2026-02-18T20:09:24.315453+0000","10.20.193.123:0/1130446084":"2026-02-18T20:09:24.315453+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T20:09:44.892 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.896+0000 7f4045038640 1 -- 10.20.193.123:0/2747699996 >> v1:10.20.193.123:6800/115662061 conn(0x7f400c04f790 legacy=0x7f400c051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:44.892 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.896+0000 7f4045038640 1 -- 10.20.193.123:0/2747699996 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f4040071f20 msgr2=0x7f40401153e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:44.892 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.896+0000 7f4045038640 1 --2- 10.20.193.123:0/2747699996 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f4040071f20 0x7f40401153e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f402800e980 tx=0x7f402800ee50 comp rx=0 tx=0).stop 2026-02-17T20:09:44.892 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.896+0000 7f4045038640 1 -- 10.20.193.123:0/2747699996 shutdown_connections 2026-02-17T20:09:44.892 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.896+0000 7f4045038640 1 --2- 10.20.193.123:0/2747699996 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f4040073910 0x7f4040115920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:44.892 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.896+0000 7f4045038640 1 --2- 10.20.193.123:0/2747699996 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f4040071f20 0x7f40401153e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:44.892 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.896+0000 7f4045038640 1 --2- 10.20.193.123:0/2747699996 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f4040071600 0x7f4040114ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:44.892 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.896+0000 7f4045038640 1 -- 10.20.193.123:0/2747699996 >> 10.20.193.123:0/2747699996 conn(0x7f404009d6c0 msgr2=0x7f4040070890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:44.892 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.896+0000 7f4045038640 1 -- 10.20.193.123:0/2747699996 shutdown_connections 2026-02-17T20:09:44.892 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.896+0000 7f4045038640 1 -- 10.20.193.123:0/2747699996 wait complete. 2026-02-17T20:09:44.900 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T20:09:44.900 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T20:09:44.900 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T20:09:44.900 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T20:09:44.967 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.971+0000 7fbde737d640 1 Processor -- start 2026-02-17T20:09:44.967 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.971+0000 7fbde737d640 1 -- start start 2026-02-17T20:09:44.968 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.971+0000 7fbde737d640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fbde0073830 0x7fbde0139ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:44.968 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.972+0000 7fbde737d640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fbde013a000 0x7fbde013c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:44.968 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.972+0000 7fbde737d640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbde009f550 con 0x7fbde0134d10 2026-02-17T20:09:44.968 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.972+0000 7fbde737d640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7fbde01347a0 con 0x7fbde0073830 2026-02-17T20:09:44.968 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.972+0000 7fbde737d640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7fbde0073f10 con 0x7fbde013a000 2026-02-17T20:09:44.968 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.972+0000 7fbde50f2640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7fbde0134d10 0x7fbde01350f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:54396/0 (socket says 10.20.193.123:54396) 2026-02-17T20:09:44.968 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.972+0000 7fbde50f2640 1 -- 10.20.193.123:0/2507242292 learned_addr learned my addr 10.20.193.123:0/2507242292 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:09:44.968 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.972+0000 7fbde58f3640 1 --2- 10.20.193.123:0/2507242292 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fbde013a000 0x7fbde013c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:44.968 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.972+0000 7fbde48f1640 1 --2- 10.20.193.123:0/2507242292 >> v2:10.20.193.123:3300/0 conn(0x7fbde0073830 0x7fbde0139ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:44.968 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.972+0000 7f63f4792640 1 Processor -- start 2026-02-17T20:09:44.968 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.972+0000 7f000d2e9640 1 Processor -- start 2026-02-17T20:09:44.968 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.972+0000 7fbdcffff640 1 -- 10.20.193.123:0/2507242292 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2808476604 0 0) 0x7fbde009f550 con 0x7fbde0134d10 2026-02-17T20:09:44.968 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.972+0000 7f63f4792640 1 -- start start 2026-02-17T20:09:44.969 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.972+0000 7fbdcffff640 1 -- 10.20.193.123:0/2507242292 --> v1:10.20.193.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbdc8003620 con 0x7fbde0134d10 2026-02-17T20:09:44.969 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.972+0000 7fbde58f3640 1 -- 10.20.193.123:0/2507242292 >> v2:10.20.193.123:3300/0 conn(0x7fbde0073830 msgr2=0x7fbde0139ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:44.969 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.972+0000 7fbde58f3640 1 --2- 10.20.193.123:0/2507242292 >> v2:10.20.193.123:3300/0 conn(0x7fbde0073830 0x7fbde0139ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:44.969 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.972+0000 7fbde58f3640 1 -- 10.20.193.123:0/2507242292 >> v1:10.20.193.123:6789/0 conn(0x7fbde0134d10 legacy=0x7fbde01350f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:44.969 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.972+0000 7fbde58f3640 1 -- 10.20.193.123:0/2507242292 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbde0072dc0 con 0x7fbde013a000 2026-02-17T20:09:44.970 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.972+0000 7f000d2e9640 1 -- start start 2026-02-17T20:09:44.970 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.972+0000 7f63f4792640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f63ec12cb80 0x7f63ec12cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:44.970 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.972+0000 7f63f4792640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f63ec073890 0x7f63ec12d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:44.970 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.972+0000 7f63f4792640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63ec074070 con 0x7f63ec1300e0 2026-02-17T20:09:44.971 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.972+0000 7f63f4792640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7f63ec12d9e0 con 0x7f63ec073890 2026-02-17T20:09:44.971 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.972+0000 7f63f4792640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f63ec072e70 con 0x7f63ec12cb80 2026-02-17T20:09:44.971 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.972+0000 7f000d2e9640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f0008134d10 0x7f00081350f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:44.971 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.972+0000 7f000d2e9640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0008071f90 0x7f000813cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:44.972 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.972+0000 7f000d2e9640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f000809f550 con 0x7f0008073830 2026-02-17T20:09:44.972 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.972+0000 7f000d2e9640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7f00081347a0 con 0x7f0008134d10 2026-02-17T20:09:44.972 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.972+0000 7f000d2e9640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f0008073f10 con 0x7f0008071f90 2026-02-17T20:09:44.972 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.972+0000 7f63f2d08640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7f63ec1300e0 0x7f63ec130550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:54410/0 (socket says 10.20.193.123:54410) 2026-02-17T20:09:44.972 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.972+0000 7f63f2d08640 1 -- 10.20.193.123:0/2682895905 learned_addr learned my addr 10.20.193.123:0/2682895905 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:09:44.973 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.972+0000 7f63f2507640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f63ec12cb80 0x7f63ec12cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:44.973 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.972+0000 7f63f1d06640 1 --2- 10.20.193.123:0/2682895905 >> v2:10.20.193.123:3300/0 conn(0x7f63ec073890 0x7f63ec12d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:44.973 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.972+0000 7f0006ffd640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f0008134d10 0x7f00081350f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:44.973 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.972+0000 7fbde58f3640 1 --2- 10.20.193.123:0/2507242292 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fbde013a000 0x7fbde013c3f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbddc009d90 tx=0x7fbddc02f150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7bc4021713f7e6f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:44.974 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.972+0000 7f0006ffd640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f0008134d10 0x7f00081350f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:58258/0 (socket says 10.20.193.123:58258) 2026-02-17T20:09:44.974 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.972+0000 7f0006ffd640 1 -- 10.20.193.123:0/1769625212 learned_addr learned my addr 10.20.193.123:0/1769625212 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:44.974 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.972+0000 7f00077fe640 1 --2- 10.20.193.123:0/1769625212 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0008071f90 0x7f000813cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:44.974 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.972+0000 7fbdcffff640 1 -- 10.20.193.123:0/2507242292 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbddc03c070 con 0x7fbde013a000 2026-02-17T20:09:44.975 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.973+0000 7f63f1505640 1 -- 10.20.193.123:0/2682895905 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2797505966 0 0) 0x7f63ec074070 con 0x7f63ec1300e0 2026-02-17T20:09:44.975 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.973+0000 7fbdcffff640 1 -- 10.20.193.123:0/2507242292 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbddc02fe10 con 0x7fbde013a000 2026-02-17T20:09:44.975 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.973+0000 7fbdcffff640 1 -- 10.20.193.123:0/2507242292 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbddc037660 con 0x7fbde013a000 2026-02-17T20:09:44.976 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.973+0000 7f0006ffd640 1 -- 10.20.193.123:0/1769625212 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0008071f90 msgr2=0x7f000813cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:44.976 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.973+0000 7f0006ffd640 1 --2- 10.20.193.123:0/1769625212 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0008071f90 0x7f000813cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:44.976 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.973+0000 7f0006ffd640 1 -- 10.20.193.123:0/1769625212 >> v1:10.20.193.123:6789/0 conn(0x7f0008073830 legacy=0x7f0008071880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:44.977 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.973+0000 7f63f2507640 1 -- 10.20.193.123:0/2682895905 >> v2:10.20.193.123:3300/0 conn(0x7f63ec073890 msgr2=0x7f63ec12d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:44.977 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.973+0000 7f63f2507640 1 --2- 10.20.193.123:0/2682895905 >> v2:10.20.193.123:3300/0 conn(0x7f63ec073890 0x7f63ec12d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:44.977 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.973+0000 7f63f2507640 1 -- 10.20.193.123:0/2682895905 >> v1:10.20.193.123:6789/0 conn(0x7f63ec1300e0 legacy=0x7f63ec130550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:44.977 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.973+0000 7f63f2507640 1 -- 10.20.193.123:0/2682895905 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63ec130c60 con 0x7f63ec12cb80 2026-02-17T20:09:44.977 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.973+0000 7f0006ffd640 1 -- 10.20.193.123:0/1769625212 --> v2:10.20.193.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0008135630 con 0x7f0008134d10 2026-02-17T20:09:44.977 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.973+0000 7f0005ffb640 1 -- 10.20.193.123:0/1769625212 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1718147647 0 0) 0x7f000809f550 con 0x7f0008073830 2026-02-17T20:09:44.978 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.973+0000 7fbde737d640 1 -- 10.20.193.123:0/2507242292 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fbde013a000 msgr2=0x7fbde013c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:44.978 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.973+0000 7fbde737d640 1 --2- 10.20.193.123:0/2507242292 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fbde013a000 0x7fbde013c3f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbddc009d90 tx=0x7fbddc02f150 comp rx=0 tx=0).stop 2026-02-17T20:09:44.978 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.973+0000 7fbde737d640 1 -- 10.20.193.123:0/2507242292 shutdown_connections 2026-02-17T20:09:44.978 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.973+0000 7fbde737d640 1 --2- 10.20.193.123:0/2507242292 >> v2:10.20.193.123:3300/0 conn(0x7fbde0073830 0x7fbde0139ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:44.979 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.973+0000 7fbde737d640 1 --2- 10.20.193.123:0/2507242292 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fbde013a000 0x7fbde013c3f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:44.979 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.973+0000 7fbde737d640 1 -- 10.20.193.123:0/2507242292 >> 10.20.193.123:0/2507242292 conn(0x7fbde009e7c0 msgr2=0x7fbde009ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:44.979 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.973+0000 7fbde737d640 1 -- 10.20.193.123:0/2507242292 shutdown_connections 2026-02-17T20:09:44.979 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.973+0000 7fbde737d640 1 -- 10.20.193.123:0/2507242292 wait complete. 2026-02-17T20:09:44.979 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.973+0000 7f0006ffd640 1 --2- 10.20.193.123:0/1769625212 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0008134d10 0x7f00081350f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7efffc009970 tx=0x7efffc02ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1710e207ce8bc7a0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:44.979 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.973+0000 7f0005ffb640 1 -- 10.20.193.123:0/1769625212 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efffc03c070 con 0x7f0008134d10 2026-02-17T20:09:44.980 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.973+0000 7f63f2507640 1 --2- 10.20.193.123:0/2682895905 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f63ec12cb80 0x7f63ec12cf60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f63dc0098a0 tx=0x7f63dc02ee10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=602b795a8bac0e8d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:44.980 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.973+0000 7f0005ffb640 1 -- 10.20.193.123:0/1769625212 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efffc02fb00 con 0x7f0008134d10 2026-02-17T20:09:44.980 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.973+0000 7f0005ffb640 1 -- 10.20.193.123:0/1769625212 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efffc037440 con 0x7f0008134d10 2026-02-17T20:09:44.981 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.973+0000 7f63f1505640 1 -- 10.20.193.123:0/2682895905 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63dc03c070 con 0x7f63ec12cb80 2026-02-17T20:09:44.981 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.973+0000 7f63f1505640 1 -- 10.20.193.123:0/2682895905 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63dc02fad0 con 0x7f63ec12cb80 2026-02-17T20:09:44.982 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.973+0000 7f63f1505640 1 -- 10.20.193.123:0/2682895905 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63dc037440 con 0x7f63ec12cb80 2026-02-17T20:09:44.982 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.973+0000 7f63f4792640 1 -- 10.20.193.123:0/2682895905 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f63ec12cb80 msgr2=0x7f63ec12cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:44.982 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.973+0000 7f63f4792640 1 --2- 10.20.193.123:0/2682895905 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f63ec12cb80 0x7f63ec12cf60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f63dc0098a0 tx=0x7f63dc02ee10 comp rx=0 tx=0).stop 2026-02-17T20:09:44.982 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.973+0000 7f63f4792640 1 -- 10.20.193.123:0/2682895905 shutdown_connections 2026-02-17T20:09:44.982 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.973+0000 7f63f4792640 1 --2- 10.20.193.123:0/2682895905 >> v2:10.20.193.123:3300/0 conn(0x7f63ec073890 0x7f63ec12d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:44.982 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.973+0000 7f63f4792640 1 --2- 10.20.193.123:0/2682895905 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f63ec12cb80 0x7f63ec12cf60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:44.982 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.973+0000 7f63f4792640 1 -- 10.20.193.123:0/2682895905 >> 10.20.193.123:0/2682895905 conn(0x7f63ec0a30f0 msgr2=0x7f63ec0a3500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:44.982 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.973+0000 7fbde737d640 1 Processor -- start 2026-02-17T20:09:44.983 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7f000d2e9640 1 -- 10.20.193.123:0/1769625212 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0008134d10 msgr2=0x7f00081350f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:44.983 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7f000d2e9640 1 --2- 10.20.193.123:0/1769625212 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0008134d10 0x7f00081350f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7efffc009970 tx=0x7efffc02ee30 comp rx=0 tx=0).stop 2026-02-17T20:09:44.983 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7f63f4792640 1 -- 10.20.193.123:0/2682895905 shutdown_connections 2026-02-17T20:09:44.984 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7f63f4792640 1 -- 10.20.193.123:0/2682895905 wait complete. 2026-02-17T20:09:44.984 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7fbde737d640 1 -- start start 2026-02-17T20:09:44.985 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7f000d2e9640 1 -- 10.20.193.123:0/1769625212 shutdown_connections 2026-02-17T20:09:44.985 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7f000d2e9640 1 --2- 10.20.193.123:0/1769625212 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0008071f90 0x7f000813cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:44.985 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7f000d2e9640 1 --2- 10.20.193.123:0/1769625212 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0008134d10 0x7f00081350f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:44.985 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7f000d2e9640 1 -- 10.20.193.123:0/1769625212 >> 10.20.193.123:0/1769625212 conn(0x7f000809e7c0 msgr2=0x7f000809ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:44.985 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7f000d2e9640 1 -- 10.20.193.123:0/1769625212 shutdown_connections 2026-02-17T20:09:44.985 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7f000d2e9640 1 -- 10.20.193.123:0/1769625212 wait complete. 2026-02-17T20:09:44.985 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7fe675b4c640 1 Processor -- start 2026-02-17T20:09:44.986 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7fbde737d640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fbde0073830 0x7fbde0071320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:44.986 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7fbde737d640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fbde0134d10 0x7fbde0071860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:44.986 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7fbde737d640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fbde013a000 0x7fbde0071da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:44.986 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7fbde737d640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbde013cb40 con 0x7fbde0134d10 2026-02-17T20:09:44.986 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7fbde737d640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7fbde0073110 con 0x7fbde0073830 2026-02-17T20:09:44.986 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7fbde737d640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7fbde013ccc0 con 0x7fbde013a000 2026-02-17T20:09:44.987 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7fe675b4c640 1 -- start start 2026-02-17T20:09:44.988 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7fbde50f2640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fbde0073830 0x7fbde0071320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:44.988 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7fbde48f1640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fbde0134d10 0x7fbde0071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:44.988 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7fbde58f3640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fbde013a000 0x7fbde0071da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:44.988 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7fbde48f1640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fbde0134d10 0x7fbde0071860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:58268/0 (socket says 10.20.193.123:58268) 2026-02-17T20:09:44.988 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7fbde50f2640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fbde0073830 0x7fbde0071320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:57872/0 (socket says 10.20.193.123:57872) 2026-02-17T20:09:44.988 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7fbde48f1640 1 -- 10.20.193.123:0/2089617519 learned_addr learned my addr 10.20.193.123:0/2089617519 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:44.988 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7fbde48f1640 1 -- 10.20.193.123:0/2089617519 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fbde013a000 msgr2=0x7fbde0071da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:44.988 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7fbde48f1640 1 --2- 10.20.193.123:0/2089617519 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fbde013a000 0x7fbde0071da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:44.988 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7fbde48f1640 1 -- 10.20.193.123:0/2089617519 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fbde0073830 msgr2=0x7fbde0071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:44.988 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7fbde48f1640 1 --2- 10.20.193.123:0/2089617519 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fbde0073830 0x7fbde0071320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:44.988 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7fbde48f1640 1 -- 10.20.193.123:0/2089617519 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbde0115940 con 0x7fbde0134d10 2026-02-17T20:09:44.988 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7fbde50f2640 1 --2- 10.20.193.123:0/2089617519 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fbde0073830 0x7fbde0071320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:44.989 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7f63f4792640 1 Processor -- start 2026-02-17T20:09:44.989 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7fe675b4c640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fe670071880 0x7fe670071c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:44.989 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7fe675b4c640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fe670073830 0x7fe6700721a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:44.989 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7fe675b4c640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe67009f550 con 0x7fe670124310 2026-02-17T20:09:44.989 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7fe675b4c640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7fe670073110 con 0x7fe670071880 2026-02-17T20:09:44.990 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7fe675b4c640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7fe670074090 con 0x7fe670073830 2026-02-17T20:09:44.990 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7fbde48f1640 1 --2- 10.20.193.123:0/2089617519 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fbde0134d10 0x7fbde0071860 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbdd400ebe0 tx=0x7fbdd400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:44.990 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7f000d2e9640 1 Processor -- start 2026-02-17T20:09:44.990 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7f63f4792640 1 -- start start 2026-02-17T20:09:44.991 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7fe66f7fe640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fe670071880 0x7fe670071c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:44.991 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7fe66f7fe640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fe670071880 0x7fe670071c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:58276/0 (socket says 10.20.193.123:58276) 2026-02-17T20:09:44.991 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7fe66f7fe640 1 -- 10.20.193.123:0/3501186300 learned_addr learned my addr 10.20.193.123:0/3501186300 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:44.991 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7f000d2e9640 1 -- start start 2026-02-17T20:09:44.992 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7fe66effd640 1 --2- 10.20.193.123:0/3501186300 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fe670073830 0x7fe6700721a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:44.992 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7fbdcdffb640 1 -- 10.20.193.123:0/2089617519 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd4017070 con 0x7fbde0134d10 2026-02-17T20:09:44.992 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7fbdcdffb640 1 -- 10.20.193.123:0/2089617519 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdd400cc40 con 0x7fbde0134d10 2026-02-17T20:09:44.992 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7fbde737d640 1 -- 10.20.193.123:0/2089617519 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbde00722e0 con 0x7fbde0134d10 2026-02-17T20:09:44.992 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7fbdcdffb640 1 -- 10.20.193.123:0/2089617519 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd4013470 con 0x7fbde0134d10 2026-02-17T20:09:44.992 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7fbde737d640 1 -- 10.20.193.123:0/2089617519 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbde01d1d40 con 0x7fbde0134d10 2026-02-17T20:09:44.993 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7fe66f7fe640 1 -- 10.20.193.123:0/3501186300 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fe670073830 msgr2=0x7fe6700721a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:44.993 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7fe66f7fe640 1 --2- 10.20.193.123:0/3501186300 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fe670073830 0x7fe6700721a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:44.993 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7fe66f7fe640 1 -- 10.20.193.123:0/3501186300 >> v1:10.20.193.123:6789/0 conn(0x7fe670124310 legacy=0x7fe670124750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:44.993 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7fe66e7fc640 1 -- 10.20.193.123:0/3501186300 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3967298172 0 0) 0x7fe67009f550 con 0x7fe670124310 2026-02-17T20:09:44.993 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7fe66f7fe640 1 -- 10.20.193.123:0/3501186300 --> v2:10.20.193.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe670072df0 con 0x7fe670071880 2026-02-17T20:09:44.994 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7f000d2e9640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0008071f90 0x7f00081cbe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:44.994 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7f000d2e9640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0008073830 0x7f00081cc350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:44.994 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7f000d2e9640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0008134d10 0x7f00081cc890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:44.994 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7f000d2e9640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0008072520 con 0x7f0008134d10 2026-02-17T20:09:44.994 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7f000d2e9640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f00080723a0 con 0x7f0008071f90 2026-02-17T20:09:44.994 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7f000d2e9640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f00080726a0 con 0x7f0008073830 2026-02-17T20:09:44.995 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7f0006ffd640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0008071f90 0x7f00081cbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:44.995 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7f0006ffd640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0008071f90 0x7f00081cbe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:57886/0 (socket says 10.20.193.123:57886) 2026-02-17T20:09:44.995 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7f0006ffd640 1 -- 10.20.193.123:0/3981139582 learned_addr learned my addr 10.20.193.123:0/3981139582 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:44.995 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7f00077fe640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0008134d10 0x7f00081cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:44.995 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7f00067fc640 1 --2- 10.20.193.123:0/3981139582 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0008073830 0x7f00081cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:44.995 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.974+0000 7f63f4792640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f63ec073890 0x7f63ec1c76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:44.996 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7f63f4792640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f63ec12cb80 0x7f63ec1c7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:44.996 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7f63f4792640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f63ec1300e0 0x7f63ec1c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:44.996 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7f63f4792640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7f63ec138690 con 0x7f63ec12cb80 2026-02-17T20:09:44.996 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7f63f4792640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f63ec073070 con 0x7f63ec1300e0 2026-02-17T20:09:44.996 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7f63f4792640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f63ec138810 con 0x7f63ec073890 2026-02-17T20:09:44.996 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7f63f2507640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f63ec073890 0x7f63ec1c76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:44.996 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7f63f2507640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f63ec073890 0x7f63ec1c76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:52308/0 (socket says 10.20.193.123:52308) 2026-02-17T20:09:44.996 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7f63f2507640 1 -- 10.20.193.123:0/958731813 learned_addr learned my addr 10.20.193.123:0/958731813 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:44.996 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7f63f2d08640 1 --2- 10.20.193.123:0/958731813 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f63ec1300e0 0x7f63ec1c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:44.996 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7f63f1d06640 1 --2- 10.20.193.123:0/958731813 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f63ec12cb80 0x7f63ec1c7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:44.996 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7fbde737d640 1 -- 10.20.193.123:0/2089617519 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbde0116540 con 0x7fbde0134d10 2026-02-17T20:09:44.997 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7f63f2507640 1 -- 10.20.193.123:0/958731813 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f63ec1300e0 msgr2=0x7f63ec1c8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:44.997 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7f63f2507640 1 --2- 10.20.193.123:0/958731813 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f63ec1300e0 0x7f63ec1c8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:44.997 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7f63f2507640 1 -- 10.20.193.123:0/958731813 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f63ec12cb80 msgr2=0x7f63ec1c7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:44.997 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7f63f2507640 1 --2- 10.20.193.123:0/958731813 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f63ec12cb80 0x7f63ec1c7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:44.997 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7f63f2507640 1 -- 10.20.193.123:0/958731813 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63ec136c30 con 0x7f63ec073890 2026-02-17T20:09:44.997 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7f0006ffd640 1 -- 10.20.193.123:0/3981139582 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0008073830 msgr2=0x7f00081cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:44.998 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7f0006ffd640 1 --2- 10.20.193.123:0/3981139582 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0008073830 0x7f00081cc350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:44.998 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7f0006ffd640 1 -- 10.20.193.123:0/3981139582 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0008134d10 msgr2=0x7f00081cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:44.998 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7f0006ffd640 1 --2- 10.20.193.123:0/3981139582 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0008134d10 0x7f00081cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:44.998 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7f0006ffd640 1 -- 10.20.193.123:0/3981139582 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0008138990 con 0x7f0008071f90 2026-02-17T20:09:44.998 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7f63f2507640 1 --2- 10.20.193.123:0/958731813 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f63ec073890 0x7f63ec1c76f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f63dc0098a0 tx=0x7f63dc0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:44.998 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7fe66f7fe640 1 --2- 10.20.193.123:0/3501186300 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fe670071880 0x7fe670071c60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe65c009970 tx=0x7fe65c02ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ef2fc3e8952f1ad server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:44.998 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7f0006ffd640 1 --2- 10.20.193.123:0/3981139582 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0008071f90 0x7f00081cbe10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efffc009aa0 tx=0x7efffc0047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:44.999 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7fe66e7fc640 1 -- 10.20.193.123:0/3501186300 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65c03c070 con 0x7fe670071880 2026-02-17T20:09:44.999 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7f63d2ffd640 1 -- 10.20.193.123:0/958731813 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63dc038d80 con 0x7f63ec073890 2026-02-17T20:09:44.999 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7fe66e7fc640 1 -- 10.20.193.123:0/3501186300 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe65c02fb00 con 0x7fe670071880 2026-02-17T20:09:44.999 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7f63d2ffd640 1 -- 10.20.193.123:0/958731813 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63dc004030 con 0x7f63ec073890 2026-02-17T20:09:44.999 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7f63f4792640 1 -- 10.20.193.123:0/958731813 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63ec12a870 con 0x7f63ec073890 2026-02-17T20:09:45.000 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7f63d2ffd640 1 -- 10.20.193.123:0/958731813 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63dc004400 con 0x7f63ec073890 2026-02-17T20:09:45.000 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7fe66e7fc640 1 -- 10.20.193.123:0/3501186300 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65c037440 con 0x7fe670071880 2026-02-17T20:09:45.000 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7f63f4792640 1 -- 10.20.193.123:0/958731813 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f63ec134090 con 0x7f63ec073890 2026-02-17T20:09:45.000 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7effe77fe640 1 -- 10.20.193.123:0/3981139582 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efffc047070 con 0x7f0008071f90 2026-02-17T20:09:45.001 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7effe77fe640 1 -- 10.20.193.123:0/3981139582 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efffc042650 con 0x7f0008071f90 2026-02-17T20:09:45.001 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7f000d2e9640 1 -- 10.20.193.123:0/3981139582 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00081383d0 con 0x7f0008071f90 2026-02-17T20:09:45.001 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7effe77fe640 1 -- 10.20.193.123:0/3981139582 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efffc03c040 con 0x7f0008071f90 2026-02-17T20:09:45.001 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7f000d2e9640 1 -- 10.20.193.123:0/3981139582 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0008135890 con 0x7f0008071f90 2026-02-17T20:09:45.001 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7fbdcdffb640 1 -- 10.20.193.123:0/2089617519 <== mon.0 v2:10.20.193.123:3300/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7fbdd4024060 con 0x7fbde0134d10 2026-02-17T20:09:45.001 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7fbdcdffb640 1 -- 10.20.193.123:0/2089617519 <== mon.0 v2:10.20.193.123:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3025+0+0 (secure 0 0 0) 0x7fbdd4066f30 con 0x7fbde0134d10 2026-02-17T20:09:45.001 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7fe675b4c640 1 -- 10.20.193.123:0/3501186300 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fe670071880 msgr2=0x7fe670071c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:45.001 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7fe675b4c640 1 --2- 10.20.193.123:0/3501186300 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fe670071880 0x7fe670071c60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe65c009970 tx=0x7fe65c02ee30 comp rx=0 tx=0).stop 2026-02-17T20:09:45.002 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7f63f4792640 1 -- 10.20.193.123:0/958731813 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f63ec130550 con 0x7f63ec073890 2026-02-17T20:09:45.002 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7fe675b4c640 1 -- 10.20.193.123:0/3501186300 shutdown_connections 2026-02-17T20:09:45.002 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7fe675b4c640 1 --2- 10.20.193.123:0/3501186300 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fe670073830 0x7fe6700721a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:45.002 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7fe675b4c640 1 --2- 10.20.193.123:0/3501186300 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fe670071880 0x7fe670071c60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:45.002 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7fe675b4c640 1 -- 10.20.193.123:0/3501186300 >> 10.20.193.123:0/3501186300 conn(0x7fe67009e7c0 msgr2=0x7fe67009ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:45.003 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7fbdcdffb640 1 -- 10.20.193.123:0/2089617519 --> v1:10.20.193.123:6805/2594724968 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbdb0059cc0 con 0x7fbdb0056010 2026-02-17T20:09:45.003 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7fbdcdffb640 1 -- 10.20.193.123:0/2089617519 <== mon.0 v2:10.20.193.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbdd40673c0 con 0x7fbde0134d10 2026-02-17T20:09:45.003 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.975+0000 7fe675b4c640 1 -- 10.20.193.123:0/3501186300 shutdown_connections 2026-02-17T20:09:45.003 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.976+0000 7fe675b4c640 1 -- 10.20.193.123:0/3501186300 wait complete. 2026-02-17T20:09:45.003 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.976+0000 7f000d2e9640 1 -- 10.20.193.123:0/3981139582 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f000812faa0 con 0x7f0008071f90 2026-02-17T20:09:45.003 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.976+0000 7f63d2ffd640 1 -- 10.20.193.123:0/958731813 <== mon.2 v2:10.20.193.123:3302/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f63dc003710 con 0x7f63ec073890 2026-02-17T20:09:45.004 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.976+0000 7effe77fe640 1 -- 10.20.193.123:0/3981139582 <== mon.1 v2:10.20.193.123:3301/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7efffc04b3b0 con 0x7f0008071f90 2026-02-17T20:09:45.004 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.976+0000 7fe675b4c640 1 Processor -- start 2026-02-17T20:09:45.004 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.976+0000 7f63d2ffd640 1 -- 10.20.193.123:0/958731813 <== mon.2 v2:10.20.193.123:3302/0 5 ==== osd_map(30..30 src has 1..30) ==== 3025+0+0 (secure 0 0 0) 0x7f63dc094630 con 0x7f63ec073890 2026-02-17T20:09:45.004 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.976+0000 7fe675b4c640 1 -- start start 2026-02-17T20:09:45.004 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.976+0000 7f63d2ffd640 1 -- 10.20.193.123:0/958731813 --> v1:10.20.193.123:6801/458007068 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f63dc033ec0 con 0x7f63bc056080 2026-02-17T20:09:45.004 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.976+0000 7f63d2ffd640 1 -- 10.20.193.123:0/958731813 <== mon.2 v2:10.20.193.123:3302/0 6 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f63dc094ac0 con 0x7f63ec073890 2026-02-17T20:09:45.005 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.976+0000 7fbdcdffb640 1 -- 10.20.193.123:0/2089617519 <== osd.1 v1:10.20.193.123:6805/2594724968 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7fbdb0059cc0 con 0x7fbdb0056010 2026-02-17T20:09:45.005 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.976+0000 7effe77fe640 1 -- 10.20.193.123:0/3981139582 <== mon.1 v2:10.20.193.123:3301/0 5 ==== osd_map(30..30 src has 1..30) ==== 3025+0+0 (secure 0 0 0) 0x7efffc08bd80 con 0x7f0008071f90 2026-02-17T20:09:45.005 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.976+0000 7effe77fe640 1 -- 10.20.193.123:0/3981139582 --> v1:10.20.193.123:6809/3596569166 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7effd4059d30 con 0x7effd4056080 2026-02-17T20:09:45.005 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.976+0000 7fe675b4c640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fe670071880 0x7fe670114e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:45.005 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.976+0000 7effe77fe640 1 -- 10.20.193.123:0/3981139582 <== mon.1 v2:10.20.193.123:3301/0 6 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7efffc08c210 con 0x7f0008071f90 2026-02-17T20:09:45.006 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.976+0000 7fe675b4c640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fe670073830 0x7fe670115350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:45.007 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.976+0000 7fe675b4c640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe670124310 0x7fe670115890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:45.007 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.976+0000 7fe675b4c640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe670136560 con 0x7fe670071880 2026-02-17T20:09:45.007 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.976+0000 7fe675b4c640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7fe670125070 con 0x7fe670124310 2026-02-17T20:09:45.007 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.976+0000 7fe675b4c640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7fe6701366e0 con 0x7fe670073830 2026-02-17T20:09:45.007 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.976+0000 7fe66f7fe640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fe670071880 0x7fe670114e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:45.007 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.976+0000 7fe66f7fe640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fe670071880 0x7fe670114e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:58296/0 (socket says 10.20.193.123:58296) 2026-02-17T20:09:45.007 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.976+0000 7fe66ffff640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe670124310 0x7fe670115890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:45.007 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.976+0000 7fe66f7fe640 1 -- 10.20.193.123:0/3742429053 learned_addr learned my addr 10.20.193.123:0/3742429053 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:45.007 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.976+0000 7fe66effd640 1 --2- 10.20.193.123:0/3742429053 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fe670073830 0x7fe670115350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:45.007 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.976+0000 7fe66ffff640 1 -- 10.20.193.123:0/3742429053 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fe670073830 msgr2=0x7fe670115350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:45.007 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.976+0000 7fe66ffff640 1 --2- 10.20.193.123:0/3742429053 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fe670073830 0x7fe670115350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:45.007 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.976+0000 7fe66ffff640 1 -- 10.20.193.123:0/3742429053 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fe670071880 msgr2=0x7fe670114e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:45.007 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.976+0000 7fe66ffff640 1 --2- 10.20.193.123:0/3742429053 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fe670071880 0x7fe670114e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:45.007 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.976+0000 7fe66ffff640 1 -- 10.20.193.123:0/3742429053 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe670135310 con 0x7fe670124310 2026-02-17T20:09:45.007 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.976+0000 7fe66f7fe640 1 --2- 10.20.193.123:0/3742429053 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fe670071880 0x7fe670114e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:45.007 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.977+0000 7fe66ffff640 1 --2- 10.20.193.123:0/3742429053 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe670124310 0x7fe670115890 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe66400cbc0 tx=0x7fe66400a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:45.007 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.977+0000 7fe64bfff640 1 -- 10.20.193.123:0/3742429053 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe664017070 con 0x7fe670124310 2026-02-17T20:09:45.007 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.977+0000 7fe64bfff640 1 -- 10.20.193.123:0/3742429053 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe66400acf0 con 0x7fe670124310 2026-02-17T20:09:45.008 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.977+0000 7fe675b4c640 1 -- 10.20.193.123:0/3742429053 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe670115fb0 con 0x7fe670124310 2026-02-17T20:09:45.008 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.977+0000 7f63d2ffd640 1 -- 10.20.193.123:0/958731813 <== osd.0 v1:10.20.193.123:6801/458007068 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7f63dc033ec0 con 0x7f63bc056080 2026-02-17T20:09:45.008 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.977+0000 7effe77fe640 1 -- 10.20.193.123:0/3981139582 <== osd.2 v1:10.20.193.123:6809/3596569166 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7effd4059d30 con 0x7effd4056080 2026-02-17T20:09:45.008 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.977+0000 7fe64bfff640 1 -- 10.20.193.123:0/3742429053 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe664003cb0 con 0x7fe670124310 2026-02-17T20:09:45.008 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.977+0000 7fe675b4c640 1 -- 10.20.193.123:0/3742429053 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6701cd6a0 con 0x7fe670124310 2026-02-17T20:09:45.008 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.977+0000 7fe64bfff640 1 -- 10.20.193.123:0/3742429053 <== mon.1 v2:10.20.193.123:3301/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7fe664005070 con 0x7fe670124310 2026-02-17T20:09:45.009 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.977+0000 7fe675b4c640 1 -- 10.20.193.123:0/3742429053 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe670116c50 con 0x7fe670124310 2026-02-17T20:09:45.009 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.978+0000 7fe64bfff640 1 -- 10.20.193.123:0/3742429053 <== mon.1 v2:10.20.193.123:3301/0 5 ==== osd_map(30..30 src has 1..30) ==== 3025+0+0 (secure 0 0 0) 0x7fe66406f350 con 0x7fe670124310 2026-02-17T20:09:45.009 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.978+0000 7fe64bfff640 1 -- 10.20.193.123:0/3742429053 --> v1:10.20.193.123:6813/2610635322 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe66400acf0 con 0x7fe640056010 2026-02-17T20:09:45.009 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.978+0000 7fe64bfff640 1 -- 10.20.193.123:0/3742429053 <== mon.1 v2:10.20.193.123:3301/0 6 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe66406c060 con 0x7fe670124310 2026-02-17T20:09:45.009 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.978+0000 7fe64bfff640 1 -- 10.20.193.123:0/3742429053 <== osd.3 v1:10.20.193.123:6813/2610635322 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7fe66400acf0 con 0x7fe640056010 2026-02-17T20:09:45.009 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.983+0000 7f63f4792640 1 -- 10.20.193.123:0/958731813 --> v1:10.20.193.123:6801/458007068 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f63ec063310 con 0x7f63bc056080 2026-02-17T20:09:45.009 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.983+0000 7f63d2ffd640 1 -- 10.20.193.123:0/958731813 <== osd.0 v1:10.20.193.123:6801/458007068 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1793987854) 0x7f63ec063310 con 0x7f63bc056080 2026-02-17T20:09:45.010 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.984+0000 7f63f4792640 1 -- 10.20.193.123:0/958731813 >> v1:10.20.193.123:6801/458007068 conn(0x7f63bc056080 legacy=0x7f63bc0584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:45.010 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.984+0000 7f63f4792640 1 -- 10.20.193.123:0/958731813 >> v1:10.20.193.123:6800/115662061 conn(0x7f63bc04f790 legacy=0x7f63bc051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:45.010 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.984+0000 7f63f4792640 1 -- 10.20.193.123:0/958731813 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f63ec073890 msgr2=0x7f63ec1c76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:45.010 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.984+0000 7f63f4792640 1 --2- 10.20.193.123:0/958731813 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f63ec073890 0x7f63ec1c76f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f63dc0098a0 tx=0x7f63dc0047c0 comp rx=0 tx=0).stop 2026-02-17T20:09:45.010 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.984+0000 7f63f2d08640 1 -- 10.20.193.123:0/958731813 reap_dead start 2026-02-17T20:09:45.010 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.984+0000 7f63f4792640 1 -- 10.20.193.123:0/958731813 shutdown_connections 2026-02-17T20:09:45.010 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.984+0000 7f63f4792640 1 -- 10.20.193.123:0/958731813 >> 10.20.193.123:0/958731813 conn(0x7f63ec0a30f0 msgr2=0x7f63ec12b590 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:45.010 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.984+0000 7f63f4792640 1 -- 10.20.193.123:0/958731813 shutdown_connections 2026-02-17T20:09:45.010 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.984+0000 7f63f4792640 1 -- 10.20.193.123:0/958731813 wait complete. 2026-02-17T20:09:45.010 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.985+0000 7fbde737d640 1 -- 10.20.193.123:0/2089617519 --> v1:10.20.193.123:6805/2594724968 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbde0063310 con 0x7fbdb0056010 2026-02-17T20:09:45.010 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.985+0000 7fbdcdffb640 1 -- 10.20.193.123:0/2089617519 <== osd.1 v1:10.20.193.123:6805/2594724968 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (unknown 0 0 1720373281) 0x7fbde0063310 con 0x7fbdb0056010 2026-02-17T20:09:45.011 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.985+0000 7fbde737d640 1 -- 10.20.193.123:0/2089617519 >> v1:10.20.193.123:6805/2594724968 conn(0x7fbdb0056010 legacy=0x7fbdb0058450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:45.011 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.985+0000 7fbde737d640 1 -- 10.20.193.123:0/2089617519 >> v1:10.20.193.123:6800/115662061 conn(0x7fbdb004f790 legacy=0x7fbdb0051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:45.011 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.985+0000 7fbde737d640 1 -- 10.20.193.123:0/2089617519 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fbde0134d10 msgr2=0x7fbde0071860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:45.011 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.985+0000 7fbde737d640 1 --2- 10.20.193.123:0/2089617519 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fbde0134d10 0x7fbde0071860 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbdd400ebe0 tx=0x7fbdd400c520 comp rx=0 tx=0).stop 2026-02-17T20:09:45.011 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.985+0000 7fbde58f3640 1 -- 10.20.193.123:0/2089617519 reap_dead start 2026-02-17T20:09:45.011 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.985+0000 7fbde737d640 1 -- 10.20.193.123:0/2089617519 shutdown_connections 2026-02-17T20:09:45.011 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.985+0000 7fbde737d640 1 -- 10.20.193.123:0/2089617519 >> 10.20.193.123:0/2089617519 conn(0x7fbde009e7c0 msgr2=0x7fbde013ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:45.011 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.985+0000 7fbde737d640 1 -- 10.20.193.123:0/2089617519 shutdown_connections 2026-02-17T20:09:45.012 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.985+0000 7fbde737d640 1 -- 10.20.193.123:0/2089617519 wait complete. 2026-02-17T20:09:45.012 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.985+0000 7fe675b4c640 1 -- 10.20.193.123:0/3742429053 --> v1:10.20.193.123:6813/2610635322 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe670126a90 con 0x7fe640056010 2026-02-17T20:09:45.012 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.985+0000 7fe64bfff640 1 -- 10.20.193.123:0/3742429053 <== osd.3 v1:10.20.193.123:6813/2610635322 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (unknown 0 0 795413372) 0x7fe670126a90 con 0x7fe640056010 2026-02-17T20:09:45.012 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.986+0000 7fe675b4c640 1 -- 10.20.193.123:0/3742429053 >> v1:10.20.193.123:6813/2610635322 conn(0x7fe640056010 legacy=0x7fe640058450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:45.012 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.986+0000 7fe675b4c640 1 -- 10.20.193.123:0/3742429053 >> v1:10.20.193.123:6800/115662061 conn(0x7fe64004f790 legacy=0x7fe640051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:45.013 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.986+0000 7fe675b4c640 1 -- 10.20.193.123:0/3742429053 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe670124310 msgr2=0x7fe670115890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:45.013 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.986+0000 7fe675b4c640 1 --2- 10.20.193.123:0/3742429053 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe670124310 0x7fe670115890 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe66400cbc0 tx=0x7fe66400a430 comp rx=0 tx=0).stop 2026-02-17T20:09:45.013 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.986+0000 7fe66ffff640 1 -- 10.20.193.123:0/3742429053 reap_dead start 2026-02-17T20:09:45.013 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.986+0000 7fe675b4c640 1 -- 10.20.193.123:0/3742429053 shutdown_connections 2026-02-17T20:09:45.013 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.986+0000 7fe675b4c640 1 -- 10.20.193.123:0/3742429053 >> 10.20.193.123:0/3742429053 conn(0x7fe67009e7c0 msgr2=0x7fe670070000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:45.013 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.986+0000 7fe675b4c640 1 -- 10.20.193.123:0/3742429053 shutdown_connections 2026-02-17T20:09:45.013 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.986+0000 7fe675b4c640 1 -- 10.20.193.123:0/3742429053 wait complete. 2026-02-17T20:09:45.013 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.986+0000 7f000d2e9640 1 -- 10.20.193.123:0/3981139582 --> v1:10.20.193.123:6809/3596569166 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0008063310 con 0x7effd4056080 2026-02-17T20:09:45.013 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.986+0000 7effe77fe640 1 -- 10.20.193.123:0/3981139582 <== osd.2 v1:10.20.193.123:6809/3596569166 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (unknown 0 0 4081650579) 0x7f0008063310 con 0x7effd4056080 2026-02-17T20:09:45.014 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.986+0000 7f000d2e9640 1 -- 10.20.193.123:0/3981139582 >> v1:10.20.193.123:6809/3596569166 conn(0x7effd4056080 legacy=0x7effd40584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:45.014 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.986+0000 7f000d2e9640 1 -- 10.20.193.123:0/3981139582 >> v1:10.20.193.123:6800/115662061 conn(0x7effd404f790 legacy=0x7effd4051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:45.014 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.986+0000 7f000d2e9640 1 -- 10.20.193.123:0/3981139582 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0008071f90 msgr2=0x7f00081cbe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:45.014 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.986+0000 7f000d2e9640 1 --2- 10.20.193.123:0/3981139582 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0008071f90 0x7f00081cbe10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efffc009aa0 tx=0x7efffc0047c0 comp rx=0 tx=0).stop 2026-02-17T20:09:45.014 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.986+0000 7f00077fe640 1 -- 10.20.193.123:0/3981139582 reap_dead start 2026-02-17T20:09:45.014 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.986+0000 7f000d2e9640 1 -- 10.20.193.123:0/3981139582 shutdown_connections 2026-02-17T20:09:45.014 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.986+0000 7f000d2e9640 1 -- 10.20.193.123:0/3981139582 >> 10.20.193.123:0/3981139582 conn(0x7f000809e7c0 msgr2=0x7f000812ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:45.014 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.986+0000 7f000d2e9640 1 -- 10.20.193.123:0/3981139582 shutdown_connections 2026-02-17T20:09:45.014 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:44.986+0000 7f000d2e9640 1 -- 10.20.193.123:0/3981139582 wait complete. 2026-02-17T20:09:45.015 INFO:teuthology.orchestra.run.trial123.stdout:98784247811 2026-02-17T20:09:45.015 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T20:09:45.015 INFO:teuthology.orchestra.run.trial123.stdout:103079215107 2026-02-17T20:09:45.016 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T20:09:45.016 INFO:teuthology.orchestra.run.trial123.stdout:111669149699 2026-02-17T20:09:45.016 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T20:09:45.017 INFO:teuthology.orchestra.run.trial123.stdout:107374182403 2026-02-17T20:09:45.017 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T20:09:45.124 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.127+0000 7f79750a9640 1 Processor -- start 2026-02-17T20:09:45.124 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.127+0000 7f79750a9640 1 -- start start 2026-02-17T20:09:45.124 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.127+0000 7f79750a9640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f7970134d10 0x7f79701350f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:45.125 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.127+0000 7f79750a9640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f7970073830 0x7f7970071880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:45.125 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.127+0000 7f79750a9640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f7970071dc0 0x7f7970072230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:45.125 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.127+0000 7f79750a9640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7f79701347a0 con 0x7f7970071dc0 2026-02-17T20:09:45.125 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.127+0000 7f79750a9640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f7970073f10 con 0x7f7970134d10 2026-02-17T20:09:45.125 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.127+0000 7f79750a9640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f7970073110 con 0x7f7970073830 2026-02-17T20:09:45.125 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.127+0000 7f796f577640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f7970071dc0 0x7f7970072230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:45.125 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.127+0000 7f796e575640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f7970073830 0x7f7970071880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:45.125 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.127+0000 7f796ed76640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f7970134d10 0x7f79701350f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:45.125 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.127+0000 7f796e575640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f7970073830 0x7f7970071880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:52342/0 (socket says 10.20.193.123:52342) 2026-02-17T20:09:45.125 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.127+0000 7f796ed76640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f7970134d10 0x7f79701350f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:57902/0 (socket says 10.20.193.123:57902) 2026-02-17T20:09:45.125 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.127+0000 7f796ed76640 1 -- 10.20.193.123:0/3014359587 learned_addr learned my addr 10.20.193.123:0/3014359587 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:45.125 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.127+0000 7f796f577640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f7970071dc0 0x7f7970072230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:58302/0 (socket says 10.20.193.123:58302) 2026-02-17T20:09:45.126 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.128+0000 7f796f577640 1 -- 10.20.193.123:0/3014359587 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f7970073830 msgr2=0x7f7970071880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:45.126 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.128+0000 7f796f577640 1 --2- 10.20.193.123:0/3014359587 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f7970073830 0x7f7970071880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:45.126 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.128+0000 7f796f577640 1 -- 10.20.193.123:0/3014359587 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f7970134d10 msgr2=0x7f79701350f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:45.126 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.128+0000 7f796f577640 1 --2- 10.20.193.123:0/3014359587 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f7970134d10 0x7f79701350f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:45.126 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.128+0000 7f796f577640 1 -- 10.20.193.123:0/3014359587 --> v2:10.20.193.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f797009f550 con 0x7f7970071dc0 2026-02-17T20:09:45.126 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.128+0000 7f796ed76640 1 --2- 10.20.193.123:0/3014359587 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f7970134d10 0x7f79701350f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:45.127 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.128+0000 7fd7910d8640 1 Processor -- start 2026-02-17T20:09:45.127 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.128+0000 7fd7910d8640 1 -- start start 2026-02-17T20:09:45.127 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.128+0000 7fd7910d8640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fd78c12cb80 0x7fd78c12cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:45.127 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.128+0000 7fd7910d8640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fd78c073890 0x7fd78c12d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:45.127 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.128+0000 7fd7910d8640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fd78c1300e0 0x7fd78c130560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:45.127 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.128+0000 7fd7910d8640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7fd78c074070 con 0x7fd78c1300e0 2026-02-17T20:09:45.127 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.128+0000 7fd7910d8640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7fd78c12d9e0 con 0x7fd78c12cb80 2026-02-17T20:09:45.128 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.128+0000 7fd7910d8640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7fd78c072e70 con 0x7fd78c073890 2026-02-17T20:09:45.128 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.128+0000 7f796f577640 1 --2- 10.20.193.123:0/3014359587 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f7970071dc0 0x7f7970072230 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7960009d90 tx=0x7f796002f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c7891faad8e64e2 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:45.128 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.128+0000 7fd78b577640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fd78c1300e0 0x7fd78c130560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:45.128 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.128+0000 7fd78ad76640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fd78c12cb80 0x7fd78c12cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:45.129 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.128+0000 7fd78a575640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fd78c073890 0x7fd78c12d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:45.129 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.128+0000 7fd78ad76640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fd78c12cb80 0x7fd78c12cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:57914/0 (socket says 10.20.193.123:57914) 2026-02-17T20:09:45.129 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.128+0000 7fd78ad76640 1 -- 10.20.193.123:0/1133920989 learned_addr learned my addr 10.20.193.123:0/1133920989 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:45.129 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.128+0000 7f796dd74640 1 -- 10.20.193.123:0/3014359587 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f796003c070 con 0x7f7970071dc0 2026-02-17T20:09:45.129 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.128+0000 7f796dd74640 1 -- 10.20.193.123:0/3014359587 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f796002fdc0 con 0x7f7970071dc0 2026-02-17T20:09:45.129 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.128+0000 7f796dd74640 1 -- 10.20.193.123:0/3014359587 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7960037660 con 0x7f7970071dc0 2026-02-17T20:09:45.130 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.128+0000 7fd78ad76640 1 -- 10.20.193.123:0/1133920989 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fd78c073890 msgr2=0x7fd78c12d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:45.130 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.128+0000 7fd78ad76640 1 --2- 10.20.193.123:0/1133920989 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fd78c073890 0x7fd78c12d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:45.130 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.128+0000 7fd78ad76640 1 -- 10.20.193.123:0/1133920989 >> v2:10.20.193.123:3300/0 conn(0x7fd78c1300e0 msgr2=0x7fd78c130560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:45.130 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.128+0000 7fd78ad76640 1 --2- 10.20.193.123:0/1133920989 >> v2:10.20.193.123:3300/0 conn(0x7fd78c1300e0 0x7fd78c130560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:45.130 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.128+0000 7fd78ad76640 1 -- 10.20.193.123:0/1133920989 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd78c130aa0 con 0x7fd78c12cb80 2026-02-17T20:09:45.131 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.128+0000 7fd78b577640 1 --2- 10.20.193.123:0/1133920989 >> v2:10.20.193.123:3300/0 conn(0x7fd78c1300e0 0x7fd78c130560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:45.131 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.128+0000 7f79750a9640 1 -- 10.20.193.123:0/3014359587 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f7970071dc0 msgr2=0x7f7970072230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:45.131 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.128+0000 7f79750a9640 1 --2- 10.20.193.123:0/3014359587 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f7970071dc0 0x7f7970072230 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7960009d90 tx=0x7f796002f150 comp rx=0 tx=0).stop 2026-02-17T20:09:45.131 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.128+0000 7f79750a9640 1 -- 10.20.193.123:0/3014359587 shutdown_connections 2026-02-17T20:09:45.131 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.128+0000 7f79750a9640 1 --2- 10.20.193.123:0/3014359587 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f7970071dc0 0x7f7970072230 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:45.132 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.128+0000 7f79750a9640 1 --2- 10.20.193.123:0/3014359587 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f7970073830 0x7f7970071880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:45.132 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.128+0000 7f79750a9640 1 --2- 10.20.193.123:0/3014359587 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f7970134d10 0x7f79701350f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:45.132 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.128+0000 7f79750a9640 1 -- 10.20.193.123:0/3014359587 >> 10.20.193.123:0/3014359587 conn(0x7f797009e7c0 msgr2=0x7f797009ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:45.132 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.128+0000 7f79750a9640 1 -- 10.20.193.123:0/3014359587 shutdown_connections 2026-02-17T20:09:45.132 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.128+0000 7f79750a9640 1 -- 10.20.193.123:0/3014359587 wait complete. 2026-02-17T20:09:45.132 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7fb08be13640 1 Processor -- start 2026-02-17T20:09:45.132 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7fd78ad76640 1 --2- 10.20.193.123:0/1133920989 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fd78c12cb80 0x7fd78c12cf60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd780009970 tx=0x7fd78002eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51ddef8e3bbe8544 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:45.133 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7fb08be13640 1 -- start start 2026-02-17T20:09:45.133 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7fd789d74640 1 -- 10.20.193.123:0/1133920989 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd78003c070 con 0x7fd78c12cb80 2026-02-17T20:09:45.133 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7fd789d74640 1 -- 10.20.193.123:0/1133920989 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd78002fb60 con 0x7fd78c12cb80 2026-02-17T20:09:45.133 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7fd789d74640 1 -- 10.20.193.123:0/1133920989 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd780037440 con 0x7fd78c12cb80 2026-02-17T20:09:45.134 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7f79750a9640 1 Processor -- start 2026-02-17T20:09:45.134 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7fd7910d8640 1 -- 10.20.193.123:0/1133920989 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fd78c12cb80 msgr2=0x7fd78c12cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:45.134 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7fd7910d8640 1 --2- 10.20.193.123:0/1133920989 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fd78c12cb80 0x7fd78c12cf60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd780009970 tx=0x7fd78002eef0 comp rx=0 tx=0).stop 2026-02-17T20:09:45.134 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7f79750a9640 1 -- start start 2026-02-17T20:09:45.135 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7fd9327fd640 1 Processor -- start 2026-02-17T20:09:45.135 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7fd7910d8640 1 -- 10.20.193.123:0/1133920989 shutdown_connections 2026-02-17T20:09:45.135 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7fd7910d8640 1 --2- 10.20.193.123:0/1133920989 >> v2:10.20.193.123:3300/0 conn(0x7fd78c1300e0 0x7fd78c130560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:45.135 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7fd7910d8640 1 --2- 10.20.193.123:0/1133920989 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fd78c073890 0x7fd78c12d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:45.135 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7fd7910d8640 1 --2- 10.20.193.123:0/1133920989 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fd78c12cb80 0x7fd78c12cf60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:45.135 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7fd7910d8640 1 -- 10.20.193.123:0/1133920989 >> 10.20.193.123:0/1133920989 conn(0x7fd78c0a30f0 msgr2=0x7fd78c0a3500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:45.136 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7fb08be13640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fb08412ae60 0x7fb08412b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:45.136 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7fb08be13640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fb08412de50 0x7fb08412e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:45.136 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7fd7910d8640 1 -- 10.20.193.123:0/1133920989 shutdown_connections 2026-02-17T20:09:45.136 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7fd7910d8640 1 -- 10.20.193.123:0/1133920989 wait complete. 2026-02-17T20:09:45.136 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7fb08be13640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fb08412e7d0 0x7fb0841351e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:45.137 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7fb08be13640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7fb084073f10 con 0x7fb08412de50 2026-02-17T20:09:45.137 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7fb08be13640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7fb084072d80 con 0x7fb08412e7d0 2026-02-17T20:09:45.137 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7fb08be13640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7fb084074910 con 0x7fb08412ae60 2026-02-17T20:09:45.137 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7fd9327fd640 1 -- start start 2026-02-17T20:09:45.137 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7fb089b88640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fb08412ae60 0x7fb08412b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:45.138 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7fb089b88640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fb08412ae60 0x7fb08412b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:52360/0 (socket says 10.20.193.123:52360) 2026-02-17T20:09:45.138 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7fb089387640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fb08412de50 0x7fb08412e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:45.138 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7fb089b88640 1 -- 10.20.193.123:0/1867765440 learned_addr learned my addr 10.20.193.123:0/1867765440 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:45.138 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7fb08a389640 1 --2- 10.20.193.123:0/1867765440 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fb08412e7d0 0x7fb0841351e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:45.138 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7f79750a9640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f7970071dc0 0x7f7970135870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:45.139 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7f79750a9640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f7970073830 0x7f7970135db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:45.139 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7f79750a9640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f7970134d10 0x7f79701362f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:45.139 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7f79750a9640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7f797013bad0 con 0x7f7970134d10 2026-02-17T20:09:45.139 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7f79750a9640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f7970072dc0 con 0x7f7970071dc0 2026-02-17T20:09:45.139 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7f79750a9640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f797013bc50 con 0x7f7970073830 2026-02-17T20:09:45.139 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7f796ed76640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f7970071dc0 0x7f7970135870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:45.139 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7fb089b88640 1 -- 10.20.193.123:0/1867765440 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fb08412e7d0 msgr2=0x7fb0841351e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:45.139 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7fb089b88640 1 --2- 10.20.193.123:0/1867765440 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fb08412e7d0 0x7fb0841351e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:45.139 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7fb089b88640 1 -- 10.20.193.123:0/1867765440 >> v2:10.20.193.123:3300/0 conn(0x7fb08412de50 msgr2=0x7fb08412e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:45.140 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7fb089b88640 1 --2- 10.20.193.123:0/1867765440 >> v2:10.20.193.123:3300/0 conn(0x7fb08412de50 0x7fb08412e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:45.140 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7f796ed76640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f7970071dc0 0x7f7970135870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:57930/0 (socket says 10.20.193.123:57930) 2026-02-17T20:09:45.140 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7f796ed76640 1 -- 10.20.193.123:0/3511487425 learned_addr learned my addr 10.20.193.123:0/3511487425 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:45.140 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7fb089b88640 1 -- 10.20.193.123:0/1867765440 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb08412ec20 con 0x7fb08412ae60 2026-02-17T20:09:45.140 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7fb089387640 1 --2- 10.20.193.123:0/1867765440 >> v2:10.20.193.123:3300/0 conn(0x7fb08412de50 0x7fb08412e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:45.141 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7f796e575640 1 --2- 10.20.193.123:0/3511487425 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f7970073830 0x7f7970135db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:45.141 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7f796f577640 1 --2- 10.20.193.123:0/3511487425 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f7970134d10 0x7f79701362f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:45.142 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7fd9327fd640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fd92c130300 0x7fd92c1306e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:45.142 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7fd9327fd640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fd92c072ea0 0x7fd92c12cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:45.142 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7fd9327fd640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fd92c130c20 0x7fd92c12d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:45.142 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7fd9327fd640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7fd92c0742d0 con 0x7fd92c130300 2026-02-17T20:09:45.142 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7fd9327fd640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7fd92c0733c0 con 0x7fd92c072ea0 2026-02-17T20:09:45.142 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7fd9327fd640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7fd92c12d640 con 0x7fd92c130c20 2026-02-17T20:09:45.142 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7fd92bfff640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fd92c130300 0x7fd92c1306e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:45.142 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.129+0000 7f796ed76640 1 -- 10.20.193.123:0/3511487425 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f7970073830 msgr2=0x7f7970135db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:45.142 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7f796ed76640 1 --2- 10.20.193.123:0/3511487425 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f7970073830 0x7f7970135db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:45.143 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7f796ed76640 1 -- 10.20.193.123:0/3511487425 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f7970134d10 msgr2=0x7f79701362f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:45.143 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7fd92bfff640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fd92c130300 0x7fd92c1306e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:58336/0 (socket says 10.20.193.123:58336) 2026-02-17T20:09:45.143 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7fd92bfff640 1 -- 10.20.193.123:0/178086761 learned_addr learned my addr 10.20.193.123:0/178086761 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:45.143 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7f796ed76640 1 --2- 10.20.193.123:0/3511487425 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f7970134d10 0x7f79701362f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:45.143 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7f796ed76640 1 -- 10.20.193.123:0/3511487425 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7970138140 con 0x7f7970071dc0 2026-02-17T20:09:45.144 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7fd92b7fe640 1 --2- 10.20.193.123:0/178086761 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fd92c072ea0 0x7fd92c12cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:45.144 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7fd7910d8640 1 Processor -- start 2026-02-17T20:09:45.144 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7fd930d73640 1 --2- 10.20.193.123:0/178086761 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fd92c130c20 0x7fd92c12d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:45.145 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7f796ed76640 1 --2- 10.20.193.123:0/3511487425 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f7970071dc0 0x7f7970135870 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f796400ebe0 tx=0x7f796400c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:45.145 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7fd7910d8640 1 -- start start 2026-02-17T20:09:45.145 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7fd92bfff640 1 -- 10.20.193.123:0/178086761 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fd92c130c20 msgr2=0x7fd92c12d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:45.145 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7fd92bfff640 1 --2- 10.20.193.123:0/178086761 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fd92c130c20 0x7fd92c12d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:45.145 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7fd92bfff640 1 -- 10.20.193.123:0/178086761 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fd92c072ea0 msgr2=0x7fd92c12cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:45.145 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7fd92bfff640 1 --2- 10.20.193.123:0/178086761 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fd92c072ea0 0x7fd92c12cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:45.146 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7fd92bfff640 1 -- 10.20.193.123:0/178086761 --> v2:10.20.193.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd92c12d7f0 con 0x7fd92c130300 2026-02-17T20:09:45.146 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7f794f7fe640 1 -- 10.20.193.123:0/3511487425 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7964017070 con 0x7f7970071dc0 2026-02-17T20:09:45.146 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7f794f7fe640 1 -- 10.20.193.123:0/3511487425 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f796400cc40 con 0x7f7970071dc0 2026-02-17T20:09:45.146 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7f79750a9640 1 -- 10.20.193.123:0/3511487425 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7970137e60 con 0x7f7970071dc0 2026-02-17T20:09:45.146 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7f794f7fe640 1 -- 10.20.193.123:0/3511487425 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7964013470 con 0x7f7970071dc0 2026-02-17T20:09:45.147 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7fb089b88640 1 --2- 10.20.193.123:0/1867765440 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fb08412ae60 0x7fb08412b240 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb074009970 tx=0x7fb07402ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d6ddbddd944da12 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:45.147 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7f79750a9640 1 -- 10.20.193.123:0/3511487425 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7970136830 con 0x7f7970071dc0 2026-02-17T20:09:45.147 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7fd7910d8640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fd78c073890 0x7fd78c1c7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:45.148 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7fd7910d8640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fd78c12cb80 0x7fd78c1c7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:45.148 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7fd7910d8640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fd78c1300e0 0x7fd78c133ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:45.148 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7fd7910d8640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd78c137470 con 0x7fd78c073890 2026-02-17T20:09:45.148 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7fd7910d8640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7fd78c073070 con 0x7fd78c12cb80 2026-02-17T20:09:45.148 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7fd7910d8640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7fd78c1375f0 con 0x7fd78c1300e0 2026-02-17T20:09:45.148 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7fb088b86640 1 -- 10.20.193.123:0/1867765440 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb07403c070 con 0x7fb08412ae60 2026-02-17T20:09:45.148 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7fb088b86640 1 -- 10.20.193.123:0/1867765440 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb07402fac0 con 0x7fb08412ae60 2026-02-17T20:09:45.149 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7fd78ad76640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fd78c073890 0x7fd78c1c7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:45.149 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7fb088b86640 1 -- 10.20.193.123:0/1867765440 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb074037440 con 0x7fb08412ae60 2026-02-17T20:09:45.150 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7fd78ad76640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fd78c073890 0x7fd78c1c7830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:58352/0 (socket says 10.20.193.123:58352) 2026-02-17T20:09:45.150 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7fd78ad76640 1 -- 10.20.193.123:0/4086609618 learned_addr learned my addr 10.20.193.123:0/4086609618 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:45.150 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7fd78b577640 1 --2- 10.20.193.123:0/4086609618 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fd78c1300e0 0x7fd78c133ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:45.150 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7fd78a575640 1 --2- 10.20.193.123:0/4086609618 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fd78c12cb80 0x7fd78c1c7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:45.150 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7fd78ad76640 1 -- 10.20.193.123:0/4086609618 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fd78c1300e0 msgr2=0x7fd78c133ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:45.150 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7fd78ad76640 1 --2- 10.20.193.123:0/4086609618 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fd78c1300e0 0x7fd78c133ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:45.150 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7fd78ad76640 1 -- 10.20.193.123:0/4086609618 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fd78c12cb80 msgr2=0x7fd78c1c7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:45.150 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7fd78ad76640 1 --2- 10.20.193.123:0/4086609618 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fd78c12cb80 0x7fd78c1c7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:45.150 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7fd78ad76640 1 -- 10.20.193.123:0/4086609618 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd78c1359f0 con 0x7fd78c073890 2026-02-17T20:09:45.150 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7fd78ad76640 1 --2- 10.20.193.123:0/4086609618 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fd78c073890 0x7fd78c1c7830 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd780009aa0 tx=0x7fd7800047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:45.151 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7fd92bfff640 1 --2- 10.20.193.123:0/178086761 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fd92c130300 0x7fd92c1306e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd9180099a0 tx=0x7fd91802efe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98982c617ab520c0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:45.151 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7fd7677fe640 1 -- 10.20.193.123:0/4086609618 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd780047070 con 0x7fd78c073890 2026-02-17T20:09:45.151 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7fd7677fe640 1 -- 10.20.193.123:0/4086609618 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd780042430 con 0x7fd78c073890 2026-02-17T20:09:45.151 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7fd7910d8640 1 -- 10.20.193.123:0/4086609618 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd78c136e10 con 0x7fd78c073890 2026-02-17T20:09:45.152 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7fb08be13640 1 -- 10.20.193.123:0/1867765440 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fb08412ae60 msgr2=0x7fb08412b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:45.152 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7fb08be13640 1 --2- 10.20.193.123:0/1867765440 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fb08412ae60 0x7fb08412b240 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb074009970 tx=0x7fb07402ee90 comp rx=0 tx=0).stop 2026-02-17T20:09:45.152 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7fd7677fe640 1 -- 10.20.193.123:0/4086609618 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd78003c040 con 0x7fd78c073890 2026-02-17T20:09:45.152 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7fd92affd640 1 -- 10.20.193.123:0/178086761 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd91803c070 con 0x7fd92c130300 2026-02-17T20:09:45.153 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7fd7910d8640 1 -- 10.20.193.123:0/4086609618 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd78c136190 con 0x7fd78c073890 2026-02-17T20:09:45.153 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7fd92affd640 1 -- 10.20.193.123:0/178086761 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd91802fc10 con 0x7fd92c130300 2026-02-17T20:09:45.153 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7fd92affd640 1 -- 10.20.193.123:0/178086761 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd918037440 con 0x7fd92c130300 2026-02-17T20:09:45.154 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7fb08be13640 1 -- 10.20.193.123:0/1867765440 shutdown_connections 2026-02-17T20:09:45.154 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7fb08be13640 1 --2- 10.20.193.123:0/1867765440 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fb08412e7d0 0x7fb0841351e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:45.154 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7fb08be13640 1 --2- 10.20.193.123:0/1867765440 >> v2:10.20.193.123:3300/0 conn(0x7fb08412de50 0x7fb08412e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:45.154 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7fb08be13640 1 --2- 10.20.193.123:0/1867765440 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fb08412ae60 0x7fb08412b240 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:45.154 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7fb08be13640 1 -- 10.20.193.123:0/1867765440 >> 10.20.193.123:0/1867765440 conn(0x7fb08409ec70 msgr2=0x7fb08409f080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:45.154 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7fb08be13640 1 -- 10.20.193.123:0/1867765440 shutdown_connections 2026-02-17T20:09:45.154 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7fb08be13640 1 -- 10.20.193.123:0/1867765440 wait complete. 2026-02-17T20:09:45.154 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.130+0000 7f79750a9640 1 -- 10.20.193.123:0/3511487425 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7970071880 con 0x7f7970071dc0 2026-02-17T20:09:45.155 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.131+0000 7fd9327fd640 1 -- 10.20.193.123:0/178086761 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fd92c130300 msgr2=0x7fd92c1306e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:45.155 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.131+0000 7fd9327fd640 1 --2- 10.20.193.123:0/178086761 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fd92c130300 0x7fd92c1306e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd9180099a0 tx=0x7fd91802efe0 comp rx=0 tx=0).stop 2026-02-17T20:09:45.155 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.131+0000 7f794f7fe640 1 -- 10.20.193.123:0/3511487425 <== mon.1 v2:10.20.193.123:3301/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f7964024060 con 0x7f7970071dc0 2026-02-17T20:09:45.156 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.131+0000 7fd9327fd640 1 -- 10.20.193.123:0/178086761 shutdown_connections 2026-02-17T20:09:45.156 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.131+0000 7fd9327fd640 1 --2- 10.20.193.123:0/178086761 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fd92c130c20 0x7fd92c12d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:45.156 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.131+0000 7fd9327fd640 1 --2- 10.20.193.123:0/178086761 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fd92c072ea0 0x7fd92c12cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:45.156 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.131+0000 7fd9327fd640 1 --2- 10.20.193.123:0/178086761 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fd92c130300 0x7fd92c1306e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:45.156 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.131+0000 7fd9327fd640 1 -- 10.20.193.123:0/178086761 >> 10.20.193.123:0/178086761 conn(0x7fd92c0a1830 msgr2=0x7fd92c0a1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:45.156 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.131+0000 7fd9327fd640 1 -- 10.20.193.123:0/178086761 shutdown_connections 2026-02-17T20:09:45.156 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.131+0000 7fd9327fd640 1 -- 10.20.193.123:0/178086761 wait complete. 2026-02-17T20:09:45.156 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.131+0000 7fd7910d8640 1 -- 10.20.193.123:0/4086609618 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd78c130560 con 0x7fd78c073890 2026-02-17T20:09:45.157 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.131+0000 7f794f7fe640 1 -- 10.20.193.123:0/3511487425 <== mon.1 v2:10.20.193.123:3301/0 5 ==== osd_map(30..30 src has 1..30) ==== 3025+0+0 (secure 0 0 0) 0x7f7964066b70 con 0x7f7970071dc0 2026-02-17T20:09:45.157 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.131+0000 7fb08be13640 1 Processor -- start 2026-02-17T20:09:45.157 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.131+0000 7fb08be13640 1 -- start start 2026-02-17T20:09:45.157 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.131+0000 7fd7677fe640 1 -- 10.20.193.123:0/4086609618 <== mon.0 v2:10.20.193.123:3300/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7fd78003f3c0 con 0x7fd78c073890 2026-02-17T20:09:45.158 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.131+0000 7fb08be13640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fb08412ae60 0x7fb08411a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:45.158 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.131+0000 7fb08be13640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fb08412de50 0x7fb08411a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:45.158 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.131+0000 7fb08be13640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fb08412e7d0 0x7fb08411ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:45.158 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.131+0000 7fb08be13640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb084073cd0 con 0x7fb08412ae60 2026-02-17T20:09:45.158 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.131+0000 7fb08be13640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7fb0840737c0 con 0x7fb08412de50 2026-02-17T20:09:45.158 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.131+0000 7fb08be13640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7fb08412b780 con 0x7fb08412e7d0 2026-02-17T20:09:45.158 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.131+0000 7fd9327fd640 1 Processor -- start 2026-02-17T20:09:45.159 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.131+0000 7fb089387640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fb08412de50 0x7fb08411a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:45.159 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.131+0000 7fb089b88640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fb08412ae60 0x7fb08411a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:45.159 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.131+0000 7fb08a389640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fb08412e7d0 0x7fb08411ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:45.159 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.131+0000 7fb089387640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fb08412de50 0x7fb08411a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:57958/0 (socket says 10.20.193.123:57958) 2026-02-17T20:09:45.159 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.131+0000 7fb089387640 1 -- 10.20.193.123:0/3740633409 learned_addr learned my addr 10.20.193.123:0/3740633409 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:45.159 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.131+0000 7fd9327fd640 1 -- start start 2026-02-17T20:09:45.159 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.131+0000 7fd7677fe640 1 -- 10.20.193.123:0/4086609618 <== mon.0 v2:10.20.193.123:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3025+0+0 (secure 0 0 0) 0x7fd78008b670 con 0x7fd78c073890 2026-02-17T20:09:45.160 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.131+0000 7fb089387640 1 -- 10.20.193.123:0/3740633409 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fb08412e7d0 msgr2=0x7fb08411ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:45.160 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.131+0000 7fb089387640 1 --2- 10.20.193.123:0/3740633409 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fb08412e7d0 0x7fb08411ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:45.160 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.131+0000 7fb089387640 1 -- 10.20.193.123:0/3740633409 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fb08412ae60 msgr2=0x7fb08411a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:45.160 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.131+0000 7fb089387640 1 --2- 10.20.193.123:0/3740633409 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fb08412ae60 0x7fb08411a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:45.160 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.131+0000 7fb089387640 1 -- 10.20.193.123:0/3740633409 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb08411d4e0 con 0x7fb08412de50 2026-02-17T20:09:45.161 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.132+0000 7fd9327fd640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fd92c072ea0 0x7fd92c133f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:45.161 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.132+0000 7fd9327fd640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fd92c130300 0x7fd92c1344a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:45.161 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.132+0000 7fd9327fd640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fd92c130c20 0x7fd92c1349e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:45.161 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.132+0000 7fd9327fd640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd92c137840 con 0x7fd92c130300 2026-02-17T20:09:45.161 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.132+0000 7fd9327fd640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7fd92c1376c0 con 0x7fd92c072ea0 2026-02-17T20:09:45.161 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.132+0000 7fd9327fd640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7fd92c1379c0 con 0x7fd92c130c20 2026-02-17T20:09:45.161 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.132+0000 7fb089387640 1 --2- 10.20.193.123:0/3740633409 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fb08412de50 0x7fb08411a630 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb07800ec10 tx=0x7fb07800c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:45.162 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.132+0000 7fd92bfff640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fd92c072ea0 0x7fd92c133f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:45.162 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.132+0000 7fd92b7fe640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fd92c130300 0x7fd92c1344a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:45.162 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.132+0000 7fd930d73640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fd92c130c20 0x7fd92c1349e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:45.163 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.132+0000 7fd92bfff640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fd92c072ea0 0x7fd92c133f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:57964/0 (socket says 10.20.193.123:57964) 2026-02-17T20:09:45.163 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.132+0000 7fd930d73640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fd92c130c20 0x7fd92c1349e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:52394/0 (socket says 10.20.193.123:52394) 2026-02-17T20:09:45.163 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.132+0000 7fd92bfff640 1 -- 10.20.193.123:0/4107844676 learned_addr learned my addr 10.20.193.123:0/4107844676 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:45.163 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.132+0000 7fd92b7fe640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fd92c130300 0x7fd92c1344a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:58364/0 (socket says 10.20.193.123:58364) 2026-02-17T20:09:45.163 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.132+0000 7fd930d73640 1 -- 10.20.193.123:0/4107844676 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fd92c072ea0 msgr2=0x7fd92c133f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:45.163 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.132+0000 7fd930d73640 1 --2- 10.20.193.123:0/4107844676 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fd92c072ea0 0x7fd92c133f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:45.163 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.132+0000 7fd930d73640 1 -- 10.20.193.123:0/4107844676 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fd92c130300 msgr2=0x7fd92c1344a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:45.163 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.132+0000 7fd930d73640 1 --2- 10.20.193.123:0/4107844676 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fd92c130300 0x7fd92c1344a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:45.163 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.132+0000 7fd930d73640 1 -- 10.20.193.123:0/4107844676 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd92c12a8b0 con 0x7fd92c130c20 2026-02-17T20:09:45.163 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.132+0000 7fd930d73640 1 --2- 10.20.193.123:0/4107844676 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fd92c130c20 0x7fd92c1349e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd920009d90 tx=0x7fd92000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:45.163 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.132+0000 7fd928ff9640 1 -- 10.20.193.123:0/4107844676 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd920018020 con 0x7fd92c130c20 2026-02-17T20:09:45.163 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.132+0000 7fd928ff9640 1 -- 10.20.193.123:0/4107844676 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd920014480 con 0x7fd92c130c20 2026-02-17T20:09:45.163 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.132+0000 7fd928ff9640 1 -- 10.20.193.123:0/4107844676 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd920014870 con 0x7fd92c130c20 2026-02-17T20:09:45.163 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.132+0000 7fd9327fd640 1 -- 10.20.193.123:0/4107844676 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd92c134f20 con 0x7fd92c130c20 2026-02-17T20:09:45.163 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.132+0000 7fd9327fd640 1 -- 10.20.193.123:0/4107844676 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fd92c136840 con 0x7fd92c130c20 2026-02-17T20:09:45.163 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.132+0000 7fd9327fd640 1 -- 10.20.193.123:0/4107844676 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd92c1306e0 con 0x7fd92c130c20 2026-02-17T20:09:45.163 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.133+0000 7fd928ff9640 1 -- 10.20.193.123:0/4107844676 <== mon.2 v2:10.20.193.123:3302/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7fd920014a10 con 0x7fd92c130c20 2026-02-17T20:09:45.163 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.133+0000 7fd928ff9640 1 -- 10.20.193.123:0/4107844676 <== mon.2 v2:10.20.193.123:3302/0 5 ==== osd_map(30..30 src has 1..30) ==== 3025+0+0 (secure 0 0 0) 0x7fd920067c20 con 0x7fd92c130c20 2026-02-17T20:09:45.164 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.133+0000 7fb0727fc640 1 -- 10.20.193.123:0/3740633409 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb078017070 con 0x7fb08412de50 2026-02-17T20:09:45.164 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.133+0000 7fb0727fc640 1 -- 10.20.193.123:0/3740633409 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb07800cc40 con 0x7fb08412de50 2026-02-17T20:09:45.164 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.133+0000 7fb08be13640 1 -- 10.20.193.123:0/3740633409 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb08411cc40 con 0x7fb08412de50 2026-02-17T20:09:45.164 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.133+0000 7fb0727fc640 1 -- 10.20.193.123:0/3740633409 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb078013470 con 0x7fb08412de50 2026-02-17T20:09:45.164 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.133+0000 7f794f7fe640 1 -- 10.20.193.123:0/3511487425 <== mon.1 v2:10.20.193.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f7970138140 con 0x7f7970071dc0 2026-02-17T20:09:45.165 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.133+0000 7fb08be13640 1 -- 10.20.193.123:0/3740633409 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0841c4e50 con 0x7fb08412de50 2026-02-17T20:09:45.165 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.133+0000 7fb08be13640 1 -- 10.20.193.123:0/3740633409 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb08412b240 con 0x7fb08412de50 2026-02-17T20:09:45.165 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.134+0000 7fd7677fe640 1 -- 10.20.193.123:0/4086609618 <== mon.0 v2:10.20.193.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7fd78c136e10 con 0x7fd78c073890 2026-02-17T20:09:45.165 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.134+0000 7fb0727fc640 1 -- 10.20.193.123:0/3740633409 <== mon.1 v2:10.20.193.123:3301/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7fb078024060 con 0x7fb08412de50 2026-02-17T20:09:45.165 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.134+0000 7fb0727fc640 1 -- 10.20.193.123:0/3740633409 <== mon.1 v2:10.20.193.123:3301/0 5 ==== osd_map(30..30 src has 1..30) ==== 3025+0+0 (secure 0 0 0) 0x7fb078066c30 con 0x7fb08412de50 2026-02-17T20:09:45.165 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.135+0000 7fd928ff9640 1 -- 10.20.193.123:0/4107844676 <== mon.2 v2:10.20.193.123:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7fd920022020 con 0x7fd92c130c20 2026-02-17T20:09:45.166 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.136+0000 7fb0727fc640 1 -- 10.20.193.123:0/3740633409 <== mon.1 v2:10.20.193.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7fb078040980 con 0x7fb08412de50 2026-02-17T20:09:45.200 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.203+0000 7f79750a9640 1 -- 10.20.193.123:0/3511487425 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f7970068530 con 0x7f7970071dc0 2026-02-17T20:09:45.200 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.204+0000 7fd7910d8640 1 -- 10.20.193.123:0/4086609618 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fd78c127250 con 0x7fd78c073890 2026-02-17T20:09:45.200 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.204+0000 7f794f7fe640 1 -- 10.20.193.123:0/3511487425 <== mon.1 v2:10.20.193.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7964040960 con 0x7f7970071dc0 2026-02-17T20:09:45.200 INFO:teuthology.orchestra.run.trial123.stdout:98784247810 2026-02-17T20:09:45.200 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.204+0000 7fd7677fe640 1 -- 10.20.193.123:0/4086609618 <== mon.0 v2:10.20.193.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd780065510 con 0x7fd78c073890 2026-02-17T20:09:45.201 INFO:teuthology.orchestra.run.trial123.stdout:103079215106 2026-02-17T20:09:45.201 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.205+0000 7f79750a9640 1 -- 10.20.193.123:0/3511487425 >> v1:10.20.193.123:6800/115662061 conn(0x7f793c04f790 legacy=0x7f793c051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:45.201 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.205+0000 7f79750a9640 1 -- 10.20.193.123:0/3511487425 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f7970071dc0 msgr2=0x7f7970135870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:45.201 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.205+0000 7f79750a9640 1 --2- 10.20.193.123:0/3511487425 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f7970071dc0 0x7f7970135870 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f796400ebe0 tx=0x7f796400c520 comp rx=0 tx=0).stop 2026-02-17T20:09:45.202 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.205+0000 7f79750a9640 1 -- 10.20.193.123:0/3511487425 shutdown_connections 2026-02-17T20:09:45.202 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.205+0000 7f79750a9640 1 --2- 10.20.193.123:0/3511487425 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f7970134d10 0x7f79701362f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:45.202 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.205+0000 7f79750a9640 1 --2- 10.20.193.123:0/3511487425 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f7970073830 0x7f7970135db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:45.202 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.205+0000 7f79750a9640 1 --2- 10.20.193.123:0/3511487425 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f7970071dc0 0x7f7970135870 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:45.202 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.205+0000 7f79750a9640 1 -- 10.20.193.123:0/3511487425 >> 10.20.193.123:0/3511487425 conn(0x7f797009e7c0 msgr2=0x7f7970131290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:45.202 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.205+0000 7f79750a9640 1 -- 10.20.193.123:0/3511487425 shutdown_connections 2026-02-17T20:09:45.202 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.205+0000 7f79750a9640 1 -- 10.20.193.123:0/3511487425 wait complete. 2026-02-17T20:09:45.202 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.205+0000 7fd7910d8640 1 -- 10.20.193.123:0/4086609618 >> v1:10.20.193.123:6800/115662061 conn(0x7fd75804f790 legacy=0x7fd758051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:45.202 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.205+0000 7fd7910d8640 1 -- 10.20.193.123:0/4086609618 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fd78c073890 msgr2=0x7fd78c1c7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:45.203 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.205+0000 7fd7910d8640 1 --2- 10.20.193.123:0/4086609618 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fd78c073890 0x7fd78c1c7830 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd780009aa0 tx=0x7fd7800047c0 comp rx=0 tx=0).stop 2026-02-17T20:09:45.203 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.205+0000 7fd7910d8640 1 -- 10.20.193.123:0/4086609618 shutdown_connections 2026-02-17T20:09:45.203 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.205+0000 7fd7910d8640 1 --2- 10.20.193.123:0/4086609618 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fd78c1300e0 0x7fd78c133ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:45.203 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.205+0000 7fd7910d8640 1 --2- 10.20.193.123:0/4086609618 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fd78c12cb80 0x7fd78c1c7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:45.203 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.205+0000 7fd7910d8640 1 --2- 10.20.193.123:0/4086609618 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fd78c073890 0x7fd78c1c7830 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:45.203 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.205+0000 7fd7910d8640 1 -- 10.20.193.123:0/4086609618 >> 10.20.193.123:0/4086609618 conn(0x7fd78c0a30f0 msgr2=0x7fd78c0703d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:45.203 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.205+0000 7fd7910d8640 1 -- 10.20.193.123:0/4086609618 shutdown_connections 2026-02-17T20:09:45.203 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.206+0000 7fd7910d8640 1 -- 10.20.193.123:0/4086609618 wait complete. 2026-02-17T20:09:45.203 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.206+0000 7fd9327fd640 1 -- 10.20.193.123:0/4107844676 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fd92c0008d0 con 0x7fd92c130c20 2026-02-17T20:09:45.203 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.206+0000 7fd928ff9640 1 -- 10.20.193.123:0/4107844676 <== mon.2 v2:10.20.193.123:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd920010040 con 0x7fd92c130c20 2026-02-17T20:09:45.203 INFO:teuthology.orchestra.run.trial123.stdout:107374182402 2026-02-17T20:09:45.204 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.207+0000 7fd9327fd640 1 -- 10.20.193.123:0/4107844676 >> v1:10.20.193.123:6800/115662061 conn(0x7fd8fc04f790 legacy=0x7fd8fc051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:45.204 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.207+0000 7fd9327fd640 1 -- 10.20.193.123:0/4107844676 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fd92c130c20 msgr2=0x7fd92c1349e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:45.204 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.207+0000 7fd9327fd640 1 --2- 10.20.193.123:0/4107844676 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fd92c130c20 0x7fd92c1349e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd920009d90 tx=0x7fd92000c490 comp rx=0 tx=0).stop 2026-02-17T20:09:45.204 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.207+0000 7fd9327fd640 1 -- 10.20.193.123:0/4107844676 shutdown_connections 2026-02-17T20:09:45.204 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.207+0000 7fd9327fd640 1 --2- 10.20.193.123:0/4107844676 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fd92c130c20 0x7fd92c1349e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:45.204 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.207+0000 7fd9327fd640 1 --2- 10.20.193.123:0/4107844676 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fd92c130300 0x7fd92c1344a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:45.204 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.207+0000 7fd9327fd640 1 --2- 10.20.193.123:0/4107844676 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fd92c072ea0 0x7fd92c133f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:45.204 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.207+0000 7fd9327fd640 1 -- 10.20.193.123:0/4107844676 >> 10.20.193.123:0/4107844676 conn(0x7fd92c0a1830 msgr2=0x7fd92c12b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:45.204 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.207+0000 7fd9327fd640 1 -- 10.20.193.123:0/4107844676 shutdown_connections 2026-02-17T20:09:45.204 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.207+0000 7fd9327fd640 1 -- 10.20.193.123:0/4107844676 wait complete. 2026-02-17T20:09:45.205 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.207+0000 7fb08be13640 1 -- 10.20.193.123:0/3740633409 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fb084075010 con 0x7fb08412de50 2026-02-17T20:09:45.205 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.208+0000 7fb0727fc640 1 -- 10.20.193.123:0/3740633409 <== mon.1 v2:10.20.193.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb078065c40 con 0x7fb08412de50 2026-02-17T20:09:45.205 INFO:teuthology.orchestra.run.trial123.stdout:111669149698 2026-02-17T20:09:45.206 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.209+0000 7fb08be13640 1 -- 10.20.193.123:0/3740633409 >> v1:10.20.193.123:6800/115662061 conn(0x7fb05404f790 legacy=0x7fb054051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:45.206 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.209+0000 7fb08be13640 1 -- 10.20.193.123:0/3740633409 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fb08412de50 msgr2=0x7fb08411a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:45.206 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.209+0000 7fb08be13640 1 --2- 10.20.193.123:0/3740633409 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fb08412de50 0x7fb08411a630 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb07800ec10 tx=0x7fb07800c520 comp rx=0 tx=0).stop 2026-02-17T20:09:45.206 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.209+0000 7fb08be13640 1 -- 10.20.193.123:0/3740633409 shutdown_connections 2026-02-17T20:09:45.206 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.209+0000 7fb08be13640 1 --2- 10.20.193.123:0/3740633409 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fb08412e7d0 0x7fb08411ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:45.206 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.209+0000 7fb08be13640 1 --2- 10.20.193.123:0/3740633409 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fb08412de50 0x7fb08411a630 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:45.206 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.209+0000 7fb08be13640 1 --2- 10.20.193.123:0/3740633409 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fb08412ae60 0x7fb08411a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:45.206 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.209+0000 7fb08be13640 1 -- 10.20.193.123:0/3740633409 >> 10.20.193.123:0/3740633409 conn(0x7fb08409ec70 msgr2=0x7fb08409be30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:45.206 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.209+0000 7fb08be13640 1 -- 10.20.193.123:0/3740633409 shutdown_connections 2026-02-17T20:09:45.206 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:45.210+0000 7fb08be13640 1 -- 10.20.193.123:0/3740633409 wait complete. 2026-02-17T20:09:45.210 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215107 got 103079215106 for osd.1 2026-02-17T20:09:45.210 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247811 got 98784247810 for osd.0 2026-02-17T20:09:45.213 INFO:tasks.ceph.ceph_manager.ceph:need seq 107374182403 got 107374182402 for osd.2 2026-02-17T20:09:45.214 INFO:tasks.ceph.ceph_manager.ceph:need seq 111669149699 got 111669149698 for osd.3 2026-02-17T20:09:46.211 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T20:09:46.212 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T20:09:46.214 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T20:09:46.215 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T20:09:46.284 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.288+0000 7fb6ab538640 1 Processor -- start 2026-02-17T20:09:46.284 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.288+0000 7fb6ab538640 1 -- start start 2026-02-17T20:09:46.284 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.288+0000 7fb6ab538640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fb6a4070f00 0x7fb6a412d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:46.284 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.288+0000 7fb6ab538640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fb6a41353d0 0x7fb6a41377c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:46.284 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.288+0000 7fb6ab538640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6a4071ab0 con 0x7fb6a412cb30 2026-02-17T20:09:46.284 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.288+0000 7fb6ab538640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7fb6a4072350 con 0x7fb6a41353d0 2026-02-17T20:09:46.284 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.288+0000 7fb6ab538640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7fb6a4070cc0 con 0x7fb6a4070f00 2026-02-17T20:09:46.284 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.288+0000 7f016f722640 1 Processor -- start 2026-02-17T20:09:46.285 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.288+0000 7fb6a8aac640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fb6a4070f00 0x7fb6a412d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:46.285 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.288+0000 7f016f722640 1 -- start start 2026-02-17T20:09:46.285 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.288+0000 7fb6a8aac640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fb6a4070f00 0x7fb6a412d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:52396/0 (socket says 10.20.193.123:52396) 2026-02-17T20:09:46.285 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.288+0000 7fb6a8aac640 1 -- 10.20.193.123:0/122911842 learned_addr learned my addr 10.20.193.123:0/122911842 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:46.285 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.288+0000 7fb6a92ad640 1 --1- 10.20.193.123:0/122911842 >> v1:10.20.193.123:6789/0 conn(0x7fb6a412cb30 0x7fb6a412cf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:54428/0 (socket says 10.20.193.123:54428) 2026-02-17T20:09:46.285 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.288+0000 7fb6a9aae640 1 --2- 10.20.193.123:0/122911842 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fb6a41353d0 0x7fb6a41377c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:46.285 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.288+0000 7fb6a8aac640 1 -- 10.20.193.123:0/122911842 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fb6a41353d0 msgr2=0x7fb6a41377c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:46.285 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.288+0000 7fb6a8aac640 1 --2- 10.20.193.123:0/122911842 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fb6a41353d0 0x7fb6a41377c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:46.285 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.288+0000 7fb6a8aac640 1 -- 10.20.193.123:0/122911842 >> v1:10.20.193.123:6789/0 conn(0x7fb6a412cb30 legacy=0x7fb6a412cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:46.285 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.288+0000 7fb693fff640 1 -- 10.20.193.123:0/122911842 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2303968840 0 0) 0x7fb6a4071ab0 con 0x7fb6a412cb30 2026-02-17T20:09:46.285 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.288+0000 7fb6a8aac640 1 -- 10.20.193.123:0/122911842 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6a4138d10 con 0x7fb6a4070f00 2026-02-17T20:09:46.286 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.288+0000 7f016f722640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f016812cb80 0x7f016812cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:46.286 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.288+0000 7f016f722640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0168135460 0x7f0168137850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:46.286 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.288+0000 7f016f722640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0168074070 con 0x7f0168073890 2026-02-17T20:09:46.286 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.289+0000 7f016f722640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7f0168072e70 con 0x7f016812cb80 2026-02-17T20:09:46.286 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.289+0000 7f016f722640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f0168073020 con 0x7f0168135460 2026-02-17T20:09:46.286 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.289+0000 7f016d497640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f016812cb80 0x7f016812cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:46.286 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.289+0000 7f016d497640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f016812cb80 0x7f016812cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:58366/0 (socket says 10.20.193.123:58366) 2026-02-17T20:09:46.286 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.289+0000 7f016d497640 1 -- 10.20.193.123:0/3111761438 learned_addr learned my addr 10.20.193.123:0/3111761438 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:46.286 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.289+0000 7f016dc98640 1 --2- 10.20.193.123:0/3111761438 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0168135460 0x7f0168137850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:46.286 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.289+0000 7f016dc98640 1 -- 10.20.193.123:0/3111761438 >> v2:10.20.193.123:3300/0 conn(0x7f016812cb80 msgr2=0x7f016812cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:46.286 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.289+0000 7f016dc98640 1 --2- 10.20.193.123:0/3111761438 >> v2:10.20.193.123:3300/0 conn(0x7f016812cb80 0x7f016812cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:46.286 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.289+0000 7f016dc98640 1 -- 10.20.193.123:0/3111761438 >> v1:10.20.193.123:6789/0 conn(0x7f0168073890 legacy=0x7f016812d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:46.286 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.289+0000 7f016dc98640 1 -- 10.20.193.123:0/3111761438 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0168138da0 con 0x7f0168135460 2026-02-17T20:09:46.286 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.289+0000 7f016d497640 1 --2- 10.20.193.123:0/3111761438 >> v2:10.20.193.123:3300/0 conn(0x7f016812cb80 0x7f016812cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:46.287 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.289+0000 7fb6a8aac640 1 --2- 10.20.193.123:0/122911842 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fb6a4070f00 0x7fb6a412d620 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb6980099a0 tx=0x7fb69802ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9799e0f590d7104 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:46.287 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.289+0000 7fb693fff640 1 -- 10.20.193.123:0/122911842 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb69803c070 con 0x7fb6a4070f00 2026-02-17T20:09:46.287 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.289+0000 7fb693fff640 1 -- 10.20.193.123:0/122911842 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb69802fb00 con 0x7fb6a4070f00 2026-02-17T20:09:46.287 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.289+0000 7fb693fff640 1 -- 10.20.193.123:0/122911842 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb698037440 con 0x7fb6a4070f00 2026-02-17T20:09:46.287 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.289+0000 7f016dc98640 1 --2- 10.20.193.123:0/3111761438 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0168135460 0x7f0168137850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0164009d90 tx=0x7f016402f1f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32712dd47f2bb3f7 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:46.287 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.289+0000 7fb6ab538640 1 -- 10.20.193.123:0/122911842 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fb6a4070f00 msgr2=0x7fb6a412d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:46.287 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.289+0000 7fb6ab538640 1 --2- 10.20.193.123:0/122911842 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fb6a4070f00 0x7fb6a412d620 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb6980099a0 tx=0x7fb69802ee90 comp rx=0 tx=0).stop 2026-02-17T20:09:46.287 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.289+0000 7fb6ab538640 1 -- 10.20.193.123:0/122911842 shutdown_connections 2026-02-17T20:09:46.287 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.289+0000 7fb6ab538640 1 --2- 10.20.193.123:0/122911842 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fb6a4070f00 0x7fb6a412d620 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:46.287 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.289+0000 7fb6ab538640 1 --2- 10.20.193.123:0/122911842 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fb6a41353d0 0x7fb6a41377c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:46.287 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.289+0000 7fb6ab538640 1 -- 10.20.193.123:0/122911842 >> 10.20.193.123:0/122911842 conn(0x7fb6a409ec70 msgr2=0x7fb6a409f080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:46.287 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.289+0000 7f0157fff640 1 -- 10.20.193.123:0/3111761438 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f016403c070 con 0x7f0168135460 2026-02-17T20:09:46.288 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.289+0000 7fb6ab538640 1 -- 10.20.193.123:0/122911842 shutdown_connections 2026-02-17T20:09:46.288 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.289+0000 7f0157fff640 1 -- 10.20.193.123:0/3111761438 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0164037440 con 0x7f0168135460 2026-02-17T20:09:46.288 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.289+0000 7f0157fff640 1 -- 10.20.193.123:0/3111761438 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0164037810 con 0x7f0168135460 2026-02-17T20:09:46.288 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.289+0000 7fb6ab538640 1 -- 10.20.193.123:0/122911842 wait complete. 2026-02-17T20:09:46.288 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.290+0000 7f016f722640 1 -- 10.20.193.123:0/3111761438 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0168135460 msgr2=0x7f0168137850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:46.288 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.290+0000 7f016f722640 1 --2- 10.20.193.123:0/3111761438 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0168135460 0x7f0168137850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0164009d90 tx=0x7f016402f1f0 comp rx=0 tx=0).stop 2026-02-17T20:09:46.288 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.290+0000 7f016f722640 1 -- 10.20.193.123:0/3111761438 shutdown_connections 2026-02-17T20:09:46.288 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.290+0000 7f016f722640 1 --2- 10.20.193.123:0/3111761438 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0168135460 0x7f0168137850 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:46.288 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.290+0000 7f016f722640 1 --2- 10.20.193.123:0/3111761438 >> v2:10.20.193.123:3300/0 conn(0x7f016812cb80 0x7f016812cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:46.288 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.290+0000 7f016f722640 1 -- 10.20.193.123:0/3111761438 >> 10.20.193.123:0/3111761438 conn(0x7f01680a30f0 msgr2=0x7f01680a3500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:46.288 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.290+0000 7f016f722640 1 -- 10.20.193.123:0/3111761438 shutdown_connections 2026-02-17T20:09:46.288 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.290+0000 7f016f722640 1 -- 10.20.193.123:0/3111761438 wait complete. 2026-02-17T20:09:46.289 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.290+0000 7fb6ab538640 1 Processor -- start 2026-02-17T20:09:46.289 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.290+0000 7fb6ab538640 1 -- start start 2026-02-17T20:09:46.289 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.290+0000 7fb6ab538640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fb6a4070f00 0x7fb6a41c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:46.289 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.290+0000 7fb6ab538640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fb6a412cb30 0x7fb6a41c7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:46.289 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.290+0000 7fb6ab538640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fb6a41353d0 0x7fb6a41c7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:46.289 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.290+0000 7fb6ab538640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb6a41381e0 con 0x7fb6a41353d0 2026-02-17T20:09:46.289 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.290+0000 7fb6ab538640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7fb6a4138060 con 0x7fb6a412cb30 2026-02-17T20:09:46.289 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.290+0000 7fb6ab538640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7fb6a4138360 con 0x7fb6a4070f00 2026-02-17T20:09:46.289 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.290+0000 7fb6a92ad640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fb6a4070f00 0x7fb6a41c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:46.289 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.290+0000 7fb6a8aac640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fb6a412cb30 0x7fb6a41c7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:46.289 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.290+0000 7fb6a92ad640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fb6a4070f00 0x7fb6a41c70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:52422/0 (socket says 10.20.193.123:52422) 2026-02-17T20:09:46.289 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.290+0000 7fb6a92ad640 1 -- 10.20.193.123:0/3049301789 learned_addr learned my addr 10.20.193.123:0/3049301789 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:46.289 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.290+0000 7fb6a9aae640 1 --2- 10.20.193.123:0/3049301789 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fb6a41353d0 0x7fb6a41c7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:46.290 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.290+0000 7f016f722640 1 Processor -- start 2026-02-17T20:09:46.290 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.290+0000 7f016f722640 1 -- start start 2026-02-17T20:09:46.290 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.290+0000 7fb6a9aae640 1 -- 10.20.193.123:0/3049301789 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fb6a4070f00 msgr2=0x7fb6a41c70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:46.290 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.290+0000 7fb6a9aae640 1 --2- 10.20.193.123:0/3049301789 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fb6a4070f00 0x7fb6a41c70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:46.290 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.290+0000 7fb6a9aae640 1 -- 10.20.193.123:0/3049301789 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fb6a412cb30 msgr2=0x7fb6a41c7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:46.290 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.290+0000 7fb6a9aae640 1 --2- 10.20.193.123:0/3049301789 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fb6a412cb30 0x7fb6a41c7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:46.290 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.290+0000 7fb6a9aae640 1 -- 10.20.193.123:0/3049301789 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6a4134b10 con 0x7fb6a41353d0 2026-02-17T20:09:46.290 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.291+0000 7fb6a9aae640 1 --2- 10.20.193.123:0/3049301789 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fb6a41353d0 0x7fb6a41c7b50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb6a000efc0 tx=0x7fb6a000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:46.290 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.291+0000 7fb691ffb640 1 -- 10.20.193.123:0/3049301789 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a0018020 con 0x7fb6a41353d0 2026-02-17T20:09:46.290 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.291+0000 7f016f722640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0168073890 0x7f0168133ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:46.290 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.291+0000 7fb691ffb640 1 -- 10.20.193.123:0/3049301789 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6a0014480 con 0x7fb6a41353d0 2026-02-17T20:09:46.290 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.291+0000 7fb691ffb640 1 -- 10.20.193.123:0/3049301789 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a0014870 con 0x7fb6a41353d0 2026-02-17T20:09:46.290 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.291+0000 7f016f722640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f016812cb80 0x7f0168134400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:46.291 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.291+0000 7fb6ab538640 1 -- 10.20.193.123:0/3049301789 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6a4133250 con 0x7fb6a41353d0 2026-02-17T20:09:46.291 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.291+0000 7f016f722640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0168135460 0x7f0168134940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:46.291 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.291+0000 7f016f722640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0168138270 con 0x7f0168135460 2026-02-17T20:09:46.291 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.291+0000 7f016f722640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f01681380f0 con 0x7f016812cb80 2026-02-17T20:09:46.291 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.291+0000 7f016f722640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f01681383f0 con 0x7f0168073890 2026-02-17T20:09:46.291 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.291+0000 7fb6ab538640 1 -- 10.20.193.123:0/3049301789 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6a4131720 con 0x7fb6a41353d0 2026-02-17T20:09:46.292 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.291+0000 7f016d497640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0168073890 0x7f0168133ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:46.292 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.291+0000 7f016cc96640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f016812cb80 0x7f0168134400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:46.292 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.291+0000 7f016d497640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0168073890 0x7f0168133ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:52436/0 (socket says 10.20.193.123:52436) 2026-02-17T20:09:46.292 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.291+0000 7f016d497640 1 -- 10.20.193.123:0/3527051564 learned_addr learned my addr 10.20.193.123:0/3527051564 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:46.292 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.291+0000 7f016dc98640 1 --2- 10.20.193.123:0/3527051564 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0168135460 0x7f0168134940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:46.292 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.291+0000 7f016d497640 1 -- 10.20.193.123:0/3527051564 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f016812cb80 msgr2=0x7f0168134400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:46.292 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.291+0000 7f016d497640 1 --2- 10.20.193.123:0/3527051564 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f016812cb80 0x7f0168134400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:46.292 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.291+0000 7f016d497640 1 -- 10.20.193.123:0/3527051564 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0168135460 msgr2=0x7f0168134940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:46.292 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.291+0000 7f016d497640 1 --2- 10.20.193.123:0/3527051564 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0168135460 0x7f0168134940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:46.292 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.291+0000 7f016d497640 1 -- 10.20.193.123:0/3527051564 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0168133650 con 0x7f0168073890 2026-02-17T20:09:46.292 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.291+0000 7f016d497640 1 --2- 10.20.193.123:0/3527051564 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0168073890 0x7f0168133ec0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f015800ebe0 tx=0x7f015800c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:46.292 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.291+0000 7f0155ffb640 1 -- 10.20.193.123:0/3527051564 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0158017070 con 0x7f0168073890 2026-02-17T20:09:46.292 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.291+0000 7f0155ffb640 1 -- 10.20.193.123:0/3527051564 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f015800cc40 con 0x7f0168073890 2026-02-17T20:09:46.292 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.291+0000 7f016f722640 1 -- 10.20.193.123:0/3527051564 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0168133020 con 0x7f0168073890 2026-02-17T20:09:46.292 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.291+0000 7f0155ffb640 1 -- 10.20.193.123:0/3527051564 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0158013470 con 0x7f0168073890 2026-02-17T20:09:46.292 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.291+0000 7f016f722640 1 -- 10.20.193.123:0/3527051564 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f01681c7200 con 0x7f0168073890 2026-02-17T20:09:46.292 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.291+0000 7fb6ab538640 1 -- 10.20.193.123:0/3049301789 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6a4138720 con 0x7fb6a41353d0 2026-02-17T20:09:46.292 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.291+0000 7fb691ffb640 1 -- 10.20.193.123:0/3049301789 <== mon.0 v2:10.20.193.123:3300/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7fb6a0014a10 con 0x7fb6a41353d0 2026-02-17T20:09:46.292 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.292+0000 7f016f722640 1 -- 10.20.193.123:0/3527051564 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0168133a20 con 0x7f0168073890 2026-02-17T20:09:46.292 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.292+0000 7fb691ffb640 1 -- 10.20.193.123:0/3049301789 <== mon.0 v2:10.20.193.123:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3025+0+0 (secure 0 0 0) 0x7fb6a0067c30 con 0x7fb6a41353d0 2026-02-17T20:09:46.293 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.292+0000 7f0155ffb640 1 -- 10.20.193.123:0/3527051564 <== mon.2 v2:10.20.193.123:3302/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f0158024060 con 0x7f0168073890 2026-02-17T20:09:46.293 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.292+0000 7f0155ffb640 1 -- 10.20.193.123:0/3527051564 <== mon.2 v2:10.20.193.123:3302/0 5 ==== osd_map(30..30 src has 1..30) ==== 3025+0+0 (secure 0 0 0) 0x7f0158066c30 con 0x7f0168073890 2026-02-17T20:09:46.293 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.293+0000 7fb691ffb640 1 -- 10.20.193.123:0/3049301789 <== mon.0 v2:10.20.193.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7fb6a0022030 con 0x7fb6a41353d0 2026-02-17T20:09:46.293 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.295+0000 7f0155ffb640 1 -- 10.20.193.123:0/3527051564 <== mon.2 v2:10.20.193.123:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f01580409a0 con 0x7f0168073890 2026-02-17T20:09:46.324 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.328+0000 7fbb88182640 1 Processor -- start 2026-02-17T20:09:46.324 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.328+0000 7fbb88182640 1 -- start start 2026-02-17T20:09:46.326 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.328+0000 7fbb88182640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fbb8012d090 0x7fbb8012d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:46.326 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.328+0000 7fbb88182640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fbb80073990 0x7fbb80135210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:46.327 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.328+0000 7fbb88182640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb80071bc0 con 0x7fbb8012d9b0 2026-02-17T20:09:46.327 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.328+0000 7fbb88182640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7fbb8009f550 con 0x7fbb80073990 2026-02-17T20:09:46.327 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.328+0000 7fbb88182640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7fbb8012ce70 con 0x7fbb8012d090 2026-02-17T20:09:46.327 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.328+0000 7fbb85ef7640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fbb8012d090 0x7fbb8012d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:46.327 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.328+0000 7fbb866f8640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fbb80073990 0x7fbb80135210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:46.327 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.328+0000 7fbb85ef7640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fbb8012d090 0x7fbb8012d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:52450/0 (socket says 10.20.193.123:52450) 2026-02-17T20:09:46.327 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.328+0000 7fbb85ef7640 1 -- 10.20.193.123:0/2376645415 learned_addr learned my addr 10.20.193.123:0/2376645415 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:46.327 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.328+0000 7fbb85ef7640 1 -- 10.20.193.123:0/2376645415 >> v2:10.20.193.123:3300/0 conn(0x7fbb80073990 msgr2=0x7fbb80135210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:46.327 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.328+0000 7fbb85ef7640 1 --2- 10.20.193.123:0/2376645415 >> v2:10.20.193.123:3300/0 conn(0x7fbb80073990 0x7fbb80135210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:46.327 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.328+0000 7fbb85ef7640 1 -- 10.20.193.123:0/2376645415 >> v1:10.20.193.123:6789/0 conn(0x7fbb8012d9b0 legacy=0x7fbb80073280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:46.328 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.328+0000 7fbb84ef5640 1 -- 10.20.193.123:0/2376645415 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3569618028 0 0) 0x7fbb74002920 con 0x7fbb8012d9b0 2026-02-17T20:09:46.328 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.328+0000 7fbb85ef7640 1 -- 10.20.193.123:0/2376645415 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb80115ca0 con 0x7fbb8012d090 2026-02-17T20:09:46.328 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.329+0000 7fbb85ef7640 1 --2- 10.20.193.123:0/2376645415 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fbb8012d090 0x7fbb8012d470 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbb70009970 tx=0x7fbb7002ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6cce6327109ceeb server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:46.328 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.329+0000 7fbb84ef5640 1 -- 10.20.193.123:0/2376645415 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb7003c070 con 0x7fbb8012d090 2026-02-17T20:09:46.328 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.329+0000 7fbb84ef5640 1 -- 10.20.193.123:0/2376645415 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb7002fb10 con 0x7fbb8012d090 2026-02-17T20:09:46.328 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.329+0000 7fbb84ef5640 1 -- 10.20.193.123:0/2376645415 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb70037440 con 0x7fbb8012d090 2026-02-17T20:09:46.328 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.329+0000 7fbb88182640 1 -- 10.20.193.123:0/2376645415 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fbb8012d090 msgr2=0x7fbb8012d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:46.328 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.329+0000 7fbb88182640 1 --2- 10.20.193.123:0/2376645415 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fbb8012d090 0x7fbb8012d470 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbb70009970 tx=0x7fbb7002ee90 comp rx=0 tx=0).stop 2026-02-17T20:09:46.328 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.329+0000 7fbb88182640 1 -- 10.20.193.123:0/2376645415 shutdown_connections 2026-02-17T20:09:46.328 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.329+0000 7fbb88182640 1 --2- 10.20.193.123:0/2376645415 >> v2:10.20.193.123:3300/0 conn(0x7fbb80073990 0x7fbb80135210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:46.328 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.329+0000 7fbb88182640 1 --2- 10.20.193.123:0/2376645415 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fbb8012d090 0x7fbb8012d470 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:46.329 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.329+0000 7fbb88182640 1 -- 10.20.193.123:0/2376645415 >> 10.20.193.123:0/2376645415 conn(0x7fbb8009e7c0 msgr2=0x7fbb8009ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:46.329 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.329+0000 7fbb88182640 1 -- 10.20.193.123:0/2376645415 shutdown_connections 2026-02-17T20:09:46.329 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.329+0000 7fbb88182640 1 -- 10.20.193.123:0/2376645415 wait complete. 2026-02-17T20:09:46.329 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.329+0000 7fe36caf0640 1 Processor -- start 2026-02-17T20:09:46.329 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.329+0000 7fe36caf0640 1 -- start start 2026-02-17T20:09:46.330 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.330+0000 7fbb88182640 1 Processor -- start 2026-02-17T20:09:46.330 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.330+0000 7fe36caf0640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fe36812cb80 0x7fe36812cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:46.330 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.330+0000 7fe36caf0640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe368073890 0x7fe36812d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:46.331 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.330+0000 7fe36caf0640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fe3681300e0 0x7fe368130560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:46.331 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.330+0000 7fe36caf0640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7fe368074070 con 0x7fe3681300e0 2026-02-17T20:09:46.331 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.330+0000 7fe36caf0640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7fe36812d9e0 con 0x7fe368073890 2026-02-17T20:09:46.331 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.330+0000 7fe36caf0640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7fe368072e70 con 0x7fe36812cb80 2026-02-17T20:09:46.331 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.330+0000 7fbb88182640 1 -- start start 2026-02-17T20:09:46.332 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.330+0000 7fe366575640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fe36812cb80 0x7fe36812cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:46.332 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.330+0000 7fe366575640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fe36812cb80 0x7fe36812cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:52454/0 (socket says 10.20.193.123:52454) 2026-02-17T20:09:46.332 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.330+0000 7fe366575640 1 -- 10.20.193.123:0/3906787662 learned_addr learned my addr 10.20.193.123:0/3906787662 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:46.332 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.330+0000 7fe366d76640 1 --2- 10.20.193.123:0/3906787662 >> v2:10.20.193.123:3300/0 conn(0x7fe3681300e0 0x7fe368130560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:46.333 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.330+0000 7fe365d74640 1 --2- 10.20.193.123:0/3906787662 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe368073890 0x7fe36812d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:46.333 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.330+0000 7fe366575640 1 -- 10.20.193.123:0/3906787662 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe368073890 msgr2=0x7fe36812d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:46.333 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.330+0000 7fe366575640 1 --2- 10.20.193.123:0/3906787662 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe368073890 0x7fe36812d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:46.333 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.330+0000 7fe366575640 1 -- 10.20.193.123:0/3906787662 >> v2:10.20.193.123:3300/0 conn(0x7fe3681300e0 msgr2=0x7fe368130560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:46.333 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.330+0000 7fe366575640 1 --2- 10.20.193.123:0/3906787662 >> v2:10.20.193.123:3300/0 conn(0x7fe3681300e0 0x7fe368130560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:46.333 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.330+0000 7fe366575640 1 -- 10.20.193.123:0/3906787662 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe368130aa0 con 0x7fe36812cb80 2026-02-17T20:09:46.333 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.330+0000 7fe365d74640 1 --2- 10.20.193.123:0/3906787662 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe368073890 0x7fe36812d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T20:09:46.334 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.330+0000 7fbb88182640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fbb80073990 0x7fbb8011bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:46.334 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.330+0000 7fbb88182640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fbb8012d090 0x7fbb8011c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:46.335 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.330+0000 7fbb88182640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fbb8012d9b0 0x7fbb8011c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:46.335 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.330+0000 7fbb88182640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbb801159e0 con 0x7fbb80073990 2026-02-17T20:09:46.335 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.330+0000 7fbb88182640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7fbb80115860 con 0x7fbb8012d9b0 2026-02-17T20:09:46.335 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.330+0000 7fbb88182640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7fbb80073de0 con 0x7fbb8012d090 2026-02-17T20:09:46.335 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.330+0000 7fbb85ef7640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fbb80073990 0x7fbb8011bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:46.335 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.330+0000 7fbb856f6640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fbb8012d090 0x7fbb8011c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:46.335 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.330+0000 7fbb85ef7640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fbb80073990 0x7fbb8011bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:58426/0 (socket says 10.20.193.123:58426) 2026-02-17T20:09:46.335 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.330+0000 7fbb866f8640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fbb8012d9b0 0x7fbb8011c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:46.335 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.330+0000 7fbb85ef7640 1 -- 10.20.193.123:0/2695491840 learned_addr learned my addr 10.20.193.123:0/2695491840 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:46.335 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.330+0000 7fbb85ef7640 1 -- 10.20.193.123:0/2695491840 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fbb8012d090 msgr2=0x7fbb8011c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:46.335 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.330+0000 7fbb85ef7640 1 --2- 10.20.193.123:0/2695491840 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fbb8012d090 0x7fbb8011c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:46.335 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.330+0000 7fbb85ef7640 1 -- 10.20.193.123:0/2695491840 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fbb8012d9b0 msgr2=0x7fbb8011c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:46.336 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.330+0000 7fbb85ef7640 1 --2- 10.20.193.123:0/2695491840 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fbb8012d9b0 0x7fbb8011c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:46.336 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.330+0000 7fbb85ef7640 1 -- 10.20.193.123:0/2695491840 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb8011e790 con 0x7fbb80073990 2026-02-17T20:09:46.336 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.330+0000 7fbb85ef7640 1 --2- 10.20.193.123:0/2695491840 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fbb80073990 0x7fbb8011bd30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbb70009aa0 tx=0x7fbb700047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:46.336 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.330+0000 7fe366575640 1 --2- 10.20.193.123:0/3906787662 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fe36812cb80 0x7fe36812cf60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe35c009970 tx=0x7fe35c02eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d57d5e255d6dd2d1 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:46.336 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.330+0000 7fbb6e7fc640 1 -- 10.20.193.123:0/2695491840 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb70047070 con 0x7fbb80073990 2026-02-17T20:09:46.337 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.330+0000 7fe365573640 1 -- 10.20.193.123:0/3906787662 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe35c03c070 con 0x7fe36812cb80 2026-02-17T20:09:46.337 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.330+0000 7fbb6e7fc640 1 -- 10.20.193.123:0/2695491840 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb70042650 con 0x7fbb80073990 2026-02-17T20:09:46.337 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.330+0000 7fbb6e7fc640 1 -- 10.20.193.123:0/2695491840 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb7003c040 con 0x7fbb80073990 2026-02-17T20:09:46.337 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.330+0000 7fe365573640 1 -- 10.20.193.123:0/3906787662 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe35c02fb60 con 0x7fe36812cb80 2026-02-17T20:09:46.338 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.330+0000 7fe365573640 1 -- 10.20.193.123:0/3906787662 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe35c037440 con 0x7fe36812cb80 2026-02-17T20:09:46.338 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.330+0000 7fbb88182640 1 -- 10.20.193.123:0/2695491840 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb801233d0 con 0x7fbb80073990 2026-02-17T20:09:46.338 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.330+0000 7fbb88182640 1 -- 10.20.193.123:0/2695491840 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb8011df00 con 0x7fbb80073990 2026-02-17T20:09:46.339 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.331+0000 7fe36caf0640 1 -- 10.20.193.123:0/3906787662 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fe36812cb80 msgr2=0x7fe36812cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:46.339 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.331+0000 7fe36caf0640 1 --2- 10.20.193.123:0/3906787662 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fe36812cb80 0x7fe36812cf60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe35c009970 tx=0x7fe35c02eef0 comp rx=0 tx=0).stop 2026-02-17T20:09:46.339 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.331+0000 7fe36caf0640 1 -- 10.20.193.123:0/3906787662 shutdown_connections 2026-02-17T20:09:46.339 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.331+0000 7fe36caf0640 1 --2- 10.20.193.123:0/3906787662 >> v2:10.20.193.123:3300/0 conn(0x7fe3681300e0 0x7fe368130560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:46.339 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.331+0000 7fe36caf0640 1 --2- 10.20.193.123:0/3906787662 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe368073890 0x7fe36812d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:46.339 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.331+0000 7fe36caf0640 1 --2- 10.20.193.123:0/3906787662 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fe36812cb80 0x7fe36812cf60 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:46.340 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.331+0000 7fe36caf0640 1 -- 10.20.193.123:0/3906787662 >> 10.20.193.123:0/3906787662 conn(0x7fe3680a30f0 msgr2=0x7fe3680a3500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:46.340 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.331+0000 7fe36caf0640 1 -- 10.20.193.123:0/3906787662 shutdown_connections 2026-02-17T20:09:46.340 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.331+0000 7fe36caf0640 1 -- 10.20.193.123:0/3906787662 wait complete. 2026-02-17T20:09:46.340 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.331+0000 7fbb88182640 1 -- 10.20.193.123:0/2695491840 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb8012d470 con 0x7fbb80073990 2026-02-17T20:09:46.340 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.331+0000 7fbb6e7fc640 1 -- 10.20.193.123:0/2695491840 <== mon.0 v2:10.20.193.123:3300/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7fbb700413d0 con 0x7fbb80073990 2026-02-17T20:09:46.341 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.331+0000 7fbb6e7fc640 1 -- 10.20.193.123:0/2695491840 <== mon.0 v2:10.20.193.123:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3025+0+0 (secure 0 0 0) 0x7fbb7008b510 con 0x7fbb80073990 2026-02-17T20:09:46.343 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.332+0000 7fe36caf0640 1 Processor -- start 2026-02-17T20:09:46.343 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.332+0000 7fe36caf0640 1 -- start start 2026-02-17T20:09:46.343 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.332+0000 7fe36caf0640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fe368073890 0x7fe368134050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:46.343 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.332+0000 7fe36caf0640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe36812cb80 0x7fe368134590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:46.343 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.332+0000 7fe36caf0640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fe3681300e0 0x7fe368134ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:46.343 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.332+0000 7fe36caf0640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe368137470 con 0x7fe3681300e0 2026-02-17T20:09:46.343 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.332+0000 7fe36caf0640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7fe368073070 con 0x7fe36812cb80 2026-02-17T20:09:46.343 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.332+0000 7fe36caf0640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7fe3681375f0 con 0x7fe368073890 2026-02-17T20:09:46.343 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.332+0000 7fe366575640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fe368073890 0x7fe368134050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:46.344 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.332+0000 7fe366575640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fe368073890 0x7fe368134050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:52460/0 (socket says 10.20.193.123:52460) 2026-02-17T20:09:46.344 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.332+0000 7fe366575640 1 -- 10.20.193.123:0/55462425 learned_addr learned my addr 10.20.193.123:0/55462425 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:46.344 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.332+0000 7fe365d74640 1 --2- 10.20.193.123:0/55462425 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe36812cb80 0x7fe368134590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:46.344 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.332+0000 7fe366d76640 1 --2- 10.20.193.123:0/55462425 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fe3681300e0 0x7fe368134ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:46.344 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.332+0000 7fe366575640 1 -- 10.20.193.123:0/55462425 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe36812cb80 msgr2=0x7fe368134590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:46.344 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.332+0000 7fe366575640 1 --2- 10.20.193.123:0/55462425 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe36812cb80 0x7fe368134590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:46.344 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.332+0000 7fe366575640 1 -- 10.20.193.123:0/55462425 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fe3681300e0 msgr2=0x7fe368134ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:46.344 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.332+0000 7fe366575640 1 --2- 10.20.193.123:0/55462425 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fe3681300e0 0x7fe368134ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:46.344 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.332+0000 7fe366575640 1 -- 10.20.193.123:0/55462425 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe368127240 con 0x7fe368073890 2026-02-17T20:09:46.344 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.332+0000 7fe366575640 1 --2- 10.20.193.123:0/55462425 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fe368073890 0x7fe368134050 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe35c009aa0 tx=0x7fe35c0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:46.344 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.332+0000 7fe34effd640 1 -- 10.20.193.123:0/55462425 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe35c03c040 con 0x7fe368073890 2026-02-17T20:09:46.344 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.332+0000 7fe34effd640 1 -- 10.20.193.123:0/55462425 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe35c042410 con 0x7fe368073890 2026-02-17T20:09:46.344 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.332+0000 7fe36caf0640 1 -- 10.20.193.123:0/55462425 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe368135010 con 0x7fe368073890 2026-02-17T20:09:46.344 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.332+0000 7fe34effd640 1 -- 10.20.193.123:0/55462425 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe35c042800 con 0x7fe368073890 2026-02-17T20:09:46.345 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.332+0000 7fe36caf0640 1 -- 10.20.193.123:0/55462425 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fe368136920 con 0x7fe368073890 2026-02-17T20:09:46.345 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.333+0000 7fe36caf0640 1 -- 10.20.193.123:0/55462425 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe368135840 con 0x7fe368073890 2026-02-17T20:09:46.345 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.333+0000 7fe34effd640 1 -- 10.20.193.123:0/55462425 <== mon.2 v2:10.20.193.123:3302/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7fe35c0429a0 con 0x7fe368073890 2026-02-17T20:09:46.345 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.333+0000 7fbb6e7fc640 1 -- 10.20.193.123:0/2695491840 <== mon.0 v2:10.20.193.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7fbb8011e790 con 0x7fbb80073990 2026-02-17T20:09:46.345 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.333+0000 7fe34effd640 1 -- 10.20.193.123:0/55462425 <== mon.2 v2:10.20.193.123:3302/0 5 ==== osd_map(30..30 src has 1..30) ==== 3025+0+0 (secure 0 0 0) 0x7fe35c08bd50 con 0x7fe368073890 2026-02-17T20:09:46.345 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.335+0000 7fe34effd640 1 -- 10.20.193.123:0/55462425 <== mon.2 v2:10.20.193.123:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7fe35c08f030 con 0x7fe368073890 2026-02-17T20:09:46.361 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.365+0000 7fb6ab538640 1 -- 10.20.193.123:0/3049301789 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fb6a4075010 con 0x7fb6a41353d0 2026-02-17T20:09:46.362 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.365+0000 7fb691ffb640 1 -- 10.20.193.123:0/3049301789 <== mon.0 v2:10.20.193.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb6a0010040 con 0x7fb6a41353d0 2026-02-17T20:09:46.362 INFO:teuthology.orchestra.run.trial123.stdout:103079215106 2026-02-17T20:09:46.363 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.367+0000 7fb6ab538640 1 -- 10.20.193.123:0/3049301789 >> v1:10.20.193.123:6800/115662061 conn(0x7fb67404f790 legacy=0x7fb674051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:46.363 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.367+0000 7fb6ab538640 1 -- 10.20.193.123:0/3049301789 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fb6a41353d0 msgr2=0x7fb6a41c7b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:46.363 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.367+0000 7fb6ab538640 1 --2- 10.20.193.123:0/3049301789 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fb6a41353d0 0x7fb6a41c7b50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb6a000efc0 tx=0x7fb6a000c490 comp rx=0 tx=0).stop 2026-02-17T20:09:46.363 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.367+0000 7fb6ab538640 1 -- 10.20.193.123:0/3049301789 shutdown_connections 2026-02-17T20:09:46.363 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.367+0000 7fb6ab538640 1 --2- 10.20.193.123:0/3049301789 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fb6a41353d0 0x7fb6a41c7b50 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:46.363 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.367+0000 7fb6ab538640 1 --2- 10.20.193.123:0/3049301789 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fb6a412cb30 0x7fb6a41c7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:46.364 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.367+0000 7fb6ab538640 1 --2- 10.20.193.123:0/3049301789 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fb6a4070f00 0x7fb6a41c70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:46.364 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.367+0000 7fb6ab538640 1 -- 10.20.193.123:0/3049301789 >> 10.20.193.123:0/3049301789 conn(0x7fb6a409ec70 msgr2=0x7fb6a4073f10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:46.364 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.367+0000 7fb6ab538640 1 -- 10.20.193.123:0/3049301789 shutdown_connections 2026-02-17T20:09:46.364 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.367+0000 7fb6ab538640 1 -- 10.20.193.123:0/3049301789 wait complete. 2026-02-17T20:09:46.366 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.370+0000 7f016f722640 1 -- 10.20.193.123:0/3527051564 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f0168138850 con 0x7f0168073890 2026-02-17T20:09:46.366 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.370+0000 7f0155ffb640 1 -- 10.20.193.123:0/3527051564 <== mon.2 v2:10.20.193.123:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0158065ce0 con 0x7f0168073890 2026-02-17T20:09:46.366 INFO:teuthology.orchestra.run.trial123.stdout:98784247810 2026-02-17T20:09:46.369 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.372+0000 7f016f722640 1 -- 10.20.193.123:0/3527051564 >> v1:10.20.193.123:6800/115662061 conn(0x7f013804f790 legacy=0x7f0138051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:46.369 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.372+0000 7f016f722640 1 -- 10.20.193.123:0/3527051564 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0168073890 msgr2=0x7f0168133ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:46.369 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.372+0000 7f016f722640 1 --2- 10.20.193.123:0/3527051564 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0168073890 0x7f0168133ec0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f015800ebe0 tx=0x7f015800c520 comp rx=0 tx=0).stop 2026-02-17T20:09:46.369 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.373+0000 7f016f722640 1 -- 10.20.193.123:0/3527051564 shutdown_connections 2026-02-17T20:09:46.369 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.373+0000 7f016f722640 1 --2- 10.20.193.123:0/3527051564 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0168135460 0x7f0168134940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:46.369 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.373+0000 7f016f722640 1 --2- 10.20.193.123:0/3527051564 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f016812cb80 0x7f0168134400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:46.369 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.373+0000 7f016f722640 1 --2- 10.20.193.123:0/3527051564 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0168073890 0x7f0168133ec0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:46.369 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.373+0000 7f016f722640 1 -- 10.20.193.123:0/3527051564 >> 10.20.193.123:0/3527051564 conn(0x7f01680a30f0 msgr2=0x7f01680705f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:46.369 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.373+0000 7f016f722640 1 -- 10.20.193.123:0/3527051564 shutdown_connections 2026-02-17T20:09:46.369 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.373+0000 7f016f722640 1 -- 10.20.193.123:0/3527051564 wait complete. 2026-02-17T20:09:46.373 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215107 got 103079215106 for osd.1 2026-02-17T20:09:46.377 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247811 got 98784247810 for osd.0 2026-02-17T20:09:46.400 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.404+0000 7fbb88182640 1 -- 10.20.193.123:0/2695491840 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fbb80124040 con 0x7fbb80073990 2026-02-17T20:09:46.400 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.404+0000 7fbb6e7fc640 1 -- 10.20.193.123:0/2695491840 <== mon.0 v2:10.20.193.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fbb700653b0 con 0x7fbb80073990 2026-02-17T20:09:46.400 INFO:teuthology.orchestra.run.trial123.stdout:107374182403 2026-02-17T20:09:46.401 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.405+0000 7fe36caf0640 1 -- 10.20.193.123:0/55462425 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fe368130560 con 0x7fe368073890 2026-02-17T20:09:46.401 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.405+0000 7fe34effd640 1 -- 10.20.193.123:0/55462425 <== mon.2 v2:10.20.193.123:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe35c065c50 con 0x7fe368073890 2026-02-17T20:09:46.401 INFO:teuthology.orchestra.run.trial123.stdout:111669149699 2026-02-17T20:09:46.402 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.405+0000 7fbb88182640 1 -- 10.20.193.123:0/2695491840 >> v1:10.20.193.123:6800/115662061 conn(0x7fbb5004f790 legacy=0x7fbb50051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:46.402 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.405+0000 7fbb88182640 1 -- 10.20.193.123:0/2695491840 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fbb80073990 msgr2=0x7fbb8011bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:46.402 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.405+0000 7fbb88182640 1 --2- 10.20.193.123:0/2695491840 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fbb80073990 0x7fbb8011bd30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbb70009aa0 tx=0x7fbb700047c0 comp rx=0 tx=0).stop 2026-02-17T20:09:46.402 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.405+0000 7fbb88182640 1 -- 10.20.193.123:0/2695491840 shutdown_connections 2026-02-17T20:09:46.402 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.405+0000 7fbb88182640 1 --2- 10.20.193.123:0/2695491840 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fbb8012d9b0 0x7fbb8011c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:46.402 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.405+0000 7fbb88182640 1 --2- 10.20.193.123:0/2695491840 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fbb8012d090 0x7fbb8011c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:46.402 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.405+0000 7fbb88182640 1 --2- 10.20.193.123:0/2695491840 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fbb80073990 0x7fbb8011bd30 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:46.402 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.405+0000 7fbb88182640 1 -- 10.20.193.123:0/2695491840 >> 10.20.193.123:0/2695491840 conn(0x7fbb8009e7c0 msgr2=0x7fbb8012bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:46.402 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.405+0000 7fbb88182640 1 -- 10.20.193.123:0/2695491840 shutdown_connections 2026-02-17T20:09:46.402 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.405+0000 7fbb88182640 1 -- 10.20.193.123:0/2695491840 wait complete. 2026-02-17T20:09:46.403 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.407+0000 7fe36caf0640 1 -- 10.20.193.123:0/55462425 >> v1:10.20.193.123:6800/115662061 conn(0x7fe33404f790 legacy=0x7fe334051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:46.403 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.407+0000 7fe36caf0640 1 -- 10.20.193.123:0/55462425 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fe368073890 msgr2=0x7fe368134050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:46.403 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.407+0000 7fe36caf0640 1 --2- 10.20.193.123:0/55462425 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fe368073890 0x7fe368134050 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe35c009aa0 tx=0x7fe35c0047c0 comp rx=0 tx=0).stop 2026-02-17T20:09:46.403 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.407+0000 7fe36caf0640 1 -- 10.20.193.123:0/55462425 shutdown_connections 2026-02-17T20:09:46.403 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.407+0000 7fe36caf0640 1 --2- 10.20.193.123:0/55462425 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fe3681300e0 0x7fe368134ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:46.403 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.407+0000 7fe36caf0640 1 --2- 10.20.193.123:0/55462425 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fe36812cb80 0x7fe368134590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:46.403 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.407+0000 7fe36caf0640 1 --2- 10.20.193.123:0/55462425 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fe368073890 0x7fe368134050 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:46.403 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.407+0000 7fe36caf0640 1 -- 10.20.193.123:0/55462425 >> 10.20.193.123:0/55462425 conn(0x7fe3680a30f0 msgr2=0x7fe36812b800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:46.403 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.407+0000 7fe36caf0640 1 -- 10.20.193.123:0/55462425 shutdown_connections 2026-02-17T20:09:46.403 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:46.407+0000 7fe36caf0640 1 -- 10.20.193.123:0/55462425 wait complete. 2026-02-17T20:09:46.409 INFO:tasks.ceph.ceph_manager.ceph:need seq 107374182403 got 107374182403 for osd.2 2026-02-17T20:09:46.409 DEBUG:teuthology.parallel:result is None 2026-02-17T20:09:46.410 INFO:tasks.ceph.ceph_manager.ceph:need seq 111669149699 got 111669149699 for osd.3 2026-02-17T20:09:46.411 DEBUG:teuthology.parallel:result is None 2026-02-17T20:09:47.374 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T20:09:47.377 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T20:09:47.447 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.447+0000 7f060a26d640 1 Processor -- start 2026-02-17T20:09:47.448 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.447+0000 7f060a26d640 1 -- start start 2026-02-17T20:09:47.448 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.447+0000 7f060a26d640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f060412cb80 0x7f060412cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:47.448 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.447+0000 7f060a26d640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f0604135460 0x7f0604137850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:47.448 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.447+0000 7f060a26d640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0604074070 con 0x7f0604073890 2026-02-17T20:09:47.448 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.447+0000 7f060a26d640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7f0604072e70 con 0x7f0604135460 2026-02-17T20:09:47.448 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.447+0000 7f060a26d640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f0604073020 con 0x7f060412cb80 2026-02-17T20:09:47.448 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.447+0000 7f06037fe640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f060412cb80 0x7f060412cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:47.448 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.447+0000 7f0602ffd640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7f0604073890 0x7f060412d4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:54450/0 (socket says 10.20.193.123:54450) 2026-02-17T20:09:47.448 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.447+0000 7f0603fff640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f0604135460 0x7f0604137850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:47.449 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.447+0000 7f0602ffd640 1 -- 10.20.193.123:0/1699602574 learned_addr learned my addr 10.20.193.123:0/1699602574 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:09:47.449 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.447+0000 7f06037fe640 1 -- 10.20.193.123:0/1699602574 >> v2:10.20.193.123:3300/0 conn(0x7f0604135460 msgr2=0x7f0604137850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:47.449 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.447+0000 7f06037fe640 1 --2- 10.20.193.123:0/1699602574 >> v2:10.20.193.123:3300/0 conn(0x7f0604135460 0x7f0604137850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:47.449 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.447+0000 7f06037fe640 1 -- 10.20.193.123:0/1699602574 >> v1:10.20.193.123:6789/0 conn(0x7f0604073890 legacy=0x7f060412d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:47.449 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.448+0000 7f06037fe640 1 -- 10.20.193.123:0/1699602574 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0604138da0 con 0x7f060412cb80 2026-02-17T20:09:47.449 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.448+0000 7f06037fe640 1 --2- 10.20.193.123:0/1699602574 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f060412cb80 0x7f060412cf60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f05f00098a0 tx=0x7f05f0037820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73a819cc73ccd97e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:47.449 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.448+0000 7f06027fc640 1 -- 10.20.193.123:0/1699602574 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f0043070 con 0x7f060412cb80 2026-02-17T20:09:47.449 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.448+0000 7f06027fc640 1 -- 10.20.193.123:0/1699602574 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05f003c710 con 0x7f060412cb80 2026-02-17T20:09:47.449 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.448+0000 7f06027fc640 1 -- 10.20.193.123:0/1699602574 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f003cae0 con 0x7f060412cb80 2026-02-17T20:09:47.449 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.448+0000 7f060a26d640 1 -- 10.20.193.123:0/1699602574 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f060412cb80 msgr2=0x7f060412cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:47.449 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.448+0000 7f060a26d640 1 --2- 10.20.193.123:0/1699602574 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f060412cb80 0x7f060412cf60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f05f00098a0 tx=0x7f05f0037820 comp rx=0 tx=0).stop 2026-02-17T20:09:47.449 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.448+0000 7f060a26d640 1 -- 10.20.193.123:0/1699602574 shutdown_connections 2026-02-17T20:09:47.450 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.448+0000 7f060a26d640 1 --2- 10.20.193.123:0/1699602574 >> v2:10.20.193.123:3300/0 conn(0x7f0604135460 0x7f0604137850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:47.450 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.448+0000 7f060a26d640 1 --2- 10.20.193.123:0/1699602574 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f060412cb80 0x7f060412cf60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:47.450 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.448+0000 7f060a26d640 1 -- 10.20.193.123:0/1699602574 >> 10.20.193.123:0/1699602574 conn(0x7f06040a30f0 msgr2=0x7f06040a3500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:47.450 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.448+0000 7f060a26d640 1 -- 10.20.193.123:0/1699602574 shutdown_connections 2026-02-17T20:09:47.450 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.448+0000 7f060a26d640 1 -- 10.20.193.123:0/1699602574 wait complete. 2026-02-17T20:09:47.450 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.449+0000 7f060a26d640 1 Processor -- start 2026-02-17T20:09:47.450 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.449+0000 7f060a26d640 1 -- start start 2026-02-17T20:09:47.450 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.449+0000 7f060a26d640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0604073890 0x7f06041bfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:47.450 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.449+0000 7f060a26d640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f060412cb80 0x7f06041c0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:47.450 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.449+0000 7f060a26d640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0604135460 0x7f06041c0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:47.450 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.449+0000 7f060a26d640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0604138220 con 0x7f0604135460 2026-02-17T20:09:47.450 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.449+0000 7f060a26d640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f06041380a0 con 0x7f060412cb80 2026-02-17T20:09:47.451 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.449+0000 7f060a26d640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f06041383a0 con 0x7f0604073890 2026-02-17T20:09:47.451 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.449+0000 7f06037fe640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0604073890 0x7f06041bfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:47.451 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.449+0000 7f0603fff640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0604135460 0x7f06041c0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:47.451 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.449+0000 7f06037fe640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0604073890 0x7f06041bfbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:52480/0 (socket says 10.20.193.123:52480) 2026-02-17T20:09:47.451 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.449+0000 7f06037fe640 1 -- 10.20.193.123:0/3667705827 learned_addr learned my addr 10.20.193.123:0/3667705827 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:47.451 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.449+0000 7f0602ffd640 1 --2- 10.20.193.123:0/3667705827 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f060412cb80 0x7f06041c0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:47.451 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.450+0000 7f0603fff640 1 -- 10.20.193.123:0/3667705827 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0604073890 msgr2=0x7f06041bfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:47.451 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.450+0000 7f0603fff640 1 --2- 10.20.193.123:0/3667705827 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0604073890 0x7f06041bfbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:47.451 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.450+0000 7f0603fff640 1 -- 10.20.193.123:0/3667705827 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f060412cb80 msgr2=0x7f06041c0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:47.451 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.450+0000 7f0603fff640 1 --2- 10.20.193.123:0/3667705827 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f060412cb80 0x7f06041c0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:47.451 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.450+0000 7f0603fff640 1 -- 10.20.193.123:0/3667705827 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0604130b50 con 0x7f0604135460 2026-02-17T20:09:47.451 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.450+0000 7f0603fff640 1 --2- 10.20.193.123:0/3667705827 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0604135460 0x7f06041c0640 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f05f800efc0 tx=0x7f05f800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:47.452 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.450+0000 7f05dffff640 1 -- 10.20.193.123:0/3667705827 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f8018020 con 0x7f0604135460 2026-02-17T20:09:47.452 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.450+0000 7f05dffff640 1 -- 10.20.193.123:0/3667705827 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05f8014480 con 0x7f0604135460 2026-02-17T20:09:47.452 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.450+0000 7f060a26d640 1 -- 10.20.193.123:0/3667705827 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f060408fc70 con 0x7f0604135460 2026-02-17T20:09:47.452 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.450+0000 7f05dffff640 1 -- 10.20.193.123:0/3667705827 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f8014870 con 0x7f0604135460 2026-02-17T20:09:47.452 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.450+0000 7f060a26d640 1 -- 10.20.193.123:0/3667705827 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f060408d3c0 con 0x7f0604135460 2026-02-17T20:09:47.452 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.450+0000 7f060a26d640 1 -- 10.20.193.123:0/3667705827 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f060408f9c0 con 0x7f0604135460 2026-02-17T20:09:47.452 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.450+0000 7f05dffff640 1 -- 10.20.193.123:0/3667705827 <== mon.0 v2:10.20.193.123:3300/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f05f8014a10 con 0x7f0604135460 2026-02-17T20:09:47.452 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.451+0000 7f05dffff640 1 -- 10.20.193.123:0/3667705827 <== mon.0 v2:10.20.193.123:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3025+0+0 (secure 0 0 0) 0x7f05f8067bc0 con 0x7f0604135460 2026-02-17T20:09:47.453 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.452+0000 7f05dffff640 1 -- 10.20.193.123:0/3667705827 <== mon.0 v2:10.20.193.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f060408f9c0 con 0x7f0604135460 2026-02-17T20:09:47.492 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.491+0000 7f12686d1640 1 Processor -- start 2026-02-17T20:09:47.492 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.491+0000 7f12686d1640 1 -- start start 2026-02-17T20:09:47.492 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.492+0000 7f12686d1640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f1260073830 0x7f1260139ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:47.492 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.492+0000 7f12686d1640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f126013a000 0x7f126013c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:47.492 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.492+0000 7f12686d1640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f126009f550 con 0x7f1260134d10 2026-02-17T20:09:47.493 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.492+0000 7f12686d1640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7f12601347a0 con 0x7f126013a000 2026-02-17T20:09:47.493 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.492+0000 7f12686d1640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f1260073f10 con 0x7f1260073830 2026-02-17T20:09:47.493 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.492+0000 7f1265c45640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f1260073830 0x7f1260139ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:47.493 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.492+0000 7f1265c45640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f1260073830 0x7f1260139ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:52486/0 (socket says 10.20.193.123:52486) 2026-02-17T20:09:47.493 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.492+0000 7f1266446640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7f1260134d10 0x7f12601350f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:54456/0 (socket says 10.20.193.123:54456) 2026-02-17T20:09:47.493 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.492+0000 7f1265c45640 1 -- 10.20.193.123:0/1104709410 learned_addr learned my addr 10.20.193.123:0/1104709410 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:47.493 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.492+0000 7f1266c47640 1 --2- 10.20.193.123:0/1104709410 >> v2:10.20.193.123:3300/0 conn(0x7f126013a000 0x7f126013c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:47.493 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.492+0000 7f1265c45640 1 -- 10.20.193.123:0/1104709410 >> v2:10.20.193.123:3300/0 conn(0x7f126013a000 msgr2=0x7f126013c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:47.493 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.492+0000 7f1265c45640 1 --2- 10.20.193.123:0/1104709410 >> v2:10.20.193.123:3300/0 conn(0x7f126013a000 0x7f126013c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:47.493 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.492+0000 7f1265c45640 1 -- 10.20.193.123:0/1104709410 >> v1:10.20.193.123:6789/0 conn(0x7f1260134d10 legacy=0x7f12601350f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:47.493 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.492+0000 7f1265c45640 1 -- 10.20.193.123:0/1104709410 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1260072dc0 con 0x7f1260073830 2026-02-17T20:09:47.494 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.492+0000 7f1265c45640 1 --2- 10.20.193.123:0/1104709410 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f1260073830 0x7f1260139ac0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1254009970 tx=0x7f125402ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9209b087ac24bf02 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:47.494 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.493+0000 7f1265444640 1 -- 10.20.193.123:0/1104709410 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f125403c070 con 0x7f1260073830 2026-02-17T20:09:47.494 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.493+0000 7f1265444640 1 -- 10.20.193.123:0/1104709410 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f125402fb10 con 0x7f1260073830 2026-02-17T20:09:47.494 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.493+0000 7f1265444640 1 -- 10.20.193.123:0/1104709410 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1254037440 con 0x7f1260073830 2026-02-17T20:09:47.494 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.493+0000 7f12686d1640 1 -- 10.20.193.123:0/1104709410 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f1260073830 msgr2=0x7f1260139ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:47.494 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.493+0000 7f12686d1640 1 --2- 10.20.193.123:0/1104709410 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f1260073830 0x7f1260139ac0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1254009970 tx=0x7f125402ee90 comp rx=0 tx=0).stop 2026-02-17T20:09:47.494 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.493+0000 7f12686d1640 1 -- 10.20.193.123:0/1104709410 shutdown_connections 2026-02-17T20:09:47.494 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.493+0000 7f12686d1640 1 --2- 10.20.193.123:0/1104709410 >> v2:10.20.193.123:3300/0 conn(0x7f126013a000 0x7f126013c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:47.494 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.493+0000 7f12686d1640 1 --2- 10.20.193.123:0/1104709410 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f1260073830 0x7f1260139ac0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:47.494 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.493+0000 7f12686d1640 1 -- 10.20.193.123:0/1104709410 >> 10.20.193.123:0/1104709410 conn(0x7f126009e7c0 msgr2=0x7f126009ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:47.494 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.493+0000 7f12686d1640 1 -- 10.20.193.123:0/1104709410 shutdown_connections 2026-02-17T20:09:47.495 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.493+0000 7f12686d1640 1 -- 10.20.193.123:0/1104709410 wait complete. 2026-02-17T20:09:47.495 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.493+0000 7f12686d1640 1 Processor -- start 2026-02-17T20:09:47.495 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.493+0000 7f12686d1640 1 -- start start 2026-02-17T20:09:47.495 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.494+0000 7f12686d1640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f1260073830 0x7f1260138860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:47.495 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.494+0000 7f12686d1640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f1260134d10 0x7f1260138da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:47.495 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.494+0000 7f12686d1640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f126013a000 0x7f12601392e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:47.495 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.494+0000 7f12686d1640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7f126013cb40 con 0x7f126013a000 2026-02-17T20:09:47.495 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.494+0000 7f12686d1640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f1260073110 con 0x7f1260073830 2026-02-17T20:09:47.495 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.494+0000 7f12686d1640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f126013ccc0 con 0x7f1260134d10 2026-02-17T20:09:47.495 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.494+0000 7f1265c45640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f1260134d10 0x7f1260138da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:47.495 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.494+0000 7f1266c47640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f126013a000 0x7f12601392e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:47.495 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.494+0000 7f1266446640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f1260073830 0x7f1260138860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:47.496 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.494+0000 7f1265c45640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f1260134d10 0x7f1260138da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:52500/0 (socket says 10.20.193.123:52500) 2026-02-17T20:09:47.496 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.494+0000 7f1265c45640 1 -- 10.20.193.123:0/255296807 learned_addr learned my addr 10.20.193.123:0/255296807 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:47.496 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.494+0000 7f1266c47640 1 -- 10.20.193.123:0/255296807 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f1260134d10 msgr2=0x7f1260138da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:47.496 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.494+0000 7f1266c47640 1 --2- 10.20.193.123:0/255296807 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f1260134d10 0x7f1260138da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:47.496 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.494+0000 7f1266c47640 1 -- 10.20.193.123:0/255296807 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f1260073830 msgr2=0x7f1260138860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:47.496 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.494+0000 7f1266c47640 1 --2- 10.20.193.123:0/255296807 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f1260073830 0x7f1260138860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:47.496 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.494+0000 7f1266c47640 1 -- 10.20.193.123:0/255296807 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12601165e0 con 0x7f126013a000 2026-02-17T20:09:47.496 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.494+0000 7f1266c47640 1 --2- 10.20.193.123:0/255296807 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f126013a000 0x7f12601392e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f125c00efc0 tx=0x7f125c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:47.496 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.494+0000 7f1246ffd640 1 -- 10.20.193.123:0/255296807 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f125c018020 con 0x7f126013a000 2026-02-17T20:09:47.496 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.494+0000 7f1246ffd640 1 -- 10.20.193.123:0/255296807 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f125c014480 con 0x7f126013a000 2026-02-17T20:09:47.496 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.494+0000 7f12686d1640 1 -- 10.20.193.123:0/255296807 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1260116b30 con 0x7f126013a000 2026-02-17T20:09:47.496 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.494+0000 7f1246ffd640 1 -- 10.20.193.123:0/255296807 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f125c014870 con 0x7f126013a000 2026-02-17T20:09:47.497 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.494+0000 7f12686d1640 1 -- 10.20.193.123:0/255296807 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1260139820 con 0x7f126013a000 2026-02-17T20:09:47.497 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.495+0000 7f12686d1640 1 -- 10.20.193.123:0/255296807 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1260139ae0 con 0x7f126013a000 2026-02-17T20:09:47.497 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.495+0000 7f1246ffd640 1 -- 10.20.193.123:0/255296807 <== mon.0 v2:10.20.193.123:3300/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f125c014a10 con 0x7f126013a000 2026-02-17T20:09:47.497 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.495+0000 7f1246ffd640 1 -- 10.20.193.123:0/255296807 <== mon.0 v2:10.20.193.123:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3025+0+0 (secure 0 0 0) 0x7f125c067b20 con 0x7f126013a000 2026-02-17T20:09:47.497 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.497+0000 7f1246ffd640 1 -- 10.20.193.123:0/255296807 <== mon.0 v2:10.20.193.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f125c022030 con 0x7f126013a000 2026-02-17T20:09:47.518 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.521+0000 7f060a26d640 1 -- 10.20.193.123:0/3667705827 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f0604138800 con 0x7f0604135460 2026-02-17T20:09:47.518 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.521+0000 7f05dffff640 1 -- 10.20.193.123:0/3667705827 <== mon.0 v2:10.20.193.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f05f8022030 con 0x7f0604135460 2026-02-17T20:09:47.518 INFO:teuthology.orchestra.run.trial123.stdout:103079215107 2026-02-17T20:09:47.519 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.523+0000 7f060a26d640 1 -- 10.20.193.123:0/3667705827 >> v1:10.20.193.123:6800/115662061 conn(0x7f05d404f790 legacy=0x7f05d4051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:47.519 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.523+0000 7f060a26d640 1 -- 10.20.193.123:0/3667705827 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0604135460 msgr2=0x7f06041c0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:47.519 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.523+0000 7f060a26d640 1 --2- 10.20.193.123:0/3667705827 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0604135460 0x7f06041c0640 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f05f800efc0 tx=0x7f05f800c490 comp rx=0 tx=0).stop 2026-02-17T20:09:47.520 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.523+0000 7f060a26d640 1 -- 10.20.193.123:0/3667705827 shutdown_connections 2026-02-17T20:09:47.520 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.523+0000 7f060a26d640 1 --2- 10.20.193.123:0/3667705827 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0604135460 0x7f06041c0640 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:47.520 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.523+0000 7f060a26d640 1 --2- 10.20.193.123:0/3667705827 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f060412cb80 0x7f06041c0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:47.520 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.523+0000 7f060a26d640 1 --2- 10.20.193.123:0/3667705827 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0604073890 0x7f06041bfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:47.520 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.523+0000 7f060a26d640 1 -- 10.20.193.123:0/3667705827 >> 10.20.193.123:0/3667705827 conn(0x7f06040a30f0 msgr2=0x7f06040703d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:47.520 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.523+0000 7f060a26d640 1 -- 10.20.193.123:0/3667705827 shutdown_connections 2026-02-17T20:09:47.520 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.523+0000 7f060a26d640 1 -- 10.20.193.123:0/3667705827 wait complete. 2026-02-17T20:09:47.527 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215107 got 103079215107 for osd.1 2026-02-17T20:09:47.527 DEBUG:teuthology.parallel:result is None 2026-02-17T20:09:47.566 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.569+0000 7f12686d1640 1 -- 10.20.193.123:0/255296807 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f12601350f0 con 0x7f126013a000 2026-02-17T20:09:47.566 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.570+0000 7f1246ffd640 1 -- 10.20.193.123:0/255296807 <== mon.0 v2:10.20.193.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f125c010040 con 0x7f126013a000 2026-02-17T20:09:47.566 INFO:teuthology.orchestra.run.trial123.stdout:98784247812 2026-02-17T20:09:47.567 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.570+0000 7f12686d1640 1 -- 10.20.193.123:0/255296807 >> v1:10.20.193.123:6800/115662061 conn(0x7f123004f790 legacy=0x7f1230051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:47.567 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.571+0000 7f12686d1640 1 -- 10.20.193.123:0/255296807 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f126013a000 msgr2=0x7f12601392e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:47.568 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.571+0000 7f12686d1640 1 --2- 10.20.193.123:0/255296807 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f126013a000 0x7f12601392e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f125c00efc0 tx=0x7f125c00c490 comp rx=0 tx=0).stop 2026-02-17T20:09:47.568 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.571+0000 7f12686d1640 1 -- 10.20.193.123:0/255296807 shutdown_connections 2026-02-17T20:09:47.568 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.571+0000 7f12686d1640 1 --2- 10.20.193.123:0/255296807 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f126013a000 0x7f12601392e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:47.568 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.571+0000 7f12686d1640 1 --2- 10.20.193.123:0/255296807 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f1260134d10 0x7f1260138da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:47.568 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.571+0000 7f12686d1640 1 --2- 10.20.193.123:0/255296807 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f1260073830 0x7f1260138860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:47.568 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.571+0000 7f12686d1640 1 -- 10.20.193.123:0/255296807 >> 10.20.193.123:0/255296807 conn(0x7f126009e7c0 msgr2=0x7f126006e800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:47.568 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.571+0000 7f12686d1640 1 -- 10.20.193.123:0/255296807 shutdown_connections 2026-02-17T20:09:47.568 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.571+0000 7f12686d1640 1 -- 10.20.193.123:0/255296807 wait complete. 2026-02-17T20:09:47.575 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247811 got 98784247812 for osd.0 2026-02-17T20:09:47.575 DEBUG:teuthology.parallel:result is None 2026-02-17T20:09:47.575 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-17T20:09:47.575 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T20:09:47.686 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.685+0000 7efcb2374640 1 Processor -- start 2026-02-17T20:09:47.686 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.685+0000 7efcb2374640 1 -- start start 2026-02-17T20:09:47.686 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.686+0000 7efcb2374640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7efcac130170 0x7efcac130550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:47.686 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.686+0000 7efcb2374640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7efcac130a90 0x7efcac12cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:47.687 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.686+0000 7efcb2374640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7efcac12d130 0x7efcac12d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:47.687 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.686+0000 7efcb2374640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7efcac071e90 con 0x7efcac12d130 2026-02-17T20:09:47.687 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.686+0000 7efcb2374640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7efcac071800 con 0x7efcac130a90 2026-02-17T20:09:47.687 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.686+0000 7efcb2374640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7efcac072260 con 0x7efcac130170 2026-02-17T20:09:47.687 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.686+0000 7efcabfff640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7efcac130170 0x7efcac130550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:47.687 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.686+0000 7efcb08ea640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7efcac12d130 0x7efcac12d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:47.687 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.686+0000 7efcab7fe640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7efcac130a90 0x7efcac12cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:47.687 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.686+0000 7efcabfff640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7efcac130170 0x7efcac130550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:52506/0 (socket says 10.20.193.123:52506) 2026-02-17T20:09:47.687 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.686+0000 7efcabfff640 1 -- 10.20.193.123:0/903333342 learned_addr learned my addr 10.20.193.123:0/903333342 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:47.687 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.686+0000 7efcabfff640 1 -- 10.20.193.123:0/903333342 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7efcac130a90 msgr2=0x7efcac12cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:47.687 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.686+0000 7efcabfff640 1 --2- 10.20.193.123:0/903333342 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7efcac130a90 0x7efcac12cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:47.688 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.686+0000 7efcabfff640 1 -- 10.20.193.123:0/903333342 >> v2:10.20.193.123:3300/0 conn(0x7efcac12d130 msgr2=0x7efcac12d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:47.688 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.686+0000 7efcabfff640 1 --2- 10.20.193.123:0/903333342 >> v2:10.20.193.123:3300/0 conn(0x7efcac12d130 0x7efcac12d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:47.688 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.686+0000 7efcabfff640 1 -- 10.20.193.123:0/903333342 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcac116aa0 con 0x7efcac130170 2026-02-17T20:09:47.688 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.686+0000 7efcb08ea640 1 --2- 10.20.193.123:0/903333342 >> v2:10.20.193.123:3300/0 conn(0x7efcac12d130 0x7efcac12d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:47.688 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.686+0000 7efcabfff640 1 --2- 10.20.193.123:0/903333342 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7efcac130170 0x7efcac130550 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efc980099a0 tx=0x7efc9802ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe12535451f42aad server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:47.688 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.687+0000 7efcaaffd640 1 -- 10.20.193.123:0/903333342 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc9803c070 con 0x7efcac130170 2026-02-17T20:09:47.688 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.687+0000 7efcaaffd640 1 -- 10.20.193.123:0/903333342 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc9802fac0 con 0x7efcac130170 2026-02-17T20:09:47.688 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.687+0000 7efcaaffd640 1 -- 10.20.193.123:0/903333342 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc98037440 con 0x7efcac130170 2026-02-17T20:09:47.688 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.687+0000 7efcb2374640 1 -- 10.20.193.123:0/903333342 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7efcac130170 msgr2=0x7efcac130550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:47.688 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.687+0000 7efcb2374640 1 --2- 10.20.193.123:0/903333342 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7efcac130170 0x7efcac130550 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efc980099a0 tx=0x7efc9802ee90 comp rx=0 tx=0).stop 2026-02-17T20:09:47.688 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.687+0000 7efcb2374640 1 -- 10.20.193.123:0/903333342 shutdown_connections 2026-02-17T20:09:47.688 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.687+0000 7efcb2374640 1 --2- 10.20.193.123:0/903333342 >> v2:10.20.193.123:3300/0 conn(0x7efcac12d130 0x7efcac12d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:47.689 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.687+0000 7efcb2374640 1 --2- 10.20.193.123:0/903333342 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7efcac130a90 0x7efcac12cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:47.689 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.687+0000 7efcb2374640 1 --2- 10.20.193.123:0/903333342 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7efcac130170 0x7efcac130550 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:47.689 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.687+0000 7efcb2374640 1 -- 10.20.193.123:0/903333342 >> 10.20.193.123:0/903333342 conn(0x7efcac09d6c0 msgr2=0x7efcac09dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:47.689 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.687+0000 7efcb2374640 1 -- 10.20.193.123:0/903333342 shutdown_connections 2026-02-17T20:09:47.689 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.687+0000 7efcb2374640 1 -- 10.20.193.123:0/903333342 wait complete. 2026-02-17T20:09:47.689 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.687+0000 7efcb2374640 1 Processor -- start 2026-02-17T20:09:47.689 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.687+0000 7efcb2374640 1 -- start start 2026-02-17T20:09:47.689 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.688+0000 7efcb2374640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7efcac12d130 0x7efcac1350b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:47.689 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.688+0000 7efcb2374640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7efcac130170 0x7efcac1355f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:47.689 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.688+0000 7efcb2374640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7efcac130a90 0x7efcac135b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:47.689 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.688+0000 7efcb2374640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7efcac137500 con 0x7efcac130a90 2026-02-17T20:09:47.689 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.688+0000 7efcb2374640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7efcac137680 con 0x7efcac130170 2026-02-17T20:09:47.689 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.688+0000 7efcb2374640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7efcac137800 con 0x7efcac12d130 2026-02-17T20:09:47.690 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.688+0000 7efcabfff640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7efcac12d130 0x7efcac1350b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:47.690 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.688+0000 7efcab7fe640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7efcac130170 0x7efcac1355f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:47.690 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.688+0000 7efcabfff640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7efcac12d130 0x7efcac1350b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:52512/0 (socket says 10.20.193.123:52512) 2026-02-17T20:09:47.690 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.688+0000 7efcabfff640 1 -- 10.20.193.123:0/3049889560 learned_addr learned my addr 10.20.193.123:0/3049889560 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:47.690 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.688+0000 7efcb08ea640 1 --2- 10.20.193.123:0/3049889560 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7efcac130a90 0x7efcac135b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:47.690 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.688+0000 7efcabfff640 1 -- 10.20.193.123:0/3049889560 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7efcac130170 msgr2=0x7efcac1355f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:47.690 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.688+0000 7efcabfff640 1 --2- 10.20.193.123:0/3049889560 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7efcac130170 0x7efcac1355f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:47.690 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.688+0000 7efcabfff640 1 -- 10.20.193.123:0/3049889560 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7efcac130a90 msgr2=0x7efcac135b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:47.690 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.688+0000 7efcabfff640 1 --2- 10.20.193.123:0/3049889560 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7efcac130a90 0x7efcac135b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:47.690 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.688+0000 7efcabfff640 1 -- 10.20.193.123:0/3049889560 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcac136e20 con 0x7efcac12d130 2026-02-17T20:09:47.690 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.688+0000 7efcab7fe640 1 --2- 10.20.193.123:0/3049889560 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7efcac130170 0x7efcac1355f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:47.691 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.688+0000 7efcb08ea640 1 --2- 10.20.193.123:0/3049889560 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7efcac130a90 0x7efcac135b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:47.691 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.688+0000 7efcabfff640 1 --2- 10.20.193.123:0/3049889560 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7efcac12d130 0x7efcac1350b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efc98009ad0 tx=0x7efc980047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:47.691 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.688+0000 7efca8ff9640 1 -- 10.20.193.123:0/3049889560 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc98047070 con 0x7efcac12d130 2026-02-17T20:09:47.691 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.688+0000 7efca8ff9640 1 -- 10.20.193.123:0/3049889560 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc98042650 con 0x7efcac12d130 2026-02-17T20:09:47.691 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.688+0000 7efcb2374640 1 -- 10.20.193.123:0/3049889560 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcac11c710 con 0x7efcac12d130 2026-02-17T20:09:47.691 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.688+0000 7efca8ff9640 1 -- 10.20.193.123:0/3049889560 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc9803c040 con 0x7efcac12d130 2026-02-17T20:09:47.691 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.688+0000 7efcb2374640 1 -- 10.20.193.123:0/3049889560 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7efcac11bda0 con 0x7efcac12d130 2026-02-17T20:09:47.691 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.688+0000 7efcb2374640 1 -- 10.20.193.123:0/3049889560 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcac12a8c0 con 0x7efcac12d130 2026-02-17T20:09:47.691 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.689+0000 7efca8ff9640 1 -- 10.20.193.123:0/3049889560 <== mon.2 v2:10.20.193.123:3302/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7efc9802f940 con 0x7efcac12d130 2026-02-17T20:09:47.691 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.689+0000 7efca8ff9640 1 -- 10.20.193.123:0/3049889560 <== mon.2 v2:10.20.193.123:3302/0 5 ==== osd_map(30..30 src has 1..30) ==== 3025+0+0 (secure 0 0 0) 0x7efc9808ba70 con 0x7efcac12d130 2026-02-17T20:09:47.692 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.691+0000 7efca8ff9640 1 -- 10.20.193.123:0/3049889560 <== mon.2 v2:10.20.193.123:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7efcac12a8c0 con 0x7efcac12d130 2026-02-17T20:09:47.754 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.758+0000 7efcb2374640 1 -- 10.20.193.123:0/3049889560 --> v1:10.20.193.123:6800/115662061 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efcac130550 con 0x7efc7c04f7c0 2026-02-17T20:09:47.755 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.759+0000 7efca8ff9640 1 -- 10.20.193.123:0/3049889560 <== mgr.14107 v1:10.20.193.123:6800/115662061 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31952 (unknown 2965378022 0 791337392) 0x7efcac130550 con 0x7efc7c04f7c0 2026-02-17T20:09:47.756 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:09:47.757 INFO:teuthology.orchestra.run.trial123.stderr:dumped all 2026-02-17T20:09:47.757 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.760+0000 7efcb2374640 1 -- 10.20.193.123:0/3049889560 >> v1:10.20.193.123:6800/115662061 conn(0x7efc7c04f7c0 legacy=0x7efc7c051c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:47.757 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.760+0000 7efcb2374640 1 -- 10.20.193.123:0/3049889560 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7efcac12d130 msgr2=0x7efcac1350b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:47.757 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.760+0000 7efcb2374640 1 --2- 10.20.193.123:0/3049889560 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7efcac12d130 0x7efcac1350b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efc98009ad0 tx=0x7efc980047c0 comp rx=0 tx=0).stop 2026-02-17T20:09:47.757 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.760+0000 7efcb2374640 1 -- 10.20.193.123:0/3049889560 shutdown_connections 2026-02-17T20:09:47.758 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.760+0000 7efcb2374640 1 --2- 10.20.193.123:0/3049889560 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7efcac130a90 0x7efcac135b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:47.758 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.760+0000 7efcb2374640 1 --2- 10.20.193.123:0/3049889560 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7efcac130170 0x7efcac1355f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:47.758 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.760+0000 7efcb2374640 1 --2- 10.20.193.123:0/3049889560 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7efcac12d130 0x7efcac1350b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:47.758 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.760+0000 7efcb2374640 1 -- 10.20.193.123:0/3049889560 >> 10.20.193.123:0/3049889560 conn(0x7efcac09d6c0 msgr2=0x7efcac06e150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:47.758 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.760+0000 7efcb2374640 1 -- 10.20.193.123:0/3049889560 shutdown_connections 2026-02-17T20:09:47.758 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.760+0000 7efcb2374640 1 -- 10.20.193.123:0/3049889560 wait complete. 2026-02-17T20:09:47.763 INFO:teuthology.orchestra.run.trial123.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2026-02-17T20:09:46.325111+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":115,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":128644,"kb_used_data":2128,"kb_used_omap":17,"kb_used_meta":126446,"kb_avail":377358716,"statfs":{"total":386547056640,"available":386415325184,"internally_reserved":0,"allocated":2179072,"data_stored":1528789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18186,"internal_metadata":129480950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.937627"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-17T20:09:42.637769+0000","last_change":"2026-02-17T20:09:40.389699+0000","last_active":"2026-02-17T20:09:42.637769+0000","last_peered":"2026-02-17T20:09:42.637769+0000","last_clean":"2026-02-17T20:09:42.637769+0000","last_became_active":"2026-02-17T20:09:40.389602+0000","last_became_peered":"2026-02-17T20:09:40.389602+0000","last_unstale":"2026-02-17T20:09:42.637769+0000","last_undegraded":"2026-02-17T20:09:42.637769+0000","last_fullsized":"2026-02-17T20:09:42.637769+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T05:00:57.169209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-17T20:09:44.397270+0000","last_change":"2026-02-17T20:09:40.959635+0000","last_active":"2026-02-17T20:09:44.397270+0000","last_peered":"2026-02-17T20:09:44.397270+0000","last_clean":"2026-02-17T20:09:44.397270+0000","last_became_active":"2026-02-17T20:09:40.959369+0000","last_became_peered":"2026-02-17T20:09:40.959369+0000","last_unstale":"2026-02-17T20:09:44.397270+0000","last_undegraded":"2026-02-17T20:09:44.397270+0000","last_fullsized":"2026-02-17T20:09:44.397270+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:34:32.321476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033416199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-17T20:09:43.394927+0000","last_change":"2026-02-17T20:09:40.389967+0000","last_active":"2026-02-17T20:09:43.394927+0000","last_peered":"2026-02-17T20:09:43.394927+0000","last_clean":"2026-02-17T20:09:43.394927+0000","last_became_active":"2026-02-17T20:09:40.389827+0000","last_became_peered":"2026-02-17T20:09:40.389827+0000","last_unstale":"2026-02-17T20:09:43.394927+0000","last_undegraded":"2026-02-17T20:09:43.394927+0000","last_fullsized":"2026-02-17T20:09:43.394927+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T07:39:21.099659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026693600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-17T20:09:44.397241+0000","last_change":"2026-02-17T20:09:40.959612+0000","last_active":"2026-02-17T20:09:44.397241+0000","last_peered":"2026-02-17T20:09:44.397241+0000","last_clean":"2026-02-17T20:09:44.397241+0000","last_became_active":"2026-02-17T20:09:40.959406+0000","last_became_peered":"2026-02-17T20:09:40.959406+0000","last_unstale":"2026-02-17T20:09:44.397241+0000","last_undegraded":"2026-02-17T20:09:44.397241+0000","last_fullsized":"2026-02-17T20:09:44.397241+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T06:06:40.610646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000242539,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"17'79","reported_seq":153,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-17T20:09:44.397310+0000","last_change":"2026-02-17T20:09:40.389898+0000","last_active":"2026-02-17T20:09:44.397310+0000","last_peered":"2026-02-17T20:09:44.397310+0000","last_clean":"2026-02-17T20:09:44.397310+0000","last_became_active":"2026-02-17T20:09:40.389750+0000","last_became_peered":"2026-02-17T20:09:40.389750+0000","last_unstale":"2026-02-17T20:09:44.397310+0000","last_undegraded":"2026-02-17T20:09:44.397310+0000","last_fullsized":"2026-02-17T20:09:44.397310+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:28.678564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:28.678564+0000","last_clean_scrub_stamp":"2026-02-17T20:08:28.678564+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T00:37:14.734978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"11'1","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-17T20:09:42.637765+0000","last_change":"2026-02-17T20:09:39.388699+0000","last_active":"2026-02-17T20:09:42.637765+0000","last_peered":"2026-02-17T20:09:42.637765+0000","last_clean":"2026-02-17T20:09:42.637765+0000","last_became_active":"2026-02-17T20:09:39.388484+0000","last_became_peered":"2026-02-17T20:09:39.388484+0000","last_unstale":"2026-02-17T20:09:42.637765+0000","last_undegraded":"2026-02-17T20:09:42.637765+0000","last_fullsized":"2026-02-17T20:09:42.637765+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T02:45:47.622204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000198235,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"13'2","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-17T20:09:44.397065+0000","last_change":"2026-02-17T20:09:38.388175+0000","last_active":"2026-02-17T20:09:44.397065+0000","last_peered":"2026-02-17T20:09:44.397065+0000","last_clean":"2026-02-17T20:09:44.397065+0000","last_became_active":"2026-02-17T20:09:38.388004+0000","last_became_peered":"2026-02-17T20:09:38.388004+0000","last_unstale":"2026-02-17T20:09:44.397065+0000","last_undegraded":"2026-02-17T20:09:44.397065+0000","last_fullsized":"2026-02-17T20:09:44.397065+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:08:31.580414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059736000000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-17T20:09:44.397243+0000","last_change":"2026-02-17T20:09:40.959406+0000","last_active":"2026-02-17T20:09:44.397243+0000","last_peered":"2026-02-17T20:09:44.397243+0000","last_clean":"2026-02-17T20:09:44.397243+0000","last_became_active":"2026-02-17T20:09:40.959125+0000","last_became_peered":"2026-02-17T20:09:40.959125+0000","last_unstale":"2026-02-17T20:09:44.397243+0000","last_undegraded":"2026-02-17T20:09:44.397243+0000","last_fullsized":"2026-02-17T20:09:44.397243+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T01:49:16.320239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00023917200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-17T20:09:42.637776+0000","last_change":"2026-02-17T20:09:38.387850+0000","last_active":"2026-02-17T20:09:42.637776+0000","last_peered":"2026-02-17T20:09:42.637776+0000","last_clean":"2026-02-17T20:09:42.637776+0000","last_became_active":"2026-02-17T20:09:38.387688+0000","last_became_peered":"2026-02-17T20:09:38.387688+0000","last_unstale":"2026-02-17T20:09:42.637776+0000","last_undegraded":"2026-02-17T20:09:42.637776+0000","last_fullsized":"2026-02-17T20:09:42.637776+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T06:48:35.959788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000175532,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":26,"seq":111669149699,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32456,"kb_used_data":828,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339384,"statfs":{"total":96636764160,"available":96603529216,"internally_reserved":0,"allocated":847872,"data_stored":680349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4547,"internal_metadata":32370237},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":25,"seq":107374182403,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31864,"kb_used_data":236,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339976,"statfs":{"total":96636764160,"available":96604135424,"internally_reserved":0,"allocated":241664,"data_stored":85808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4547,"internal_metadata":32370237},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":24,"seq":103079215107,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32440,"kb_used_data":812,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":831488,"data_stored":672632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4546,"internal_metadata":32370238},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":23,"seq":98784247812,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31884,"kb_used_data":252,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339956,"statfs":{"total":96636764160,"available":96604114944,"internally_reserved":0,"allocated":258048,"data_stored":90000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4546,"internal_metadata":32370238},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T20:09:47.764 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T20:09:47.836 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.835+0000 7efd3fbea640 1 Processor -- start 2026-02-17T20:09:47.836 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.835+0000 7efd3fbea640 1 -- start start 2026-02-17T20:09:47.836 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.836+0000 7efd3fbea640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7efd38130170 0x7efd38130550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:47.836 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.836+0000 7efd3fbea640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7efd38130a90 0x7efd3812cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:47.837 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.836+0000 7efd3fbea640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7efd3812d130 0x7efd3812d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:47.837 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.836+0000 7efd3fbea640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7efd38071e90 con 0x7efd3812d130 2026-02-17T20:09:47.837 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.836+0000 7efd3fbea640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7efd38071800 con 0x7efd38130a90 2026-02-17T20:09:47.837 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.836+0000 7efd3fbea640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7efd38072260 con 0x7efd38130170 2026-02-17T20:09:47.837 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.836+0000 7efd3d95f640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7efd38130170 0x7efd38130550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:47.837 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.836+0000 7efd3d95f640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7efd38130170 0x7efd38130550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:52516/0 (socket says 10.20.193.123:52516) 2026-02-17T20:09:47.837 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.836+0000 7efd3d95f640 1 -- 10.20.193.123:0/1909712036 learned_addr learned my addr 10.20.193.123:0/1909712036 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:47.837 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.836+0000 7efd3e160640 1 --2- 10.20.193.123:0/1909712036 >> v2:10.20.193.123:3300/0 conn(0x7efd3812d130 0x7efd3812d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:47.837 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.836+0000 7efd3d15e640 1 --2- 10.20.193.123:0/1909712036 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7efd38130a90 0x7efd3812cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:47.837 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.836+0000 7efd3e160640 1 -- 10.20.193.123:0/1909712036 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7efd38130170 msgr2=0x7efd38130550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:47.837 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.836+0000 7efd3e160640 1 --2- 10.20.193.123:0/1909712036 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7efd38130170 0x7efd38130550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:47.838 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.836+0000 7efd3e160640 1 -- 10.20.193.123:0/1909712036 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7efd38130a90 msgr2=0x7efd3812cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:47.838 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.836+0000 7efd3e160640 1 --2- 10.20.193.123:0/1909712036 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7efd38130a90 0x7efd3812cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:47.838 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.836+0000 7efd3e160640 1 -- 10.20.193.123:0/1909712036 --> v2:10.20.193.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd38116aa0 con 0x7efd3812d130 2026-02-17T20:09:47.838 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.836+0000 7efd3d95f640 1 --2- 10.20.193.123:0/1909712036 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7efd38130170 0x7efd38130550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:47.838 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.836+0000 7efd3d15e640 1 --2- 10.20.193.123:0/1909712036 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7efd38130a90 0x7efd3812cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:47.838 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.836+0000 7efd3e160640 1 --2- 10.20.193.123:0/1909712036 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7efd3812d130 0x7efd3812d5e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7efd34009dc0 tx=0x7efd3402f180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=978ab006462c9c5e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:47.838 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.836+0000 7efd3c95d640 1 -- 10.20.193.123:0/1909712036 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd3403c070 con 0x7efd3812d130 2026-02-17T20:09:47.838 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.836+0000 7efd3c95d640 1 -- 10.20.193.123:0/1909712036 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd3402fdb0 con 0x7efd3812d130 2026-02-17T20:09:47.838 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.836+0000 7efd3c95d640 1 -- 10.20.193.123:0/1909712036 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd34037660 con 0x7efd3812d130 2026-02-17T20:09:47.838 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.837+0000 7efd3fbea640 1 -- 10.20.193.123:0/1909712036 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7efd3812d130 msgr2=0x7efd3812d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:47.838 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.837+0000 7efd3fbea640 1 --2- 10.20.193.123:0/1909712036 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7efd3812d130 0x7efd3812d5e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7efd34009dc0 tx=0x7efd3402f180 comp rx=0 tx=0).stop 2026-02-17T20:09:47.838 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.837+0000 7efd3fbea640 1 -- 10.20.193.123:0/1909712036 shutdown_connections 2026-02-17T20:09:47.839 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.837+0000 7efd3fbea640 1 --2- 10.20.193.123:0/1909712036 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7efd3812d130 0x7efd3812d5e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:47.839 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.837+0000 7efd3fbea640 1 --2- 10.20.193.123:0/1909712036 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7efd38130a90 0x7efd3812cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:47.839 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.837+0000 7efd3fbea640 1 --2- 10.20.193.123:0/1909712036 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7efd38130170 0x7efd38130550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:47.839 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.837+0000 7efd3fbea640 1 -- 10.20.193.123:0/1909712036 >> 10.20.193.123:0/1909712036 conn(0x7efd3809d6c0 msgr2=0x7efd3809dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:47.839 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.837+0000 7efd3fbea640 1 -- 10.20.193.123:0/1909712036 shutdown_connections 2026-02-17T20:09:47.839 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.837+0000 7efd3fbea640 1 -- 10.20.193.123:0/1909712036 wait complete. 2026-02-17T20:09:47.839 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.837+0000 7efd3fbea640 1 Processor -- start 2026-02-17T20:09:47.839 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.837+0000 7efd3fbea640 1 -- start start 2026-02-17T20:09:47.839 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.837+0000 7efd3fbea640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7efd3812d130 0x7efd381c7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:47.839 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.837+0000 7efd3fbea640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7efd38130170 0x7efd381c80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:47.839 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.837+0000 7efd3fbea640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7efd38130a90 0x7efd38134f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:47.839 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.837+0000 7efd3fbea640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7efd38137500 con 0x7efd38130170 2026-02-17T20:09:47.840 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.837+0000 7efd3fbea640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7efd38137680 con 0x7efd3812d130 2026-02-17T20:09:47.840 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.837+0000 7efd3fbea640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7efd38137800 con 0x7efd38130a90 2026-02-17T20:09:47.840 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.837+0000 7efd3d15e640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7efd38130170 0x7efd381c80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:47.840 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.837+0000 7efd3d95f640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7efd3812d130 0x7efd381c7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:47.840 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.837+0000 7efd3d15e640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7efd38130170 0x7efd381c80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:58508/0 (socket says 10.20.193.123:58508) 2026-02-17T20:09:47.840 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.837+0000 7efd3d15e640 1 -- 10.20.193.123:0/1991647336 learned_addr learned my addr 10.20.193.123:0/1991647336 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:47.840 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.837+0000 7efd3e160640 1 --2- 10.20.193.123:0/1991647336 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7efd38130a90 0x7efd38134f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:47.840 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.838+0000 7efd3d15e640 1 -- 10.20.193.123:0/1991647336 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7efd38130a90 msgr2=0x7efd38134f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:47.840 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.838+0000 7efd3d15e640 1 --2- 10.20.193.123:0/1991647336 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7efd38130a90 0x7efd38134f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:47.840 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.838+0000 7efd3d15e640 1 -- 10.20.193.123:0/1991647336 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7efd3812d130 msgr2=0x7efd381c7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:47.841 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.838+0000 7efd3d15e640 1 --2- 10.20.193.123:0/1991647336 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7efd3812d130 0x7efd381c7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:47.841 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.838+0000 7efd3d15e640 1 -- 10.20.193.123:0/1991647336 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd38136e50 con 0x7efd38130170 2026-02-17T20:09:47.841 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.838+0000 7efd3d15e640 1 --2- 10.20.193.123:0/1991647336 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7efd38130170 0x7efd381c80a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efd2c00ebe0 tx=0x7efd2c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:47.841 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.838+0000 7efd267fc640 1 -- 10.20.193.123:0/1991647336 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd2c017070 con 0x7efd38130170 2026-02-17T20:09:47.841 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.838+0000 7efd267fc640 1 -- 10.20.193.123:0/1991647336 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd2c00cc40 con 0x7efd38130170 2026-02-17T20:09:47.841 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.838+0000 7efd3fbea640 1 -- 10.20.193.123:0/1991647336 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd3811c8d0 con 0x7efd38130170 2026-02-17T20:09:47.841 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.838+0000 7efd267fc640 1 -- 10.20.193.123:0/1991647336 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd2c013470 con 0x7efd38130170 2026-02-17T20:09:47.841 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.838+0000 7efd3fbea640 1 -- 10.20.193.123:0/1991647336 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd381c85e0 con 0x7efd38130170 2026-02-17T20:09:47.841 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.838+0000 7efd3fbea640 1 -- 10.20.193.123:0/1991647336 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd3812c180 con 0x7efd38130170 2026-02-17T20:09:47.841 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.838+0000 7efd267fc640 1 -- 10.20.193.123:0/1991647336 <== mon.0 v2:10.20.193.123:3300/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7efd2c024060 con 0x7efd38130170 2026-02-17T20:09:47.842 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.839+0000 7efd267fc640 1 -- 10.20.193.123:0/1991647336 <== mon.0 v2:10.20.193.123:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3025+0+0 (secure 0 0 0) 0x7efd2c066b70 con 0x7efd38130170 2026-02-17T20:09:47.842 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.840+0000 7efd267fc640 1 -- 10.20.193.123:0/1991647336 <== mon.0 v2:10.20.193.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7efd3812c180 con 0x7efd38130170 2026-02-17T20:09:47.904 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.908+0000 7efd3fbea640 1 -- 10.20.193.123:0/1991647336 --> v1:10.20.193.123:6800/115662061 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efd38130550 con 0x7efd0804f790 2026-02-17T20:09:47.905 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.908+0000 7efd267fc640 1 -- 10.20.193.123:0/1991647336 <== mgr.14107 v1:10.20.193.123:6800/115662061 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31952 (unknown 2965378022 0 791337392) 0x7efd38130550 con 0x7efd0804f790 2026-02-17T20:09:47.905 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:09:47.906 INFO:teuthology.orchestra.run.trial123.stderr:dumped all 2026-02-17T20:09:47.906 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.909+0000 7efd3fbea640 1 -- 10.20.193.123:0/1991647336 >> v1:10.20.193.123:6800/115662061 conn(0x7efd0804f790 legacy=0x7efd08051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:47.906 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.909+0000 7efd3fbea640 1 -- 10.20.193.123:0/1991647336 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7efd38130170 msgr2=0x7efd381c80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:47.907 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.909+0000 7efd3fbea640 1 --2- 10.20.193.123:0/1991647336 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7efd38130170 0x7efd381c80a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efd2c00ebe0 tx=0x7efd2c00c520 comp rx=0 tx=0).stop 2026-02-17T20:09:47.907 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.909+0000 7efd3fbea640 1 -- 10.20.193.123:0/1991647336 shutdown_connections 2026-02-17T20:09:47.907 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.909+0000 7efd3fbea640 1 --2- 10.20.193.123:0/1991647336 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7efd38130a90 0x7efd38134f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:47.907 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.909+0000 7efd3fbea640 1 --2- 10.20.193.123:0/1991647336 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7efd38130170 0x7efd381c80a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:47.907 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.909+0000 7efd3fbea640 1 --2- 10.20.193.123:0/1991647336 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7efd3812d130 0x7efd381c7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:47.907 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.909+0000 7efd3fbea640 1 -- 10.20.193.123:0/1991647336 >> 10.20.193.123:0/1991647336 conn(0x7efd3809d6c0 msgr2=0x7efd3806e150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:47.907 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.909+0000 7efd3fbea640 1 -- 10.20.193.123:0/1991647336 shutdown_connections 2026-02-17T20:09:47.907 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.909+0000 7efd3fbea640 1 -- 10.20.193.123:0/1991647336 wait complete. 2026-02-17T20:09:47.913 INFO:teuthology.orchestra.run.trial123.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2026-02-17T20:09:46.325111+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":115,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":128644,"kb_used_data":2128,"kb_used_omap":17,"kb_used_meta":126446,"kb_avail":377358716,"statfs":{"total":386547056640,"available":386415325184,"internally_reserved":0,"allocated":2179072,"data_stored":1528789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18186,"internal_metadata":129480950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.937627"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-17T20:09:42.637769+0000","last_change":"2026-02-17T20:09:40.389699+0000","last_active":"2026-02-17T20:09:42.637769+0000","last_peered":"2026-02-17T20:09:42.637769+0000","last_clean":"2026-02-17T20:09:42.637769+0000","last_became_active":"2026-02-17T20:09:40.389602+0000","last_became_peered":"2026-02-17T20:09:40.389602+0000","last_unstale":"2026-02-17T20:09:42.637769+0000","last_undegraded":"2026-02-17T20:09:42.637769+0000","last_fullsized":"2026-02-17T20:09:42.637769+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T05:00:57.169209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-17T20:09:44.397270+0000","last_change":"2026-02-17T20:09:40.959635+0000","last_active":"2026-02-17T20:09:44.397270+0000","last_peered":"2026-02-17T20:09:44.397270+0000","last_clean":"2026-02-17T20:09:44.397270+0000","last_became_active":"2026-02-17T20:09:40.959369+0000","last_became_peered":"2026-02-17T20:09:40.959369+0000","last_unstale":"2026-02-17T20:09:44.397270+0000","last_undegraded":"2026-02-17T20:09:44.397270+0000","last_fullsized":"2026-02-17T20:09:44.397270+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:34:32.321476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033416199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-17T20:09:43.394927+0000","last_change":"2026-02-17T20:09:40.389967+0000","last_active":"2026-02-17T20:09:43.394927+0000","last_peered":"2026-02-17T20:09:43.394927+0000","last_clean":"2026-02-17T20:09:43.394927+0000","last_became_active":"2026-02-17T20:09:40.389827+0000","last_became_peered":"2026-02-17T20:09:40.389827+0000","last_unstale":"2026-02-17T20:09:43.394927+0000","last_undegraded":"2026-02-17T20:09:43.394927+0000","last_fullsized":"2026-02-17T20:09:43.394927+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T07:39:21.099659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026693600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-17T20:09:44.397241+0000","last_change":"2026-02-17T20:09:40.959612+0000","last_active":"2026-02-17T20:09:44.397241+0000","last_peered":"2026-02-17T20:09:44.397241+0000","last_clean":"2026-02-17T20:09:44.397241+0000","last_became_active":"2026-02-17T20:09:40.959406+0000","last_became_peered":"2026-02-17T20:09:40.959406+0000","last_unstale":"2026-02-17T20:09:44.397241+0000","last_undegraded":"2026-02-17T20:09:44.397241+0000","last_fullsized":"2026-02-17T20:09:44.397241+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T06:06:40.610646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000242539,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"17'79","reported_seq":153,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-17T20:09:44.397310+0000","last_change":"2026-02-17T20:09:40.389898+0000","last_active":"2026-02-17T20:09:44.397310+0000","last_peered":"2026-02-17T20:09:44.397310+0000","last_clean":"2026-02-17T20:09:44.397310+0000","last_became_active":"2026-02-17T20:09:40.389750+0000","last_became_peered":"2026-02-17T20:09:40.389750+0000","last_unstale":"2026-02-17T20:09:44.397310+0000","last_undegraded":"2026-02-17T20:09:44.397310+0000","last_fullsized":"2026-02-17T20:09:44.397310+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:28.678564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:28.678564+0000","last_clean_scrub_stamp":"2026-02-17T20:08:28.678564+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T00:37:14.734978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"11'1","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-17T20:09:42.637765+0000","last_change":"2026-02-17T20:09:39.388699+0000","last_active":"2026-02-17T20:09:42.637765+0000","last_peered":"2026-02-17T20:09:42.637765+0000","last_clean":"2026-02-17T20:09:42.637765+0000","last_became_active":"2026-02-17T20:09:39.388484+0000","last_became_peered":"2026-02-17T20:09:39.388484+0000","last_unstale":"2026-02-17T20:09:42.637765+0000","last_undegraded":"2026-02-17T20:09:42.637765+0000","last_fullsized":"2026-02-17T20:09:42.637765+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T02:45:47.622204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000198235,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"13'2","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-17T20:09:44.397065+0000","last_change":"2026-02-17T20:09:38.388175+0000","last_active":"2026-02-17T20:09:44.397065+0000","last_peered":"2026-02-17T20:09:44.397065+0000","last_clean":"2026-02-17T20:09:44.397065+0000","last_became_active":"2026-02-17T20:09:38.388004+0000","last_became_peered":"2026-02-17T20:09:38.388004+0000","last_unstale":"2026-02-17T20:09:44.397065+0000","last_undegraded":"2026-02-17T20:09:44.397065+0000","last_fullsized":"2026-02-17T20:09:44.397065+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:08:31.580414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059736000000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-17T20:09:44.397243+0000","last_change":"2026-02-17T20:09:40.959406+0000","last_active":"2026-02-17T20:09:44.397243+0000","last_peered":"2026-02-17T20:09:44.397243+0000","last_clean":"2026-02-17T20:09:44.397243+0000","last_became_active":"2026-02-17T20:09:40.959125+0000","last_became_peered":"2026-02-17T20:09:40.959125+0000","last_unstale":"2026-02-17T20:09:44.397243+0000","last_undegraded":"2026-02-17T20:09:44.397243+0000","last_fullsized":"2026-02-17T20:09:44.397243+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T01:49:16.320239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00023917200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-17T20:09:42.637776+0000","last_change":"2026-02-17T20:09:38.387850+0000","last_active":"2026-02-17T20:09:42.637776+0000","last_peered":"2026-02-17T20:09:42.637776+0000","last_clean":"2026-02-17T20:09:42.637776+0000","last_became_active":"2026-02-17T20:09:38.387688+0000","last_became_peered":"2026-02-17T20:09:38.387688+0000","last_unstale":"2026-02-17T20:09:42.637776+0000","last_undegraded":"2026-02-17T20:09:42.637776+0000","last_fullsized":"2026-02-17T20:09:42.637776+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T06:48:35.959788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000175532,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":26,"seq":111669149699,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32456,"kb_used_data":828,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339384,"statfs":{"total":96636764160,"available":96603529216,"internally_reserved":0,"allocated":847872,"data_stored":680349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4547,"internal_metadata":32370237},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":25,"seq":107374182403,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31864,"kb_used_data":236,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339976,"statfs":{"total":96636764160,"available":96604135424,"internally_reserved":0,"allocated":241664,"data_stored":85808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4547,"internal_metadata":32370237},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":24,"seq":103079215107,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32440,"kb_used_data":812,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":831488,"data_stored":672632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4546,"internal_metadata":32370238},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":23,"seq":98784247812,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31884,"kb_used_data":252,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339956,"statfs":{"total":96636764160,"available":96604114944,"internally_reserved":0,"allocated":258048,"data_stored":90000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4546,"internal_metadata":32370238},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T20:09:47.914 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-17T20:09:47.914 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-17T20:09:47.914 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-17T20:09:47.915 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T20:09:47.985 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.984+0000 7fcfb3f52640 1 Processor -- start 2026-02-17T20:09:47.985 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.984+0000 7fcfb3f52640 1 -- start start 2026-02-17T20:09:47.985 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.984+0000 7fcfb3f52640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fcfac071600 0x7fcfac0719e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:47.985 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.984+0000 7fcfb3f52640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fcfac073910 0x7fcfac1347c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:47.985 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.984+0000 7fcfb3f52640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfac072940 con 0x7fcfac071f20 2026-02-17T20:09:47.985 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.984+0000 7fcfb3f52640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7fcfac074220 con 0x7fcfac073910 2026-02-17T20:09:47.985 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.984+0000 7fcfb3f52640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7fcfac072f40 con 0x7fcfac071600 2026-02-17T20:09:47.985 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.984+0000 7fcfb1cc7640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fcfac071600 0x7fcfac0719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:47.986 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.985+0000 7fcfb14c6640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fcfac073910 0x7fcfac1347c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:47.986 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.985+0000 7fcfb24c8640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7fcfac071f20 0x7fcfac134d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:54466/0 (socket says 10.20.193.123:54466) 2026-02-17T20:09:47.986 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.985+0000 7fcfb1cc7640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fcfac071600 0x7fcfac0719e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:58074/0 (socket says 10.20.193.123:58074) 2026-02-17T20:09:47.986 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.985+0000 7fcfb24c8640 1 -- 10.20.193.123:0/1885287213 learned_addr learned my addr 10.20.193.123:0/1885287213 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:09:47.986 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.985+0000 7fcfb14c6640 1 -- 10.20.193.123:0/1885287213 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fcfac071600 msgr2=0x7fcfac0719e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:47.986 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.985+0000 7fcfb14c6640 1 --2- 10.20.193.123:0/1885287213 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fcfac071600 0x7fcfac0719e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:47.986 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.985+0000 7fcfb14c6640 1 -- 10.20.193.123:0/1885287213 >> v1:10.20.193.123:6789/0 conn(0x7fcfac071f20 legacy=0x7fcfac134d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:47.986 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.985+0000 7fcfb0cc5640 1 -- 10.20.193.123:0/1885287213 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3031853774 0 0) 0x7fcfac072940 con 0x7fcfac071f20 2026-02-17T20:09:47.986 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.985+0000 7fcfb14c6640 1 -- 10.20.193.123:0/1885287213 --> v2:10.20.193.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfac135410 con 0x7fcfac073910 2026-02-17T20:09:47.986 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.985+0000 7fcfb14c6640 1 --2- 10.20.193.123:0/1885287213 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fcfac073910 0x7fcfac1347c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcfa00098a0 tx=0x7fcfa002ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=444e03fdaa992c70 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:47.986 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.985+0000 7fcfb0cc5640 1 -- 10.20.193.123:0/1885287213 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa003c070 con 0x7fcfac073910 2026-02-17T20:09:47.987 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.985+0000 7fcfb0cc5640 1 -- 10.20.193.123:0/1885287213 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfa002fa40 con 0x7fcfac073910 2026-02-17T20:09:47.987 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.985+0000 7fcfb0cc5640 1 -- 10.20.193.123:0/1885287213 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa002fe10 con 0x7fcfac073910 2026-02-17T20:09:47.987 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.985+0000 7fcfb3f52640 1 -- 10.20.193.123:0/1885287213 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fcfac073910 msgr2=0x7fcfac1347c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:47.987 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.985+0000 7fcfb3f52640 1 --2- 10.20.193.123:0/1885287213 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fcfac073910 0x7fcfac1347c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcfa00098a0 tx=0x7fcfa002ed80 comp rx=0 tx=0).stop 2026-02-17T20:09:47.987 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.985+0000 7fcfb3f52640 1 -- 10.20.193.123:0/1885287213 shutdown_connections 2026-02-17T20:09:47.987 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.985+0000 7fcfb3f52640 1 --2- 10.20.193.123:0/1885287213 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fcfac073910 0x7fcfac1347c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:47.987 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.985+0000 7fcfb3f52640 1 --2- 10.20.193.123:0/1885287213 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fcfac071600 0x7fcfac0719e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:47.987 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.985+0000 7fcfb3f52640 1 -- 10.20.193.123:0/1885287213 >> 10.20.193.123:0/1885287213 conn(0x7fcfac09d6c0 msgr2=0x7fcfac09dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:47.987 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.985+0000 7fcfb3f52640 1 -- 10.20.193.123:0/1885287213 shutdown_connections 2026-02-17T20:09:47.987 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.985+0000 7fcfb3f52640 1 -- 10.20.193.123:0/1885287213 wait complete. 2026-02-17T20:09:47.987 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.986+0000 7fcfb3f52640 1 Processor -- start 2026-02-17T20:09:47.987 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.986+0000 7fcfb3f52640 1 -- start start 2026-02-17T20:09:47.988 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.986+0000 7fcfb3f52640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fcfac071600 0x7fcfac116610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:47.988 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.986+0000 7fcfb3f52640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fcfac071f20 0x7fcfac116b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:47.988 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.986+0000 7fcfb3f52640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fcfac073910 0x7fcfac117090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:47.988 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.986+0000 7fcfb3f52640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7fcfac13ce90 con 0x7fcfac071f20 2026-02-17T20:09:47.988 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.986+0000 7fcfb3f52640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7fcfac13cd10 con 0x7fcfac071600 2026-02-17T20:09:47.988 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.986+0000 7fcfb3f52640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7fcfac13d010 con 0x7fcfac073910 2026-02-17T20:09:47.988 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.986+0000 7fcfb1cc7640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fcfac071600 0x7fcfac116610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:47.988 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.986+0000 7fcfb14c6640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fcfac071f20 0x7fcfac116b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:47.988 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.986+0000 7fcfb1cc7640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fcfac071600 0x7fcfac116610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:58076/0 (socket says 10.20.193.123:58076) 2026-02-17T20:09:47.988 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.986+0000 7fcfb14c6640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fcfac071f20 0x7fcfac116b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:58522/0 (socket says 10.20.193.123:58522) 2026-02-17T20:09:47.988 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.986+0000 7fcfb1cc7640 1 -- 10.20.193.123:0/1545767290 learned_addr learned my addr 10.20.193.123:0/1545767290 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:47.988 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.986+0000 7fcfb24c8640 1 --2- 10.20.193.123:0/1545767290 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fcfac073910 0x7fcfac117090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:47.989 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.986+0000 7fcfb14c6640 1 -- 10.20.193.123:0/1545767290 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fcfac073910 msgr2=0x7fcfac117090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:47.989 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.986+0000 7fcfb14c6640 1 --2- 10.20.193.123:0/1545767290 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fcfac073910 0x7fcfac117090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:47.989 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.986+0000 7fcfb14c6640 1 -- 10.20.193.123:0/1545767290 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fcfac071600 msgr2=0x7fcfac116610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:47.989 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.986+0000 7fcfb14c6640 1 --2- 10.20.193.123:0/1545767290 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fcfac071600 0x7fcfac116610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:47.989 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.986+0000 7fcfb14c6640 1 -- 10.20.193.123:0/1545767290 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfac118180 con 0x7fcfac071f20 2026-02-17T20:09:47.989 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.986+0000 7fcfb24c8640 1 --2- 10.20.193.123:0/1545767290 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fcfac073910 0x7fcfac117090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T20:09:47.989 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.986+0000 7fcfb14c6640 1 --2- 10.20.193.123:0/1545767290 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fcfac071f20 0x7fcfac116b50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0036000 tx=0x7fcfa00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:47.989 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.986+0000 7fcf9a7fc640 1 -- 10.20.193.123:0/1545767290 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa003c040 con 0x7fcfac071f20 2026-02-17T20:09:47.989 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.987+0000 7fcf9a7fc640 1 -- 10.20.193.123:0/1545767290 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfa0004230 con 0x7fcfac071f20 2026-02-17T20:09:47.989 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.987+0000 7fcfb3f52640 1 -- 10.20.193.123:0/1545767290 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfac119e10 con 0x7fcfac071f20 2026-02-17T20:09:47.989 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.987+0000 7fcf9a7fc640 1 -- 10.20.193.123:0/1545767290 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa0003710 con 0x7fcfac071f20 2026-02-17T20:09:47.990 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.987+0000 7fcfb3f52640 1 -- 10.20.193.123:0/1545767290 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfac118a30 con 0x7fcfac071f20 2026-02-17T20:09:47.990 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.987+0000 7fcfb3f52640 1 -- 10.20.193.123:0/1545767290 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfac119fe0 con 0x7fcfac071f20 2026-02-17T20:09:47.990 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.987+0000 7fcf9a7fc640 1 -- 10.20.193.123:0/1545767290 <== mon.0 v2:10.20.193.123:3300/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7fcfa0053060 con 0x7fcfac071f20 2026-02-17T20:09:47.990 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.988+0000 7fcf9a7fc640 1 -- 10.20.193.123:0/1545767290 <== mon.0 v2:10.20.193.123:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3025+0+0 (secure 0 0 0) 0x7fcfa008c1c0 con 0x7fcfac071f20 2026-02-17T20:09:47.990 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:47.989+0000 7fcf9a7fc640 1 -- 10.20.193.123:0/1545767290 <== mon.0 v2:10.20.193.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7fcfa00660c0 con 0x7fcfac071f20 2026-02-17T20:09:48.065 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.069+0000 7fcfb3f52640 1 -- 10.20.193.123:0/1545767290 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fcfac068530 con 0x7fcfac071f20 2026-02-17T20:09:48.065 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.069+0000 7fcf9a7fc640 1 -- 10.20.193.123:0/1545767290 <== mon.0 v2:10.20.193.123:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fcfa0045160 con 0x7fcfac071f20 2026-02-17T20:09:48.065 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:09:48.065 INFO:teuthology.orchestra.run.trial123.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-17T20:09:48.066 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.069+0000 7fcfb3f52640 1 -- 10.20.193.123:0/1545767290 >> v1:10.20.193.123:6800/115662061 conn(0x7fcf7c04f790 legacy=0x7fcf7c051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:48.067 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.070+0000 7fcfb3f52640 1 -- 10.20.193.123:0/1545767290 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fcfac071f20 msgr2=0x7fcfac116b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:48.067 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.070+0000 7fcfb3f52640 1 --2- 10.20.193.123:0/1545767290 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fcfac071f20 0x7fcfac116b50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0036000 tx=0x7fcfa00047c0 comp rx=0 tx=0).stop 2026-02-17T20:09:48.067 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.070+0000 7fcfb3f52640 1 -- 10.20.193.123:0/1545767290 shutdown_connections 2026-02-17T20:09:48.067 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.070+0000 7fcfb3f52640 1 --2- 10.20.193.123:0/1545767290 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fcfac073910 0x7fcfac117090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:48.067 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.070+0000 7fcfb3f52640 1 --2- 10.20.193.123:0/1545767290 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fcfac071f20 0x7fcfac116b50 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:48.067 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.070+0000 7fcfb3f52640 1 --2- 10.20.193.123:0/1545767290 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fcfac071600 0x7fcfac116610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:48.067 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.070+0000 7fcfb3f52640 1 -- 10.20.193.123:0/1545767290 >> 10.20.193.123:0/1545767290 conn(0x7fcfac09d6c0 msgr2=0x7fcfac133ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:48.067 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.070+0000 7fcfb3f52640 1 -- 10.20.193.123:0/1545767290 shutdown_connections 2026-02-17T20:09:48.067 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.070+0000 7fcfb3f52640 1 -- 10.20.193.123:0/1545767290 wait complete. 2026-02-17T20:09:48.073 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-17T20:09:48.073 INFO:teuthology.run_tasks:Running task print... 2026-02-17T20:09:48.090 INFO:teuthology.task.print:**** done ceph.restart 2026-02-17T20:09:48.090 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2026-02-17T20:09:48.106 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2026-02-17T20:09:48.123 DEBUG:teuthology.run_tasks:Unwinding manager install.upgrade 2026-02-17T20:09:48.138 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-17T20:09:48.155 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-17T20:09:48.155 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T20:09:48.226 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.226+0000 7ff0c2bb5640 1 Processor -- start 2026-02-17T20:09:48.227 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.226+0000 7ff0c2bb5640 1 -- start start 2026-02-17T20:09:48.227 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.226+0000 7ff0c2bb5640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7ff0bc130170 0x7ff0bc130550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:48.227 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.226+0000 7ff0c2bb5640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7ff0bc12d300 0x7ff0bc138510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:48.227 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.227+0000 7ff0c2bb5640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0bc071e90 con 0x7ff0bc130a90 2026-02-17T20:09:48.227 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.227+0000 7ff0c2bb5640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7ff0bc071800 con 0x7ff0bc12d300 2026-02-17T20:09:48.227 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.227+0000 7ff0c2bb5640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7ff0bc072260 con 0x7ff0bc130170 2026-02-17T20:09:48.227 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.227+0000 7ff0c092a640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7ff0bc130170 0x7ff0bc130550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:48.227 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.227+0000 7ff0b3fff640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7ff0bc130a90 0x7ff0bc12cbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:39580/0 (socket says 10.20.193.123:39580) 2026-02-17T20:09:48.228 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.227+0000 7ff0b3fff640 1 -- 10.20.193.123:0/273244356 learned_addr learned my addr 10.20.193.123:0/273244356 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:09:48.228 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.227+0000 7ff0c112b640 1 --2- 10.20.193.123:0/273244356 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7ff0bc12d300 0x7ff0bc138510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:48.228 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.227+0000 7ff0b37fe640 1 -- 10.20.193.123:0/273244356 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3328830713 0 0) 0x7ff0bc071e90 con 0x7ff0bc130a90 2026-02-17T20:09:48.228 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.227+0000 7ff0b37fe640 1 -- 10.20.193.123:0/273244356 --> v1:10.20.193.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0a8003620 con 0x7ff0bc130a90 2026-02-17T20:09:48.228 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.227+0000 7ff0c092a640 1 -- 10.20.193.123:0/273244356 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7ff0bc12d300 msgr2=0x7ff0bc138510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:48.228 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.227+0000 7ff0c092a640 1 --2- 10.20.193.123:0/273244356 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7ff0bc12d300 0x7ff0bc138510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:48.228 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.227+0000 7ff0c092a640 1 -- 10.20.193.123:0/273244356 >> v1:10.20.193.123:6789/0 conn(0x7ff0bc130a90 legacy=0x7ff0bc12cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:48.228 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.227+0000 7ff0c092a640 1 -- 10.20.193.123:0/273244356 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0bc116aa0 con 0x7ff0bc130170 2026-02-17T20:09:48.228 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.227+0000 7ff0c112b640 1 --2- 10.20.193.123:0/273244356 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7ff0bc12d300 0x7ff0bc138510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:48.228 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.227+0000 7ff0c092a640 1 --2- 10.20.193.123:0/273244356 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7ff0bc130170 0x7ff0bc130550 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac0098d0 tx=0x7ff0ac02edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26c2f59c780abfcc server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:48.228 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.227+0000 7ff0b37fe640 1 -- 10.20.193.123:0/273244356 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac03c070 con 0x7ff0bc130170 2026-02-17T20:09:48.228 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.227+0000 7ff0b37fe640 1 -- 10.20.193.123:0/273244356 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0ac02fa30 con 0x7ff0bc130170 2026-02-17T20:09:48.229 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.227+0000 7ff0b37fe640 1 -- 10.20.193.123:0/273244356 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac02fde0 con 0x7ff0bc130170 2026-02-17T20:09:48.229 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.228+0000 7ff0c2bb5640 1 -- 10.20.193.123:0/273244356 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7ff0bc130170 msgr2=0x7ff0bc130550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:48.229 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.228+0000 7ff0c2bb5640 1 --2- 10.20.193.123:0/273244356 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7ff0bc130170 0x7ff0bc130550 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac0098d0 tx=0x7ff0ac02edc0 comp rx=0 tx=0).stop 2026-02-17T20:09:48.229 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.228+0000 7ff0c2bb5640 1 -- 10.20.193.123:0/273244356 shutdown_connections 2026-02-17T20:09:48.229 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.228+0000 7ff0c2bb5640 1 --2- 10.20.193.123:0/273244356 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7ff0bc12d300 0x7ff0bc138510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:48.229 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.228+0000 7ff0c2bb5640 1 --2- 10.20.193.123:0/273244356 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7ff0bc130170 0x7ff0bc130550 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:48.229 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.228+0000 7ff0c2bb5640 1 -- 10.20.193.123:0/273244356 >> 10.20.193.123:0/273244356 conn(0x7ff0bc09d6c0 msgr2=0x7ff0bc09dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:48.229 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.228+0000 7ff0c2bb5640 1 -- 10.20.193.123:0/273244356 shutdown_connections 2026-02-17T20:09:48.229 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.228+0000 7ff0c2bb5640 1 -- 10.20.193.123:0/273244356 wait complete. 2026-02-17T20:09:48.229 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.228+0000 7ff0c2bb5640 1 Processor -- start 2026-02-17T20:09:48.229 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.228+0000 7ff0c2bb5640 1 -- start start 2026-02-17T20:09:48.229 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.228+0000 7ff0c2bb5640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7ff0bc12d300 0x7ff0bc134f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:48.230 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.228+0000 7ff0c2bb5640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7ff0bc130170 0x7ff0bc1354d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:48.230 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.228+0000 7ff0c2bb5640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7ff0bc130a90 0x7ff0bc135a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:48.230 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.228+0000 7ff0c2bb5640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff0bc12d910 con 0x7ff0bc130170 2026-02-17T20:09:48.230 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.228+0000 7ff0c2bb5640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7ff0bc12d790 con 0x7ff0bc130a90 2026-02-17T20:09:48.230 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.228+0000 7ff0c2bb5640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7ff0bc138a50 con 0x7ff0bc12d300 2026-02-17T20:09:48.230 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.228+0000 7ff0c092a640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7ff0bc12d300 0x7ff0bc134f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:48.230 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.228+0000 7ff0c112b640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7ff0bc130a90 0x7ff0bc135a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:48.230 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.228+0000 7ff0b3fff640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7ff0bc130170 0x7ff0bc1354d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:48.230 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.228+0000 7ff0c092a640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7ff0bc12d300 0x7ff0bc134f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:37874/0 (socket says 10.20.193.123:37874) 2026-02-17T20:09:48.230 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.228+0000 7ff0c092a640 1 -- 10.20.193.123:0/2308286915 learned_addr learned my addr 10.20.193.123:0/2308286915 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:48.230 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.229+0000 7ff0c092a640 1 -- 10.20.193.123:0/2308286915 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7ff0bc130a90 msgr2=0x7ff0bc135a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:48.230 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.229+0000 7ff0c092a640 1 --2- 10.20.193.123:0/2308286915 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7ff0bc130a90 0x7ff0bc135a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:48.231 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.229+0000 7ff0c092a640 1 -- 10.20.193.123:0/2308286915 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7ff0bc130170 msgr2=0x7ff0bc1354d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:48.231 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.229+0000 7ff0c092a640 1 --2- 10.20.193.123:0/2308286915 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7ff0bc130170 0x7ff0bc1354d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:48.231 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.229+0000 7ff0c092a640 1 -- 10.20.193.123:0/2308286915 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0bc12a8c0 con 0x7ff0bc12d300 2026-02-17T20:09:48.231 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.229+0000 7ff0b3fff640 1 --2- 10.20.193.123:0/2308286915 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7ff0bc130170 0x7ff0bc1354d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:48.231 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.229+0000 7ff0c092a640 1 --2- 10.20.193.123:0/2308286915 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7ff0bc12d300 0x7ff0bc134f90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac0098d0 tx=0x7ff0ac0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:48.231 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.229+0000 7ff0b17fa640 1 -- 10.20.193.123:0/2308286915 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac03c040 con 0x7ff0bc12d300 2026-02-17T20:09:48.231 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.229+0000 7ff0b17fa640 1 -- 10.20.193.123:0/2308286915 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0ac038cf0 con 0x7ff0bc12d300 2026-02-17T20:09:48.231 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.229+0000 7ff0c2bb5640 1 -- 10.20.193.123:0/2308286915 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0bc137ba0 con 0x7ff0bc12d300 2026-02-17T20:09:48.231 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.229+0000 7ff0b17fa640 1 -- 10.20.193.123:0/2308286915 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac004270 con 0x7ff0bc12d300 2026-02-17T20:09:48.231 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.229+0000 7ff0c2bb5640 1 -- 10.20.193.123:0/2308286915 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0bc137210 con 0x7ff0bc12d300 2026-02-17T20:09:48.231 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.229+0000 7ff0c2bb5640 1 -- 10.20.193.123:0/2308286915 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0bc137470 con 0x7ff0bc12d300 2026-02-17T20:09:48.231 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.230+0000 7ff0b17fa640 1 -- 10.20.193.123:0/2308286915 <== mon.2 v2:10.20.193.123:3302/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7ff0ac053060 con 0x7ff0bc12d300 2026-02-17T20:09:48.232 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.230+0000 7ff0b17fa640 1 -- 10.20.193.123:0/2308286915 <== mon.2 v2:10.20.193.123:3302/0 5 ==== osd_map(30..30 src has 1..30) ==== 3025+0+0 (secure 0 0 0) 0x7ff0ac08bcb0 con 0x7ff0bc12d300 2026-02-17T20:09:48.232 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.232+0000 7ff0b17fa640 1 -- 10.20.193.123:0/2308286915 <== mon.2 v2:10.20.193.123:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7ff0bc137470 con 0x7ff0bc12d300 2026-02-17T20:09:48.298 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.302+0000 7ff0c2bb5640 1 -- 10.20.193.123:0/2308286915 --> v1:10.20.193.123:6800/115662061 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff0bc130550 con 0x7ff08c04f790 2026-02-17T20:09:48.299 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.303+0000 7ff0b17fa640 1 -- 10.20.193.123:0/2308286915 <== mgr.14107 v1:10.20.193.123:6800/115662061 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31952 (unknown 2965378022 0 791337392) 0x7ff0bc130550 con 0x7ff08c04f790 2026-02-17T20:09:48.299 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:09:48.299 INFO:teuthology.orchestra.run.trial123.stderr:dumped all 2026-02-17T20:09:48.300 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.304+0000 7ff0c2bb5640 1 -- 10.20.193.123:0/2308286915 >> v1:10.20.193.123:6800/115662061 conn(0x7ff08c04f790 legacy=0x7ff08c051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:48.300 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.304+0000 7ff0c2bb5640 1 -- 10.20.193.123:0/2308286915 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7ff0bc12d300 msgr2=0x7ff0bc134f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:48.300 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.304+0000 7ff0c2bb5640 1 --2- 10.20.193.123:0/2308286915 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7ff0bc12d300 0x7ff0bc134f90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac0098d0 tx=0x7ff0ac0047c0 comp rx=0 tx=0).stop 2026-02-17T20:09:48.300 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.304+0000 7ff0c2bb5640 1 -- 10.20.193.123:0/2308286915 shutdown_connections 2026-02-17T20:09:48.300 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.304+0000 7ff0c2bb5640 1 --2- 10.20.193.123:0/2308286915 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7ff0bc130a90 0x7ff0bc135a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:48.300 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.304+0000 7ff0c2bb5640 1 --2- 10.20.193.123:0/2308286915 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7ff0bc130170 0x7ff0bc1354d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:48.300 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.304+0000 7ff0c2bb5640 1 --2- 10.20.193.123:0/2308286915 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7ff0bc12d300 0x7ff0bc134f90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:48.300 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.304+0000 7ff0c2bb5640 1 -- 10.20.193.123:0/2308286915 >> 10.20.193.123:0/2308286915 conn(0x7ff0bc09d6c0 msgr2=0x7ff0bc06e150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:48.300 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.304+0000 7ff0c2bb5640 1 -- 10.20.193.123:0/2308286915 shutdown_connections 2026-02-17T20:09:48.300 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.304+0000 7ff0c2bb5640 1 -- 10.20.193.123:0/2308286915 wait complete. 2026-02-17T20:09:48.307 INFO:teuthology.orchestra.run.trial123.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2026-02-17T20:09:46.325111+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":115,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":128644,"kb_used_data":2128,"kb_used_omap":17,"kb_used_meta":126446,"kb_avail":377358716,"statfs":{"total":386547056640,"available":386415325184,"internally_reserved":0,"allocated":2179072,"data_stored":1528789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18186,"internal_metadata":129480950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.937627"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-17T20:09:42.637769+0000","last_change":"2026-02-17T20:09:40.389699+0000","last_active":"2026-02-17T20:09:42.637769+0000","last_peered":"2026-02-17T20:09:42.637769+0000","last_clean":"2026-02-17T20:09:42.637769+0000","last_became_active":"2026-02-17T20:09:40.389602+0000","last_became_peered":"2026-02-17T20:09:40.389602+0000","last_unstale":"2026-02-17T20:09:42.637769+0000","last_undegraded":"2026-02-17T20:09:42.637769+0000","last_fullsized":"2026-02-17T20:09:42.637769+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T05:00:57.169209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-17T20:09:44.397270+0000","last_change":"2026-02-17T20:09:40.959635+0000","last_active":"2026-02-17T20:09:44.397270+0000","last_peered":"2026-02-17T20:09:44.397270+0000","last_clean":"2026-02-17T20:09:44.397270+0000","last_became_active":"2026-02-17T20:09:40.959369+0000","last_became_peered":"2026-02-17T20:09:40.959369+0000","last_unstale":"2026-02-17T20:09:44.397270+0000","last_undegraded":"2026-02-17T20:09:44.397270+0000","last_fullsized":"2026-02-17T20:09:44.397270+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:34:32.321476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033416199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-17T20:09:43.394927+0000","last_change":"2026-02-17T20:09:40.389967+0000","last_active":"2026-02-17T20:09:43.394927+0000","last_peered":"2026-02-17T20:09:43.394927+0000","last_clean":"2026-02-17T20:09:43.394927+0000","last_became_active":"2026-02-17T20:09:40.389827+0000","last_became_peered":"2026-02-17T20:09:40.389827+0000","last_unstale":"2026-02-17T20:09:43.394927+0000","last_undegraded":"2026-02-17T20:09:43.394927+0000","last_fullsized":"2026-02-17T20:09:43.394927+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T07:39:21.099659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026693600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-17T20:09:44.397241+0000","last_change":"2026-02-17T20:09:40.959612+0000","last_active":"2026-02-17T20:09:44.397241+0000","last_peered":"2026-02-17T20:09:44.397241+0000","last_clean":"2026-02-17T20:09:44.397241+0000","last_became_active":"2026-02-17T20:09:40.959406+0000","last_became_peered":"2026-02-17T20:09:40.959406+0000","last_unstale":"2026-02-17T20:09:44.397241+0000","last_undegraded":"2026-02-17T20:09:44.397241+0000","last_fullsized":"2026-02-17T20:09:44.397241+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T06:06:40.610646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000242539,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"17'79","reported_seq":153,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-17T20:09:44.397310+0000","last_change":"2026-02-17T20:09:40.389898+0000","last_active":"2026-02-17T20:09:44.397310+0000","last_peered":"2026-02-17T20:09:44.397310+0000","last_clean":"2026-02-17T20:09:44.397310+0000","last_became_active":"2026-02-17T20:09:40.389750+0000","last_became_peered":"2026-02-17T20:09:40.389750+0000","last_unstale":"2026-02-17T20:09:44.397310+0000","last_undegraded":"2026-02-17T20:09:44.397310+0000","last_fullsized":"2026-02-17T20:09:44.397310+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:28.678564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:28.678564+0000","last_clean_scrub_stamp":"2026-02-17T20:08:28.678564+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T00:37:14.734978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"11'1","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-17T20:09:42.637765+0000","last_change":"2026-02-17T20:09:39.388699+0000","last_active":"2026-02-17T20:09:42.637765+0000","last_peered":"2026-02-17T20:09:42.637765+0000","last_clean":"2026-02-17T20:09:42.637765+0000","last_became_active":"2026-02-17T20:09:39.388484+0000","last_became_peered":"2026-02-17T20:09:39.388484+0000","last_unstale":"2026-02-17T20:09:42.637765+0000","last_undegraded":"2026-02-17T20:09:42.637765+0000","last_fullsized":"2026-02-17T20:09:42.637765+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T02:45:47.622204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000198235,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"13'2","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-17T20:09:44.397065+0000","last_change":"2026-02-17T20:09:38.388175+0000","last_active":"2026-02-17T20:09:44.397065+0000","last_peered":"2026-02-17T20:09:44.397065+0000","last_clean":"2026-02-17T20:09:44.397065+0000","last_became_active":"2026-02-17T20:09:38.388004+0000","last_became_peered":"2026-02-17T20:09:38.388004+0000","last_unstale":"2026-02-17T20:09:44.397065+0000","last_undegraded":"2026-02-17T20:09:44.397065+0000","last_fullsized":"2026-02-17T20:09:44.397065+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:08:31.580414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059736000000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-17T20:09:44.397243+0000","last_change":"2026-02-17T20:09:40.959406+0000","last_active":"2026-02-17T20:09:44.397243+0000","last_peered":"2026-02-17T20:09:44.397243+0000","last_clean":"2026-02-17T20:09:44.397243+0000","last_became_active":"2026-02-17T20:09:40.959125+0000","last_became_peered":"2026-02-17T20:09:40.959125+0000","last_unstale":"2026-02-17T20:09:44.397243+0000","last_undegraded":"2026-02-17T20:09:44.397243+0000","last_fullsized":"2026-02-17T20:09:44.397243+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T01:49:16.320239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00023917200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-17T20:09:42.637776+0000","last_change":"2026-02-17T20:09:38.387850+0000","last_active":"2026-02-17T20:09:42.637776+0000","last_peered":"2026-02-17T20:09:42.637776+0000","last_clean":"2026-02-17T20:09:42.637776+0000","last_became_active":"2026-02-17T20:09:38.387688+0000","last_became_peered":"2026-02-17T20:09:38.387688+0000","last_unstale":"2026-02-17T20:09:42.637776+0000","last_undegraded":"2026-02-17T20:09:42.637776+0000","last_fullsized":"2026-02-17T20:09:42.637776+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T06:48:35.959788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000175532,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":26,"seq":111669149699,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32456,"kb_used_data":828,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339384,"statfs":{"total":96636764160,"available":96603529216,"internally_reserved":0,"allocated":847872,"data_stored":680349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4547,"internal_metadata":32370237},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":25,"seq":107374182403,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31864,"kb_used_data":236,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339976,"statfs":{"total":96636764160,"available":96604135424,"internally_reserved":0,"allocated":241664,"data_stored":85808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4547,"internal_metadata":32370237},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":24,"seq":103079215107,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32440,"kb_used_data":812,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":831488,"data_stored":672632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4546,"internal_metadata":32370238},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":23,"seq":98784247812,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31884,"kb_used_data":252,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339956,"statfs":{"total":96636764160,"available":96604114944,"internally_reserved":0,"allocated":258048,"data_stored":90000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4546,"internal_metadata":32370238},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T20:09:48.308 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T20:09:48.375 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.379+0000 7f340662c640 1 Processor -- start 2026-02-17T20:09:48.375 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.379+0000 7f340662c640 1 -- start start 2026-02-17T20:09:48.375 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.379+0000 7f340662c640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f3400071600 0x7f34000719e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:48.375 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.379+0000 7f340662c640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3400073910 0x7f34001347c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:48.376 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.379+0000 7f340662c640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f3400071f20 0x7f3400134d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:48.376 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.379+0000 7f340662c640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7f3400074220 con 0x7f3400071f20 2026-02-17T20:09:48.376 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.379+0000 7f340662c640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f3400072940 con 0x7f3400071600 2026-02-17T20:09:48.376 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.379+0000 7f340662c640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f3400072f40 con 0x7f3400073910 2026-02-17T20:09:48.376 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.379+0000 7f33fffff640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f3400071600 0x7f34000719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:48.376 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.379+0000 7f33ff7fe640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3400073910 0x7f34001347c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:48.376 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.379+0000 7f3404ba2640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f3400071f20 0x7f3400134d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:48.376 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.379+0000 7f33fffff640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f3400071600 0x7f34000719e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:46820/0 (socket says 10.20.193.123:46820) 2026-02-17T20:09:48.376 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.379+0000 7f33fffff640 1 -- 10.20.193.123:0/573278740 learned_addr learned my addr 10.20.193.123:0/573278740 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:48.376 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.379+0000 7f33ff7fe640 1 -- 10.20.193.123:0/573278740 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f3400071600 msgr2=0x7f34000719e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:48.376 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.379+0000 7f33ff7fe640 1 --2- 10.20.193.123:0/573278740 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f3400071600 0x7f34000719e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:48.376 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.379+0000 7f33ff7fe640 1 -- 10.20.193.123:0/573278740 >> v2:10.20.193.123:3300/0 conn(0x7f3400071f20 msgr2=0x7f3400134d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:48.376 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.379+0000 7f33ff7fe640 1 --2- 10.20.193.123:0/573278740 >> v2:10.20.193.123:3300/0 conn(0x7f3400071f20 0x7f3400134d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:48.376 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.379+0000 7f33ff7fe640 1 -- 10.20.193.123:0/573278740 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3400135240 con 0x7f3400073910 2026-02-17T20:09:48.376 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.379+0000 7f33fffff640 1 --2- 10.20.193.123:0/573278740 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f3400071600 0x7f34000719e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:48.376 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.380+0000 7f33ff7fe640 1 --2- 10.20.193.123:0/573278740 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3400073910 0x7f34001347c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f33f00098d0 tx=0x7f33f002edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b62a76ce6318a40 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:48.376 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.380+0000 7f33feffd640 1 -- 10.20.193.123:0/573278740 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f003c070 con 0x7f3400073910 2026-02-17T20:09:48.377 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.380+0000 7f33feffd640 1 -- 10.20.193.123:0/573278740 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33f002f9f0 con 0x7f3400073910 2026-02-17T20:09:48.377 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.380+0000 7f33feffd640 1 -- 10.20.193.123:0/573278740 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f002fdc0 con 0x7f3400073910 2026-02-17T20:09:48.377 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.380+0000 7f340662c640 1 -- 10.20.193.123:0/573278740 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3400073910 msgr2=0x7f34001347c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:48.377 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.380+0000 7f340662c640 1 --2- 10.20.193.123:0/573278740 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3400073910 0x7f34001347c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f33f00098d0 tx=0x7f33f002edc0 comp rx=0 tx=0).stop 2026-02-17T20:09:48.377 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.380+0000 7f340662c640 1 -- 10.20.193.123:0/573278740 shutdown_connections 2026-02-17T20:09:48.377 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.380+0000 7f340662c640 1 --2- 10.20.193.123:0/573278740 >> v2:10.20.193.123:3300/0 conn(0x7f3400071f20 0x7f3400134d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:48.377 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.380+0000 7f340662c640 1 --2- 10.20.193.123:0/573278740 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3400073910 0x7f34001347c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:48.377 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.380+0000 7f340662c640 1 --2- 10.20.193.123:0/573278740 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f3400071600 0x7f34000719e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:48.377 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.380+0000 7f340662c640 1 -- 10.20.193.123:0/573278740 >> 10.20.193.123:0/573278740 conn(0x7f340009d6c0 msgr2=0x7f340009dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:48.377 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.380+0000 7f340662c640 1 -- 10.20.193.123:0/573278740 shutdown_connections 2026-02-17T20:09:48.377 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.380+0000 7f340662c640 1 -- 10.20.193.123:0/573278740 wait complete. 2026-02-17T20:09:48.377 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.381+0000 7f340662c640 1 Processor -- start 2026-02-17T20:09:48.377 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.381+0000 7f340662c640 1 -- start start 2026-02-17T20:09:48.378 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.381+0000 7f340662c640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f3400071600 0x7f3400135b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:48.378 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.381+0000 7f340662c640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3400071f20 0x7f3400136060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:48.378 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.381+0000 7f340662c640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f3400073910 0x7f34001365a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:48.378 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.381+0000 7f340662c640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7f340013bc70 con 0x7f3400071600 2026-02-17T20:09:48.378 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.381+0000 7f340662c640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f340013baf0 con 0x7f3400073910 2026-02-17T20:09:48.378 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.381+0000 7f340662c640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f340013bdf0 con 0x7f3400071f20 2026-02-17T20:09:48.378 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.381+0000 7f33fffff640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f3400071600 0x7f3400135b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:48.378 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.381+0000 7f33ff7fe640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3400071f20 0x7f3400136060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:48.378 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.381+0000 7f3404ba2640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f3400073910 0x7f34001365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:48.378 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.381+0000 7f33fffff640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f3400071600 0x7f3400135b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:47784/0 (socket says 10.20.193.123:47784) 2026-02-17T20:09:48.378 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.381+0000 7f33fffff640 1 -- 10.20.193.123:0/2625070053 learned_addr learned my addr 10.20.193.123:0/2625070053 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:48.378 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.381+0000 7f33fffff640 1 -- 10.20.193.123:0/2625070053 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3400071f20 msgr2=0x7f3400136060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:48.378 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.381+0000 7f33fffff640 1 --2- 10.20.193.123:0/2625070053 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3400071f20 0x7f3400136060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:48.378 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.381+0000 7f33fffff640 1 -- 10.20.193.123:0/2625070053 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f3400073910 msgr2=0x7f34001365a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:48.378 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.381+0000 7f33fffff640 1 --2- 10.20.193.123:0/2625070053 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f3400073910 0x7f34001365a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:48.378 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.381+0000 7f33fffff640 1 -- 10.20.193.123:0/2625070053 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3400136e00 con 0x7f3400071600 2026-02-17T20:09:48.378 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.381+0000 7f33ff7fe640 1 --2- 10.20.193.123:0/2625070053 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3400071f20 0x7f3400136060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:48.378 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.381+0000 7f3404ba2640 1 --2- 10.20.193.123:0/2625070053 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f3400073910 0x7f34001365a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:48.378 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.381+0000 7f33fffff640 1 --2- 10.20.193.123:0/2625070053 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f3400071600 0x7f3400135b20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f33ec00ebb0 tx=0x7f33ec00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:48.378 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.381+0000 7f33fcff9640 1 -- 10.20.193.123:0/2625070053 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ec00cc40 con 0x7f3400071600 2026-02-17T20:09:48.378 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.381+0000 7f33fcff9640 1 -- 10.20.193.123:0/2625070053 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33ec00cde0 con 0x7f3400071600 2026-02-17T20:09:48.378 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.381+0000 7f340662c640 1 -- 10.20.193.123:0/2625070053 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3400137ec0 con 0x7f3400071600 2026-02-17T20:09:48.378 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.381+0000 7f33fcff9640 1 -- 10.20.193.123:0/2625070053 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ec004250 con 0x7f3400071600 2026-02-17T20:09:48.378 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.381+0000 7f340662c640 1 -- 10.20.193.123:0/2625070053 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34001376a0 con 0x7f3400071600 2026-02-17T20:09:48.378 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.382+0000 7f340662c640 1 -- 10.20.193.123:0/2625070053 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34000719e0 con 0x7f3400071600 2026-02-17T20:09:48.378 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.382+0000 7f33fcff9640 1 -- 10.20.193.123:0/2625070053 <== mon.0 v2:10.20.193.123:3300/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f33ec023060 con 0x7f3400071600 2026-02-17T20:09:48.379 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.382+0000 7f33fcff9640 1 -- 10.20.193.123:0/2625070053 <== mon.0 v2:10.20.193.123:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3025+0+0 (secure 0 0 0) 0x7f33ec0668b0 con 0x7f3400071600 2026-02-17T20:09:48.380 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.384+0000 7f33fcff9640 1 -- 10.20.193.123:0/2625070053 <== mon.0 v2:10.20.193.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f33ec017020 con 0x7f3400071600 2026-02-17T20:09:48.451 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.455+0000 7f340662c640 1 -- 10.20.193.123:0/2625070053 --> v1:10.20.193.123:6800/115662061 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3400070870 con 0x7f33d004f790 2026-02-17T20:09:48.452 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.456+0000 7f33fcff9640 1 -- 10.20.193.123:0/2625070053 <== mgr.14107 v1:10.20.193.123:6800/115662061 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31952 (unknown 2965378022 0 605441455) 0x7f3400070870 con 0x7f33d004f790 2026-02-17T20:09:48.452 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:09:48.452 INFO:teuthology.orchestra.run.trial123.stderr:dumped all 2026-02-17T20:09:48.453 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.457+0000 7f340662c640 1 -- 10.20.193.123:0/2625070053 >> v1:10.20.193.123:6800/115662061 conn(0x7f33d004f790 legacy=0x7f33d0051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:48.453 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.457+0000 7f340662c640 1 -- 10.20.193.123:0/2625070053 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f3400071600 msgr2=0x7f3400135b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:48.453 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.457+0000 7f340662c640 1 --2- 10.20.193.123:0/2625070053 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f3400071600 0x7f3400135b20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f33ec00ebb0 tx=0x7f33ec00c520 comp rx=0 tx=0).stop 2026-02-17T20:09:48.453 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.457+0000 7f340662c640 1 -- 10.20.193.123:0/2625070053 shutdown_connections 2026-02-17T20:09:48.453 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.457+0000 7f340662c640 1 --2- 10.20.193.123:0/2625070053 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f3400073910 0x7f34001365a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:48.453 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.457+0000 7f340662c640 1 --2- 10.20.193.123:0/2625070053 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f3400071f20 0x7f3400136060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:48.453 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.457+0000 7f340662c640 1 --2- 10.20.193.123:0/2625070053 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f3400071600 0x7f3400135b20 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:48.453 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.457+0000 7f340662c640 1 -- 10.20.193.123:0/2625070053 >> 10.20.193.123:0/2625070053 conn(0x7f340009d6c0 msgr2=0x7f3400070160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:48.453 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.457+0000 7f340662c640 1 -- 10.20.193.123:0/2625070053 shutdown_connections 2026-02-17T20:09:48.453 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.457+0000 7f340662c640 1 -- 10.20.193.123:0/2625070053 wait complete. 2026-02-17T20:09:48.461 INFO:teuthology.orchestra.run.trial123.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2026-02-17T20:09:48.325392+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":115,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":128644,"kb_used_data":2128,"kb_used_omap":17,"kb_used_meta":126446,"kb_avail":377358716,"statfs":{"total":386547056640,"available":386415325184,"internally_reserved":0,"allocated":2179072,"data_stored":1528789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18186,"internal_metadata":129480950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000775"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-17T20:09:42.637769+0000","last_change":"2026-02-17T20:09:40.389699+0000","last_active":"2026-02-17T20:09:42.637769+0000","last_peered":"2026-02-17T20:09:42.637769+0000","last_clean":"2026-02-17T20:09:42.637769+0000","last_became_active":"2026-02-17T20:09:40.389602+0000","last_became_peered":"2026-02-17T20:09:40.389602+0000","last_unstale":"2026-02-17T20:09:42.637769+0000","last_undegraded":"2026-02-17T20:09:42.637769+0000","last_fullsized":"2026-02-17T20:09:42.637769+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T05:00:57.169209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-17T20:09:44.397270+0000","last_change":"2026-02-17T20:09:40.959635+0000","last_active":"2026-02-17T20:09:44.397270+0000","last_peered":"2026-02-17T20:09:44.397270+0000","last_clean":"2026-02-17T20:09:44.397270+0000","last_became_active":"2026-02-17T20:09:40.959369+0000","last_became_peered":"2026-02-17T20:09:40.959369+0000","last_unstale":"2026-02-17T20:09:44.397270+0000","last_undegraded":"2026-02-17T20:09:44.397270+0000","last_fullsized":"2026-02-17T20:09:44.397270+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:34:32.321476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033416199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-17T20:09:47.172011+0000","last_change":"2026-02-17T20:09:40.389967+0000","last_active":"2026-02-17T20:09:47.172011+0000","last_peered":"2026-02-17T20:09:47.172011+0000","last_clean":"2026-02-17T20:09:47.172011+0000","last_became_active":"2026-02-17T20:09:40.389827+0000","last_became_peered":"2026-02-17T20:09:40.389827+0000","last_unstale":"2026-02-17T20:09:47.172011+0000","last_undegraded":"2026-02-17T20:09:47.172011+0000","last_fullsized":"2026-02-17T20:09:47.172011+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T07:39:21.099659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026693600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-17T20:09:44.397241+0000","last_change":"2026-02-17T20:09:40.959612+0000","last_active":"2026-02-17T20:09:44.397241+0000","last_peered":"2026-02-17T20:09:44.397241+0000","last_clean":"2026-02-17T20:09:44.397241+0000","last_became_active":"2026-02-17T20:09:40.959406+0000","last_became_peered":"2026-02-17T20:09:40.959406+0000","last_unstale":"2026-02-17T20:09:44.397241+0000","last_undegraded":"2026-02-17T20:09:44.397241+0000","last_fullsized":"2026-02-17T20:09:44.397241+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T06:06:40.610646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000242539,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"17'79","reported_seq":153,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-17T20:09:44.397310+0000","last_change":"2026-02-17T20:09:40.389898+0000","last_active":"2026-02-17T20:09:44.397310+0000","last_peered":"2026-02-17T20:09:44.397310+0000","last_clean":"2026-02-17T20:09:44.397310+0000","last_became_active":"2026-02-17T20:09:40.389750+0000","last_became_peered":"2026-02-17T20:09:40.389750+0000","last_unstale":"2026-02-17T20:09:44.397310+0000","last_undegraded":"2026-02-17T20:09:44.397310+0000","last_fullsized":"2026-02-17T20:09:44.397310+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:28.678564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:28.678564+0000","last_clean_scrub_stamp":"2026-02-17T20:08:28.678564+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T00:37:14.734978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"11'1","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-17T20:09:42.637765+0000","last_change":"2026-02-17T20:09:39.388699+0000","last_active":"2026-02-17T20:09:42.637765+0000","last_peered":"2026-02-17T20:09:42.637765+0000","last_clean":"2026-02-17T20:09:42.637765+0000","last_became_active":"2026-02-17T20:09:39.388484+0000","last_became_peered":"2026-02-17T20:09:39.388484+0000","last_unstale":"2026-02-17T20:09:42.637765+0000","last_undegraded":"2026-02-17T20:09:42.637765+0000","last_fullsized":"2026-02-17T20:09:42.637765+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T02:45:47.622204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000198235,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"13'2","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-17T20:09:44.397065+0000","last_change":"2026-02-17T20:09:38.388175+0000","last_active":"2026-02-17T20:09:44.397065+0000","last_peered":"2026-02-17T20:09:44.397065+0000","last_clean":"2026-02-17T20:09:44.397065+0000","last_became_active":"2026-02-17T20:09:38.388004+0000","last_became_peered":"2026-02-17T20:09:38.388004+0000","last_unstale":"2026-02-17T20:09:44.397065+0000","last_undegraded":"2026-02-17T20:09:44.397065+0000","last_fullsized":"2026-02-17T20:09:44.397065+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:08:31.580414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059736000000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-17T20:09:44.397243+0000","last_change":"2026-02-17T20:09:40.959406+0000","last_active":"2026-02-17T20:09:44.397243+0000","last_peered":"2026-02-17T20:09:44.397243+0000","last_clean":"2026-02-17T20:09:44.397243+0000","last_became_active":"2026-02-17T20:09:40.959125+0000","last_became_peered":"2026-02-17T20:09:40.959125+0000","last_unstale":"2026-02-17T20:09:44.397243+0000","last_undegraded":"2026-02-17T20:09:44.397243+0000","last_fullsized":"2026-02-17T20:09:44.397243+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T01:49:16.320239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00023917200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-17T20:09:42.637776+0000","last_change":"2026-02-17T20:09:38.387850+0000","last_active":"2026-02-17T20:09:42.637776+0000","last_peered":"2026-02-17T20:09:42.637776+0000","last_clean":"2026-02-17T20:09:42.637776+0000","last_became_active":"2026-02-17T20:09:38.387688+0000","last_became_peered":"2026-02-17T20:09:38.387688+0000","last_unstale":"2026-02-17T20:09:42.637776+0000","last_undegraded":"2026-02-17T20:09:42.637776+0000","last_fullsized":"2026-02-17T20:09:42.637776+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T06:48:35.959788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000175532,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":26,"seq":111669149699,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32456,"kb_used_data":828,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339384,"statfs":{"total":96636764160,"available":96603529216,"internally_reserved":0,"allocated":847872,"data_stored":680349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4547,"internal_metadata":32370237},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":25,"seq":107374182404,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31864,"kb_used_data":236,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339976,"statfs":{"total":96636764160,"available":96604135424,"internally_reserved":0,"allocated":241664,"data_stored":85808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4547,"internal_metadata":32370237},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":24,"seq":103079215108,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32440,"kb_used_data":812,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":831488,"data_stored":672632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4546,"internal_metadata":32370238},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":23,"seq":98784247812,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31884,"kb_used_data":252,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339956,"statfs":{"total":96636764160,"available":96604114944,"internally_reserved":0,"allocated":258048,"data_stored":90000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4546,"internal_metadata":32370238},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T20:09:48.461 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-17T20:09:48.461 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T20:09:48.532 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.532+0000 7f0f775cd640 1 Processor -- start 2026-02-17T20:09:48.532 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.532+0000 7f0f775cd640 1 -- start start 2026-02-17T20:09:48.532 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.532+0000 7f0f775cd640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0f70071600 0x7f0f700719e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:48.533 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.532+0000 7f0f775cd640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0f70073910 0x7f0f701347c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:48.533 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.532+0000 7f0f775cd640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f70072940 con 0x7f0f70071f20 2026-02-17T20:09:48.533 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.532+0000 7f0f775cd640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f0f70074220 con 0x7f0f70071600 2026-02-17T20:09:48.533 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.532+0000 7f0f775cd640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f0f70072f40 con 0x7f0f70073910 2026-02-17T20:09:48.533 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.533+0000 7f0f75342640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0f70071600 0x7f0f700719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:48.533 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.533+0000 7f0f74b41640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0f70073910 0x7f0f701347c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:48.533 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.533+0000 7f0f75b43640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7f0f70071f20 0x7f0f70134d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:39584/0 (socket says 10.20.193.123:39584) 2026-02-17T20:09:48.533 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.533+0000 7f0f75b43640 1 -- 10.20.193.123:0/259940739 learned_addr learned my addr 10.20.193.123:0/259940739 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:09:48.533 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.533+0000 7f0f75342640 1 -- 10.20.193.123:0/259940739 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0f70073910 msgr2=0x7f0f701347c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:48.533 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.533+0000 7f0f75342640 1 --2- 10.20.193.123:0/259940739 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0f70073910 0x7f0f701347c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:48.533 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.533+0000 7f0f75342640 1 -- 10.20.193.123:0/259940739 >> v1:10.20.193.123:6789/0 conn(0x7f0f70071f20 legacy=0x7f0f70134d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:48.534 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.533+0000 7f0f75342640 1 -- 10.20.193.123:0/259940739 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f70135410 con 0x7f0f70071600 2026-02-17T20:09:48.534 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.533+0000 7f0f75342640 1 --2- 10.20.193.123:0/259940739 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0f70071600 0x7f0f700719e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0f60009900 tx=0x7f0f6002ede0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18ad501152127486 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:48.534 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.533+0000 7f0f5ffff640 1 -- 10.20.193.123:0/259940739 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f6003c070 con 0x7f0f70071600 2026-02-17T20:09:48.534 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.533+0000 7f0f5ffff640 1 -- 10.20.193.123:0/259940739 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f6002fa10 con 0x7f0f70071600 2026-02-17T20:09:48.534 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.533+0000 7f0f5ffff640 1 -- 10.20.193.123:0/259940739 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f6002fde0 con 0x7f0f70071600 2026-02-17T20:09:48.534 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.533+0000 7f0f775cd640 1 -- 10.20.193.123:0/259940739 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0f70071600 msgr2=0x7f0f700719e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:48.534 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.533+0000 7f0f775cd640 1 --2- 10.20.193.123:0/259940739 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0f70071600 0x7f0f700719e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0f60009900 tx=0x7f0f6002ede0 comp rx=0 tx=0).stop 2026-02-17T20:09:48.534 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.533+0000 7f0f775cd640 1 -- 10.20.193.123:0/259940739 shutdown_connections 2026-02-17T20:09:48.534 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.533+0000 7f0f775cd640 1 --2- 10.20.193.123:0/259940739 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0f70073910 0x7f0f701347c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:48.534 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.533+0000 7f0f775cd640 1 --2- 10.20.193.123:0/259940739 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0f70071600 0x7f0f700719e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:48.534 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.533+0000 7f0f775cd640 1 -- 10.20.193.123:0/259940739 >> 10.20.193.123:0/259940739 conn(0x7f0f7009d6c0 msgr2=0x7f0f7009dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:48.534 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.533+0000 7f0f775cd640 1 -- 10.20.193.123:0/259940739 shutdown_connections 2026-02-17T20:09:48.535 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.533+0000 7f0f775cd640 1 -- 10.20.193.123:0/259940739 wait complete. 2026-02-17T20:09:48.535 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.534+0000 7f0f775cd640 1 Processor -- start 2026-02-17T20:09:48.535 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.534+0000 7f0f775cd640 1 -- start start 2026-02-17T20:09:48.535 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.534+0000 7f0f775cd640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0f70071600 0x7f0f70135870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:48.535 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.534+0000 7f0f775cd640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0f70071f20 0x7f0f70135db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:48.535 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.534+0000 7f0f775cd640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0f70073910 0x7f0f701362f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:48.535 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.534+0000 7f0f775cd640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0f7013ce90 con 0x7f0f70071600 2026-02-17T20:09:48.535 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.534+0000 7f0f775cd640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f0f7013cd10 con 0x7f0f70073910 2026-02-17T20:09:48.535 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.534+0000 7f0f775cd640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f0f7013d010 con 0x7f0f70071f20 2026-02-17T20:09:48.535 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.534+0000 7f0f75342640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0f70071600 0x7f0f70135870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:48.535 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.534+0000 7f0f74b41640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0f70071f20 0x7f0f70135db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:48.535 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.534+0000 7f0f75b43640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0f70073910 0x7f0f701362f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:48.536 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.534+0000 7f0f75342640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0f70071600 0x7f0f70135870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:47788/0 (socket says 10.20.193.123:47788) 2026-02-17T20:09:48.536 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.534+0000 7f0f75342640 1 -- 10.20.193.123:0/1094422543 learned_addr learned my addr 10.20.193.123:0/1094422543 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:48.536 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.534+0000 7f0f74b41640 1 -- 10.20.193.123:0/1094422543 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0f70073910 msgr2=0x7f0f701362f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:48.536 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.534+0000 7f0f74b41640 1 --2- 10.20.193.123:0/1094422543 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0f70073910 0x7f0f701362f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:48.536 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.534+0000 7f0f74b41640 1 -- 10.20.193.123:0/1094422543 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0f70071600 msgr2=0x7f0f70135870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:48.536 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.534+0000 7f0f74b41640 1 --2- 10.20.193.123:0/1094422543 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0f70071600 0x7f0f70135870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:48.536 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.534+0000 7f0f74b41640 1 -- 10.20.193.123:0/1094422543 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f7011acb0 con 0x7f0f70071f20 2026-02-17T20:09:48.536 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.534+0000 7f0f75b43640 1 --2- 10.20.193.123:0/1094422543 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0f70073910 0x7f0f701362f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:48.536 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.534+0000 7f0f75342640 1 --2- 10.20.193.123:0/1094422543 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0f70071600 0x7f0f70135870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:48.536 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.534+0000 7f0f74b41640 1 --2- 10.20.193.123:0/1094422543 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0f70071f20 0x7f0f70135db0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0f6400e980 tx=0x7f0f6400ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:48.536 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.535+0000 7f0f5dffb640 1 -- 10.20.193.123:0/1094422543 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f64017070 con 0x7f0f70071f20 2026-02-17T20:09:48.537 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.535+0000 7f0f5dffb640 1 -- 10.20.193.123:0/1094422543 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f6400c9a0 con 0x7f0f70071f20 2026-02-17T20:09:48.537 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.535+0000 7f0f775cd640 1 -- 10.20.193.123:0/1094422543 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f70137f00 con 0x7f0f70071f20 2026-02-17T20:09:48.537 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.535+0000 7f0f5dffb640 1 -- 10.20.193.123:0/1094422543 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f6400cd90 con 0x7f0f70071f20 2026-02-17T20:09:48.537 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.535+0000 7f0f775cd640 1 -- 10.20.193.123:0/1094422543 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f701d2070 con 0x7f0f70071f20 2026-02-17T20:09:48.537 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.535+0000 7f0f775cd640 1 -- 10.20.193.123:0/1094422543 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f700719e0 con 0x7f0f70071f20 2026-02-17T20:09:48.537 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.535+0000 7f0f5dffb640 1 -- 10.20.193.123:0/1094422543 <== mon.2 v2:10.20.193.123:3302/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f0f64013470 con 0x7f0f70071f20 2026-02-17T20:09:48.537 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.536+0000 7f0f5dffb640 1 -- 10.20.193.123:0/1094422543 <== mon.2 v2:10.20.193.123:3302/0 5 ==== osd_map(30..30 src has 1..30) ==== 3025+0+0 (secure 0 0 0) 0x7f0f640670c0 con 0x7f0f70071f20 2026-02-17T20:09:48.537 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.538+0000 7f0f5dffb640 1 -- 10.20.193.123:0/1094422543 <== mon.2 v2:10.20.193.123:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f0f64021030 con 0x7f0f70071f20 2026-02-17T20:09:48.601 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.605+0000 7f0f775cd640 1 -- 10.20.193.123:0/1094422543 --> v1:10.20.193.123:6800/115662061 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0f70068530 con 0x7f0f4004f7c0 2026-02-17T20:09:48.602 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.606+0000 7f0f5dffb640 1 -- 10.20.193.123:0/1094422543 <== mgr.14107 v1:10.20.193.123:6800/115662061 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31952 (unknown 2965378022 0 605441455) 0x7f0f70068530 con 0x7f0f4004f7c0 2026-02-17T20:09:48.602 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:09:48.604 INFO:teuthology.orchestra.run.trial123.stderr:dumped all 2026-02-17T20:09:48.604 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.607+0000 7f0f775cd640 1 -- 10.20.193.123:0/1094422543 >> v1:10.20.193.123:6800/115662061 conn(0x7f0f4004f7c0 legacy=0x7f0f40051c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:48.604 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.607+0000 7f0f775cd640 1 -- 10.20.193.123:0/1094422543 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0f70071f20 msgr2=0x7f0f70135db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:48.604 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.607+0000 7f0f775cd640 1 --2- 10.20.193.123:0/1094422543 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0f70071f20 0x7f0f70135db0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0f6400e980 tx=0x7f0f6400ee50 comp rx=0 tx=0).stop 2026-02-17T20:09:48.604 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.607+0000 7f0f775cd640 1 -- 10.20.193.123:0/1094422543 shutdown_connections 2026-02-17T20:09:48.604 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.607+0000 7f0f775cd640 1 --2- 10.20.193.123:0/1094422543 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f0f70073910 0x7f0f701362f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:48.604 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.607+0000 7f0f775cd640 1 --2- 10.20.193.123:0/1094422543 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f0f70071f20 0x7f0f70135db0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:48.604 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.607+0000 7f0f775cd640 1 --2- 10.20.193.123:0/1094422543 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f0f70071600 0x7f0f70135870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:48.604 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.607+0000 7f0f775cd640 1 -- 10.20.193.123:0/1094422543 >> 10.20.193.123:0/1094422543 conn(0x7f0f7009d6c0 msgr2=0x7f0f70070800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:48.604 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.607+0000 7f0f775cd640 1 -- 10.20.193.123:0/1094422543 shutdown_connections 2026-02-17T20:09:48.605 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.607+0000 7f0f775cd640 1 -- 10.20.193.123:0/1094422543 wait complete. 2026-02-17T20:09:48.611 INFO:teuthology.orchestra.run.trial123.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2026-02-17T20:09:48.325392+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":115,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":128644,"kb_used_data":2128,"kb_used_omap":17,"kb_used_meta":126446,"kb_avail":377358716,"statfs":{"total":386547056640,"available":386415325184,"internally_reserved":0,"allocated":2179072,"data_stored":1528789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18186,"internal_metadata":129480950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000775"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-17T20:09:42.637769+0000","last_change":"2026-02-17T20:09:40.389699+0000","last_active":"2026-02-17T20:09:42.637769+0000","last_peered":"2026-02-17T20:09:42.637769+0000","last_clean":"2026-02-17T20:09:42.637769+0000","last_became_active":"2026-02-17T20:09:40.389602+0000","last_became_peered":"2026-02-17T20:09:40.389602+0000","last_unstale":"2026-02-17T20:09:42.637769+0000","last_undegraded":"2026-02-17T20:09:42.637769+0000","last_fullsized":"2026-02-17T20:09:42.637769+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T05:00:57.169209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-17T20:09:44.397270+0000","last_change":"2026-02-17T20:09:40.959635+0000","last_active":"2026-02-17T20:09:44.397270+0000","last_peered":"2026-02-17T20:09:44.397270+0000","last_clean":"2026-02-17T20:09:44.397270+0000","last_became_active":"2026-02-17T20:09:40.959369+0000","last_became_peered":"2026-02-17T20:09:40.959369+0000","last_unstale":"2026-02-17T20:09:44.397270+0000","last_undegraded":"2026-02-17T20:09:44.397270+0000","last_fullsized":"2026-02-17T20:09:44.397270+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:34:32.321476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033416199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-17T20:09:47.172011+0000","last_change":"2026-02-17T20:09:40.389967+0000","last_active":"2026-02-17T20:09:47.172011+0000","last_peered":"2026-02-17T20:09:47.172011+0000","last_clean":"2026-02-17T20:09:47.172011+0000","last_became_active":"2026-02-17T20:09:40.389827+0000","last_became_peered":"2026-02-17T20:09:40.389827+0000","last_unstale":"2026-02-17T20:09:47.172011+0000","last_undegraded":"2026-02-17T20:09:47.172011+0000","last_fullsized":"2026-02-17T20:09:47.172011+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T07:39:21.099659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026693600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-17T20:09:44.397241+0000","last_change":"2026-02-17T20:09:40.959612+0000","last_active":"2026-02-17T20:09:44.397241+0000","last_peered":"2026-02-17T20:09:44.397241+0000","last_clean":"2026-02-17T20:09:44.397241+0000","last_became_active":"2026-02-17T20:09:40.959406+0000","last_became_peered":"2026-02-17T20:09:40.959406+0000","last_unstale":"2026-02-17T20:09:44.397241+0000","last_undegraded":"2026-02-17T20:09:44.397241+0000","last_fullsized":"2026-02-17T20:09:44.397241+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T06:06:40.610646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000242539,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"17'79","reported_seq":153,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-17T20:09:44.397310+0000","last_change":"2026-02-17T20:09:40.389898+0000","last_active":"2026-02-17T20:09:44.397310+0000","last_peered":"2026-02-17T20:09:44.397310+0000","last_clean":"2026-02-17T20:09:44.397310+0000","last_became_active":"2026-02-17T20:09:40.389750+0000","last_became_peered":"2026-02-17T20:09:40.389750+0000","last_unstale":"2026-02-17T20:09:44.397310+0000","last_undegraded":"2026-02-17T20:09:44.397310+0000","last_fullsized":"2026-02-17T20:09:44.397310+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:28.678564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:28.678564+0000","last_clean_scrub_stamp":"2026-02-17T20:08:28.678564+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T00:37:14.734978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"11'1","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-17T20:09:42.637765+0000","last_change":"2026-02-17T20:09:39.388699+0000","last_active":"2026-02-17T20:09:42.637765+0000","last_peered":"2026-02-17T20:09:42.637765+0000","last_clean":"2026-02-17T20:09:42.637765+0000","last_became_active":"2026-02-17T20:09:39.388484+0000","last_became_peered":"2026-02-17T20:09:39.388484+0000","last_unstale":"2026-02-17T20:09:42.637765+0000","last_undegraded":"2026-02-17T20:09:42.637765+0000","last_fullsized":"2026-02-17T20:09:42.637765+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T02:45:47.622204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000198235,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"13'2","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-17T20:09:44.397065+0000","last_change":"2026-02-17T20:09:38.388175+0000","last_active":"2026-02-17T20:09:44.397065+0000","last_peered":"2026-02-17T20:09:44.397065+0000","last_clean":"2026-02-17T20:09:44.397065+0000","last_became_active":"2026-02-17T20:09:38.388004+0000","last_became_peered":"2026-02-17T20:09:38.388004+0000","last_unstale":"2026-02-17T20:09:44.397065+0000","last_undegraded":"2026-02-17T20:09:44.397065+0000","last_fullsized":"2026-02-17T20:09:44.397065+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:08:31.580414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059736000000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-17T20:09:44.397243+0000","last_change":"2026-02-17T20:09:40.959406+0000","last_active":"2026-02-17T20:09:44.397243+0000","last_peered":"2026-02-17T20:09:44.397243+0000","last_clean":"2026-02-17T20:09:44.397243+0000","last_became_active":"2026-02-17T20:09:40.959125+0000","last_became_peered":"2026-02-17T20:09:40.959125+0000","last_unstale":"2026-02-17T20:09:44.397243+0000","last_undegraded":"2026-02-17T20:09:44.397243+0000","last_fullsized":"2026-02-17T20:09:44.397243+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T01:49:16.320239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00023917200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-17T20:09:42.637776+0000","last_change":"2026-02-17T20:09:38.387850+0000","last_active":"2026-02-17T20:09:42.637776+0000","last_peered":"2026-02-17T20:09:42.637776+0000","last_clean":"2026-02-17T20:09:42.637776+0000","last_became_active":"2026-02-17T20:09:38.387688+0000","last_became_peered":"2026-02-17T20:09:38.387688+0000","last_unstale":"2026-02-17T20:09:42.637776+0000","last_undegraded":"2026-02-17T20:09:42.637776+0000","last_fullsized":"2026-02-17T20:09:42.637776+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T06:48:35.959788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000175532,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":26,"seq":111669149699,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32456,"kb_used_data":828,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339384,"statfs":{"total":96636764160,"available":96603529216,"internally_reserved":0,"allocated":847872,"data_stored":680349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4547,"internal_metadata":32370237},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":25,"seq":107374182404,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31864,"kb_used_data":236,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339976,"statfs":{"total":96636764160,"available":96604135424,"internally_reserved":0,"allocated":241664,"data_stored":85808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4547,"internal_metadata":32370237},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":24,"seq":103079215108,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32440,"kb_used_data":812,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":831488,"data_stored":672632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4546,"internal_metadata":32370238},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":23,"seq":98784247812,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31884,"kb_used_data":252,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339956,"statfs":{"total":96636764160,"available":96604114944,"internally_reserved":0,"allocated":258048,"data_stored":90000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4546,"internal_metadata":32370238},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T20:09:48.613 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T20:09:48.684 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.683+0000 7f87bb974640 1 Processor -- start 2026-02-17T20:09:48.684 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.683+0000 7f87bb974640 1 -- start start 2026-02-17T20:09:48.684 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.684+0000 7f87bb974640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f87b412e2b0 0x7f87b412e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:48.684 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.684+0000 7f87bb974640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f87b4072f00 0x7f87b4073390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:48.684 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.684+0000 7f87bb974640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87b41163f0 con 0x7f87b40738d0 2026-02-17T20:09:48.684 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.684+0000 7f87bb974640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7f87b4125080 con 0x7f87b412e2b0 2026-02-17T20:09:48.684 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.684+0000 7f87bb974640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f87b412de60 con 0x7f87b4072f00 2026-02-17T20:09:48.685 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.684+0000 7f87b96e9640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f87b412e2b0 0x7f87b412e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:48.685 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.684+0000 7f87b9eea640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7f87b40738d0 0x7f87b4135150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:39594/0 (socket says 10.20.193.123:39594) 2026-02-17T20:09:48.685 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.684+0000 7f87b9eea640 1 -- 10.20.193.123:0/3282549974 learned_addr learned my addr 10.20.193.123:0/3282549974 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:09:48.685 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.684+0000 7f87b8ee8640 1 --2- 10.20.193.123:0/3282549974 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f87b4072f00 0x7f87b4073390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:48.685 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.684+0000 7f87b96e9640 1 -- 10.20.193.123:0/3282549974 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f87b4072f00 msgr2=0x7f87b4073390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:48.685 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.684+0000 7f87b96e9640 1 --2- 10.20.193.123:0/3282549974 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f87b4072f00 0x7f87b4073390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:48.685 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.684+0000 7f87b96e9640 1 -- 10.20.193.123:0/3282549974 >> v1:10.20.193.123:6789/0 conn(0x7f87b40738d0 legacy=0x7f87b4135150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:48.685 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.684+0000 7f87a3fff640 1 -- 10.20.193.123:0/3282549974 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 499669534 0 0) 0x7f87b41163f0 con 0x7f87b40738d0 2026-02-17T20:09:48.685 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.684+0000 7f87b96e9640 1 -- 10.20.193.123:0/3282549974 --> v2:10.20.193.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87b4073d40 con 0x7f87b412e2b0 2026-02-17T20:09:48.685 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.684+0000 7f87b8ee8640 1 --2- 10.20.193.123:0/3282549974 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f87b4072f00 0x7f87b4073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:48.685 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.684+0000 7f87b96e9640 1 --2- 10.20.193.123:0/3282549974 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f87b412e2b0 0x7f87b412e690 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f87a40098a0 tx=0x7f87a402ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=550cd3eea629ac47 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:48.686 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.685+0000 7f87a3fff640 1 -- 10.20.193.123:0/3282549974 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a403c070 con 0x7f87b412e2b0 2026-02-17T20:09:48.686 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.685+0000 7f87a3fff640 1 -- 10.20.193.123:0/3282549974 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87a402fa40 con 0x7f87b412e2b0 2026-02-17T20:09:48.686 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.685+0000 7f87a3fff640 1 -- 10.20.193.123:0/3282549974 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a402fe10 con 0x7f87b412e2b0 2026-02-17T20:09:48.686 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.685+0000 7f87bb974640 1 -- 10.20.193.123:0/3282549974 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f87b412e2b0 msgr2=0x7f87b412e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:48.686 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.685+0000 7f87bb974640 1 --2- 10.20.193.123:0/3282549974 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f87b412e2b0 0x7f87b412e690 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f87a40098a0 tx=0x7f87a402ed80 comp rx=0 tx=0).stop 2026-02-17T20:09:48.686 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.685+0000 7f87bb974640 1 -- 10.20.193.123:0/3282549974 shutdown_connections 2026-02-17T20:09:48.686 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.685+0000 7f87bb974640 1 --2- 10.20.193.123:0/3282549974 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f87b4072f00 0x7f87b4073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:48.686 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.685+0000 7f87bb974640 1 --2- 10.20.193.123:0/3282549974 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f87b412e2b0 0x7f87b412e690 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:48.686 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.685+0000 7f87bb974640 1 -- 10.20.193.123:0/3282549974 >> 10.20.193.123:0/3282549974 conn(0x7f87b409cb30 msgr2=0x7f87b406f550 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:48.686 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.685+0000 7f87bb974640 1 -- 10.20.193.123:0/3282549974 shutdown_connections 2026-02-17T20:09:48.686 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.685+0000 7f87bb974640 1 -- 10.20.193.123:0/3282549974 wait complete. 2026-02-17T20:09:48.686 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.685+0000 7f87bb974640 1 Processor -- start 2026-02-17T20:09:48.687 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.685+0000 7f87bb974640 1 -- start start 2026-02-17T20:09:48.687 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.686+0000 7f87bb974640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f87b4072f00 0x7f87b4070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:48.687 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.686+0000 7f87bb974640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f87b40738d0 0x7f87b4071420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:48.687 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.686+0000 7f87bb974640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f87b412e2b0 0x7f87b41c6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:48.687 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.686+0000 7f87bb974640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7f87b406e6a0 con 0x7f87b40738d0 2026-02-17T20:09:48.687 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.686+0000 7f87bb974640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f87b4116880 con 0x7f87b412e2b0 2026-02-17T20:09:48.687 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.686+0000 7f87bb974640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f87b406e820 con 0x7f87b4072f00 2026-02-17T20:09:48.687 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.686+0000 7f87b8ee8640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f87b40738d0 0x7f87b4071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:48.687 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.686+0000 7f87b96e9640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f87b4072f00 0x7f87b4070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:48.687 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.686+0000 7f87b8ee8640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f87b40738d0 0x7f87b4071420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:47810/0 (socket says 10.20.193.123:47810) 2026-02-17T20:09:48.687 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.686+0000 7f87b96e9640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f87b4072f00 0x7f87b4070ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:37930/0 (socket says 10.20.193.123:37930) 2026-02-17T20:09:48.687 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.686+0000 7f87b8ee8640 1 -- 10.20.193.123:0/1413697249 learned_addr learned my addr 10.20.193.123:0/1413697249 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:48.688 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.686+0000 7f87b9eea640 1 --2- 10.20.193.123:0/1413697249 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f87b412e2b0 0x7f87b41c6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:48.688 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.686+0000 7f87b8ee8640 1 -- 10.20.193.123:0/1413697249 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f87b4072f00 msgr2=0x7f87b4070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:48.688 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.686+0000 7f87b8ee8640 1 --2- 10.20.193.123:0/1413697249 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f87b4072f00 0x7f87b4070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:48.688 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.686+0000 7f87b8ee8640 1 -- 10.20.193.123:0/1413697249 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f87b412e2b0 msgr2=0x7f87b41c6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:48.688 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.686+0000 7f87b8ee8640 1 --2- 10.20.193.123:0/1413697249 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f87b412e2b0 0x7f87b41c6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:48.688 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.686+0000 7f87b8ee8640 1 -- 10.20.193.123:0/1413697249 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87b4072660 con 0x7f87b40738d0 2026-02-17T20:09:48.688 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.686+0000 7f87b96e9640 1 --2- 10.20.193.123:0/1413697249 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f87b4072f00 0x7f87b4070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:48.688 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.686+0000 7f87b8ee8640 1 --2- 10.20.193.123:0/1413697249 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f87b40738d0 0x7f87b4071420 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f87a800ebe0 tx=0x7f87a800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:48.688 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.686+0000 7f87a1ffb640 1 -- 10.20.193.123:0/1413697249 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a8017070 con 0x7f87b40738d0 2026-02-17T20:09:48.688 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.686+0000 7f87a1ffb640 1 -- 10.20.193.123:0/1413697249 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87a800cbe0 con 0x7f87b40738d0 2026-02-17T20:09:48.688 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.686+0000 7f87bb974640 1 -- 10.20.193.123:0/1413697249 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87b4071960 con 0x7f87b40738d0 2026-02-17T20:09:48.689 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.686+0000 7f87a1ffb640 1 -- 10.20.193.123:0/1413697249 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a8013470 con 0x7f87b40738d0 2026-02-17T20:09:48.689 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.686+0000 7f87bb974640 1 -- 10.20.193.123:0/1413697249 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87b411f120 con 0x7f87b40738d0 2026-02-17T20:09:48.689 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.686+0000 7f87bb974640 1 -- 10.20.193.123:0/1413697249 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87b4073390 con 0x7f87b40738d0 2026-02-17T20:09:48.689 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.687+0000 7f87a1ffb640 1 -- 10.20.193.123:0/1413697249 <== mon.0 v2:10.20.193.123:3300/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f87a8024060 con 0x7f87b40738d0 2026-02-17T20:09:48.689 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.687+0000 7f87a1ffb640 1 -- 10.20.193.123:0/1413697249 <== mon.0 v2:10.20.193.123:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3025+0+0 (secure 0 0 0) 0x7f87a8066a50 con 0x7f87b40738d0 2026-02-17T20:09:48.689 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.689+0000 7f87a1ffb640 1 -- 10.20.193.123:0/1413697249 <== mon.0 v2:10.20.193.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f87a8040840 con 0x7f87b40738d0 2026-02-17T20:09:48.757 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.761+0000 7f87bb974640 1 -- 10.20.193.123:0/1413697249 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f87b4068530 con 0x7f87b40738d0 2026-02-17T20:09:48.757 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.761+0000 7f87a1ffb640 1 -- 10.20.193.123:0/1413697249 <== mon.0 v2:10.20.193.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+9201 (secure 0 0 0) 0x7f87a8065b00 con 0x7f87b40738d0 2026-02-17T20:09:48.758 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:09:48.758 INFO:teuthology.orchestra.run.trial123.stdout:{"epoch":30,"fsid":"ddf342a7-b912-46f2-b373-84d7f3b75be2","created":"2026-02-17T20:08:19.090665+0000","modified":"2026-02-17T20:09:44.394074+0000","last_up_change":"2026-02-17T20:09:39.385739+0000","last_in_change":"2026-02-17T20:08:19.810884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"quincy","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-17T20:08:27.136671+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":13,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2026-02-17T20:08:28.174323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5cfdb97e-5584-42e3-8c32-a9b4ace549f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":17,"up_from":23,"up_thru":24,"down_at":18,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6801","nonce":458007068}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6802","nonce":458007068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6804","nonce":458007068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6803","nonce":458007068}]},"public_addr":"10.20.193.123:6801/458007068","cluster_addr":"10.20.193.123:6802/458007068","heartbeat_back_addr":"10.20.193.123:6804/458007068","heartbeat_front_addr":"10.20.193.123:6803/458007068","state":["exists","up"]},{"osd":1,"uuid":"9b7f5906-8ae8-4a34-8e71-1ba7cf3eeda1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":18,"up_from":24,"up_thru":26,"down_at":19,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6805","nonce":2594724968}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6806","nonce":2594724968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6808","nonce":2594724968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6807","nonce":2594724968}]},"public_addr":"10.20.193.123:6805/2594724968","cluster_addr":"10.20.193.123:6806/2594724968","heartbeat_back_addr":"10.20.193.123:6808/2594724968","heartbeat_front_addr":"10.20.193.123:6807/2594724968","state":["exists","up"]},{"osd":2,"uuid":"db6be5e2-fdd2-460f-bf35-269d92577824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":18,"up_from":25,"up_thru":26,"down_at":20,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6809","nonce":3596569166}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6810","nonce":3596569166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6812","nonce":3596569166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6811","nonce":3596569166}]},"public_addr":"10.20.193.123:6809/3596569166","cluster_addr":"10.20.193.123:6810/3596569166","heartbeat_back_addr":"10.20.193.123:6812/3596569166","heartbeat_front_addr":"10.20.193.123:6811/3596569166","state":["exists","up"]},{"osd":3,"uuid":"23275d01-0d57-497c-a600-d9aeef747af2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":20,"up_from":26,"up_thru":26,"down_at":21,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6813","nonce":2610635322}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6814","nonce":2610635322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6816","nonce":2610635322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.123:6815","nonce":2610635322}]},"public_addr":"10.20.193.123:6813/2610635322","cluster_addr":"10.20.193.123:6814/2610635322","heartbeat_back_addr":"10.20.193.123:6816/2610635322","heartbeat_front_addr":"10.20.193.123:6815/2610635322","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:08:24.897268+0000","dead_epoch":18},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:08:24.890530+0000","dead_epoch":19},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:08:24.941602+0000","dead_epoch":20},{"osd":3,"down_stamp":"2026-02-17T20:09:31.377910+0000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:08:24.897001+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.123:0/3994607579":"2026-02-18T20:09:24.315453+0000","10.20.193.123:0/1995254470":"2026-02-18T20:09:24.315453+0000","10.20.193.123:0/2996849897":"2026-02-18T20:09:24.315453+0000","10.20.193.123:6800/23720":"2026-02-18T20:09:24.315453+0000","10.20.193.123:0/1130446084":"2026-02-18T20:09:24.315453+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T20:09:48.759 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.762+0000 7f87bb974640 1 -- 10.20.193.123:0/1413697249 >> v1:10.20.193.123:6800/115662061 conn(0x7f878404f790 legacy=0x7f8784051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:48.759 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.762+0000 7f87bb974640 1 -- 10.20.193.123:0/1413697249 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f87b40738d0 msgr2=0x7f87b4071420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:48.759 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.762+0000 7f87bb974640 1 --2- 10.20.193.123:0/1413697249 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f87b40738d0 0x7f87b4071420 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f87a800ebe0 tx=0x7f87a800c520 comp rx=0 tx=0).stop 2026-02-17T20:09:48.759 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.762+0000 7f87bb974640 1 -- 10.20.193.123:0/1413697249 shutdown_connections 2026-02-17T20:09:48.759 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.762+0000 7f87bb974640 1 --2- 10.20.193.123:0/1413697249 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f87b412e2b0 0x7f87b41c6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:48.760 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.762+0000 7f87bb974640 1 --2- 10.20.193.123:0/1413697249 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f87b40738d0 0x7f87b4071420 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:48.760 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.762+0000 7f87bb974640 1 --2- 10.20.193.123:0/1413697249 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f87b4072f00 0x7f87b4070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:48.760 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.762+0000 7f87bb974640 1 -- 10.20.193.123:0/1413697249 >> 10.20.193.123:0/1413697249 conn(0x7f87b409cb30 msgr2=0x7f87b409e330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:48.760 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.762+0000 7f87bb974640 1 -- 10.20.193.123:0/1413697249 shutdown_connections 2026-02-17T20:09:48.760 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:48.762+0000 7f87bb974640 1 -- 10.20.193.123:0/1413697249 wait complete. 2026-02-17T20:09:49.767 INFO:tasks.ceph:Scrubbing osd.0 2026-02-17T20:09:49.767 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-17T20:09:49.844 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.843+0000 7f8efad7b640 1 Processor -- start 2026-02-17T20:09:49.844 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.843+0000 7f8efad7b640 1 -- start start 2026-02-17T20:09:49.845 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.843+0000 7f8efad7b640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f8ef4131480 0x7f8ef4131860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:49.845 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.843+0000 7f8efad7b640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f8ef4131da0 0x7f8ef41347a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:49.845 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.843+0000 7f8efad7b640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ef40744d0 con 0x7f8ef4134ce0 2026-02-17T20:09:49.845 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.843+0000 7f8efad7b640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7f8ef40747e0 con 0x7f8ef4131480 2026-02-17T20:09:49.845 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.843+0000 7f8efad7b640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f8ef4073610 con 0x7f8ef4131da0 2026-02-17T20:09:49.845 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.843+0000 7f8ef8af0640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f8ef4131480 0x7f8ef4131860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:49.845 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.843+0000 7f8eebfff640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f8ef4131da0 0x7f8ef41347a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:49.845 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.843+0000 7f8ef92f1640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7f8ef4134ce0 0x7f8ef4135130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:39598/0 (socket says 10.20.193.123:39598) 2026-02-17T20:09:49.845 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.843+0000 7f8ef92f1640 1 -- 10.20.193.123:0/1924306498 learned_addr learned my addr 10.20.193.123:0/1924306498 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:09:49.845 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.844+0000 7f8ef8af0640 1 -- 10.20.193.123:0/1924306498 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f8ef4131da0 msgr2=0x7f8ef41347a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:49.846 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.844+0000 7f8ef8af0640 1 --2- 10.20.193.123:0/1924306498 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f8ef4131da0 0x7f8ef41347a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:49.846 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.844+0000 7f8ef8af0640 1 -- 10.20.193.123:0/1924306498 >> v1:10.20.193.123:6789/0 conn(0x7f8ef4134ce0 legacy=0x7f8ef4135130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:49.846 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.844+0000 7f8ef8af0640 1 -- 10.20.193.123:0/1924306498 --> v2:10.20.193.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ef40732f0 con 0x7f8ef4131480 2026-02-17T20:09:49.846 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.844+0000 7f8eeb7fe640 1 -- 10.20.193.123:0/1924306498 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2397915488 0 0) 0x7f8ef40744d0 con 0x7f8ef4134ce0 2026-02-17T20:09:49.846 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.844+0000 7f8eebfff640 1 --2- 10.20.193.123:0/1924306498 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f8ef4131da0 0x7f8ef41347a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:49.846 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.844+0000 7f8ef8af0640 1 --2- 10.20.193.123:0/1924306498 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f8ef4131480 0x7f8ef4131860 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8ee40098a0 tx=0x7f8ee402ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f9f1e0f30621813 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:49.846 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.844+0000 7f8eeb7fe640 1 -- 10.20.193.123:0/1924306498 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ee403c070 con 0x7f8ef4131480 2026-02-17T20:09:49.846 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.844+0000 7f8eeb7fe640 1 -- 10.20.193.123:0/1924306498 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ee402fa30 con 0x7f8ef4131480 2026-02-17T20:09:49.846 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.844+0000 7f8eeb7fe640 1 -- 10.20.193.123:0/1924306498 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ee402fe00 con 0x7f8ef4131480 2026-02-17T20:09:49.846 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.844+0000 7f8efad7b640 1 -- 10.20.193.123:0/1924306498 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f8ef4131480 msgr2=0x7f8ef4131860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:49.846 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.844+0000 7f8efad7b640 1 --2- 10.20.193.123:0/1924306498 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f8ef4131480 0x7f8ef4131860 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8ee40098a0 tx=0x7f8ee402ed20 comp rx=0 tx=0).stop 2026-02-17T20:09:49.846 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.844+0000 7f8efad7b640 1 -- 10.20.193.123:0/1924306498 shutdown_connections 2026-02-17T20:09:49.847 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.844+0000 7f8efad7b640 1 --2- 10.20.193.123:0/1924306498 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f8ef4131da0 0x7f8ef41347a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:49.847 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.844+0000 7f8efad7b640 1 --2- 10.20.193.123:0/1924306498 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f8ef4131480 0x7f8ef4131860 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:49.847 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.844+0000 7f8efad7b640 1 -- 10.20.193.123:0/1924306498 >> 10.20.193.123:0/1924306498 conn(0x7f8ef409d580 msgr2=0x7f8ef409d990 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:49.847 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.844+0000 7f8efad7b640 1 -- 10.20.193.123:0/1924306498 shutdown_connections 2026-02-17T20:09:49.847 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.844+0000 7f8efad7b640 1 -- 10.20.193.123:0/1924306498 wait complete. 2026-02-17T20:09:49.847 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.845+0000 7f8efad7b640 1 Processor -- start 2026-02-17T20:09:49.847 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.845+0000 7f8efad7b640 1 -- start start 2026-02-17T20:09:49.847 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.845+0000 7f8efad7b640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f8ef4131480 0x7f8ef412e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:49.847 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.845+0000 7f8efad7b640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f8ef4131da0 0x7f8ef412e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:49.847 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.845+0000 7f8efad7b640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f8ef4134ce0 0x7f8ef4135890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:49.847 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.845+0000 7f8efad7b640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef413cc60 con 0x7f8ef4131da0 2026-02-17T20:09:49.847 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.845+0000 7f8efad7b640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f8ef413cae0 con 0x7f8ef4131480 2026-02-17T20:09:49.848 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.845+0000 7f8efad7b640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f8ef413cde0 con 0x7f8ef4134ce0 2026-02-17T20:09:49.848 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.845+0000 7f8eebfff640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f8ef4131da0 0x7f8ef412e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:49.848 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.845+0000 7f8eebfff640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f8ef4131da0 0x7f8ef412e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:47818/0 (socket says 10.20.193.123:47818) 2026-02-17T20:09:49.848 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.845+0000 7f8ef92f1640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f8ef4134ce0 0x7f8ef4135890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:49.848 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.845+0000 7f8ef8af0640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f8ef4131480 0x7f8ef412e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:49.848 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.845+0000 7f8eebfff640 1 -- 10.20.193.123:0/891215631 learned_addr learned my addr 10.20.193.123:0/891215631 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:49.848 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.845+0000 7f8eebfff640 1 -- 10.20.193.123:0/891215631 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f8ef4134ce0 msgr2=0x7f8ef4135890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:49.848 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.845+0000 7f8eebfff640 1 --2- 10.20.193.123:0/891215631 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f8ef4134ce0 0x7f8ef4135890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:49.848 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.845+0000 7f8eebfff640 1 -- 10.20.193.123:0/891215631 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f8ef4131480 msgr2=0x7f8ef412e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:49.848 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.845+0000 7f8eebfff640 1 --2- 10.20.193.123:0/891215631 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f8ef4131480 0x7f8ef412e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:49.848 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.845+0000 7f8eebfff640 1 -- 10.20.193.123:0/891215631 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ef4136ff0 con 0x7f8ef4131da0 2026-02-17T20:09:49.848 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.845+0000 7f8ef92f1640 1 --2- 10.20.193.123:0/891215631 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f8ef4134ce0 0x7f8ef4135890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:49.849 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.845+0000 7f8eebfff640 1 --2- 10.20.193.123:0/891215631 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f8ef4131da0 0x7f8ef412e7a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8edc00ec10 tx=0x7f8edc00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:49.849 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.846+0000 7f8ee97fa640 1 -- 10.20.193.123:0/891215631 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8edc017070 con 0x7f8ef4131da0 2026-02-17T20:09:49.849 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.846+0000 7f8ee97fa640 1 -- 10.20.193.123:0/891215631 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8edc00cc40 con 0x7f8ef4131da0 2026-02-17T20:09:49.849 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.846+0000 7f8efad7b640 1 -- 10.20.193.123:0/891215631 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ef4137720 con 0x7f8ef4131da0 2026-02-17T20:09:49.849 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.846+0000 7f8ee97fa640 1 -- 10.20.193.123:0/891215631 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8edc013470 con 0x7f8ef4131da0 2026-02-17T20:09:49.849 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.846+0000 7f8efad7b640 1 -- 10.20.193.123:0/891215631 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ef4138190 con 0x7f8ef4131da0 2026-02-17T20:09:49.849 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.846+0000 7f8efad7b640 1 -- 10.20.193.123:0/891215631 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8ef4138420 con 0x7f8ef4131da0 2026-02-17T20:09:49.849 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.846+0000 7f8ee97fa640 1 -- 10.20.193.123:0/891215631 <== mon.0 v2:10.20.193.123:3300/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f8edc024060 con 0x7f8ef4131da0 2026-02-17T20:09:49.849 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.846+0000 7f8ee97fa640 1 -- 10.20.193.123:0/891215631 <== mon.0 v2:10.20.193.123:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3025+0+0 (secure 0 0 0) 0x7f8edc066b10 con 0x7f8ef4131da0 2026-02-17T20:09:49.849 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.847+0000 7f8ee97fa640 1 -- 10.20.193.123:0/891215631 --> v1:10.20.193.123:6801/458007068 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8edc01ee50 con 0x7f8ec4056080 2026-02-17T20:09:49.849 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.847+0000 7f8ee97fa640 1 -- 10.20.193.123:0/891215631 <== mon.0 v2:10.20.193.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8edc06b2c0 con 0x7f8ef4131da0 2026-02-17T20:09:49.850 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.847+0000 7f8ee97fa640 1 -- 10.20.193.123:0/891215631 <== osd.0 v1:10.20.193.123:6801/458007068 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7f8edc01ee50 con 0x7f8ec4056080 2026-02-17T20:09:49.850 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.853+0000 7f8efad7b640 1 -- 10.20.193.123:0/891215631 --> v1:10.20.193.123:6801/458007068 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8ef4136020 con 0x7f8ec4056080 2026-02-17T20:09:49.850 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.853+0000 7f8ee97fa640 1 -- 10.20.193.123:0/891215631 <== osd.0 v1:10.20.193.123:6801/458007068 2 ==== command_reply(tid 2: 0 ) ==== 8+0+712 (unknown 0 0 714369635) 0x7f8ef4136020 con 0x7f8ec4056080 2026-02-17T20:09:49.851 INFO:teuthology.orchestra.run.trial123.stdout:{ 2026-02-17T20:09:49.851 INFO:teuthology.orchestra.run.trial123.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-17T20:09:49.851 INFO:teuthology.orchestra.run.trial123.stdout:} 2026-02-17T20:09:49.852 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.853+0000 7f8efad7b640 1 -- 10.20.193.123:0/891215631 >> v1:10.20.193.123:6801/458007068 conn(0x7f8ec4056080 legacy=0x7f8ec40584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:49.852 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.853+0000 7f8efad7b640 1 -- 10.20.193.123:0/891215631 >> v1:10.20.193.123:6800/115662061 conn(0x7f8ec404f790 legacy=0x7f8ec4051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:49.852 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.853+0000 7f8efad7b640 1 -- 10.20.193.123:0/891215631 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f8ef4131da0 msgr2=0x7f8ef412e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:49.852 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.853+0000 7f8efad7b640 1 --2- 10.20.193.123:0/891215631 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f8ef4131da0 0x7f8ef412e7a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8edc00ec10 tx=0x7f8edc00c520 comp rx=0 tx=0).stop 2026-02-17T20:09:49.853 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.853+0000 7f8ef92f1640 1 -- 10.20.193.123:0/891215631 reap_dead start 2026-02-17T20:09:49.853 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.853+0000 7f8efad7b640 1 -- 10.20.193.123:0/891215631 shutdown_connections 2026-02-17T20:09:49.853 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.853+0000 7f8efad7b640 1 -- 10.20.193.123:0/891215631 >> 10.20.193.123:0/891215631 conn(0x7f8ef409d580 msgr2=0x7f8ef4070e60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:49.853 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.853+0000 7f8efad7b640 1 -- 10.20.193.123:0/891215631 shutdown_connections 2026-02-17T20:09:49.853 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.853+0000 7f8efad7b640 1 -- 10.20.193.123:0/891215631 wait complete. 2026-02-17T20:09:49.855 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-17T20:09:49.928 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.927+0000 7fa5f06a9640 1 Processor -- start 2026-02-17T20:09:49.928 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.927+0000 7fa5f06a9640 1 -- start start 2026-02-17T20:09:49.929 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.927+0000 7fa5f06a9640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fa5e81335b0 0x7fa5e81359a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:49.929 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.927+0000 7fa5f06a9640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fa5e8135ee0 0x7fa5e81382d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:49.929 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.927+0000 7fa5f06a9640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5e81310f0 con 0x7fa5e8130600 2026-02-17T20:09:49.929 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.927+0000 7fa5f06a9640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7fa5e8130240 con 0x7fa5e8135ee0 2026-02-17T20:09:49.929 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.927+0000 7fa5f06a9640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7fa5e809f550 con 0x7fa5e81335b0 2026-02-17T20:09:49.929 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.927+0000 7fa5ee41e640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7fa5e8130600 0x7fa5e81309e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:39600/0 (socket says 10.20.193.123:39600) 2026-02-17T20:09:49.929 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.927+0000 7fa5ee41e640 1 -- 10.20.193.123:0/2213497765 learned_addr learned my addr 10.20.193.123:0/2213497765 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:09:49.929 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.927+0000 7fa5edc1d640 1 --2- 10.20.193.123:0/2213497765 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fa5e81335b0 0x7fa5e81359a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:49.929 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.927+0000 7fa5eec1f640 1 --2- 10.20.193.123:0/2213497765 >> v2:10.20.193.123:3300/0 conn(0x7fa5e8135ee0 0x7fa5e81382d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:49.930 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.927+0000 7fa5edc1d640 1 -- 10.20.193.123:0/2213497765 >> v2:10.20.193.123:3300/0 conn(0x7fa5e8135ee0 msgr2=0x7fa5e81382d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:49.930 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.927+0000 7fa5edc1d640 1 --2- 10.20.193.123:0/2213497765 >> v2:10.20.193.123:3300/0 conn(0x7fa5e8135ee0 0x7fa5e81382d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:49.930 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.927+0000 7fa5ed41c640 1 -- 10.20.193.123:0/2213497765 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3590908337 0 0) 0x7fa5e81310f0 con 0x7fa5e8130600 2026-02-17T20:09:49.930 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.927+0000 7fa5edc1d640 1 -- 10.20.193.123:0/2213497765 >> v1:10.20.193.123:6789/0 conn(0x7fa5e8130600 legacy=0x7fa5e81309e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:49.930 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.927+0000 7fa5edc1d640 1 -- 10.20.193.123:0/2213497765 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5e8071c80 con 0x7fa5e81335b0 2026-02-17T20:09:49.930 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.928+0000 7fa5edc1d640 1 --2- 10.20.193.123:0/2213497765 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fa5e81335b0 0x7fa5e81359a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc0098a0 tx=0x7fa5dc02ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9cbcf0e37de47894 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:49.930 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.928+0000 7fa5ed41c640 1 -- 10.20.193.123:0/2213497765 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc03c070 con 0x7fa5e81335b0 2026-02-17T20:09:49.930 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.928+0000 7fa5ed41c640 1 -- 10.20.193.123:0/2213497765 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5dc02fa40 con 0x7fa5e81335b0 2026-02-17T20:09:49.930 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.928+0000 7fa5ed41c640 1 -- 10.20.193.123:0/2213497765 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc02fe10 con 0x7fa5e81335b0 2026-02-17T20:09:49.930 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.928+0000 7fa5f06a9640 1 -- 10.20.193.123:0/2213497765 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fa5e81335b0 msgr2=0x7fa5e81359a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:49.931 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.928+0000 7fa5f06a9640 1 --2- 10.20.193.123:0/2213497765 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fa5e81335b0 0x7fa5e81359a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc0098a0 tx=0x7fa5dc02ed80 comp rx=0 tx=0).stop 2026-02-17T20:09:49.931 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.928+0000 7fa5f06a9640 1 -- 10.20.193.123:0/2213497765 shutdown_connections 2026-02-17T20:09:49.931 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.928+0000 7fa5f06a9640 1 --2- 10.20.193.123:0/2213497765 >> v2:10.20.193.123:3300/0 conn(0x7fa5e8135ee0 0x7fa5e81382d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:49.931 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.928+0000 7fa5f06a9640 1 --2- 10.20.193.123:0/2213497765 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fa5e81335b0 0x7fa5e81359a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:49.931 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.928+0000 7fa5f06a9640 1 -- 10.20.193.123:0/2213497765 >> 10.20.193.123:0/2213497765 conn(0x7fa5e809e7c0 msgr2=0x7fa5e809ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:49.931 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.928+0000 7fa5f06a9640 1 -- 10.20.193.123:0/2213497765 shutdown_connections 2026-02-17T20:09:49.931 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.928+0000 7fa5f06a9640 1 -- 10.20.193.123:0/2213497765 wait complete. 2026-02-17T20:09:49.931 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.929+0000 7fa5f06a9640 1 Processor -- start 2026-02-17T20:09:49.931 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.929+0000 7fa5f06a9640 1 -- start start 2026-02-17T20:09:49.931 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.929+0000 7fa5f06a9640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fa5e8130600 0x7fa5e812a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:49.931 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.929+0000 7fa5f06a9640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fa5e81335b0 0x7fa5e812aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:49.932 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.929+0000 7fa5f06a9640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fa5e8135ee0 0x7fa5e812b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:49.932 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.929+0000 7fa5f06a9640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa5e8138810 con 0x7fa5e81335b0 2026-02-17T20:09:49.932 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.929+0000 7fa5f06a9640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7fa5e8116cc0 con 0x7fa5e8135ee0 2026-02-17T20:09:49.932 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.929+0000 7fa5f06a9640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7fa5e8138990 con 0x7fa5e8130600 2026-02-17T20:09:49.932 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.929+0000 7fa5ee41e640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fa5e8130600 0x7fa5e812a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:49.932 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.929+0000 7fa5edc1d640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fa5e81335b0 0x7fa5e812aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:49.932 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.929+0000 7fa5ee41e640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fa5e8130600 0x7fa5e812a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:37978/0 (socket says 10.20.193.123:37978) 2026-02-17T20:09:49.932 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.929+0000 7fa5edc1d640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fa5e81335b0 0x7fa5e812aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:47836/0 (socket says 10.20.193.123:47836) 2026-02-17T20:09:49.932 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.929+0000 7fa5ee41e640 1 -- 10.20.193.123:0/3460828149 learned_addr learned my addr 10.20.193.123:0/3460828149 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:49.932 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.929+0000 7fa5eec1f640 1 --2- 10.20.193.123:0/3460828149 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fa5e8135ee0 0x7fa5e812b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:49.932 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.929+0000 7fa5ee41e640 1 -- 10.20.193.123:0/3460828149 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fa5e8135ee0 msgr2=0x7fa5e812b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:49.933 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.929+0000 7fa5ee41e640 1 --2- 10.20.193.123:0/3460828149 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fa5e8135ee0 0x7fa5e812b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:49.933 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.929+0000 7fa5ee41e640 1 -- 10.20.193.123:0/3460828149 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fa5e81335b0 msgr2=0x7fa5e812aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:49.933 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.929+0000 7fa5ee41e640 1 --2- 10.20.193.123:0/3460828149 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fa5e81335b0 0x7fa5e812aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:49.933 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.929+0000 7fa5ee41e640 1 -- 10.20.193.123:0/3460828149 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5e812d430 con 0x7fa5e8130600 2026-02-17T20:09:49.933 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.929+0000 7fa5edc1d640 1 --2- 10.20.193.123:0/3460828149 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fa5e81335b0 0x7fa5e812aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:49.933 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.929+0000 7fa5ee41e640 1 --2- 10.20.193.123:0/3460828149 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fa5e8130600 0x7fa5e812a990 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa5d800c700 tx=0x7fa5d800cbd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:49.933 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.930+0000 7fa5ceffd640 1 -- 10.20.193.123:0/3460828149 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d8018070 con 0x7fa5e8130600 2026-02-17T20:09:49.933 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.930+0000 7fa5ceffd640 1 -- 10.20.193.123:0/3460828149 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5d8004ae0 con 0x7fa5e8130600 2026-02-17T20:09:49.933 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.930+0000 7fa5f06a9640 1 -- 10.20.193.123:0/3460828149 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5e812b950 con 0x7fa5e8130600 2026-02-17T20:09:49.933 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.930+0000 7fa5ceffd640 1 -- 10.20.193.123:0/3460828149 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d80070d0 con 0x7fa5e8130600 2026-02-17T20:09:49.934 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.930+0000 7fa5f06a9640 1 -- 10.20.193.123:0/3460828149 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5e812c830 con 0x7fa5e8130600 2026-02-17T20:09:49.934 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.930+0000 7fa5f06a9640 1 -- 10.20.193.123:0/3460828149 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5e812d090 con 0x7fa5e8130600 2026-02-17T20:09:49.934 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.930+0000 7fa5ceffd640 1 -- 10.20.193.123:0/3460828149 <== mon.2 v2:10.20.193.123:3302/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7fa5d8007270 con 0x7fa5e8130600 2026-02-17T20:09:49.934 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.931+0000 7fa5ceffd640 1 -- 10.20.193.123:0/3460828149 <== mon.2 v2:10.20.193.123:3302/0 5 ==== osd_map(30..30 src has 1..30) ==== 3025+0+0 (secure 0 0 0) 0x7fa5d8066190 con 0x7fa5e8130600 2026-02-17T20:09:49.934 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:49.932+0000 7fa5ceffd640 1 -- 10.20.193.123:0/3460828149 <== mon.2 v2:10.20.193.123:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7fa5e812d090 con 0x7fa5e8130600 2026-02-17T20:09:49.998 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.001+0000 7fa5f06a9640 1 -- 10.20.193.123:0/3460828149 --> v1:10.20.193.123:6800/115662061 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fa5e81309e0 con 0x7fa5b804f790 2026-02-17T20:09:49.998 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.001+0000 7fa5ceffd640 1 -- 10.20.193.123:0/3460828149 <== mgr.14107 v1:10.20.193.123:6800/115662061 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (unknown 2057319476 0 0) 0x7fa5e81309e0 con 0x7fa5b804f790 2026-02-17T20:09:49.998 INFO:teuthology.orchestra.run.trial123.stderr:instructed osd(s) 0 to deep-scrub 2026-02-17T20:09:49.999 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.002+0000 7fa5f06a9640 1 -- 10.20.193.123:0/3460828149 >> v1:10.20.193.123:6800/115662061 conn(0x7fa5b804f790 legacy=0x7fa5b8051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:50.000 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.002+0000 7fa5f06a9640 1 -- 10.20.193.123:0/3460828149 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fa5e8130600 msgr2=0x7fa5e812a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:50.000 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.002+0000 7fa5f06a9640 1 --2- 10.20.193.123:0/3460828149 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fa5e8130600 0x7fa5e812a990 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa5d800c700 tx=0x7fa5d800cbd0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.000 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.002+0000 7fa5f06a9640 1 -- 10.20.193.123:0/3460828149 shutdown_connections 2026-02-17T20:09:50.000 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.002+0000 7fa5f06a9640 1 --2- 10.20.193.123:0/3460828149 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fa5e8135ee0 0x7fa5e812b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.000 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.002+0000 7fa5f06a9640 1 --2- 10.20.193.123:0/3460828149 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fa5e81335b0 0x7fa5e812aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.000 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.002+0000 7fa5f06a9640 1 --2- 10.20.193.123:0/3460828149 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fa5e8130600 0x7fa5e812a990 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.000 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.002+0000 7fa5f06a9640 1 -- 10.20.193.123:0/3460828149 >> 10.20.193.123:0/3460828149 conn(0x7fa5e809e7c0 msgr2=0x7fa5e8133990 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:50.000 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.002+0000 7fa5f06a9640 1 -- 10.20.193.123:0/3460828149 shutdown_connections 2026-02-17T20:09:50.000 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.002+0000 7fa5f06a9640 1 -- 10.20.193.123:0/3460828149 wait complete. 2026-02-17T20:09:50.006 INFO:tasks.ceph:Scrubbing osd.1 2026-02-17T20:09:50.006 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-17T20:09:50.075 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.079+0000 7f61e2298640 1 Processor -- start 2026-02-17T20:09:50.075 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.079+0000 7f61e2298640 1 -- start start 2026-02-17T20:09:50.076 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.079+0000 7f61e2298640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f61dc131480 0x7f61dc131860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:50.076 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.079+0000 7f61e2298640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f61dc131da0 0x7f61dc1347a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:50.076 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.079+0000 7f61e2298640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61dc0744d0 con 0x7f61dc134ce0 2026-02-17T20:09:50.076 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.079+0000 7f61e2298640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f61dc0747e0 con 0x7f61dc131480 2026-02-17T20:09:50.076 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.079+0000 7f61e2298640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f61dc073610 con 0x7f61dc131da0 2026-02-17T20:09:50.076 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.079+0000 7f61dbfff640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f61dc131480 0x7f61dc131860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:50.076 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.079+0000 7f61db7fe640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f61dc131da0 0x7f61dc1347a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:50.076 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.079+0000 7f61e080e640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7f61dc134ce0 0x7f61dc13bad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:39608/0 (socket says 10.20.193.123:39608) 2026-02-17T20:09:50.076 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.079+0000 7f61db7fe640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f61dc131da0 0x7f61dc1347a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:37982/0 (socket says 10.20.193.123:37982) 2026-02-17T20:09:50.076 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.079+0000 7f61e080e640 1 -- 10.20.193.123:0/3890565092 learned_addr learned my addr 10.20.193.123:0/3890565092 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:09:50.076 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.080+0000 7f61db7fe640 1 -- 10.20.193.123:0/3890565092 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f61dc131480 msgr2=0x7f61dc131860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:50.076 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.080+0000 7f61db7fe640 1 --2- 10.20.193.123:0/3890565092 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f61dc131480 0x7f61dc131860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.076 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.080+0000 7f61db7fe640 1 -- 10.20.193.123:0/3890565092 >> v1:10.20.193.123:6789/0 conn(0x7f61dc134ce0 legacy=0x7f61dc13bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:50.076 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.080+0000 7f61daffd640 1 -- 10.20.193.123:0/3890565092 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4186902372 0 0) 0x7f61dc0744d0 con 0x7f61dc134ce0 2026-02-17T20:09:50.076 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.080+0000 7f61db7fe640 1 -- 10.20.193.123:0/3890565092 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61dc0732f0 con 0x7f61dc131da0 2026-02-17T20:09:50.076 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.080+0000 7f61dbfff640 1 --2- 10.20.193.123:0/3890565092 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f61dc131480 0x7f61dc131860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:50.077 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.080+0000 7f61db7fe640 1 --2- 10.20.193.123:0/3890565092 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f61dc131da0 0x7f61dc1347a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f61cc0098d0 tx=0x7f61cc02edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6810cf9a2f198381 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:50.077 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.080+0000 7f61daffd640 1 -- 10.20.193.123:0/3890565092 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61cc03c070 con 0x7f61dc131da0 2026-02-17T20:09:50.077 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.080+0000 7f61daffd640 1 -- 10.20.193.123:0/3890565092 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61cc02fa30 con 0x7f61dc131da0 2026-02-17T20:09:50.077 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.080+0000 7f61daffd640 1 -- 10.20.193.123:0/3890565092 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61cc02fe00 con 0x7f61dc131da0 2026-02-17T20:09:50.077 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.080+0000 7f61e2298640 1 -- 10.20.193.123:0/3890565092 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f61dc131da0 msgr2=0x7f61dc1347a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:50.077 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.080+0000 7f61e2298640 1 --2- 10.20.193.123:0/3890565092 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f61dc131da0 0x7f61dc1347a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f61cc0098d0 tx=0x7f61cc02edc0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.077 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.080+0000 7f61e2298640 1 -- 10.20.193.123:0/3890565092 shutdown_connections 2026-02-17T20:09:50.077 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.080+0000 7f61e2298640 1 --2- 10.20.193.123:0/3890565092 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f61dc131da0 0x7f61dc1347a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.077 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.080+0000 7f61e2298640 1 --2- 10.20.193.123:0/3890565092 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f61dc131480 0x7f61dc131860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.077 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.080+0000 7f61e2298640 1 -- 10.20.193.123:0/3890565092 >> 10.20.193.123:0/3890565092 conn(0x7f61dc09d580 msgr2=0x7f61dc09d990 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:50.077 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.080+0000 7f61e2298640 1 -- 10.20.193.123:0/3890565092 shutdown_connections 2026-02-17T20:09:50.077 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.080+0000 7f61e2298640 1 -- 10.20.193.123:0/3890565092 wait complete. 2026-02-17T20:09:50.077 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.081+0000 7f61e2298640 1 Processor -- start 2026-02-17T20:09:50.077 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.081+0000 7f61e2298640 1 -- start start 2026-02-17T20:09:50.078 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.081+0000 7f61e2298640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f61dc131480 0x7f61dc123f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:50.078 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.081+0000 7f61e2298640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f61dc131da0 0x7f61dc124490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:50.078 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.081+0000 7f61e2298640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f61dc134ce0 0x7f61dc1249d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:50.078 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.081+0000 7f61e2298640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7f61dc135310 con 0x7f61dc131480 2026-02-17T20:09:50.078 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.081+0000 7f61e2298640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f61dc135190 con 0x7f61dc134ce0 2026-02-17T20:09:50.078 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.081+0000 7f61e2298640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f61dc135490 con 0x7f61dc131da0 2026-02-17T20:09:50.078 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.081+0000 7f61db7fe640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f61dc131da0 0x7f61dc124490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:50.078 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.081+0000 7f61dbfff640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f61dc131480 0x7f61dc123f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:50.078 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.081+0000 7f61db7fe640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f61dc131da0 0x7f61dc124490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:37998/0 (socket says 10.20.193.123:37998) 2026-02-17T20:09:50.078 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.081+0000 7f61db7fe640 1 -- 10.20.193.123:0/1705413887 learned_addr learned my addr 10.20.193.123:0/1705413887 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:50.078 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.081+0000 7f61e080e640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f61dc134ce0 0x7f61dc1249d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:50.078 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.081+0000 7f61db7fe640 1 -- 10.20.193.123:0/1705413887 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f61dc134ce0 msgr2=0x7f61dc1249d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:50.078 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.081+0000 7f61db7fe640 1 --2- 10.20.193.123:0/1705413887 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f61dc134ce0 0x7f61dc1249d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.078 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.081+0000 7f61db7fe640 1 -- 10.20.193.123:0/1705413887 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f61dc131480 msgr2=0x7f61dc123f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:50.078 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.081+0000 7f61db7fe640 1 --2- 10.20.193.123:0/1705413887 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f61dc131480 0x7f61dc123f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.078 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.081+0000 7f61db7fe640 1 -- 10.20.193.123:0/1705413887 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61dc1261c0 con 0x7f61dc131da0 2026-02-17T20:09:50.078 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.081+0000 7f61dbfff640 1 --2- 10.20.193.123:0/1705413887 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f61dc131480 0x7f61dc123f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:50.078 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.081+0000 7f61e080e640 1 --2- 10.20.193.123:0/1705413887 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f61dc134ce0 0x7f61dc1249d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:50.078 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.081+0000 7f61db7fe640 1 --2- 10.20.193.123:0/1705413887 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f61dc131da0 0x7f61dc124490 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f61cc03a040 tx=0x7f61cc0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:50.078 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.082+0000 7f61d8ff9640 1 -- 10.20.193.123:0/1705413887 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61cc03c040 con 0x7f61dc131da0 2026-02-17T20:09:50.078 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.082+0000 7f61d8ff9640 1 -- 10.20.193.123:0/1705413887 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61cc042630 con 0x7f61dc131da0 2026-02-17T20:09:50.078 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.082+0000 7f61e2298640 1 -- 10.20.193.123:0/1705413887 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61dc126ce0 con 0x7f61dc131da0 2026-02-17T20:09:50.078 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.082+0000 7f61d8ff9640 1 -- 10.20.193.123:0/1705413887 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61cc042a20 con 0x7f61dc131da0 2026-02-17T20:09:50.078 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.082+0000 7f61e2298640 1 -- 10.20.193.123:0/1705413887 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f61dc1cb7f0 con 0x7f61dc131da0 2026-02-17T20:09:50.078 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.082+0000 7f61e2298640 1 -- 10.20.193.123:0/1705413887 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f61dc131860 con 0x7f61dc131da0 2026-02-17T20:09:50.078 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.082+0000 7f61d8ff9640 1 -- 10.20.193.123:0/1705413887 <== mon.2 v2:10.20.193.123:3302/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f61cc04b450 con 0x7f61dc131da0 2026-02-17T20:09:50.078 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.082+0000 7f61d8ff9640 1 -- 10.20.193.123:0/1705413887 <== mon.2 v2:10.20.193.123:3302/0 5 ==== osd_map(30..30 src has 1..30) ==== 3025+0+0 (secure 0 0 0) 0x7f61cc08b780 con 0x7f61dc131da0 2026-02-17T20:09:50.078 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.083+0000 7f61d8ff9640 1 -- 10.20.193.123:0/1705413887 --> v1:10.20.193.123:6805/2594724968 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f61cc035e50 con 0x7f61ac056010 2026-02-17T20:09:50.079 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.083+0000 7f61d8ff9640 1 -- 10.20.193.123:0/1705413887 <== mon.2 v2:10.20.193.123:3302/0 6 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f61cc092050 con 0x7f61dc131da0 2026-02-17T20:09:50.079 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.083+0000 7f61d8ff9640 1 -- 10.20.193.123:0/1705413887 <== osd.1 v1:10.20.193.123:6805/2594724968 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7f61cc035e50 con 0x7f61ac056010 2026-02-17T20:09:50.085 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.089+0000 7f61e2298640 1 -- 10.20.193.123:0/1705413887 --> v1:10.20.193.123:6805/2594724968 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f61dc0713a0 con 0x7f61ac056010 2026-02-17T20:09:50.085 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.089+0000 7f61d8ff9640 1 -- 10.20.193.123:0/1705413887 <== osd.1 v1:10.20.193.123:6805/2594724968 2 ==== command_reply(tid 2: 0 ) ==== 8+0+712 (unknown 0 0 714369635) 0x7f61dc0713a0 con 0x7f61ac056010 2026-02-17T20:09:50.085 INFO:teuthology.orchestra.run.trial123.stdout:{ 2026-02-17T20:09:50.085 INFO:teuthology.orchestra.run.trial123.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-17T20:09:50.085 INFO:teuthology.orchestra.run.trial123.stdout:} 2026-02-17T20:09:50.086 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.089+0000 7f61e2298640 1 -- 10.20.193.123:0/1705413887 >> v1:10.20.193.123:6805/2594724968 conn(0x7f61ac056010 legacy=0x7f61ac058450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:50.086 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.089+0000 7f61e2298640 1 -- 10.20.193.123:0/1705413887 >> v1:10.20.193.123:6800/115662061 conn(0x7f61ac04f790 legacy=0x7f61ac051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:50.086 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.089+0000 7f61e2298640 1 -- 10.20.193.123:0/1705413887 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f61dc131da0 msgr2=0x7f61dc124490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:50.086 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.089+0000 7f61e2298640 1 --2- 10.20.193.123:0/1705413887 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f61dc131da0 0x7f61dc124490 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f61cc03a040 tx=0x7f61cc0047c0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.086 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.089+0000 7f61e080e640 1 -- 10.20.193.123:0/1705413887 reap_dead start 2026-02-17T20:09:50.086 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.089+0000 7f61e2298640 1 -- 10.20.193.123:0/1705413887 shutdown_connections 2026-02-17T20:09:50.086 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.089+0000 7f61e2298640 1 -- 10.20.193.123:0/1705413887 >> 10.20.193.123:0/1705413887 conn(0x7f61dc09d580 msgr2=0x7f61dc070a40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:50.086 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.090+0000 7f61e2298640 1 -- 10.20.193.123:0/1705413887 shutdown_connections 2026-02-17T20:09:50.086 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.090+0000 7f61e2298640 1 -- 10.20.193.123:0/1705413887 wait complete. 2026-02-17T20:09:50.091 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-17T20:09:50.163 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.162+0000 7f83786bb640 1 Processor -- start 2026-02-17T20:09:50.164 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.162+0000 7f83786bb640 1 -- start start 2026-02-17T20:09:50.164 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.162+0000 7f83786bb640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f8370134d10 0x7f83701350f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:50.164 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.162+0000 7f83786bb640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f8370071f90 0x7f837013cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:50.164 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.162+0000 7f83786bb640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f837009f550 con 0x7f8370073830 2026-02-17T20:09:50.164 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.162+0000 7f83786bb640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7f83701347a0 con 0x7f8370071f90 2026-02-17T20:09:50.164 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.162+0000 7f83786bb640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f8370073f10 con 0x7f8370134d10 2026-02-17T20:09:50.164 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.162+0000 7f8376430640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f8370134d10 0x7f83701350f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:50.164 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.162+0000 7f8376c31640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f8370071f90 0x7f837013cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:50.165 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.162+0000 7f8376430640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f8370134d10 0x7f83701350f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:38010/0 (socket says 10.20.193.123:38010) 2026-02-17T20:09:50.165 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.162+0000 7f8376430640 1 -- 10.20.193.123:0/223152649 learned_addr learned my addr 10.20.193.123:0/223152649 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:50.165 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.162+0000 7f8375c2f640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7f8370073830 0x7f8370071880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:39622/0 (socket says 10.20.193.123:39622) 2026-02-17T20:09:50.165 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.162+0000 7f837542e640 1 -- 10.20.193.123:0/223152649 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3814199643 0 0) 0x7f837009f550 con 0x7f8370073830 2026-02-17T20:09:50.165 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.162+0000 7f837542e640 1 -- 10.20.193.123:0/223152649 --> v1:10.20.193.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8358003620 con 0x7f8370073830 2026-02-17T20:09:50.165 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.162+0000 7f8376430640 1 -- 10.20.193.123:0/223152649 >> v2:10.20.193.123:3300/0 conn(0x7f8370071f90 msgr2=0x7f837013cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:50.165 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.162+0000 7f8376430640 1 --2- 10.20.193.123:0/223152649 >> v2:10.20.193.123:3300/0 conn(0x7f8370071f90 0x7f837013cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.165 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.162+0000 7f8376430640 1 -- 10.20.193.123:0/223152649 >> v1:10.20.193.123:6789/0 conn(0x7f8370073830 legacy=0x7f8370071880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:50.165 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.162+0000 7f8376430640 1 -- 10.20.193.123:0/223152649 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8370135630 con 0x7f8370134d10 2026-02-17T20:09:50.166 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.162+0000 7f8376c31640 1 --2- 10.20.193.123:0/223152649 >> v2:10.20.193.123:3300/0 conn(0x7f8370071f90 0x7f837013cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:50.166 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.163+0000 7f8376430640 1 --2- 10.20.193.123:0/223152649 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f8370134d10 0x7f83701350f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8360009970 tx=0x7f836002ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=562c8689b1b8e0e2 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:50.166 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.163+0000 7f837542e640 1 -- 10.20.193.123:0/223152649 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f836003c070 con 0x7f8370134d10 2026-02-17T20:09:50.166 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.163+0000 7f837542e640 1 -- 10.20.193.123:0/223152649 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f836002fb10 con 0x7f8370134d10 2026-02-17T20:09:50.166 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.163+0000 7f837542e640 1 -- 10.20.193.123:0/223152649 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8360037440 con 0x7f8370134d10 2026-02-17T20:09:50.166 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.163+0000 7f83786bb640 1 -- 10.20.193.123:0/223152649 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f8370134d10 msgr2=0x7f83701350f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:50.166 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.163+0000 7f83786bb640 1 --2- 10.20.193.123:0/223152649 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f8370134d10 0x7f83701350f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8360009970 tx=0x7f836002ee90 comp rx=0 tx=0).stop 2026-02-17T20:09:50.166 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.163+0000 7f83786bb640 1 -- 10.20.193.123:0/223152649 shutdown_connections 2026-02-17T20:09:50.166 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.163+0000 7f83786bb640 1 --2- 10.20.193.123:0/223152649 >> v2:10.20.193.123:3300/0 conn(0x7f8370071f90 0x7f837013cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.166 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.163+0000 7f83786bb640 1 --2- 10.20.193.123:0/223152649 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f8370134d10 0x7f83701350f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.166 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.163+0000 7f83786bb640 1 -- 10.20.193.123:0/223152649 >> 10.20.193.123:0/223152649 conn(0x7f837009e7c0 msgr2=0x7f837009ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:50.167 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.163+0000 7f83786bb640 1 -- 10.20.193.123:0/223152649 shutdown_connections 2026-02-17T20:09:50.167 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.163+0000 7f83786bb640 1 -- 10.20.193.123:0/223152649 wait complete. 2026-02-17T20:09:50.167 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.164+0000 7f83786bb640 1 Processor -- start 2026-02-17T20:09:50.167 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.164+0000 7f83786bb640 1 -- start start 2026-02-17T20:09:50.167 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.164+0000 7f83786bb640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f8370071f90 0x7f8370135b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:50.167 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.164+0000 7f83786bb640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f8370073830 0x7f8370136040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:50.167 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.164+0000 7f83786bb640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f8370134d10 0x7f8370136580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:50.167 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.164+0000 7f83786bb640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7f83700723c0 con 0x7f8370071f90 2026-02-17T20:09:50.167 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.164+0000 7f83786bb640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f8370073110 con 0x7f8370134d10 2026-02-17T20:09:50.167 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.164+0000 7f83786bb640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f8370072540 con 0x7f8370073830 2026-02-17T20:09:50.167 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.164+0000 7f8376430640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f8370071f90 0x7f8370135b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:50.168 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.164+0000 7f8375c2f640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f8370073830 0x7f8370136040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:50.168 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.164+0000 7f8376430640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f8370071f90 0x7f8370135b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:47866/0 (socket says 10.20.193.123:47866) 2026-02-17T20:09:50.168 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.164+0000 7f8376430640 1 -- 10.20.193.123:0/3629820619 learned_addr learned my addr 10.20.193.123:0/3629820619 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:50.168 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.164+0000 7f8376c31640 1 --2- 10.20.193.123:0/3629820619 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f8370134d10 0x7f8370136580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:50.168 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.164+0000 7f8376430640 1 -- 10.20.193.123:0/3629820619 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f8370073830 msgr2=0x7f8370136040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:50.168 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.164+0000 7f8376430640 1 --2- 10.20.193.123:0/3629820619 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f8370073830 0x7f8370136040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.168 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.164+0000 7f8376430640 1 -- 10.20.193.123:0/3629820619 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f8370134d10 msgr2=0x7f8370136580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:50.168 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.164+0000 7f8376430640 1 --2- 10.20.193.123:0/3629820619 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f8370134d10 0x7f8370136580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.168 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.164+0000 7f8376430640 1 -- 10.20.193.123:0/3629820619 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8370138a30 con 0x7f8370071f90 2026-02-17T20:09:50.169 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.164+0000 7f8376c31640 1 --2- 10.20.193.123:0/3629820619 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f8370134d10 0x7f8370136580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T20:09:50.169 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.164+0000 7f8376430640 1 --2- 10.20.193.123:0/3629820619 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f8370071f90 0x7f8370135b00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8360002410 tx=0x7f83600047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:50.169 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.164+0000 7f8356ffd640 1 -- 10.20.193.123:0/3629820619 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f836003c040 con 0x7f8370071f90 2026-02-17T20:09:50.169 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.164+0000 7f8356ffd640 1 -- 10.20.193.123:0/3629820619 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8360004230 con 0x7f8370071f90 2026-02-17T20:09:50.169 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.164+0000 7f83786bb640 1 -- 10.20.193.123:0/3629820619 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8370137a10 con 0x7f8370071f90 2026-02-17T20:09:50.169 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.164+0000 7f8356ffd640 1 -- 10.20.193.123:0/3629820619 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83600045e0 con 0x7f8370071f90 2026-02-17T20:09:50.169 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.164+0000 7f83786bb640 1 -- 10.20.193.123:0/3629820619 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8370137e80 con 0x7f8370071f90 2026-02-17T20:09:50.169 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.165+0000 7f83786bb640 1 -- 10.20.193.123:0/3629820619 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8370131460 con 0x7f8370071f90 2026-02-17T20:09:50.169 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.165+0000 7f8356ffd640 1 -- 10.20.193.123:0/3629820619 <== mon.0 v2:10.20.193.123:3300/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f8360051060 con 0x7f8370071f90 2026-02-17T20:09:50.169 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.165+0000 7f8356ffd640 1 -- 10.20.193.123:0/3629820619 <== mon.0 v2:10.20.193.123:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3025+0+0 (secure 0 0 0) 0x7f836008ba40 con 0x7f8370071f90 2026-02-17T20:09:50.169 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.167+0000 7f8356ffd640 1 -- 10.20.193.123:0/3629820619 <== mon.0 v2:10.20.193.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f8370131460 con 0x7f8370071f90 2026-02-17T20:09:50.232 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.235+0000 7f83786bb640 1 -- 10.20.193.123:0/3629820619 --> v1:10.20.193.123:6800/115662061 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f8370137240 con 0x7f834004f790 2026-02-17T20:09:50.232 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.235+0000 7f8356ffd640 1 -- 10.20.193.123:0/3629820619 <== mgr.14107 v1:10.20.193.123:6800/115662061 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (unknown 489605429 0 0) 0x7f8370137240 con 0x7f834004f790 2026-02-17T20:09:50.232 INFO:teuthology.orchestra.run.trial123.stderr:instructed osd(s) 1 to deep-scrub 2026-02-17T20:09:50.233 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.236+0000 7f83786bb640 1 -- 10.20.193.123:0/3629820619 >> v1:10.20.193.123:6800/115662061 conn(0x7f834004f790 legacy=0x7f8340051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:50.233 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.236+0000 7f83786bb640 1 -- 10.20.193.123:0/3629820619 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f8370071f90 msgr2=0x7f8370135b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:50.233 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.236+0000 7f83786bb640 1 --2- 10.20.193.123:0/3629820619 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f8370071f90 0x7f8370135b00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8360002410 tx=0x7f83600047c0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.234 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.236+0000 7f83786bb640 1 -- 10.20.193.123:0/3629820619 shutdown_connections 2026-02-17T20:09:50.234 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.236+0000 7f83786bb640 1 --2- 10.20.193.123:0/3629820619 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f8370134d10 0x7f8370136580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.234 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.236+0000 7f83786bb640 1 --2- 10.20.193.123:0/3629820619 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f8370073830 0x7f8370136040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.234 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.236+0000 7f83786bb640 1 --2- 10.20.193.123:0/3629820619 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f8370071f90 0x7f8370135b00 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.234 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.236+0000 7f83786bb640 1 -- 10.20.193.123:0/3629820619 >> 10.20.193.123:0/3629820619 conn(0x7f837009e7c0 msgr2=0x7f837012fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:50.234 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.236+0000 7f83786bb640 1 -- 10.20.193.123:0/3629820619 shutdown_connections 2026-02-17T20:09:50.234 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.236+0000 7f83786bb640 1 -- 10.20.193.123:0/3629820619 wait complete. 2026-02-17T20:09:50.240 INFO:tasks.ceph:Scrubbing osd.2 2026-02-17T20:09:50.240 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-17T20:09:50.308 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.312+0000 7f47958bc640 1 Processor -- start 2026-02-17T20:09:50.308 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.312+0000 7f47958bc640 1 -- start start 2026-02-17T20:09:50.308 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.312+0000 7f47958bc640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f4790072fa0 0x7f4790073380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:50.308 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.312+0000 7f47958bc640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f4790114da0 0x7f47901151e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:50.308 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.312+0000 7f47958bc640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47900738c0 con 0x7f4790115720 2026-02-17T20:09:50.308 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.312+0000 7f47958bc640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7f4790071ce0 con 0x7f4790072fa0 2026-02-17T20:09:50.308 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.312+0000 7f47958bc640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f47901168a0 con 0x7f4790114da0 2026-02-17T20:09:50.308 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.312+0000 7f478e7fc640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f4790114da0 0x7f47901151e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:50.308 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.312+0000 7f478effd640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7f4790072fa0 0x7f4790073380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:50.308 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.312+0000 7f478f7fe640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7f4790115720 0x7f47901376d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:39630/0 (socket says 10.20.193.123:39630) 2026-02-17T20:09:50.308 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.312+0000 7f478f7fe640 1 -- 10.20.193.123:0/693175286 learned_addr learned my addr 10.20.193.123:0/693175286 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:09:50.308 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.312+0000 7f478e7fc640 1 -- 10.20.193.123:0/693175286 >> v2:10.20.193.123:3300/0 conn(0x7f4790072fa0 msgr2=0x7f4790073380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:50.308 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.312+0000 7f478e7fc640 1 --2- 10.20.193.123:0/693175286 >> v2:10.20.193.123:3300/0 conn(0x7f4790072fa0 0x7f4790073380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.308 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.312+0000 7f478e7fc640 1 -- 10.20.193.123:0/693175286 >> v1:10.20.193.123:6789/0 conn(0x7f4790115720 legacy=0x7f47901376d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:50.309 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.312+0000 7f478e7fc640 1 -- 10.20.193.123:0/693175286 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4790072ae0 con 0x7f4790114da0 2026-02-17T20:09:50.309 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.313+0000 7f478e7fc640 1 --2- 10.20.193.123:0/693175286 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f4790114da0 0x7f47901151e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f47780098a0 tx=0x7f477802ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43a635d79b9a22c8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:50.309 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.313+0000 7f478dffb640 1 -- 10.20.193.123:0/693175286 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477803c070 con 0x7f4790114da0 2026-02-17T20:09:50.309 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.313+0000 7f478dffb640 1 -- 10.20.193.123:0/693175286 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f477802fa40 con 0x7f4790114da0 2026-02-17T20:09:50.309 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.313+0000 7f478dffb640 1 -- 10.20.193.123:0/693175286 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477802fe10 con 0x7f4790114da0 2026-02-17T20:09:50.309 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.313+0000 7f47958bc640 1 -- 10.20.193.123:0/693175286 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f4790114da0 msgr2=0x7f47901151e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:50.309 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.313+0000 7f47958bc640 1 --2- 10.20.193.123:0/693175286 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f4790114da0 0x7f47901151e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f47780098a0 tx=0x7f477802ed80 comp rx=0 tx=0).stop 2026-02-17T20:09:50.309 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.313+0000 7f47958bc640 1 -- 10.20.193.123:0/693175286 shutdown_connections 2026-02-17T20:09:50.309 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.313+0000 7f47958bc640 1 --2- 10.20.193.123:0/693175286 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f4790114da0 0x7f47901151e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.309 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.313+0000 7f47958bc640 1 --2- 10.20.193.123:0/693175286 >> v2:10.20.193.123:3300/0 conn(0x7f4790072fa0 0x7f4790073380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.309 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.313+0000 7f47958bc640 1 -- 10.20.193.123:0/693175286 >> 10.20.193.123:0/693175286 conn(0x7f479009d580 msgr2=0x7f479009d990 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:50.309 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.313+0000 7f47958bc640 1 -- 10.20.193.123:0/693175286 shutdown_connections 2026-02-17T20:09:50.309 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.313+0000 7f47958bc640 1 -- 10.20.193.123:0/693175286 wait complete. 2026-02-17T20:09:50.310 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.314+0000 7f47958bc640 1 Processor -- start 2026-02-17T20:09:50.310 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.314+0000 7f47958bc640 1 -- start start 2026-02-17T20:09:50.310 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.314+0000 7f47958bc640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f4790072fa0 0x7f47901a8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:50.310 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.314+0000 7f47958bc640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f4790114da0 0x7f47901a8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:50.310 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.314+0000 7f47958bc640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f4790115720 0x7f47901c7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:50.310 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.314+0000 7f47958bc640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7f47900721e0 con 0x7f4790114da0 2026-02-17T20:09:50.310 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.314+0000 7f47958bc640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f4790071a00 con 0x7f4790072fa0 2026-02-17T20:09:50.311 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.314+0000 7f47958bc640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f4790116ab0 con 0x7f4790115720 2026-02-17T20:09:50.311 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.314+0000 7f478effd640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f4790072fa0 0x7f47901a8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:50.311 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.314+0000 7f478e7fc640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f4790114da0 0x7f47901a8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:50.311 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.314+0000 7f478effd640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f4790072fa0 0x7f47901a8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:46924/0 (socket says 10.20.193.123:46924) 2026-02-17T20:09:50.311 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.314+0000 7f478effd640 1 -- 10.20.193.123:0/3778736037 learned_addr learned my addr 10.20.193.123:0/3778736037 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:50.311 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.314+0000 7f478f7fe640 1 --2- 10.20.193.123:0/3778736037 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f4790115720 0x7f47901c7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:50.311 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.314+0000 7f478effd640 1 -- 10.20.193.123:0/3778736037 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f4790115720 msgr2=0x7f47901c7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:50.311 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.314+0000 7f478effd640 1 --2- 10.20.193.123:0/3778736037 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f4790115720 0x7f47901c7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.311 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.314+0000 7f478effd640 1 -- 10.20.193.123:0/3778736037 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f4790114da0 msgr2=0x7f47901a8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:50.311 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.314+0000 7f478effd640 1 --2- 10.20.193.123:0/3778736037 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f4790114da0 0x7f47901a8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.311 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.314+0000 7f478effd640 1 -- 10.20.193.123:0/3778736037 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47901aa3a0 con 0x7f4790072fa0 2026-02-17T20:09:50.311 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.314+0000 7f478f7fe640 1 --2- 10.20.193.123:0/3778736037 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f4790115720 0x7f47901c7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T20:09:50.311 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.314+0000 7f478e7fc640 1 --2- 10.20.193.123:0/3778736037 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f4790114da0 0x7f47901a8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:50.311 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.314+0000 7f478effd640 1 --2- 10.20.193.123:0/3778736037 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f4790072fa0 0x7f47901a8aa0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f478400ebe0 tx=0x7f478400c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:50.311 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.314+0000 7f4767fff640 1 -- 10.20.193.123:0/3778736037 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4784017070 con 0x7f4790072fa0 2026-02-17T20:09:50.311 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.314+0000 7f4767fff640 1 -- 10.20.193.123:0/3778736037 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f478400cc40 con 0x7f4790072fa0 2026-02-17T20:09:50.311 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.314+0000 7f47958bc640 1 -- 10.20.193.123:0/3778736037 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47901aac80 con 0x7f4790072fa0 2026-02-17T20:09:50.311 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.314+0000 7f4767fff640 1 -- 10.20.193.123:0/3778736037 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4784013470 con 0x7f4790072fa0 2026-02-17T20:09:50.311 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.314+0000 7f47958bc640 1 -- 10.20.193.123:0/3778736037 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f47901a9700 con 0x7f4790072fa0 2026-02-17T20:09:50.311 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.315+0000 7f47958bc640 1 -- 10.20.193.123:0/3778736037 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4790073380 con 0x7f4790072fa0 2026-02-17T20:09:50.311 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.315+0000 7f4767fff640 1 -- 10.20.193.123:0/3778736037 <== mon.1 v2:10.20.193.123:3301/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f4784024060 con 0x7f4790072fa0 2026-02-17T20:09:50.311 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.315+0000 7f4767fff640 1 -- 10.20.193.123:0/3778736037 <== mon.1 v2:10.20.193.123:3301/0 5 ==== osd_map(30..30 src has 1..30) ==== 3025+0+0 (secure 0 0 0) 0x7f4784066c20 con 0x7f4790072fa0 2026-02-17T20:09:50.312 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.315+0000 7f4767fff640 1 -- 10.20.193.123:0/3778736037 --> v1:10.20.193.123:6809/3596569166 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f478401ee50 con 0x7f4760056010 2026-02-17T20:09:50.312 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.315+0000 7f4767fff640 1 -- 10.20.193.123:0/3778736037 <== mon.1 v2:10.20.193.123:3301/0 6 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4784069320 con 0x7f4790072fa0 2026-02-17T20:09:50.312 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.316+0000 7f4767fff640 1 -- 10.20.193.123:0/3778736037 <== osd.2 v1:10.20.193.123:6809/3596569166 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7f478401ee50 con 0x7f4760056010 2026-02-17T20:09:50.318 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.322+0000 7f47958bc640 1 -- 10.20.193.123:0/3778736037 --> v1:10.20.193.123:6809/3596569166 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f4790070300 con 0x7f4760056010 2026-02-17T20:09:50.318 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.323+0000 7f4767fff640 1 -- 10.20.193.123:0/3778736037 <== osd.2 v1:10.20.193.123:6809/3596569166 2 ==== command_reply(tid 2: 0 ) ==== 8+0+712 (unknown 0 0 714369635) 0x7f4790070300 con 0x7f4760056010 2026-02-17T20:09:50.319 INFO:teuthology.orchestra.run.trial123.stdout:{ 2026-02-17T20:09:50.319 INFO:teuthology.orchestra.run.trial123.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-17T20:09:50.319 INFO:teuthology.orchestra.run.trial123.stdout:} 2026-02-17T20:09:50.319 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.323+0000 7f47958bc640 1 -- 10.20.193.123:0/3778736037 >> v1:10.20.193.123:6809/3596569166 conn(0x7f4760056010 legacy=0x7f4760058450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:50.319 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.323+0000 7f47958bc640 1 -- 10.20.193.123:0/3778736037 >> v1:10.20.193.123:6800/115662061 conn(0x7f476004f790 legacy=0x7f4760051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:50.319 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.323+0000 7f47958bc640 1 -- 10.20.193.123:0/3778736037 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f4790072fa0 msgr2=0x7f47901a8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:50.319 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.323+0000 7f47958bc640 1 --2- 10.20.193.123:0/3778736037 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f4790072fa0 0x7f47901a8aa0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f478400ebe0 tx=0x7f478400c520 comp rx=0 tx=0).stop 2026-02-17T20:09:50.319 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.323+0000 7f478f7fe640 1 -- 10.20.193.123:0/3778736037 reap_dead start 2026-02-17T20:09:50.319 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.323+0000 7f47958bc640 1 -- 10.20.193.123:0/3778736037 shutdown_connections 2026-02-17T20:09:50.319 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.323+0000 7f47958bc640 1 -- 10.20.193.123:0/3778736037 >> 10.20.193.123:0/3778736037 conn(0x7f479009d580 msgr2=0x7f479006f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:50.319 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.323+0000 7f47958bc640 1 -- 10.20.193.123:0/3778736037 shutdown_connections 2026-02-17T20:09:50.319 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.323+0000 7f47958bc640 1 -- 10.20.193.123:0/3778736037 wait complete. 2026-02-17T20:09:50.325 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-17T20:09:50.397 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.396+0000 7fd4f076a640 1 Processor -- start 2026-02-17T20:09:50.398 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.396+0000 7fd4f076a640 1 -- start start 2026-02-17T20:09:50.398 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.396+0000 7fd4f076a640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fd4e8134d10 0x7fd4e81350f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:50.398 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.396+0000 7fd4f076a640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fd4e8073830 0x7fd4e8071880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:50.398 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.396+0000 7fd4f076a640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4e809f550 con 0x7fd4e8071dc0 2026-02-17T20:09:50.398 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.396+0000 7fd4f076a640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7fd4e81347a0 con 0x7fd4e8073830 2026-02-17T20:09:50.398 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.396+0000 7fd4f076a640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7fd4e8073f10 con 0x7fd4e8134d10 2026-02-17T20:09:50.398 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.396+0000 7fd4ee4df640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fd4e8134d10 0x7fd4e81350f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:50.398 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.396+0000 7fd4ee4df640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fd4e8134d10 0x7fd4e81350f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:46938/0 (socket says 10.20.193.123:46938) 2026-02-17T20:09:50.398 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.396+0000 7fd4ee4df640 1 -- 10.20.193.123:0/550714842 learned_addr learned my addr 10.20.193.123:0/550714842 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:50.399 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.396+0000 7fd4edcde640 1 --2- 10.20.193.123:0/550714842 >> v2:10.20.193.123:3300/0 conn(0x7fd4e8073830 0x7fd4e8071880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:50.399 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.396+0000 7fd4ee4df640 1 -- 10.20.193.123:0/550714842 >> v2:10.20.193.123:3300/0 conn(0x7fd4e8073830 msgr2=0x7fd4e8071880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:50.399 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.396+0000 7fd4ee4df640 1 --2- 10.20.193.123:0/550714842 >> v2:10.20.193.123:3300/0 conn(0x7fd4e8073830 0x7fd4e8071880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.399 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.396+0000 7fd4ee4df640 1 -- 10.20.193.123:0/550714842 >> v1:10.20.193.123:6789/0 conn(0x7fd4e8071dc0 legacy=0x7fd4e813bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:50.399 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.396+0000 7fd4ee4df640 1 -- 10.20.193.123:0/550714842 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e8135630 con 0x7fd4e8134d10 2026-02-17T20:09:50.399 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.397+0000 7fd4ee4df640 1 --2- 10.20.193.123:0/550714842 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fd4e8134d10 0x7fd4e81350f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8009970 tx=0x7fd4d802ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f20355c1a9e343b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:50.399 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.397+0000 7fd4ed4dd640 1 -- 10.20.193.123:0/550714842 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d803c070 con 0x7fd4e8134d10 2026-02-17T20:09:50.399 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.397+0000 7fd4ed4dd640 1 -- 10.20.193.123:0/550714842 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4d802fb10 con 0x7fd4e8134d10 2026-02-17T20:09:50.399 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.397+0000 7fd4ed4dd640 1 -- 10.20.193.123:0/550714842 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d8037440 con 0x7fd4e8134d10 2026-02-17T20:09:50.399 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.397+0000 7fd4f076a640 1 -- 10.20.193.123:0/550714842 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fd4e8134d10 msgr2=0x7fd4e81350f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:50.400 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.397+0000 7fd4f076a640 1 --2- 10.20.193.123:0/550714842 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fd4e8134d10 0x7fd4e81350f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8009970 tx=0x7fd4d802ee90 comp rx=0 tx=0).stop 2026-02-17T20:09:50.400 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.397+0000 7fd4f076a640 1 -- 10.20.193.123:0/550714842 shutdown_connections 2026-02-17T20:09:50.400 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.397+0000 7fd4f076a640 1 --2- 10.20.193.123:0/550714842 >> v2:10.20.193.123:3300/0 conn(0x7fd4e8073830 0x7fd4e8071880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.400 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.397+0000 7fd4f076a640 1 --2- 10.20.193.123:0/550714842 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fd4e8134d10 0x7fd4e81350f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.400 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.397+0000 7fd4f076a640 1 -- 10.20.193.123:0/550714842 >> 10.20.193.123:0/550714842 conn(0x7fd4e809e7c0 msgr2=0x7fd4e809ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:50.400 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.397+0000 7fd4f076a640 1 -- 10.20.193.123:0/550714842 shutdown_connections 2026-02-17T20:09:50.400 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.397+0000 7fd4f076a640 1 -- 10.20.193.123:0/550714842 wait complete. 2026-02-17T20:09:50.400 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.398+0000 7fd4f076a640 1 Processor -- start 2026-02-17T20:09:50.400 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.398+0000 7fd4f076a640 1 -- start start 2026-02-17T20:09:50.400 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.398+0000 7fd4f076a640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fd4e8071dc0 0x7fd4e8123fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:50.401 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.398+0000 7fd4f076a640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fd4e8073830 0x7fd4e8124500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:50.401 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.398+0000 7fd4f076a640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fd4e8134d10 0x7fd4e8124a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:50.401 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.398+0000 7fd4f076a640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e80721f0 con 0x7fd4e8134d10 2026-02-17T20:09:50.401 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.398+0000 7fd4f076a640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7fd4e8073110 con 0x7fd4e8073830 2026-02-17T20:09:50.401 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.398+0000 7fd4f076a640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7fd4e8072370 con 0x7fd4e8071dc0 2026-02-17T20:09:50.401 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.398+0000 7fd4edcde640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fd4e8073830 0x7fd4e8124500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:50.401 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.398+0000 7fd4ee4df640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fd4e8071dc0 0x7fd4e8123fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:50.401 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.398+0000 7fd4eece0640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fd4e8134d10 0x7fd4e8124a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:50.401 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.398+0000 7fd4edcde640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fd4e8073830 0x7fd4e8124500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:46954/0 (socket says 10.20.193.123:46954) 2026-02-17T20:09:50.401 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.398+0000 7fd4ee4df640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fd4e8071dc0 0x7fd4e8123fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:38048/0 (socket says 10.20.193.123:38048) 2026-02-17T20:09:50.402 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.398+0000 7fd4edcde640 1 -- 10.20.193.123:0/2347983211 learned_addr learned my addr 10.20.193.123:0/2347983211 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:50.402 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.398+0000 7fd4edcde640 1 -- 10.20.193.123:0/2347983211 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fd4e8071dc0 msgr2=0x7fd4e8123fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:50.402 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.398+0000 7fd4edcde640 1 --2- 10.20.193.123:0/2347983211 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fd4e8071dc0 0x7fd4e8123fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.402 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.398+0000 7fd4edcde640 1 -- 10.20.193.123:0/2347983211 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fd4e8134d10 msgr2=0x7fd4e8124a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:50.402 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.398+0000 7fd4edcde640 1 --2- 10.20.193.123:0/2347983211 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fd4e8134d10 0x7fd4e8124a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.402 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.398+0000 7fd4edcde640 1 -- 10.20.193.123:0/2347983211 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e8127670 con 0x7fd4e8073830 2026-02-17T20:09:50.402 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.398+0000 7fd4edcde640 1 --2- 10.20.193.123:0/2347983211 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fd4e8073830 0x7fd4e8124500 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc00ebe0 tx=0x7fd4dc00c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:50.402 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.398+0000 7fd4ceffd640 1 -- 10.20.193.123:0/2347983211 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc017070 con 0x7fd4e8073830 2026-02-17T20:09:50.402 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.398+0000 7fd4ceffd640 1 -- 10.20.193.123:0/2347983211 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4dc00cc40 con 0x7fd4e8073830 2026-02-17T20:09:50.402 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.398+0000 7fd4f076a640 1 -- 10.20.193.123:0/2347983211 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4e8126270 con 0x7fd4e8073830 2026-02-17T20:09:50.403 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.398+0000 7fd4ceffd640 1 -- 10.20.193.123:0/2347983211 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc013470 con 0x7fd4e8073830 2026-02-17T20:09:50.403 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.398+0000 7fd4f076a640 1 -- 10.20.193.123:0/2347983211 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4e81cb6b0 con 0x7fd4e8073830 2026-02-17T20:09:50.403 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.399+0000 7fd4f076a640 1 -- 10.20.193.123:0/2347983211 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4e8071880 con 0x7fd4e8073830 2026-02-17T20:09:50.403 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.399+0000 7fd4ceffd640 1 -- 10.20.193.123:0/2347983211 <== mon.1 v2:10.20.193.123:3301/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7fd4dc024060 con 0x7fd4e8073830 2026-02-17T20:09:50.403 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.399+0000 7fd4ceffd640 1 -- 10.20.193.123:0/2347983211 <== mon.1 v2:10.20.193.123:3301/0 5 ==== osd_map(30..30 src has 1..30) ==== 3025+0+0 (secure 0 0 0) 0x7fd4dc066c20 con 0x7fd4e8073830 2026-02-17T20:09:50.403 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.401+0000 7fd4ceffd640 1 -- 10.20.193.123:0/2347983211 <== mon.1 v2:10.20.193.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7fd4dc040a10 con 0x7fd4e8073830 2026-02-17T20:09:50.468 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.471+0000 7fd4f076a640 1 -- 10.20.193.123:0/2347983211 --> v1:10.20.193.123:6800/115662061 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fd4e8068530 con 0x7fd4b804f790 2026-02-17T20:09:50.468 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.471+0000 7fd4ceffd640 1 -- 10.20.193.123:0/2347983211 <== mgr.14107 v1:10.20.193.123:6800/115662061 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (unknown 3049115190 0 0) 0x7fd4e8068530 con 0x7fd4b804f790 2026-02-17T20:09:50.468 INFO:teuthology.orchestra.run.trial123.stderr:instructed osd(s) 2 to deep-scrub 2026-02-17T20:09:50.469 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.472+0000 7fd4f076a640 1 -- 10.20.193.123:0/2347983211 >> v1:10.20.193.123:6800/115662061 conn(0x7fd4b804f790 legacy=0x7fd4b8051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:50.469 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.472+0000 7fd4f076a640 1 -- 10.20.193.123:0/2347983211 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fd4e8073830 msgr2=0x7fd4e8124500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:50.470 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.472+0000 7fd4f076a640 1 --2- 10.20.193.123:0/2347983211 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fd4e8073830 0x7fd4e8124500 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc00ebe0 tx=0x7fd4dc00c520 comp rx=0 tx=0).stop 2026-02-17T20:09:50.470 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.472+0000 7fd4f076a640 1 -- 10.20.193.123:0/2347983211 shutdown_connections 2026-02-17T20:09:50.470 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.472+0000 7fd4f076a640 1 --2- 10.20.193.123:0/2347983211 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fd4e8134d10 0x7fd4e8124a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.470 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.472+0000 7fd4f076a640 1 --2- 10.20.193.123:0/2347983211 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fd4e8073830 0x7fd4e8124500 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.470 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.473+0000 7fd4f076a640 1 --2- 10.20.193.123:0/2347983211 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fd4e8071dc0 0x7fd4e8123fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.470 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.473+0000 7fd4f076a640 1 -- 10.20.193.123:0/2347983211 >> 10.20.193.123:0/2347983211 conn(0x7fd4e809e7c0 msgr2=0x7fd4e8131290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:50.470 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.473+0000 7fd4f076a640 1 -- 10.20.193.123:0/2347983211 shutdown_connections 2026-02-17T20:09:50.470 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.473+0000 7fd4f076a640 1 -- 10.20.193.123:0/2347983211 wait complete. 2026-02-17T20:09:50.477 INFO:tasks.ceph:Scrubbing osd.3 2026-02-17T20:09:50.477 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2026-02-17T20:09:50.548 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.548+0000 7fec5895e640 1 Processor -- start 2026-02-17T20:09:50.549 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.548+0000 7fec5895e640 1 -- start start 2026-02-17T20:09:50.549 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.548+0000 7fec5895e640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fec50137ab0 0x7fec50139ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:50.549 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.548+0000 7fec5895e640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fec5013a3e0 0x7fec5013c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:50.549 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.548+0000 7fec5895e640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec500744d0 con 0x7fec50131480 2026-02-17T20:09:50.549 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.548+0000 7fec5895e640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7fec500747e0 con 0x7fec50137ab0 2026-02-17T20:09:50.549 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.548+0000 7fec5895e640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7fec50073610 con 0x7fec5013a3e0 2026-02-17T20:09:50.549 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.548+0000 7fec56ed4640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fec5013a3e0 0x7fec5013c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:50.549 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.548+0000 7fec55ed2640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fec50137ab0 0x7fec50139ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:50.549 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.548+0000 7fec55ed2640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fec50137ab0 0x7fec50139ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:47910/0 (socket says 10.20.193.123:47910) 2026-02-17T20:09:50.550 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.548+0000 7fec566d3640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7fec50131480 0x7fec50131860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:39650/0 (socket says 10.20.193.123:39650) 2026-02-17T20:09:50.550 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.548+0000 7fec55ed2640 1 -- 10.20.193.123:0/2328180315 learned_addr learned my addr 10.20.193.123:0/2328180315 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:50.550 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.548+0000 7fec56ed4640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fec5013a3e0 0x7fec5013c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:38052/0 (socket says 10.20.193.123:38052) 2026-02-17T20:09:50.550 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.549+0000 7fec56ed4640 1 -- 10.20.193.123:0/2328180315 >> v2:10.20.193.123:3300/0 conn(0x7fec50137ab0 msgr2=0x7fec50139ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:50.550 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.549+0000 7fec56ed4640 1 --2- 10.20.193.123:0/2328180315 >> v2:10.20.193.123:3300/0 conn(0x7fec50137ab0 0x7fec50139ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.550 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.549+0000 7fec56ed4640 1 -- 10.20.193.123:0/2328180315 >> v1:10.20.193.123:6789/0 conn(0x7fec50131480 legacy=0x7fec50131860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:50.550 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.549+0000 7fec56ed4640 1 -- 10.20.193.123:0/2328180315 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec500732f0 con 0x7fec5013a3e0 2026-02-17T20:09:50.550 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.549+0000 7fec56ed4640 1 --2- 10.20.193.123:0/2328180315 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fec5013a3e0 0x7fec5013c7d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fec44009d90 tx=0x7fec4402f190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6801f2b58fc4bbe5 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:50.550 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.549+0000 7fec556d1640 1 -- 10.20.193.123:0/2328180315 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec4403c070 con 0x7fec5013a3e0 2026-02-17T20:09:50.550 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.549+0000 7fec556d1640 1 -- 10.20.193.123:0/2328180315 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec4402fe10 con 0x7fec5013a3e0 2026-02-17T20:09:50.550 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.549+0000 7fec556d1640 1 -- 10.20.193.123:0/2328180315 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec44037660 con 0x7fec5013a3e0 2026-02-17T20:09:50.551 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.549+0000 7fec5895e640 1 -- 10.20.193.123:0/2328180315 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fec5013a3e0 msgr2=0x7fec5013c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:50.551 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.549+0000 7fec5895e640 1 --2- 10.20.193.123:0/2328180315 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fec5013a3e0 0x7fec5013c7d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fec44009d90 tx=0x7fec4402f190 comp rx=0 tx=0).stop 2026-02-17T20:09:50.551 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.549+0000 7fec5895e640 1 -- 10.20.193.123:0/2328180315 shutdown_connections 2026-02-17T20:09:50.551 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.549+0000 7fec5895e640 1 --2- 10.20.193.123:0/2328180315 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fec5013a3e0 0x7fec5013c7d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.551 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.549+0000 7fec5895e640 1 --2- 10.20.193.123:0/2328180315 >> v2:10.20.193.123:3300/0 conn(0x7fec50137ab0 0x7fec50139ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.551 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.549+0000 7fec5895e640 1 -- 10.20.193.123:0/2328180315 >> 10.20.193.123:0/2328180315 conn(0x7fec5009d580 msgr2=0x7fec5009d990 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:50.551 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.549+0000 7fec5895e640 1 -- 10.20.193.123:0/2328180315 shutdown_connections 2026-02-17T20:09:50.551 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.549+0000 7fec5895e640 1 -- 10.20.193.123:0/2328180315 wait complete. 2026-02-17T20:09:50.551 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.550+0000 7fec5895e640 1 Processor -- start 2026-02-17T20:09:50.551 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.550+0000 7fec5895e640 1 -- start start 2026-02-17T20:09:50.551 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.550+0000 7fec5895e640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fec50131480 0x7fec50070d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:50.552 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.550+0000 7fec5895e640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fec50137ab0 0x7fec50071250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:50.552 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.550+0000 7fec5895e640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fec5013a3e0 0x7fec50071790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:50.552 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.550+0000 7fec5895e640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7fec501320f0 con 0x7fec5013a3e0 2026-02-17T20:09:50.552 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.550+0000 7fec5895e640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7fec50131f70 con 0x7fec50131480 2026-02-17T20:09:50.552 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.550+0000 7fec5895e640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7fec5013cd10 con 0x7fec50137ab0 2026-02-17T20:09:50.552 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.550+0000 7fec56ed4640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fec5013a3e0 0x7fec50071790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:50.552 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.550+0000 7fec566d3640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fec50131480 0x7fec50070d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:50.552 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.550+0000 7fec56ed4640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fec5013a3e0 0x7fec50071790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:47912/0 (socket says 10.20.193.123:47912) 2026-02-17T20:09:50.552 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.550+0000 7fec55ed2640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fec50137ab0 0x7fec50071250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:50.552 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.550+0000 7fec56ed4640 1 -- 10.20.193.123:0/3815848636 learned_addr learned my addr 10.20.193.123:0/3815848636 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:50.552 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.551+0000 7fec56ed4640 1 -- 10.20.193.123:0/3815848636 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fec50137ab0 msgr2=0x7fec50071250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:50.553 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.551+0000 7fec56ed4640 1 --2- 10.20.193.123:0/3815848636 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fec50137ab0 0x7fec50071250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.553 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.551+0000 7fec56ed4640 1 -- 10.20.193.123:0/3815848636 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fec50131480 msgr2=0x7fec50070d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:50.553 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.551+0000 7fec56ed4640 1 --2- 10.20.193.123:0/3815848636 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fec50131480 0x7fec50070d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.553 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.551+0000 7fec56ed4640 1 -- 10.20.193.123:0/3815848636 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec50116600 con 0x7fec5013a3e0 2026-02-17T20:09:50.553 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.551+0000 7fec56ed4640 1 --2- 10.20.193.123:0/3815848636 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fec5013a3e0 0x7fec50071790 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fec4403a040 tx=0x7fec44004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:50.553 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.551+0000 7fec3affd640 1 -- 10.20.193.123:0/3815848636 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec44046070 con 0x7fec5013a3e0 2026-02-17T20:09:50.553 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.551+0000 7fec3affd640 1 -- 10.20.193.123:0/3815848636 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec44041460 con 0x7fec5013a3e0 2026-02-17T20:09:50.553 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.551+0000 7fec5895e640 1 -- 10.20.193.123:0/3815848636 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec50116b50 con 0x7fec5013a3e0 2026-02-17T20:09:50.553 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.551+0000 7fec3affd640 1 -- 10.20.193.123:0/3815848636 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec4403c040 con 0x7fec5013a3e0 2026-02-17T20:09:50.553 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.551+0000 7fec5895e640 1 -- 10.20.193.123:0/3815848636 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec50071cd0 con 0x7fec5013a3e0 2026-02-17T20:09:50.553 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.551+0000 7fec5895e640 1 -- 10.20.193.123:0/3815848636 --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fec50131860 con 0x7fec5013a3e0 2026-02-17T20:09:50.553 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.551+0000 7fec3affd640 1 -- 10.20.193.123:0/3815848636 <== mon.0 v2:10.20.193.123:3300/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7fec44041830 con 0x7fec5013a3e0 2026-02-17T20:09:50.554 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.552+0000 7fec3affd640 1 -- 10.20.193.123:0/3815848636 <== mon.0 v2:10.20.193.123:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3025+0+0 (secure 0 0 0) 0x7fec4408c8c0 con 0x7fec5013a3e0 2026-02-17T20:09:50.554 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.552+0000 7fec3affd640 1 -- 10.20.193.123:0/3815848636 --> v1:10.20.193.123:6813/2610635322 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fec44046e70 con 0x7fec20056080 2026-02-17T20:09:50.554 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.552+0000 7fec3affd640 1 -- 10.20.193.123:0/3815848636 <== mon.0 v2:10.20.193.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fec440912c0 con 0x7fec5013a3e0 2026-02-17T20:09:50.555 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.552+0000 7fec3affd640 1 -- 10.20.193.123:0/3815848636 <== osd.3 v1:10.20.193.123:6813/2610635322 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7fec44046e70 con 0x7fec20056080 2026-02-17T20:09:50.555 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.558+0000 7fec5895e640 1 -- 10.20.193.123:0/3815848636 --> v1:10.20.193.123:6813/2610635322 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fec500630c0 con 0x7fec20056080 2026-02-17T20:09:50.555 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.559+0000 7fec3affd640 1 -- 10.20.193.123:0/3815848636 <== osd.3 v1:10.20.193.123:6813/2610635322 2 ==== command_reply(tid 2: 0 ) ==== 8+0+712 (unknown 0 0 714369635) 0x7fec500630c0 con 0x7fec20056080 2026-02-17T20:09:50.555 INFO:teuthology.orchestra.run.trial123.stdout:{ 2026-02-17T20:09:50.555 INFO:teuthology.orchestra.run.trial123.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-17T20:09:50.556 INFO:teuthology.orchestra.run.trial123.stdout:} 2026-02-17T20:09:50.557 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.559+0000 7fec5895e640 1 -- 10.20.193.123:0/3815848636 >> v1:10.20.193.123:6813/2610635322 conn(0x7fec20056080 legacy=0x7fec200584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:50.557 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.559+0000 7fec5895e640 1 -- 10.20.193.123:0/3815848636 >> v1:10.20.193.123:6800/115662061 conn(0x7fec2004f790 legacy=0x7fec20051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:50.557 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.559+0000 7fec5895e640 1 -- 10.20.193.123:0/3815848636 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fec5013a3e0 msgr2=0x7fec50071790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:50.557 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.559+0000 7fec5895e640 1 --2- 10.20.193.123:0/3815848636 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fec5013a3e0 0x7fec50071790 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fec4403a040 tx=0x7fec44004b40 comp rx=0 tx=0).stop 2026-02-17T20:09:50.557 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.559+0000 7fec56ed4640 1 -- 10.20.193.123:0/3815848636 reap_dead start 2026-02-17T20:09:50.557 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.559+0000 7fec5895e640 1 -- 10.20.193.123:0/3815848636 shutdown_connections 2026-02-17T20:09:50.557 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.559+0000 7fec5895e640 1 -- 10.20.193.123:0/3815848636 >> 10.20.193.123:0/3815848636 conn(0x7fec5009d580 msgr2=0x7fec50139ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:50.557 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.559+0000 7fec5895e640 1 -- 10.20.193.123:0/3815848636 shutdown_connections 2026-02-17T20:09:50.557 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.559+0000 7fec5895e640 1 -- 10.20.193.123:0/3815848636 wait complete. 2026-02-17T20:09:50.560 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2026-02-17T20:09:50.632 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.631+0000 7fdbb380e640 1 Processor -- start 2026-02-17T20:09:50.633 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.631+0000 7fdbb380e640 1 -- start start 2026-02-17T20:09:50.633 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.631+0000 7fdbb380e640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fdbac130600 0x7fdbac1309e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:50.633 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.631+0000 7fdbb380e640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fdbac115920 0x7fdbac1385e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:50.633 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.631+0000 7fdbb380e640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbac09f550 con 0x7fdbac114e10 2026-02-17T20:09:50.633 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.632+0000 7fdbb380e640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7fdbac130240 con 0x7fdbac115920 2026-02-17T20:09:50.633 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.632+0000 7fdbb380e640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7fdbac071c80 con 0x7fdbac130600 2026-02-17T20:09:50.633 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.632+0000 7fdbb1583640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fdbac130600 0x7fdbac1309e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:50.633 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.632+0000 7fdbb1d84640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fdbac115920 0x7fdbac1385e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:50.633 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.632+0000 7fdbb1583640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fdbac130600 0x7fdbac1309e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:46984/0 (socket says 10.20.193.123:46984) 2026-02-17T20:09:50.634 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.632+0000 7fdbb1d84640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fdbac115920 0x7fdbac1385e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:47922/0 (socket says 10.20.193.123:47922) 2026-02-17T20:09:50.634 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.632+0000 7fdbb1583640 1 -- 10.20.193.123:0/1295131636 learned_addr learned my addr 10.20.193.123:0/1295131636 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:50.634 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.632+0000 7fdbb1583640 1 -- 10.20.193.123:0/1295131636 >> v2:10.20.193.123:3300/0 conn(0x7fdbac115920 msgr2=0x7fdbac1385e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:50.634 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.632+0000 7fdbb1583640 1 --2- 10.20.193.123:0/1295131636 >> v2:10.20.193.123:3300/0 conn(0x7fdbac115920 0x7fdbac1385e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.634 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.632+0000 7fdbb1583640 1 -- 10.20.193.123:0/1295131636 >> v1:10.20.193.123:6789/0 conn(0x7fdbac114e10 legacy=0x7fdbac115210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:50.634 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.632+0000 7fdbb1583640 1 -- 10.20.193.123:0/1295131636 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbac072050 con 0x7fdbac130600 2026-02-17T20:09:50.634 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.632+0000 7fdbb1583640 1 --2- 10.20.193.123:0/1295131636 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fdbac130600 0x7fdbac1309e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c009970 tx=0x7fdb9c02ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92c39b6385113759 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:50.634 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.632+0000 7fdb9bfff640 1 -- 10.20.193.123:0/1295131636 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c03c070 con 0x7fdbac130600 2026-02-17T20:09:50.634 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.632+0000 7fdb9bfff640 1 -- 10.20.193.123:0/1295131636 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb9c02fb10 con 0x7fdbac130600 2026-02-17T20:09:50.634 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.632+0000 7fdb9bfff640 1 -- 10.20.193.123:0/1295131636 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c037440 con 0x7fdbac130600 2026-02-17T20:09:50.635 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.633+0000 7fdbb380e640 1 -- 10.20.193.123:0/1295131636 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fdbac130600 msgr2=0x7fdbac1309e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:50.635 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.633+0000 7fdbb380e640 1 --2- 10.20.193.123:0/1295131636 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fdbac130600 0x7fdbac1309e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c009970 tx=0x7fdb9c02ee90 comp rx=0 tx=0).stop 2026-02-17T20:09:50.635 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.633+0000 7fdbb380e640 1 -- 10.20.193.123:0/1295131636 shutdown_connections 2026-02-17T20:09:50.635 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.633+0000 7fdbb380e640 1 --2- 10.20.193.123:0/1295131636 >> v2:10.20.193.123:3300/0 conn(0x7fdbac115920 0x7fdbac1385e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.635 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.633+0000 7fdbb380e640 1 --2- 10.20.193.123:0/1295131636 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fdbac130600 0x7fdbac1309e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.635 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.633+0000 7fdbb380e640 1 -- 10.20.193.123:0/1295131636 >> 10.20.193.123:0/1295131636 conn(0x7fdbac09e7c0 msgr2=0x7fdbac09ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:50.635 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.633+0000 7fdbb380e640 1 -- 10.20.193.123:0/1295131636 shutdown_connections 2026-02-17T20:09:50.635 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.633+0000 7fdbb380e640 1 -- 10.20.193.123:0/1295131636 wait complete. 2026-02-17T20:09:50.635 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.633+0000 7fdbb380e640 1 Processor -- start 2026-02-17T20:09:50.635 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.633+0000 7fdbb380e640 1 -- start start 2026-02-17T20:09:50.636 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.634+0000 7fdbb380e640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fdbac114e10 0x7fdbac1323e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:50.636 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.634+0000 7fdbb380e640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fdbac115920 0x7fdbac132920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:50.636 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.634+0000 7fdbb380e640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fdbac130600 0x7fdbac132e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:50.636 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.634+0000 7fdbb380e640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdbac130f20 con 0x7fdbac115920 2026-02-17T20:09:50.636 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.634+0000 7fdbb380e640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7fdbac116cc0 con 0x7fdbac130600 2026-02-17T20:09:50.636 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.634+0000 7fdbb380e640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7fdbac1310a0 con 0x7fdbac114e10 2026-02-17T20:09:50.636 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.634+0000 7fdbb1583640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fdbac114e10 0x7fdbac1323e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:50.636 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.634+0000 7fdbb0d82640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fdbac115920 0x7fdbac132920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:50.636 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.634+0000 7fdbb1583640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fdbac114e10 0x7fdbac1323e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:38082/0 (socket says 10.20.193.123:38082) 2026-02-17T20:09:50.636 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.634+0000 7fdbb1583640 1 -- 10.20.193.123:0/3717914084 learned_addr learned my addr 10.20.193.123:0/3717914084 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:50.636 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.634+0000 7fdbb0d82640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fdbac115920 0x7fdbac132920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:47936/0 (socket says 10.20.193.123:47936) 2026-02-17T20:09:50.637 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.634+0000 7fdbb1d84640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fdbac130600 0x7fdbac132e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:50.637 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.634+0000 7fdbb1583640 1 -- 10.20.193.123:0/3717914084 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fdbac130600 msgr2=0x7fdbac132e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:50.637 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.634+0000 7fdbb1583640 1 --2- 10.20.193.123:0/3717914084 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fdbac130600 0x7fdbac132e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.637 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.634+0000 7fdbb1583640 1 -- 10.20.193.123:0/3717914084 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fdbac115920 msgr2=0x7fdbac132920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:50.637 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.634+0000 7fdbb1583640 1 --2- 10.20.193.123:0/3717914084 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fdbac115920 0x7fdbac132920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.637 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.634+0000 7fdbb1583640 1 -- 10.20.193.123:0/3717914084 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbac135770 con 0x7fdbac114e10 2026-02-17T20:09:50.637 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.634+0000 7fdbb0d82640 1 --2- 10.20.193.123:0/3717914084 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fdbac115920 0x7fdbac132920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:09:50.637 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.634+0000 7fdbb1583640 1 --2- 10.20.193.123:0/3717914084 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fdbac114e10 0x7fdbac1323e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c009aa0 tx=0x7fdb9c0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:50.637 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.634+0000 7fdb99ffb640 1 -- 10.20.193.123:0/3717914084 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c03c040 con 0x7fdbac114e10 2026-02-17T20:09:50.637 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.634+0000 7fdb99ffb640 1 -- 10.20.193.123:0/3717914084 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb9c045070 con 0x7fdbac114e10 2026-02-17T20:09:50.637 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.634+0000 7fdbb380e640 1 -- 10.20.193.123:0/3717914084 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbac135140 con 0x7fdbac114e10 2026-02-17T20:09:50.637 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.634+0000 7fdb99ffb640 1 -- 10.20.193.123:0/3717914084 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c040890 con 0x7fdbac114e10 2026-02-17T20:09:50.638 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.634+0000 7fdbb380e640 1 -- 10.20.193.123:0/3717914084 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbac1347a0 con 0x7fdbac114e10 2026-02-17T20:09:50.638 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.635+0000 7fdbb380e640 1 -- 10.20.193.123:0/3717914084 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbac1309e0 con 0x7fdbac114e10 2026-02-17T20:09:50.638 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.635+0000 7fdb99ffb640 1 -- 10.20.193.123:0/3717914084 <== mon.2 v2:10.20.193.123:3302/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7fdb9c03f070 con 0x7fdbac114e10 2026-02-17T20:09:50.638 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.635+0000 7fdb99ffb640 1 -- 10.20.193.123:0/3717914084 <== mon.2 v2:10.20.193.123:3302/0 5 ==== osd_map(30..30 src has 1..30) ==== 3025+0+0 (secure 0 0 0) 0x7fdb9c08b630 con 0x7fdbac114e10 2026-02-17T20:09:50.638 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.637+0000 7fdb99ffb640 1 -- 10.20.193.123:0/3717914084 <== mon.2 v2:10.20.193.123:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7fdb9c065570 con 0x7fdbac114e10 2026-02-17T20:09:50.705 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.709+0000 7fdbb380e640 1 -- 10.20.193.123:0/3717914084 --> v1:10.20.193.123:6800/115662061 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fdbac134ef0 con 0x7fdb7c04f790 2026-02-17T20:09:50.705 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.709+0000 7fdb99ffb640 1 -- 10.20.193.123:0/3717914084 <== mgr.14107 v1:10.20.193.123:6800/115662061 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (unknown 3526570807 0 0) 0x7fdba0003f90 con 0x7fdb7c04f790 2026-02-17T20:09:50.705 INFO:teuthology.orchestra.run.trial123.stderr:instructed osd(s) 3 to deep-scrub 2026-02-17T20:09:50.706 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.710+0000 7fdbb380e640 1 -- 10.20.193.123:0/3717914084 >> v1:10.20.193.123:6800/115662061 conn(0x7fdb7c04f790 legacy=0x7fdb7c051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:50.706 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.710+0000 7fdbb380e640 1 -- 10.20.193.123:0/3717914084 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fdbac114e10 msgr2=0x7fdbac1323e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:50.706 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.710+0000 7fdbb380e640 1 --2- 10.20.193.123:0/3717914084 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fdbac114e10 0x7fdbac1323e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c009aa0 tx=0x7fdb9c0047c0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.706 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.710+0000 7fdbb380e640 1 -- 10.20.193.123:0/3717914084 shutdown_connections 2026-02-17T20:09:50.706 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.710+0000 7fdbb380e640 1 --2- 10.20.193.123:0/3717914084 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fdbac130600 0x7fdbac132e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.706 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.710+0000 7fdbb380e640 1 --2- 10.20.193.123:0/3717914084 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fdbac115920 0x7fdbac132920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.706 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.710+0000 7fdbb380e640 1 --2- 10.20.193.123:0/3717914084 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fdbac114e10 0x7fdbac1323e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.706 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.710+0000 7fdbb380e640 1 -- 10.20.193.123:0/3717914084 >> 10.20.193.123:0/3717914084 conn(0x7fdbac09e7c0 msgr2=0x7fdbac06e820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:50.706 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.710+0000 7fdbb380e640 1 -- 10.20.193.123:0/3717914084 shutdown_connections 2026-02-17T20:09:50.706 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.710+0000 7fdbb380e640 1 -- 10.20.193.123:0/3717914084 wait complete. 2026-02-17T20:09:50.713 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T20:09:50.783 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.782+0000 7f16099c1640 1 Processor -- start 2026-02-17T20:09:50.783 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.782+0000 7f16099c1640 1 -- start start 2026-02-17T20:09:50.783 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.783+0000 7f16099c1640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f1604073910 0x7f1604139ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:50.783 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.783+0000 7f16099c1640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f160413a020 0x7f160413c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:50.784 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.783+0000 7f16099c1640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1604072940 con 0x7f1604071600 2026-02-17T20:09:50.784 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.783+0000 7f16099c1640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f1604074220 con 0x7f160413a020 2026-02-17T20:09:50.784 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.783+0000 7f16099c1640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f16040720f0 con 0x7f1604073910 2026-02-17T20:09:50.784 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.783+0000 7f1602ffd640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7f1604071600 0x7f16040719e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:39672/0 (socket says 10.20.193.123:39672) 2026-02-17T20:09:50.784 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.783+0000 7f1602ffd640 1 -- 10.20.193.123:0/2554557110 learned_addr learned my addr 10.20.193.123:0/2554557110 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:09:50.784 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.783+0000 7f16027fc640 1 --2- 10.20.193.123:0/2554557110 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f1604073910 0x7f1604139ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:50.784 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.783+0000 7f16037fe640 1 --2- 10.20.193.123:0/2554557110 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f160413a020 0x7f160413c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:50.784 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.783+0000 7f1601ffb640 1 -- 10.20.193.123:0/2554557110 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 74877561 0 0) 0x7f1604072940 con 0x7f1604071600 2026-02-17T20:09:50.784 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.783+0000 7f1601ffb640 1 -- 10.20.193.123:0/2554557110 --> v1:10.20.193.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15f0003620 con 0x7f1604071600 2026-02-17T20:09:50.784 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.783+0000 7f16027fc640 1 -- 10.20.193.123:0/2554557110 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f160413a020 msgr2=0x7f160413c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:09:50.784 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.783+0000 7f16027fc640 1 --2- 10.20.193.123:0/2554557110 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f160413a020 0x7f160413c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.785 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.783+0000 7f16027fc640 1 -- 10.20.193.123:0/2554557110 >> v1:10.20.193.123:6789/0 conn(0x7f1604071600 legacy=0x7f16040719e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:50.785 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.783+0000 7f16027fc640 1 -- 10.20.193.123:0/2554557110 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1604072f40 con 0x7f1604073910 2026-02-17T20:09:50.785 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.783+0000 7f16027fc640 1 --2- 10.20.193.123:0/2554557110 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f1604073910 0x7f1604139ae0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f15ec0098d0 tx=0x7f15ec02edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e6d75034e84fe60 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:50.785 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.783+0000 7f1601ffb640 1 -- 10.20.193.123:0/2554557110 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15ec03c070 con 0x7f1604073910 2026-02-17T20:09:50.785 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.783+0000 7f1601ffb640 1 -- 10.20.193.123:0/2554557110 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15ec02fa30 con 0x7f1604073910 2026-02-17T20:09:50.785 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.783+0000 7f1601ffb640 1 -- 10.20.193.123:0/2554557110 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15ec02fde0 con 0x7f1604073910 2026-02-17T20:09:50.785 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.784+0000 7f16099c1640 1 -- 10.20.193.123:0/2554557110 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f1604073910 msgr2=0x7f1604139ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:50.785 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.784+0000 7f16099c1640 1 --2- 10.20.193.123:0/2554557110 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f1604073910 0x7f1604139ae0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f15ec0098d0 tx=0x7f15ec02edc0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.785 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.784+0000 7f16099c1640 1 -- 10.20.193.123:0/2554557110 shutdown_connections 2026-02-17T20:09:50.785 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.784+0000 7f16099c1640 1 --2- 10.20.193.123:0/2554557110 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f1604073910 0x7f1604139ae0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.785 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.784+0000 7f16099c1640 1 --2- 10.20.193.123:0/2554557110 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f160413a020 0x7f160413c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.785 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.784+0000 7f16099c1640 1 -- 10.20.193.123:0/2554557110 >> 10.20.193.123:0/2554557110 conn(0x7f160409d6c0 msgr2=0x7f160409dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:50.786 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.784+0000 7f16099c1640 1 -- 10.20.193.123:0/2554557110 shutdown_connections 2026-02-17T20:09:50.786 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.784+0000 7f16099c1640 1 -- 10.20.193.123:0/2554557110 wait complete. 2026-02-17T20:09:50.786 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.784+0000 7f16099c1640 1 Processor -- start 2026-02-17T20:09:50.786 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.785+0000 7f16099c1640 1 -- start start 2026-02-17T20:09:50.786 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.785+0000 7f16099c1640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f1604071600 0x7f1604138920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:50.786 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.785+0000 7f16099c1640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f1604073910 0x7f1604138e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:50.786 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.785+0000 7f16099c1640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f160413a020 0x7f16041393a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:09:50.786 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.785+0000 7f16099c1640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7f160413cce0 con 0x7f160413a020 2026-02-17T20:09:50.786 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.785+0000 7f16099c1640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f160413cb60 con 0x7f1604071600 2026-02-17T20:09:50.786 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.785+0000 7f16099c1640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f160413ce60 con 0x7f1604073910 2026-02-17T20:09:50.786 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.785+0000 7f16027fc640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f1604073910 0x7f1604138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:50.786 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.785+0000 7f16027fc640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f1604073910 0x7f1604138e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3302/0 says I am v2:10.20.193.123:38102/0 (socket says 10.20.193.123:38102) 2026-02-17T20:09:50.787 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.785+0000 7f16027fc640 1 -- 10.20.193.123:0/3459831774 learned_addr learned my addr 10.20.193.123:0/3459831774 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:09:50.787 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.785+0000 7f1602ffd640 1 --2- 10.20.193.123:0/3459831774 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f1604071600 0x7f1604138920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:50.787 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.785+0000 7f16037fe640 1 --2- 10.20.193.123:0/3459831774 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f160413a020 0x7f16041393a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:09:50.787 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.785+0000 7f16027fc640 1 -- 10.20.193.123:0/3459831774 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f1604071600 msgr2=0x7f1604138920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:50.787 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.785+0000 7f16027fc640 1 --2- 10.20.193.123:0/3459831774 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f1604071600 0x7f1604138920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.787 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.785+0000 7f16027fc640 1 -- 10.20.193.123:0/3459831774 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f160413a020 msgr2=0x7f16041393a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:50.787 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.785+0000 7f16027fc640 1 --2- 10.20.193.123:0/3459831774 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f160413a020 0x7f16041393a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.787 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.785+0000 7f16027fc640 1 -- 10.20.193.123:0/3459831774 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1604116620 con 0x7f1604073910 2026-02-17T20:09:50.787 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.785+0000 7f16027fc640 1 --2- 10.20.193.123:0/3459831774 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f1604073910 0x7f1604138e60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f15ec03a040 tx=0x7f15ec0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:09:50.787 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.785+0000 7f15dbfff640 1 -- 10.20.193.123:0/3459831774 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15ec03c040 con 0x7f1604073910 2026-02-17T20:09:50.787 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.785+0000 7f15dbfff640 1 -- 10.20.193.123:0/3459831774 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15ec038c50 con 0x7f1604073910 2026-02-17T20:09:50.788 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.785+0000 7f16099c1640 1 -- 10.20.193.123:0/3459831774 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1604116b70 con 0x7f1604073910 2026-02-17T20:09:50.788 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.785+0000 7f15dbfff640 1 -- 10.20.193.123:0/3459831774 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15ec004030 con 0x7f1604073910 2026-02-17T20:09:50.788 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.785+0000 7f16099c1640 1 -- 10.20.193.123:0/3459831774 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f16041398e0 con 0x7f1604073910 2026-02-17T20:09:50.788 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.786+0000 7f16099c1640 1 -- 10.20.193.123:0/3459831774 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16040719e0 con 0x7f1604073910 2026-02-17T20:09:50.788 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.786+0000 7f15dbfff640 1 -- 10.20.193.123:0/3459831774 <== mon.2 v2:10.20.193.123:3302/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f15ec053060 con 0x7f1604073910 2026-02-17T20:09:50.788 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.786+0000 7f15dbfff640 1 -- 10.20.193.123:0/3459831774 <== mon.2 v2:10.20.193.123:3302/0 5 ==== osd_map(30..30 src has 1..30) ==== 3025+0+0 (secure 0 0 0) 0x7f15ec08bd50 con 0x7f1604073910 2026-02-17T20:09:50.788 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.788+0000 7f15dbfff640 1 -- 10.20.193.123:0/3459831774 <== mon.2 v2:10.20.193.123:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f15ec08f030 con 0x7f1604073910 2026-02-17T20:09:50.853 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.857+0000 7f16099c1640 1 -- 10.20.193.123:0/3459831774 --> v1:10.20.193.123:6800/115662061 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f16040008d0 con 0x7f15d404f790 2026-02-17T20:09:50.854 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.857+0000 7f15dbfff640 1 -- 10.20.193.123:0/3459831774 <== mgr.14107 v1:10.20.193.123:6800/115662061 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31952 (unknown 2965378022 0 1957667114) 0x7f16040008d0 con 0x7f15d404f790 2026-02-17T20:09:50.854 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:09:50.855 INFO:teuthology.orchestra.run.trial123.stderr:dumped all 2026-02-17T20:09:50.855 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.858+0000 7f16099c1640 1 -- 10.20.193.123:0/3459831774 >> v1:10.20.193.123:6800/115662061 conn(0x7f15d404f790 legacy=0x7f15d4051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:50.856 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.858+0000 7f16099c1640 1 -- 10.20.193.123:0/3459831774 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f1604073910 msgr2=0x7f1604138e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:09:50.856 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.858+0000 7f16099c1640 1 --2- 10.20.193.123:0/3459831774 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f1604073910 0x7f1604138e60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f15ec03a040 tx=0x7f15ec0047c0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.856 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.858+0000 7f16099c1640 1 -- 10.20.193.123:0/3459831774 shutdown_connections 2026-02-17T20:09:50.856 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.858+0000 7f16099c1640 1 --2- 10.20.193.123:0/3459831774 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f160413a020 0x7f16041393a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.856 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.858+0000 7f16099c1640 1 --2- 10.20.193.123:0/3459831774 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f1604073910 0x7f1604138e60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.856 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.858+0000 7f16099c1640 1 --2- 10.20.193.123:0/3459831774 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f1604071600 0x7f1604138920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:09:50.856 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.858+0000 7f16099c1640 1 -- 10.20.193.123:0/3459831774 >> 10.20.193.123:0/3459831774 conn(0x7f160409d6c0 msgr2=0x7f1604130d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:09:50.856 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.858+0000 7f16099c1640 1 -- 10.20.193.123:0/3459831774 shutdown_connections 2026-02-17T20:09:50.856 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:09:50.858+0000 7f16099c1640 1 -- 10.20.193.123:0/3459831774 wait complete. 2026-02-17T20:09:50.862 INFO:teuthology.orchestra.run.trial123.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2026-02-17T20:09:50.325607+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":115,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":128644,"kb_used_data":2128,"kb_used_omap":17,"kb_used_meta":126446,"kb_avail":377358716,"statfs":{"total":386547056640,"available":386415325184,"internally_reserved":0,"allocated":2179072,"data_stored":1528789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18186,"internal_metadata":129480950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.934610"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-17T20:09:42.637769+0000","last_change":"2026-02-17T20:09:40.389699+0000","last_active":"2026-02-17T20:09:42.637769+0000","last_peered":"2026-02-17T20:09:42.637769+0000","last_clean":"2026-02-17T20:09:42.637769+0000","last_became_active":"2026-02-17T20:09:40.389602+0000","last_became_peered":"2026-02-17T20:09:40.389602+0000","last_unstale":"2026-02-17T20:09:42.637769+0000","last_undegraded":"2026-02-17T20:09:42.637769+0000","last_fullsized":"2026-02-17T20:09:42.637769+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T05:00:57.169209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-17T20:09:44.397270+0000","last_change":"2026-02-17T20:09:40.959635+0000","last_active":"2026-02-17T20:09:44.397270+0000","last_peered":"2026-02-17T20:09:44.397270+0000","last_clean":"2026-02-17T20:09:44.397270+0000","last_became_active":"2026-02-17T20:09:40.959369+0000","last_became_peered":"2026-02-17T20:09:40.959369+0000","last_unstale":"2026-02-17T20:09:44.397270+0000","last_undegraded":"2026-02-17T20:09:44.397270+0000","last_fullsized":"2026-02-17T20:09:44.397270+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:34:32.321476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033416199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-17T20:09:47.172011+0000","last_change":"2026-02-17T20:09:40.389967+0000","last_active":"2026-02-17T20:09:47.172011+0000","last_peered":"2026-02-17T20:09:47.172011+0000","last_clean":"2026-02-17T20:09:47.172011+0000","last_became_active":"2026-02-17T20:09:40.389827+0000","last_became_peered":"2026-02-17T20:09:40.389827+0000","last_unstale":"2026-02-17T20:09:47.172011+0000","last_undegraded":"2026-02-17T20:09:47.172011+0000","last_fullsized":"2026-02-17T20:09:47.172011+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T07:39:21.099659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026693600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-17T20:09:44.397241+0000","last_change":"2026-02-17T20:09:40.959612+0000","last_active":"2026-02-17T20:09:44.397241+0000","last_peered":"2026-02-17T20:09:44.397241+0000","last_clean":"2026-02-17T20:09:44.397241+0000","last_became_active":"2026-02-17T20:09:40.959406+0000","last_became_peered":"2026-02-17T20:09:40.959406+0000","last_unstale":"2026-02-17T20:09:44.397241+0000","last_undegraded":"2026-02-17T20:09:44.397241+0000","last_fullsized":"2026-02-17T20:09:44.397241+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T06:06:40.610646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000242539,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"17'79","reported_seq":153,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-17T20:09:44.397310+0000","last_change":"2026-02-17T20:09:40.389898+0000","last_active":"2026-02-17T20:09:44.397310+0000","last_peered":"2026-02-17T20:09:44.397310+0000","last_clean":"2026-02-17T20:09:44.397310+0000","last_became_active":"2026-02-17T20:09:40.389750+0000","last_became_peered":"2026-02-17T20:09:40.389750+0000","last_unstale":"2026-02-17T20:09:44.397310+0000","last_undegraded":"2026-02-17T20:09:44.397310+0000","last_fullsized":"2026-02-17T20:09:44.397310+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:28.678564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:28.678564+0000","last_clean_scrub_stamp":"2026-02-17T20:08:28.678564+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T00:37:14.734978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"11'1","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-17T20:09:42.637765+0000","last_change":"2026-02-17T20:09:39.388699+0000","last_active":"2026-02-17T20:09:42.637765+0000","last_peered":"2026-02-17T20:09:42.637765+0000","last_clean":"2026-02-17T20:09:42.637765+0000","last_became_active":"2026-02-17T20:09:39.388484+0000","last_became_peered":"2026-02-17T20:09:39.388484+0000","last_unstale":"2026-02-17T20:09:42.637765+0000","last_undegraded":"2026-02-17T20:09:42.637765+0000","last_fullsized":"2026-02-17T20:09:42.637765+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T02:45:47.622204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000198235,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"13'2","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-17T20:09:44.397065+0000","last_change":"2026-02-17T20:09:38.388175+0000","last_active":"2026-02-17T20:09:44.397065+0000","last_peered":"2026-02-17T20:09:44.397065+0000","last_clean":"2026-02-17T20:09:44.397065+0000","last_became_active":"2026-02-17T20:09:38.388004+0000","last_became_peered":"2026-02-17T20:09:38.388004+0000","last_unstale":"2026-02-17T20:09:44.397065+0000","last_undegraded":"2026-02-17T20:09:44.397065+0000","last_fullsized":"2026-02-17T20:09:44.397065+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:08:31.580414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059736000000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-17T20:09:44.397243+0000","last_change":"2026-02-17T20:09:40.959406+0000","last_active":"2026-02-17T20:09:44.397243+0000","last_peered":"2026-02-17T20:09:44.397243+0000","last_clean":"2026-02-17T20:09:44.397243+0000","last_became_active":"2026-02-17T20:09:40.959125+0000","last_became_peered":"2026-02-17T20:09:40.959125+0000","last_unstale":"2026-02-17T20:09:44.397243+0000","last_undegraded":"2026-02-17T20:09:44.397243+0000","last_fullsized":"2026-02-17T20:09:44.397243+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T01:49:16.320239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00023917200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-17T20:09:42.637776+0000","last_change":"2026-02-17T20:09:38.387850+0000","last_active":"2026-02-17T20:09:42.637776+0000","last_peered":"2026-02-17T20:09:42.637776+0000","last_clean":"2026-02-17T20:09:42.637776+0000","last_became_active":"2026-02-17T20:09:38.387688+0000","last_became_peered":"2026-02-17T20:09:38.387688+0000","last_unstale":"2026-02-17T20:09:42.637776+0000","last_undegraded":"2026-02-17T20:09:42.637776+0000","last_fullsized":"2026-02-17T20:09:42.637776+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:08:27.677312+0000","last_clean_scrub_stamp":"2026-02-17T20:08:27.677312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T06:48:35.959788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000175532,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":26,"seq":111669149700,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32456,"kb_used_data":828,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339384,"statfs":{"total":96636764160,"available":96603529216,"internally_reserved":0,"allocated":847872,"data_stored":680349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4547,"internal_metadata":32370237},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":25,"seq":107374182404,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31864,"kb_used_data":236,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339976,"statfs":{"total":96636764160,"available":96604135424,"internally_reserved":0,"allocated":241664,"data_stored":85808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4547,"internal_metadata":32370237},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":24,"seq":103079215108,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32440,"kb_used_data":812,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":831488,"data_stored":672632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4546,"internal_metadata":32370238},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":23,"seq":98784247812,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31884,"kb_used_data":252,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339956,"statfs":{"total":96636764160,"available":96604114944,"internally_reserved":0,"allocated":258048,"data_stored":90000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4546,"internal_metadata":32370238},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T20:09:50.867 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2026-02-17T20:08:27.677312+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=20, tm_min=8, tm_sec=27, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=20, tm_min=9, tm_sec=48, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T20:09:50.867 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2026-02-17T20:08:27.677312+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=20, tm_min=8, tm_sec=27, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=20, tm_min=9, tm_sec=48, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T20:09:50.867 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2026-02-17T20:08:27.677312+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=20, tm_min=8, tm_sec=27, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=20, tm_min=9, tm_sec=48, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T20:09:50.867 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2026-02-17T20:08:27.677312+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=20, tm_min=8, tm_sec=27, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=20, tm_min=9, tm_sec=48, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T20:09:50.868 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2026-02-17T20:08:28.678564+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=20, tm_min=8, tm_sec=28, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=20, tm_min=9, tm_sec=48, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T20:09:50.868 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2026-02-17T20:08:27.677312+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=20, tm_min=8, tm_sec=27, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=20, tm_min=9, tm_sec=48, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T20:09:50.868 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2026-02-17T20:08:27.677312+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=20, tm_min=8, tm_sec=27, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=20, tm_min=9, tm_sec=48, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T20:09:50.868 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2026-02-17T20:08:27.677312+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=20, tm_min=8, tm_sec=27, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=20, tm_min=9, tm_sec=48, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T20:09:50.868 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2026-02-17T20:08:27.677312+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=20, tm_min=8, tm_sec=27, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=20, tm_min=9, tm_sec=48, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T20:09:50.868 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-17T20:10:10.869 DEBUG:teuthology.orchestra.run.trial123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T20:10:10.955 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.953+0000 7f739c3aa640 1 Processor -- start 2026-02-17T20:10:10.955 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.953+0000 7f739c3aa640 1 -- start start 2026-02-17T20:10:10.955 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.954+0000 7f739c3aa640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f7394073e40 0x7f7394133230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:10:10.955 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.954+0000 7f739c3aa640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f7394133770 0x7f7394135b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:10:10.955 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.954+0000 7f739c3aa640 1 -- --> v1:10.20.193.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73940733b0 con 0x7f739412e400 2026-02-17T20:10:10.955 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.954+0000 7f739c3aa640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f7394074500 con 0x7f7394073e40 2026-02-17T20:10:10.955 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.954+0000 7f739c3aa640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f7394073700 con 0x7f7394133770 2026-02-17T20:10:10.956 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.954+0000 7f739a920640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f7394133770 0x7f7394135b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:10:10.956 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.954+0000 7f739991e640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f7394073e40 0x7f7394133230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:10:10.956 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.954+0000 7f739a11f640 1 --1- >> v1:10.20.193.123:6789/0 conn(0x7f739412e400 0x7f739412e7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.123:6789/0 says I am v1:10.20.193.123:37546/0 (socket says 10.20.193.123:37546) 2026-02-17T20:10:10.956 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.954+0000 7f739a11f640 1 -- 10.20.193.123:0/3266989431 learned_addr learned my addr 10.20.193.123:0/3266989431 (peer_addr_for_me v1:10.20.193.123:0/0) 2026-02-17T20:10:10.956 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.954+0000 7f739911d640 1 -- 10.20.193.123:0/3266989431 <== mon.0 v1:10.20.193.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3598361485 0 0) 0x7f73940733b0 con 0x7f739412e400 2026-02-17T20:10:10.956 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.954+0000 7f739911d640 1 -- 10.20.193.123:0/3266989431 --> v1:10.20.193.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f737c003620 con 0x7f739412e400 2026-02-17T20:10:10.956 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.954+0000 7f739a920640 1 -- 10.20.193.123:0/3266989431 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f7394073e40 msgr2=0x7f7394133230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:10:10.956 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.954+0000 7f739a920640 1 --2- 10.20.193.123:0/3266989431 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f7394073e40 0x7f7394133230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:10:10.956 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.954+0000 7f739a920640 1 -- 10.20.193.123:0/3266989431 >> v1:10.20.193.123:6789/0 conn(0x7f739412e400 legacy=0x7f739412e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:10:10.956 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.954+0000 7f739a920640 1 -- 10.20.193.123:0/3266989431 --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f739412e120 con 0x7f7394133770 2026-02-17T20:10:10.956 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.955+0000 7f739a920640 1 --2- 10.20.193.123:0/3266989431 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f7394133770 0x7f7394135b60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7390009df0 tx=0x7f739002f200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c76ab37abeb2edf3 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:10:10.957 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.955+0000 7f739911d640 1 -- 10.20.193.123:0/3266989431 <== mon.2 v2:10.20.193.123:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f739003c070 con 0x7f7394133770 2026-02-17T20:10:10.957 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.955+0000 7f739911d640 1 -- 10.20.193.123:0/3266989431 <== mon.2 v2:10.20.193.123:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f739002fe30 con 0x7f7394133770 2026-02-17T20:10:10.957 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.955+0000 7f739911d640 1 -- 10.20.193.123:0/3266989431 <== mon.2 v2:10.20.193.123:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7390037640 con 0x7f7394133770 2026-02-17T20:10:10.957 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.955+0000 7f739c3aa640 1 -- 10.20.193.123:0/3266989431 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f7394133770 msgr2=0x7f7394135b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:10:10.957 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.955+0000 7f739c3aa640 1 --2- 10.20.193.123:0/3266989431 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f7394133770 0x7f7394135b60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7390009df0 tx=0x7f739002f200 comp rx=0 tx=0).stop 2026-02-17T20:10:10.957 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.955+0000 7f739c3aa640 1 -- 10.20.193.123:0/3266989431 shutdown_connections 2026-02-17T20:10:10.957 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.955+0000 7f739c3aa640 1 --2- 10.20.193.123:0/3266989431 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f7394133770 0x7f7394135b60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:10:10.957 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.955+0000 7f739c3aa640 1 --2- 10.20.193.123:0/3266989431 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f7394073e40 0x7f7394133230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:10:10.957 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.955+0000 7f739c3aa640 1 -- 10.20.193.123:0/3266989431 >> 10.20.193.123:0/3266989431 conn(0x7f739409ea30 msgr2=0x7f739409ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:10:10.957 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.955+0000 7f739c3aa640 1 -- 10.20.193.123:0/3266989431 shutdown_connections 2026-02-17T20:10:10.957 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.955+0000 7f739c3aa640 1 -- 10.20.193.123:0/3266989431 wait complete. 2026-02-17T20:10:10.957 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.956+0000 7f739c3aa640 1 Processor -- start 2026-02-17T20:10:10.958 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.956+0000 7f739c3aa640 1 -- start start 2026-02-17T20:10:10.958 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.956+0000 7f739c3aa640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f7394073e40 0x7f73941c7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:10:10.958 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.956+0000 7f739c3aa640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f739412e400 0x7f73941c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:10:10.958 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.956+0000 7f739c3aa640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f7394133770 0x7f739406f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:10:10.958 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.956+0000 7f739c3aa640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7394136430 con 0x7f7394073e40 2026-02-17T20:10:10.958 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.956+0000 7f739c3aa640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7f73941362b0 con 0x7f739412e400 2026-02-17T20:10:10.958 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.956+0000 7f739c3aa640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7f73941365b0 con 0x7f7394133770 2026-02-17T20:10:10.958 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.956+0000 7f739991e640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f739412e400 0x7f73941c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:10:10.958 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.956+0000 7f739a11f640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f7394073e40 0x7f73941c7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:10:10.958 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.956+0000 7f739991e640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f739412e400 0x7f73941c7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:50982/0 (socket says 10.20.193.123:50982) 2026-02-17T20:10:10.958 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.956+0000 7f739991e640 1 -- 10.20.193.123:0/2854619991 learned_addr learned my addr 10.20.193.123:0/2854619991 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:10:10.958 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.956+0000 7f739a920640 1 --2- 10.20.193.123:0/2854619991 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f7394133770 0x7f739406f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:10:10.959 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.956+0000 7f739991e640 1 -- 10.20.193.123:0/2854619991 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f7394133770 msgr2=0x7f739406f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:10:10.959 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.956+0000 7f739991e640 1 --2- 10.20.193.123:0/2854619991 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f7394133770 0x7f739406f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:10:10.959 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.956+0000 7f739991e640 1 -- 10.20.193.123:0/2854619991 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f7394073e40 msgr2=0x7f73941c7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:10:10.959 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.956+0000 7f739991e640 1 --2- 10.20.193.123:0/2854619991 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f7394073e40 0x7f73941c7770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:10:10.959 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.956+0000 7f739991e640 1 -- 10.20.193.123:0/2854619991 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7394118340 con 0x7f739412e400 2026-02-17T20:10:10.959 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.956+0000 7f739991e640 1 --2- 10.20.193.123:0/2854619991 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f739412e400 0x7f73941c7cb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f738800ebe0 tx=0x7f738800c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:10:10.959 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.956+0000 7f737affd640 1 -- 10.20.193.123:0/2854619991 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7388017070 con 0x7f739412e400 2026-02-17T20:10:10.959 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.956+0000 7f737affd640 1 -- 10.20.193.123:0/2854619991 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f738800cc40 con 0x7f739412e400 2026-02-17T20:10:10.959 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.956+0000 7f739c3aa640 1 -- 10.20.193.123:0/2854619991 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7394117920 con 0x7f739412e400 2026-02-17T20:10:10.959 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.956+0000 7f737affd640 1 -- 10.20.193.123:0/2854619991 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7388013470 con 0x7f739412e400 2026-02-17T20:10:10.959 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.956+0000 7f739c3aa640 1 -- 10.20.193.123:0/2854619991 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f73941c83d0 con 0x7f739412e400 2026-02-17T20:10:10.959 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.957+0000 7f739c3aa640 1 -- 10.20.193.123:0/2854619991 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f739412e7e0 con 0x7f739412e400 2026-02-17T20:10:10.960 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.957+0000 7f737affd640 1 -- 10.20.193.123:0/2854619991 <== mon.1 v2:10.20.193.123:3301/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f7388024060 con 0x7f739412e400 2026-02-17T20:10:10.960 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.957+0000 7f737affd640 1 -- 10.20.193.123:0/2854619991 <== mon.1 v2:10.20.193.123:3301/0 5 ==== osd_map(30..30 src has 1..30) ==== 3025+0+0 (secure 0 0 0) 0x7f7388066c20 con 0x7f739412e400 2026-02-17T20:10:10.960 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:10.959+0000 7f737affd640 1 -- 10.20.193.123:0/2854619991 <== mon.1 v2:10.20.193.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f7388040a10 con 0x7f739412e400 2026-02-17T20:10:11.024 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.027+0000 7f739c3aa640 1 -- 10.20.193.123:0/2854619991 --> v1:10.20.193.123:6800/115662061 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7394068530 con 0x7f736404f790 2026-02-17T20:10:11.025 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.028+0000 7f737affd640 1 -- 10.20.193.123:0/2854619991 <== mgr.14107 v1:10.20.193.123:6800/115662061 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31961 (unknown 2965378022 0 1721776828) 0x7f7394068530 con 0x7f736404f790 2026-02-17T20:10:11.026 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-17T20:10:11.027 INFO:teuthology.orchestra.run.trial123.stderr:dumped all 2026-02-17T20:10:11.027 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.029+0000 7f739c3aa640 1 -- 10.20.193.123:0/2854619991 >> v1:10.20.193.123:6800/115662061 conn(0x7f736404f790 legacy=0x7f7364051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:10:11.027 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.029+0000 7f739c3aa640 1 -- 10.20.193.123:0/2854619991 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f739412e400 msgr2=0x7f73941c7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:10:11.027 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.029+0000 7f739c3aa640 1 --2- 10.20.193.123:0/2854619991 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f739412e400 0x7f73941c7cb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f738800ebe0 tx=0x7f738800c520 comp rx=0 tx=0).stop 2026-02-17T20:10:11.027 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.029+0000 7f739c3aa640 1 -- 10.20.193.123:0/2854619991 shutdown_connections 2026-02-17T20:10:11.027 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.029+0000 7f739c3aa640 1 --2- 10.20.193.123:0/2854619991 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7f7394133770 0x7f739406f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:10:11.027 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.029+0000 7f739c3aa640 1 --2- 10.20.193.123:0/2854619991 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7f739412e400 0x7f73941c7cb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:10:11.027 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.029+0000 7f739c3aa640 1 --2- 10.20.193.123:0/2854619991 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7f7394073e40 0x7f73941c7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:10:11.028 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.029+0000 7f739c3aa640 1 -- 10.20.193.123:0/2854619991 >> 10.20.193.123:0/2854619991 conn(0x7f739409ea30 msgr2=0x7f739412ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:10:11.028 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.029+0000 7f739c3aa640 1 -- 10.20.193.123:0/2854619991 shutdown_connections 2026-02-17T20:10:11.028 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.029+0000 7f739c3aa640 1 -- 10.20.193.123:0/2854619991 wait complete. 2026-02-17T20:10:11.033 INFO:teuthology.orchestra.run.trial123.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2026-02-17T20:10:10.327294+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":115,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":85,"ondisk_log_size":85,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":128648,"kb_used_data":2152,"kb_used_omap":17,"kb_used_meta":126446,"kb_avail":377358712,"statfs":{"total":386547056640,"available":386415321088,"internally_reserved":0,"allocated":2203648,"data_stored":1539542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18186,"internal_metadata":129480950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.000910"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-17T20:09:52.995470+0000","last_change":"2026-02-17T20:09:52.995480+0000","last_active":"2026-02-17T20:09:52.995470+0000","last_peered":"2026-02-17T20:09:52.995470+0000","last_clean":"2026-02-17T20:09:52.995470+0000","last_became_active":"2026-02-17T20:09:40.389602+0000","last_became_peered":"2026-02-17T20:09:40.389602+0000","last_unstale":"2026-02-17T20:09:52.995470+0000","last_undegraded":"2026-02-17T20:09:52.995470+0000","last_fullsized":"2026-02-17T20:09:52.995470+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:09:52.995425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:09:52.995425+0000","last_clean_scrub_stamp":"2026-02-17T20:09:52.995425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T06:34:20.615813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-17T20:09:53.919643+0000","last_change":"2026-02-17T20:09:53.919658+0000","last_active":"2026-02-17T20:09:53.919643+0000","last_peered":"2026-02-17T20:09:53.919643+0000","last_clean":"2026-02-17T20:09:53.919643+0000","last_became_active":"2026-02-17T20:09:40.959369+0000","last_became_peered":"2026-02-17T20:09:40.959369+0000","last_unstale":"2026-02-17T20:09:53.919643+0000","last_undegraded":"2026-02-17T20:09:53.919643+0000","last_fullsized":"2026-02-17T20:09:53.919643+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:09:53.919590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:09:53.919590+0000","last_clean_scrub_stamp":"2026-02-17T20:09:53.919590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T07:45:25.698766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033416199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-17T20:09:50.785269+0000","last_change":"2026-02-17T20:09:50.785283+0000","last_active":"2026-02-17T20:09:50.785269+0000","last_peered":"2026-02-17T20:09:50.785269+0000","last_clean":"2026-02-17T20:09:50.785269+0000","last_became_active":"2026-02-17T20:09:40.389827+0000","last_became_peered":"2026-02-17T20:09:40.389827+0000","last_unstale":"2026-02-17T20:09:50.785269+0000","last_undegraded":"2026-02-17T20:09:50.785269+0000","last_fullsized":"2026-02-17T20:09:50.785269+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:09:50.785209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:09:50.785209+0000","last_clean_scrub_stamp":"2026-02-17T20:09:50.785209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T06:57:47.462489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026693600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-17T20:09:52.966935+0000","last_change":"2026-02-17T20:09:52.966973+0000","last_active":"2026-02-17T20:09:52.966935+0000","last_peered":"2026-02-17T20:09:52.966935+0000","last_clean":"2026-02-17T20:09:52.966935+0000","last_became_active":"2026-02-17T20:09:40.959406+0000","last_became_peered":"2026-02-17T20:09:40.959406+0000","last_unstale":"2026-02-17T20:09:52.966935+0000","last_undegraded":"2026-02-17T20:09:52.966935+0000","last_fullsized":"2026-02-17T20:09:52.966935+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:09:52.966789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:09:52.966789+0000","last_clean_scrub_stamp":"2026-02-17T20:09:52.966789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T06:44:02.311200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000242539,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"30'80","reported_seq":163,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-17T20:09:50.931937+0000","last_change":"2026-02-17T20:09:50.931958+0000","last_active":"2026-02-17T20:09:50.931937+0000","last_peered":"2026-02-17T20:09:50.931937+0000","last_clean":"2026-02-17T20:09:50.931937+0000","last_became_active":"2026-02-17T20:09:40.389750+0000","last_became_peered":"2026-02-17T20:09:40.389750+0000","last_unstale":"2026-02-17T20:09:50.931937+0000","last_undegraded":"2026-02-17T20:09:50.931937+0000","last_fullsized":"2026-02-17T20:09:50.931937+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'80","last_scrub_stamp":"2026-02-17T20:09:50.931893+0000","last_deep_scrub":"30'80","last_deep_scrub_stamp":"2026-02-17T20:09:50.931893+0000","last_clean_scrub_stamp":"2026-02-17T20:09:50.931893+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T05:17:11.667900+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"30'2","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-17T20:09:52.004970+0000","last_change":"2026-02-17T20:09:52.004990+0000","last_active":"2026-02-17T20:09:52.004970+0000","last_peered":"2026-02-17T20:09:52.004970+0000","last_clean":"2026-02-17T20:09:52.004970+0000","last_became_active":"2026-02-17T20:09:39.388484+0000","last_became_peered":"2026-02-17T20:09:39.388484+0000","last_unstale":"2026-02-17T20:09:52.004970+0000","last_undegraded":"2026-02-17T20:09:52.004970+0000","last_fullsized":"2026-02-17T20:09:52.004970+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2026-02-17T20:09:52.004934+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2026-02-17T20:09:52.004934+0000","last_clean_scrub_stamp":"2026-02-17T20:09:52.004934+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T07:36:38.182937+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.000198235,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"30'3","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-17T20:09:50.041824+0000","last_change":"2026-02-17T20:09:50.041841+0000","last_active":"2026-02-17T20:09:50.041824+0000","last_peered":"2026-02-17T20:09:50.041824+0000","last_clean":"2026-02-17T20:09:50.041824+0000","last_became_active":"2026-02-17T20:09:38.388004+0000","last_became_peered":"2026-02-17T20:09:38.388004+0000","last_unstale":"2026-02-17T20:09:50.041824+0000","last_undegraded":"2026-02-17T20:09:50.041824+0000","last_fullsized":"2026-02-17T20:09:50.041824+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2026-02-17T20:09:50.041790+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2026-02-17T20:09:50.041790+0000","last_clean_scrub_stamp":"2026-02-17T20:09:50.041790+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:58:48.212486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059736000000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-17T20:09:51.947098+0000","last_change":"2026-02-17T20:09:51.947109+0000","last_active":"2026-02-17T20:09:51.947098+0000","last_peered":"2026-02-17T20:09:51.947098+0000","last_clean":"2026-02-17T20:09:51.947098+0000","last_became_active":"2026-02-17T20:09:40.959125+0000","last_became_peered":"2026-02-17T20:09:40.959125+0000","last_unstale":"2026-02-17T20:09:51.947098+0000","last_undegraded":"2026-02-17T20:09:51.947098+0000","last_fullsized":"2026-02-17T20:09:51.947098+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:09:51.947030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:09:51.947030+0000","last_clean_scrub_stamp":"2026-02-17T20:09:51.947030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T05:14:37.630468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00023917200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-17T20:09:50.990146+0000","last_change":"2026-02-17T20:09:50.990159+0000","last_active":"2026-02-17T20:09:50.990146+0000","last_peered":"2026-02-17T20:09:50.990146+0000","last_clean":"2026-02-17T20:09:50.990146+0000","last_became_active":"2026-02-17T20:09:38.387688+0000","last_became_peered":"2026-02-17T20:09:38.387688+0000","last_unstale":"2026-02-17T20:09:50.990146+0000","last_undegraded":"2026-02-17T20:09:50.990146+0000","last_fullsized":"2026-02-17T20:09:50.990146+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:09:50.990101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:09:50.990101+0000","last_clean_scrub_stamp":"2026-02-17T20:09:50.990101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T07:57:22.959859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000175532,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":26,"seq":111669149704,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32452,"kb_used_data":828,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339388,"statfs":{"total":96636764160,"available":96603533312,"internally_reserved":0,"allocated":847872,"data_stored":680349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4547,"internal_metadata":32370237},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":25,"seq":107374182408,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31868,"kb_used_data":244,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339972,"statfs":{"total":96636764160,"available":96604131328,"internally_reserved":0,"allocated":249856,"data_stored":89403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4547,"internal_metadata":32370237},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":24,"seq":103079215112,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32452,"kb_used_data":828,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339388,"statfs":{"total":96636764160,"available":96603533312,"internally_reserved":0,"allocated":847872,"data_stored":679790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4546,"internal_metadata":32370238},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":23,"seq":98784247816,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31876,"kb_used_data":252,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339964,"statfs":{"total":96636764160,"available":96604123136,"internally_reserved":0,"allocated":258048,"data_stored":90000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4546,"internal_metadata":32370238},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T20:10:11.035 DEBUG:teuthology.orchestra.run.trial123:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-17T20:10:11.107 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.105+0000 7fa3f2261640 1 Processor -- start 2026-02-17T20:10:11.107 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.105+0000 7fa3f2261640 1 -- start start 2026-02-17T20:10:11.107 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.105+0000 7fa3f2261640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fa3ec1301a0 0x7fa3ec130840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:10:11.107 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.105+0000 7fa3f2261640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fa3ec071690 0x7fa3ec130d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:10:11.107 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.105+0000 7fa3f2261640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fa3ec12cc20 0x7fa3ec12d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:10:11.107 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.105+0000 7fa3f2261640 1 -- --> v2:10.20.193.123:3300/0 -- mon_getmap magic: 0 -- 0x7fa3ec12a730 con 0x7fa3ec1301a0 2026-02-17T20:10:11.107 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.105+0000 7fa3f2261640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7fa3ec130580 con 0x7fa3ec071690 2026-02-17T20:10:11.107 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.105+0000 7fa3f2261640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7fa3ec116350 con 0x7fa3ec12cc20 2026-02-17T20:10:11.108 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.106+0000 7fa3eb7fe640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fa3ec1301a0 0x7fa3ec130840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:10:11.108 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.106+0000 7fa3eb7fe640 1 --2- >> v2:10.20.193.123:3300/0 conn(0x7fa3ec1301a0 0x7fa3ec130840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3300/0 says I am v2:10.20.193.123:56078/0 (socket says 10.20.193.123:56078) 2026-02-17T20:10:11.108 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.106+0000 7fa3eb7fe640 1 -- 10.20.193.123:0/1838655218 learned_addr learned my addr 10.20.193.123:0/1838655218 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:10:11.108 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.106+0000 7fa3ebfff640 1 --2- 10.20.193.123:0/1838655218 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fa3ec12cc20 0x7fa3ec12d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:10:11.108 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.106+0000 7fa3eaffd640 1 --2- 10.20.193.123:0/1838655218 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fa3ec071690 0x7fa3ec130d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:10:11.108 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.106+0000 7fa3eb7fe640 1 -- 10.20.193.123:0/1838655218 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fa3ec12cc20 msgr2=0x7fa3ec12d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:10:11.108 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.106+0000 7fa3eb7fe640 1 --2- 10.20.193.123:0/1838655218 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fa3ec12cc20 0x7fa3ec12d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:10:11.108 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.106+0000 7fa3eb7fe640 1 -- 10.20.193.123:0/1838655218 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fa3ec071690 msgr2=0x7fa3ec130d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:10:11.108 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.106+0000 7fa3eb7fe640 1 --2- 10.20.193.123:0/1838655218 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fa3ec071690 0x7fa3ec130d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:10:11.108 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.106+0000 7fa3eb7fe640 1 -- 10.20.193.123:0/1838655218 --> v2:10.20.193.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3ec071e70 con 0x7fa3ec1301a0 2026-02-17T20:10:11.108 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.106+0000 7fa3eb7fe640 1 --2- 10.20.193.123:0/1838655218 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fa3ec1301a0 0x7fa3ec130840 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8009970 tx=0x7fa3d802ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d2567a5f0db3db7 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:10:11.108 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.106+0000 7fa3ea7fc640 1 -- 10.20.193.123:0/1838655218 <== mon.0 v2:10.20.193.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d803c070 con 0x7fa3ec1301a0 2026-02-17T20:10:11.109 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.106+0000 7fa3ea7fc640 1 -- 10.20.193.123:0/1838655218 <== mon.0 v2:10.20.193.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3d802fac0 con 0x7fa3ec1301a0 2026-02-17T20:10:11.109 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.106+0000 7fa3ea7fc640 1 -- 10.20.193.123:0/1838655218 <== mon.0 v2:10.20.193.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d8037440 con 0x7fa3ec1301a0 2026-02-17T20:10:11.109 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.107+0000 7fa3f2261640 1 -- 10.20.193.123:0/1838655218 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fa3ec1301a0 msgr2=0x7fa3ec130840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:10:11.109 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.107+0000 7fa3f2261640 1 --2- 10.20.193.123:0/1838655218 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fa3ec1301a0 0x7fa3ec130840 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8009970 tx=0x7fa3d802ee90 comp rx=0 tx=0).stop 2026-02-17T20:10:11.109 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.107+0000 7fa3f2261640 1 -- 10.20.193.123:0/1838655218 shutdown_connections 2026-02-17T20:10:11.109 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.107+0000 7fa3f2261640 1 --2- 10.20.193.123:0/1838655218 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fa3ec12cc20 0x7fa3ec12d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:10:11.109 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.107+0000 7fa3f2261640 1 --2- 10.20.193.123:0/1838655218 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fa3ec071690 0x7fa3ec130d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:10:11.109 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.107+0000 7fa3f2261640 1 --2- 10.20.193.123:0/1838655218 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fa3ec1301a0 0x7fa3ec130840 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:10:11.109 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.107+0000 7fa3f2261640 1 -- 10.20.193.123:0/1838655218 >> 10.20.193.123:0/1838655218 conn(0x7fa3ec09d360 msgr2=0x7fa3ec09d770 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:10:11.109 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.107+0000 7fa3f2261640 1 -- 10.20.193.123:0/1838655218 shutdown_connections 2026-02-17T20:10:11.109 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.107+0000 7fa3f2261640 1 -- 10.20.193.123:0/1838655218 wait complete. 2026-02-17T20:10:11.109 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.107+0000 7fa3f2261640 1 Processor -- start 2026-02-17T20:10:11.110 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.107+0000 7fa3f2261640 1 -- start start 2026-02-17T20:10:11.110 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.107+0000 7fa3f2261640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fa3ec071690 0x7fa3ec1345c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:10:11.110 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.107+0000 7fa3f2261640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fa3ec12cc20 0x7fa3ec134b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:10:11.110 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.107+0000 7fa3f2261640 1 --2- >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fa3ec1301a0 0x7fa3ec135040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:10:11.110 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.107+0000 7fa3f2261640 1 -- --> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa3ec12dab0 con 0x7fa3ec1301a0 2026-02-17T20:10:11.110 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.107+0000 7fa3f2261640 1 -- --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_getmap magic: 0 -- 0x7fa3ec12d930 con 0x7fa3ec12cc20 2026-02-17T20:10:11.110 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.107+0000 7fa3f2261640 1 -- --> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] -- mon_getmap magic: 0 -- 0x7fa3ec137530 con 0x7fa3ec071690 2026-02-17T20:10:11.110 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.107+0000 7fa3eaffd640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fa3ec12cc20 0x7fa3ec134b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:10:11.110 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.107+0000 7fa3eaffd640 1 --2- >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fa3ec12cc20 0x7fa3ec134b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.123:3301/0 says I am v2:10.20.193.123:51014/0 (socket says 10.20.193.123:51014) 2026-02-17T20:10:11.111 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.107+0000 7fa3eb7fe640 1 --2- >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fa3ec071690 0x7fa3ec1345c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:10:11.111 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.107+0000 7fa3eaffd640 1 -- 10.20.193.123:0/4061446521 learned_addr learned my addr 10.20.193.123:0/4061446521 (peer_addr_for_me v2:10.20.193.123:0/0) 2026-02-17T20:10:11.111 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.107+0000 7fa3ebfff640 1 --2- 10.20.193.123:0/4061446521 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fa3ec1301a0 0x7fa3ec135040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:10:11.111 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.108+0000 7fa3eaffd640 1 -- 10.20.193.123:0/4061446521 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fa3ec071690 msgr2=0x7fa3ec1345c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:10:11.111 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.108+0000 7fa3eaffd640 1 --2- 10.20.193.123:0/4061446521 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fa3ec071690 0x7fa3ec1345c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:10:11.111 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.108+0000 7fa3eaffd640 1 -- 10.20.193.123:0/4061446521 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fa3ec1301a0 msgr2=0x7fa3ec135040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:10:11.111 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.108+0000 7fa3eaffd640 1 --2- 10.20.193.123:0/4061446521 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fa3ec1301a0 0x7fa3ec135040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:10:11.111 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.108+0000 7fa3eaffd640 1 -- 10.20.193.123:0/4061446521 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3ec12a8f0 con 0x7fa3ec12cc20 2026-02-17T20:10:11.111 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.108+0000 7fa3eb7fe640 1 --2- 10.20.193.123:0/4061446521 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fa3ec071690 0x7fa3ec1345c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T20:10:11.111 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.108+0000 7fa3eaffd640 1 --2- 10.20.193.123:0/4061446521 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fa3ec12cc20 0x7fa3ec134b00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc00e990 tx=0x7fa3dc00ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:10:11.111 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.108+0000 7fa3c7fff640 1 -- 10.20.193.123:0/4061446521 <== mon.1 v2:10.20.193.123:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc017070 con 0x7fa3ec12cc20 2026-02-17T20:10:11.111 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.108+0000 7fa3c7fff640 1 -- 10.20.193.123:0/4061446521 <== mon.1 v2:10.20.193.123:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3dc00c9a0 con 0x7fa3ec12cc20 2026-02-17T20:10:11.112 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.108+0000 7fa3f2261640 1 -- 10.20.193.123:0/4061446521 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3ec135580 con 0x7fa3ec12cc20 2026-02-17T20:10:11.112 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.108+0000 7fa3c7fff640 1 -- 10.20.193.123:0/4061446521 <== mon.1 v2:10.20.193.123:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc00cd70 con 0x7fa3ec12cc20 2026-02-17T20:10:11.112 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.108+0000 7fa3f2261640 1 -- 10.20.193.123:0/4061446521 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3ec11bb60 con 0x7fa3ec12cc20 2026-02-17T20:10:11.112 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.108+0000 7fa3f2261640 1 -- 10.20.193.123:0/4061446521 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3ec12d0d0 con 0x7fa3ec12cc20 2026-02-17T20:10:11.112 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.108+0000 7fa3c7fff640 1 -- 10.20.193.123:0/4061446521 <== mon.1 v2:10.20.193.123:3301/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7fa3dc024060 con 0x7fa3ec12cc20 2026-02-17T20:10:11.112 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.109+0000 7fa3c7fff640 1 -- 10.20.193.123:0/4061446521 <== mon.1 v2:10.20.193.123:3301/0 5 ==== osd_map(30..30 src has 1..30) ==== 3025+0+0 (secure 0 0 0) 0x7fa3dc066b20 con 0x7fa3ec12cc20 2026-02-17T20:10:11.112 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.110+0000 7fa3c7fff640 1 -- 10.20.193.123:0/4061446521 <== mon.1 v2:10.20.193.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7fa3dc040910 con 0x7fa3ec12cc20 2026-02-17T20:10:11.177 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.180+0000 7fa3f2261640 1 -- 10.20.193.123:0/4061446521 --> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fa3ec070550 con 0x7fa3ec12cc20 2026-02-17T20:10:11.180 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.183+0000 7fa3c7fff640 1 -- 10.20.193.123:0/4061446521 <== mon.1 v2:10.20.193.123:3301/0 7 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa3dc065bd0 con 0x7fa3ec12cc20 2026-02-17T20:10:11.180 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.183+0000 7fa3c7fff640 1 -- 10.20.193.123:0/4061446521 <== mon.1 v2:10.20.193.123:3301/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7fa3dc065710 con 0x7fa3ec12cc20 2026-02-17T20:10:11.181 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.184+0000 7fa3f2261640 1 -- 10.20.193.123:0/4061446521 >> v1:10.20.193.123:6800/115662061 conn(0x7fa3bc04f790 legacy=0x7fa3bc051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:10:11.181 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.184+0000 7fa3f2261640 1 -- 10.20.193.123:0/4061446521 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fa3ec12cc20 msgr2=0x7fa3ec134b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:10:11.181 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.184+0000 7fa3f2261640 1 --2- 10.20.193.123:0/4061446521 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fa3ec12cc20 0x7fa3ec134b00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc00e990 tx=0x7fa3dc00ee60 comp rx=0 tx=0).stop 2026-02-17T20:10:11.181 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.184+0000 7fa3f2261640 1 -- 10.20.193.123:0/4061446521 shutdown_connections 2026-02-17T20:10:11.181 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.184+0000 7fa3f2261640 1 --2- 10.20.193.123:0/4061446521 >> [v2:10.20.193.123:3300/0,v1:10.20.193.123:6789/0] conn(0x7fa3ec1301a0 0x7fa3ec135040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:10:11.181 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.184+0000 7fa3f2261640 1 --2- 10.20.193.123:0/4061446521 >> [v2:10.20.193.123:3301/0,v1:10.20.193.123:6790/0] conn(0x7fa3ec12cc20 0x7fa3ec134b00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:10:11.182 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.184+0000 7fa3f2261640 1 --2- 10.20.193.123:0/4061446521 >> [v2:10.20.193.123:3302/0,v1:10.20.193.123:6791/0] conn(0x7fa3ec071690 0x7fa3ec1345c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:10:11.182 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.184+0000 7fa3f2261640 1 -- 10.20.193.123:0/4061446521 >> 10.20.193.123:0/4061446521 conn(0x7fa3ec09d360 msgr2=0x7fa3ec072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:10:11.182 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.184+0000 7fa3f2261640 1 -- 10.20.193.123:0/4061446521 shutdown_connections 2026-02-17T20:10:11.182 INFO:teuthology.orchestra.run.trial123.stderr:2026-02-17T20:10:11.184+0000 7fa3f2261640 1 -- 10.20.193.123:0/4061446521 wait complete. 2026-02-17T20:10:11.188 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-17T20:10:11.189 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-17T20:10:11.189 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-17T20:10:11.189 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T20:10:11.221 INFO:tasks.ceph.osd.0:Stopped 2026-02-17T20:10:11.221 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-17T20:10:11.221 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T20:10:11.295 INFO:tasks.ceph.osd.1:Stopped 2026-02-17T20:10:11.295 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-17T20:10:11.296 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T20:10:11.370 INFO:tasks.ceph.osd.2:Stopped 2026-02-17T20:10:11.371 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-17T20:10:11.371 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T20:10:11.442 INFO:tasks.ceph.osd.3:Stopped 2026-02-17T20:10:11.442 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-17T20:10:11.442 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-17T20:10:11.442 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T20:10:11.504 INFO:tasks.ceph.mgr.x:Stopped 2026-02-17T20:10:11.505 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2026-02-17T20:10:11.505 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T20:10:11.567 INFO:tasks.ceph.mgr.y:Stopped 2026-02-17T20:10:11.567 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-17T20:10:11.567 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-17T20:10:11.567 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T20:10:11.616 INFO:tasks.ceph.mon.a:Stopped 2026-02-17T20:10:11.616 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-17T20:10:11.616 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T20:10:11.664 INFO:tasks.ceph.mon.b:Stopped 2026-02-17T20:10:11.665 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-17T20:10:11.665 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T20:10:11.714 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2026-02-17T20:10:11.714 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2026-02-17T20:10:11.715 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2026-02-17T20:10:11.715 INFO:tasks.ceph.mon.c:Stopped 2026-02-17T20:10:11.715 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-17T20:10:11.716 DEBUG:teuthology.orchestra.run.trial123:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'overall HEALTH_' | egrep -v '\(FS_' | egrep -v '\(MDS_' | egrep -v '\(OSD_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(CACHE_POOL_' | egrep -v '\(POOL_' | egrep -v '\(MGR_DOWN\)' | egrep -v '\(PG_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v 'Monitor daemon marked osd' | egrep -v 'Behind on trimming' | egrep -v 'Manager daemon' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v 'is offline because no MDS' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v MGR_MODULE_ERROR | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'pg .* is stuck inactive' | egrep -v 'pg .* is .*degraded' | egrep -v 'pg .* is stuck peering' | egrep -v 'scrub mismatch' | egrep -v ScrubResult | egrep -v 'wrongly marked' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'overall HEALTH_' | egrep -v '\(MON_MSGR2_NOT_ENABLED\)' | egrep -v 'slow request' | head -n 1 2026-02-17T20:10:11.782 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial123.front.sepia.ceph.com 2026-02-17T20:10:11.783 DEBUG:teuthology.orchestra.run.trial123:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-17T20:10:11.852 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial123.front.sepia.ceph.com 2026-02-17T20:10:11.853 DEBUG:teuthology.orchestra.run.trial123:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-17T20:10:11.920 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial123.front.sepia.ceph.com 2026-02-17T20:10:11.921 DEBUG:teuthology.orchestra.run.trial123:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-17T20:10:11.988 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@trial123.front.sepia.ceph.com 2026-02-17T20:10:11.988 DEBUG:teuthology.orchestra.run.trial123:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2026-02-17T20:10:12.061 INFO:tasks.ceph:Archiving mon data... 2026-02-17T20:10:12.063 DEBUG:teuthology.misc:Transferring archived files from trial123:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/jcollin-2026-02-17_12:20:44-fs-wip-jcollin-testing-20260217.030412-squid-distro-default-trial/52816/data/mon.a.tgz 2026-02-17T20:10:12.063 DEBUG:teuthology.orchestra.run.trial123:> mktemp 2026-02-17T20:10:12.117 INFO:teuthology.orchestra.run.trial123.stdout:/tmp/tmp.ry21JFZhcy 2026-02-17T20:10:12.117 DEBUG:teuthology.orchestra.run.trial123:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.ry21JFZhcy 2026-02-17T20:10:12.207 DEBUG:teuthology.orchestra.run.trial123:> sudo chmod 0666 /tmp/tmp.ry21JFZhcy 2026-02-17T20:10:12.290 DEBUG:teuthology.orchestra.remote:trial123:/tmp/tmp.ry21JFZhcy is 211KB 2026-02-17T20:10:12.387 DEBUG:teuthology.orchestra.run.trial123:> rm -fr /tmp/tmp.ry21JFZhcy 2026-02-17T20:10:12.403 DEBUG:teuthology.misc:Transferring archived files from trial123:/var/lib/ceph/mon/ceph-b to /home/teuthworker/mnt/teuthology/jcollin-2026-02-17_12:20:44-fs-wip-jcollin-testing-20260217.030412-squid-distro-default-trial/52816/data/mon.b.tgz 2026-02-17T20:10:12.403 DEBUG:teuthology.orchestra.run.trial123:> mktemp 2026-02-17T20:10:12.458 INFO:teuthology.orchestra.run.trial123.stdout:/tmp/tmp.IDb3a2R88G 2026-02-17T20:10:12.458 DEBUG:teuthology.orchestra.run.trial123:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.IDb3a2R88G 2026-02-17T20:10:12.551 DEBUG:teuthology.orchestra.run.trial123:> sudo chmod 0666 /tmp/tmp.IDb3a2R88G 2026-02-17T20:10:12.632 DEBUG:teuthology.orchestra.remote:trial123:/tmp/tmp.IDb3a2R88G is 249KB 2026-02-17T20:10:12.725 DEBUG:teuthology.orchestra.run.trial123:> rm -fr /tmp/tmp.IDb3a2R88G 2026-02-17T20:10:12.741 DEBUG:teuthology.misc:Transferring archived files from trial123:/var/lib/ceph/mon/ceph-c to /home/teuthworker/mnt/teuthology/jcollin-2026-02-17_12:20:44-fs-wip-jcollin-testing-20260217.030412-squid-distro-default-trial/52816/data/mon.c.tgz 2026-02-17T20:10:12.741 DEBUG:teuthology.orchestra.run.trial123:> mktemp 2026-02-17T20:10:12.796 INFO:teuthology.orchestra.run.trial123.stdout:/tmp/tmp.RActBlwyJa 2026-02-17T20:10:12.797 DEBUG:teuthology.orchestra.run.trial123:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.RActBlwyJa 2026-02-17T20:10:12.890 DEBUG:teuthology.orchestra.run.trial123:> sudo chmod 0666 /tmp/tmp.RActBlwyJa 2026-02-17T20:10:12.971 DEBUG:teuthology.orchestra.remote:trial123:/tmp/tmp.RActBlwyJa is 248KB 2026-02-17T20:10:13.063 DEBUG:teuthology.orchestra.run.trial123:> rm -fr /tmp/tmp.RActBlwyJa 2026-02-17T20:10:13.079 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-17T20:10:13.080 DEBUG:teuthology.orchestra.run.trial123:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-17T20:10:13.199 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-17T20:10:13.199 INFO:tasks.ceph:Archiving crash dumps... 2026-02-17T20:10:13.201 DEBUG:teuthology.misc:Transferring archived files from trial123:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/jcollin-2026-02-17_12:20:44-fs-wip-jcollin-testing-20260217.030412-squid-distro-default-trial/52816/remote/trial123/crash 2026-02-17T20:10:13.202 DEBUG:teuthology.orchestra.run.trial123:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-17T20:10:13.262 INFO:tasks.ceph:Compressing logs... 2026-02-17T20:10:13.263 DEBUG:teuthology.orchestra.run.trial123:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T20:10:13.327 INFO:teuthology.orchestra.run.trial123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-17T20:10:13.361 INFO:teuthology.orchestra.run.trial123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-17T20:10:13.361 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.17438.log 2026-02-17T20:10:13.362 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-17T20:10:13.362 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph.tmp-client.admin.17438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35126.log 2026-02-17T20:10:13.362 INFO:teuthology.orchestra.run.trial123.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.17438.log.gz 2026-02-17T20:10:13.362 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2026-02-17T20:10:13.362 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.35126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31550.log 2026-02-17T20:10:13.362 INFO:teuthology.orchestra.run.trial123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35126.log.gz 2026-02-17T20:10:13.362 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31027.log 2026-02-17T20:10:13.362 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.31550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35543.log 2026-02-17T20:10:13.362 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.31027.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.31550.log.gz 2026-02-17T20:10:13.362 INFO:teuthology.orchestra.run.trial123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2026-02-17T20:10:13.362 INFO:teuthology.orchestra.run.trial123.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.31027.log.gz 2026-02-17T20:10:13.362 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.35543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28305.log 2026-02-17T20:10:13.362 INFO:teuthology.orchestra.run.trial123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35543.log.gz 2026-02-17T20:10:13.363 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37105.log 2026-02-17T20:10:13.363 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.28305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31092.log 2026-02-17T20:10:13.363 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.37105.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.28305.log.gz 2026-02-17T20:10:13.363 INFO:teuthology.orchestra.run.trial123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37301.log 2026-02-17T20:10:13.363 INFO:teuthology.orchestra.run.trial123.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.37105.log.gz 2026-02-17T20:10:13.363 INFO:teuthology.orchestra.run.trial123.stderr:gzip -5/var/log/ceph/ceph-client.admin.31092.log: --verbose -- /var/log/ceph/ceph-client.admin.35684.log 2026-02-17T20:10:13.363 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.37301.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.31092.log.gz 2026-02-17T20:10:13.363 INFO:teuthology.orchestra.run.trial123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2026-02-17T20:10:13.363 INFO:teuthology.orchestra.run.trial123.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37301.log.gz 2026-02-17T20:10:13.363 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.35684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36615.log 2026-02-17T20:10:13.363 INFO:teuthology.orchestra.run.trial123.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35684.log.gz 2026-02-17T20:10:13.363 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28865.log 2026-02-17T20:10:13.363 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.36615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31026.log 2026-02-17T20:10:13.363 INFO:teuthology.orchestra.run.trial123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36615.log.gz 2026-02-17T20:10:13.363 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.28865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31233.log 2026-02-17T20:10:13.364 INFO:teuthology.orchestra.run.trial123.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.28865.log.gz 2026-02-17T20:10:13.364 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.31026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31638.log 2026-02-17T20:10:13.364 INFO:teuthology.orchestra.run.trial123.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.31026.log.gz 2026-02-17T20:10:13.364 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.31233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29057.log 2026-02-17T20:10:13.364 INFO:teuthology.orchestra.run.trial123.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31233.log.gz 2026-02-17T20:10:13.364 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.31638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36154.log 2026-02-17T20:10:13.364 INFO:teuthology.orchestra.run.trial123.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31638.log.gz 2026-02-17T20:10:13.364 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.29057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28077.log 2026-02-17T20:10:13.364 INFO:teuthology.orchestra.run.trial123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.29057.log.gz 2026-02-17T20:10:13.364 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.36154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36468.log 2026-02-17T20:10:13.364 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.28077.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36154.log.gz 2026-02-17T20:10:13.364 INFO:teuthology.orchestra.run.trial123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28899.log 2026-02-17T20:10:13.364 INFO:teuthology.orchestra.run.trial123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.28077.log.gz 2026-02-17T20:10:13.364 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.36468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24485.log 2026-02-17T20:10:13.364 INFO:teuthology.orchestra.run.trial123.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36468.log.gz 2026-02-17T20:10:13.365 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.28899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28498.log 2026-02-17T20:10:13.365 INFO:teuthology.orchestra.run.trial123.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.28899.log.gz 2026-02-17T20:10:13.365 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.24485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36713.log 2026-02-17T20:10:13.365 INFO:teuthology.orchestra.run.trial123.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.24485.log.gz 2026-02-17T20:10:13.365 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.28498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30891.log 2026-02-17T20:10:13.365 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.36713.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.28498.log.gz 2026-02-17T20:10:13.365 INFO:teuthology.orchestra.run.trial123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30687.log 2026-02-17T20:10:13.365 INFO:teuthology.orchestra.run.trial123.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36713.log.gz 2026-02-17T20:10:13.365 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.30891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35957.log 2026-02-17T20:10:13.365 INFO:teuthology.orchestra.run.trial123.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.30891.log.gz 2026-02-17T20:10:13.365 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.30687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37351.log 2026-02-17T20:10:13.365 INFO:teuthology.orchestra.run.trial123.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.30687.log.gz 2026-02-17T20:10:13.365 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.35957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28499.log 2026-02-17T20:10:13.365 INFO:teuthology.orchestra.run.trial123.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.35957.log.gz 2026-02-17T20:10:13.365 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.37351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36299.log 2026-02-17T20:10:13.365 INFO:teuthology.orchestra.run.trial123.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37351.log.gz 2026-02-17T20:10:13.366 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.28499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31308.log 2026-02-17T20:10:13.366 INFO:teuthology.orchestra.run.trial123.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.28499.log.gz 2026-02-17T20:10:13.366 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.36299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35782.log 2026-02-17T20:10:13.366 INFO:teuthology.orchestra.run.trial123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36299.log.gz 2026-02-17T20:10:13.366 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.31308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29153.log 2026-02-17T20:10:13.366 INFO:teuthology.orchestra.run.trial123.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.31308.log.gz 2026-02-17T20:10:13.366 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.35782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36355.log 2026-02-17T20:10:13.366 INFO:teuthology.orchestra.run.trial123.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35782.log.gz 2026-02-17T20:10:13.366 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.29153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37154.log 2026-02-17T20:10:13.366 INFO:teuthology.orchestra.run.trial123.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.29153.log.gz 2026-02-17T20:10:13.366 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.36355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30688.log 2026-02-17T20:10:13.366 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.37154.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36355.log.gz 2026-02-17T20:10:13.366 INFO:teuthology.orchestra.run.trial123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35733.log 2026-02-17T20:10:13.366 INFO:teuthology.orchestra.run.trial123.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37154.log.gz 2026-02-17T20:10:13.366 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.30688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35402.log 2026-02-17T20:10:13.366 INFO:teuthology.orchestra.run.trial123.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.30688.log.gz 2026-02-17T20:10:13.367 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.35733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28864.log 2026-02-17T20:10:13.367 INFO:teuthology.orchestra.run.trial123.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35733.log.gz 2026-02-17T20:10:13.367 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.35402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31452.log 2026-02-17T20:10:13.367 INFO:teuthology.orchestra.run.trial123.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35402.log.gz 2026-02-17T20:10:13.367 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.28864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30349.log 2026-02-17T20:10:13.367 INFO:teuthology.orchestra.run.trial123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.28864.log.gz 2026-02-17T20:10:13.367 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.31452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37203.log 2026-02-17T20:10:13.367 INFO:teuthology.orchestra.run.trial123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31452.log.gz 2026-02-17T20:10:13.367 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.30349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28697.log 2026-02-17T20:10:13.367 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.37203.log: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.30349.log.gz 2026-02-17T20:10:13.367 INFO:teuthology.orchestra.run.trial123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30510.log 2026-02-17T20:10:13.367 INFO:teuthology.orchestra.run.trial123.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37203.log.gz 2026-02-17T20:10:13.367 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.28697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37252.log 2026-02-17T20:10:13.367 INFO:teuthology.orchestra.run.trial123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.28697.log.gz 2026-02-17T20:10:13.367 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.30510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36566.log 2026-02-17T20:10:13.367 INFO:teuthology.orchestra.run.trial123.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.30510.log.gz 2026-02-17T20:10:13.368 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.37252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36762.log 2026-02-17T20:10:13.368 INFO:teuthology.orchestra.run.trial123.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37252.log.gz 2026-02-17T20:10:13.368 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.36566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36860.log 2026-02-17T20:10:13.368 INFO:teuthology.orchestra.run.trial123.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36566.log.gz 2026-02-17T20:10:13.368 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.36762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28866.log 2026-02-17T20:10:13.368 INFO:teuthology.orchestra.run.trial123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36762.log.gz 2026-02-17T20:10:13.368 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.36860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31294.log 2026-02-17T20:10:13.368 INFO:teuthology.orchestra.run.trial123.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36860.log.gz 2026-02-17T20:10:13.368 INFO:teuthology.orchestra.run.trial123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31942.log 2026-02-17T20:10:13.368 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.28866.log: /var/log/ceph/ceph-client.admin.31294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28696.log 2026-02-17T20:10:13.368 INFO:teuthology.orchestra.run.trial123.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.28866.log.gz 2026-02-17T20:10:13.368 INFO:teuthology.orchestra.run.trial123.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.31294.log.gz 2026-02-17T20:10:13.368 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.31942.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-17T20:10:13.368 INFO:teuthology.orchestra.run.trial123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.31942.log.gz 2026-02-17T20:10:13.368 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.28696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36157.log 2026-02-17T20:10:13.368 INFO:teuthology.orchestra.run.trial123.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.28696.log.gz 2026-02-17T20:10:13.369 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30857.log 2026-02-17T20:10:13.369 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.36157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27943.log 2026-02-17T20:10:13.369 INFO:teuthology.orchestra.run.trial123.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36157.log.gz 2026-02-17T20:10:13.369 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.30857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31501.log 2026-02-17T20:10:13.369 INFO:teuthology.orchestra.run.trial123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.30857.log.gz 2026-02-17T20:10:13.369 INFO:teuthology.orchestra.run.trial123.stderr: 94.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-17T20:10:13.369 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.27943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24323.log 2026-02-17T20:10:13.369 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.31501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36505.log 2026-02-17T20:10:13.369 INFO:teuthology.orchestra.run.trial123.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.27943.log.gz 2026-02-17T20:10:13.369 INFO:teuthology.orchestra.run.trial123.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31501.log.gz 2026-02-17T20:10:13.369 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.24323.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2026-02-17T20:10:13.369 INFO:teuthology.orchestra.run.trial123.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.24323.log.gz 2026-02-17T20:10:13.369 INFO:teuthology.orchestra.run.trial123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35496.log 2026-02-17T20:10:13.369 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.36505.log: /var/log/ceph/ceph-mon.b.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36505.log.gz 2026-02-17T20:10:13.369 INFO:teuthology.orchestra.run.trial123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37007.log 2026-02-17T20:10:13.369 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.35496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23715.log 2026-02-17T20:10:13.369 INFO:teuthology.orchestra.run.trial123.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35496.log.gz 2026-02-17T20:10:13.370 INFO:teuthology.orchestra.run.trial123.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2026-02-17T20:10:13.370 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.37007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30856.log 2026-02-17T20:10:13.370 INFO:teuthology.orchestra.run.trial123.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37007.log.gz 2026-02-17T20:10:13.370 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.23715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32514.log 2026-02-17T20:10:13.370 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.30856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36664.log 2026-02-17T20:10:13.370 INFO:teuthology.orchestra.run.trial123.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.23715.log.gz 2026-02-17T20:10:13.370 INFO:teuthology.orchestra.run.trial123.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.30856.log.gz 2026-02-17T20:10:13.370 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.32514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28695.log 2026-02-17T20:10:13.370 INFO:teuthology.orchestra.run.trial123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32514.log.gz 2026-02-17T20:10:13.370 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.36664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31837.log 2026-02-17T20:10:13.370 INFO:teuthology.orchestra.run.trial123.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36664.log.gz 2026-02-17T20:10:13.370 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.28695.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-17T20:10:13.370 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.31837.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.28695.log.gz 2026-02-17T20:10:13.370 INFO:teuthology.orchestra.run.trial123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30559.log 2026-02-17T20:10:13.370 INFO:teuthology.orchestra.run.trial123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.31837.log.gz 2026-02-17T20:10:13.370 INFO:teuthology.orchestra.run.trial123.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-17T20:10:13.370 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28302.log 2026-02-17T20:10:13.371 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.30559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36156.log 2026-02-17T20:10:13.371 INFO:teuthology.orchestra.run.trial123.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.30559.log.gz 2026-02-17T20:10:13.371 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.28302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31100.log 2026-02-17T20:10:13.371 INFO:teuthology.orchestra.run.trial123.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.28302.log.gz 2026-02-17T20:10:13.371 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.36156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36811.log 2026-02-17T20:10:13.371 INFO:teuthology.orchestra.run.trial123.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36156.log.gz 2026-02-17T20:10:13.371 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.31100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36909.log 2026-02-17T20:10:13.371 INFO:teuthology.orchestra.run.trial123.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31100.log.gz 2026-02-17T20:10:13.371 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.36811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35449.log 2026-02-17T20:10:13.371 INFO:teuthology.orchestra.run.trial123.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36811.log.gz 2026-02-17T20:10:13.371 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.36909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35638.log 2026-02-17T20:10:13.371 INFO:teuthology.orchestra.run.trial123.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.36909.log.gz 2026-02-17T20:10:13.371 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.35449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31403.log 2026-02-17T20:10:13.371 INFO:teuthology.orchestra.run.trial123.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35449.log.gz 2026-02-17T20:10:13.371 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.35638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24013.log 2026-02-17T20:10:13.371 INFO:teuthology.orchestra.run.trial123.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35638.log.gz 2026-02-17T20:10:13.371 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.31403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30686.log 2026-02-17T20:10:13.371 INFO:teuthology.orchestra.run.trial123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31403.log.gz 2026-02-17T20:10:13.371 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.24013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35590.log 2026-02-17T20:10:13.372 INFO:teuthology.orchestra.run.trial123.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.24013.log.gz 2026-02-17T20:10:13.372 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.30686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24170.log 2026-02-17T20:10:13.372 INFO:teuthology.orchestra.run.trial123.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.30686.log.gz 2026-02-17T20:10:13.372 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.35590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24123.log 2026-02-17T20:10:13.372 INFO:teuthology.orchestra.run.trial123.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35590.log.gz 2026-02-17T20:10:13.372 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.24170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28304.log 2026-02-17T20:10:13.372 INFO:teuthology.orchestra.run.trial123.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.24170.log.gz 2026-02-17T20:10:13.372 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.24123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30858.log 2026-02-17T20:10:13.372 INFO:teuthology.orchestra.run.trial123.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.24123.log.gz 2026-02-17T20:10:13.372 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.28304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28175.log 2026-02-17T20:10:13.372 INFO:teuthology.orchestra.run.trial123.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.28304.log.gz 2026-02-17T20:10:13.372 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.30858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29008.log 2026-02-17T20:10:13.372 INFO:teuthology.orchestra.run.trial123.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.30858.log.gz 2026-02-17T20:10:13.372 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.28175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36155.log 2026-02-17T20:10:13.372 INFO:teuthology.orchestra.run.trial123.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.28175.log.gz 2026-02-17T20:10:13.372 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.29008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36298.log 2026-02-17T20:10:13.372 INFO:teuthology.orchestra.run.trial123.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.29008.log.gz 2026-02-17T20:10:13.372 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.36155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35960.log 2026-02-17T20:10:13.372 INFO:teuthology.orchestra.run.trial123.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36155.log.gz 2026-02-17T20:10:13.373 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.36298.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-17T20:10:13.373 INFO:teuthology.orchestra.run.trial123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36298.log.gz 2026-02-17T20:10:13.373 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.35960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37056.log 2026-02-17T20:10:13.373 INFO:teuthology.orchestra.run.trial123.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35960.log.gz 2026-02-17T20:10:13.373 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35831.log 2026-02-17T20:10:13.373 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.37056.log: 93.4% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-17T20:10:13.373 INFO:teuthology.orchestra.run.trial123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36958.log 2026-02-17T20:10:13.373 INFO:teuthology.orchestra.run.trial123.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37056.log.gz 2026-02-17T20:10:13.373 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.35831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35959.log 2026-02-17T20:10:13.373 INFO:teuthology.orchestra.run.trial123.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35831.log.gz 2026-02-17T20:10:13.373 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.36958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36356.log 2026-02-17T20:10:13.373 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.35959.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36958.log.gz 2026-02-17T20:10:13.373 INFO:teuthology.orchestra.run.trial123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27918.log 2026-02-17T20:10:13.373 INFO:teuthology.orchestra.run.trial123.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.35959.log.gz 2026-02-17T20:10:13.373 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.36356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37398.log 2026-02-17T20:10:13.373 INFO:teuthology.orchestra.run.trial123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36356.log.gz 2026-02-17T20:10:13.373 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.27918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29200.log 2026-02-17T20:10:13.373 INFO:teuthology.orchestra.run.trial123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.27918.log.gz 2026-02-17T20:10:13.373 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.37398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28303.log 2026-02-17T20:10:13.374 INFO:teuthology.orchestra.run.trial123.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37398.log.gz 2026-02-17T20:10:13.374 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.29200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29106.log 2026-02-17T20:10:13.374 INFO:teuthology.orchestra.run.trial123.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.29200.log.gz 91.8% 2026-02-17T20:10:13.374 INFO:teuthology.orchestra.run.trial123.stderr: -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-17T20:10:13.374 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.28303.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-17T20:10:13.374 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.29106.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.28303.log.gz 2026-02-17T20:10:13.374 INFO:teuthology.orchestra.run.trial123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31234.log 2026-02-17T20:10:13.374 INFO:teuthology.orchestra.run.trial123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.29106.log.gz 2026-02-17T20:10:13.374 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35961.log 2026-02-17T20:10:13.374 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.31234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28693.log 2026-02-17T20:10:13.374 INFO:teuthology.orchestra.run.trial123.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31234.log.gz 2026-02-17T20:10:13.374 INFO:teuthology.orchestra.run.trial123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28126.log 2026-02-17T20:10:13.374 INFO:teuthology.orchestra.run.trial123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28501.log 2026-02-17T20:10:13.374 INFO:teuthology.orchestra.run.trial123.stderr: 93.5%/var/log/ceph/ceph-client.admin.28126.log: -- replaced with /var/log/ceph/ceph.log.gz 2026-02-17T20:10:13.374 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.35961.log: /var/log/ceph/ceph-client.admin.28693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31732.log 2026-02-17T20:10:13.374 INFO:teuthology.orchestra.run.trial123.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35961.log.gz 2026-02-17T20:10:13.374 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.28501.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.28126.log.gz 2026-02-17T20:10:13.374 INFO:teuthology.orchestra.run.trial123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.28693.log.gz 2026-02-17T20:10:13.374 INFO:teuthology.orchestra.run.trial123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30689.log 2026-02-17T20:10:13.375 INFO:teuthology.orchestra.run.trial123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.28501.log.gz 2026-02-17T20:10:13.375 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.31732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28500.log 2026-02-17T20:10:13.375 INFO:teuthology.orchestra.run.trial123.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31732.log.gz 2026-02-17T20:10:13.375 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.30689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35661.log 2026-02-17T20:10:13.375 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.28500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24076.log 2026-02-17T20:10:13.375 INFO:teuthology.orchestra.run.trial123.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.30689.log.gz 2026-02-17T20:10:13.375 INFO:teuthology.orchestra.run.trial123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.28500.log.gz 2026-02-17T20:10:13.375 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.35661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27848.log 2026-02-17T20:10:13.375 INFO:teuthology.orchestra.run.trial123.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35661.log.gz 2026-02-17T20:10:13.375 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.24076.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.24076.log.gz 2026-02-17T20:10:13.375 INFO:teuthology.orchestra.run.trial123.stderr:/var/log/ceph/ceph-client.admin.27848.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.27848.log.gz 2026-02-17T20:10:13.376 INFO:teuthology.orchestra.run.trial123.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2026-02-17T20:10:13.376 INFO:teuthology.orchestra.run.trial123.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2026-02-17T20:10:13.376 INFO:teuthology.orchestra.run.trial123.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2026-02-17T20:10:13.376 INFO:teuthology.orchestra.run.trial123.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-17T20:10:13.385 INFO:teuthology.orchestra.run.trial123.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-17T20:10:13.387 INFO:teuthology.orchestra.run.trial123.stderr: 2026-02-17T20:10:13.387 INFO:teuthology.orchestra.run.trial123.stderr:real 0m0.068s 2026-02-17T20:10:13.387 INFO:teuthology.orchestra.run.trial123.stderr:user 0m0.275s 2026-02-17T20:10:13.387 INFO:teuthology.orchestra.run.trial123.stderr:sys 0m0.081s 2026-02-17T20:10:13.387 INFO:tasks.ceph:Archiving logs... 2026-02-17T20:10:13.388 DEBUG:teuthology.misc:Transferring archived files from trial123:/var/log/ceph to /home/teuthworker/mnt/teuthology/jcollin-2026-02-17_12:20:44-fs-wip-jcollin-testing-20260217.030412-squid-distro-default-trial/52816/remote/trial123/log 2026-02-17T20:10:13.389 DEBUG:teuthology.orchestra.run.trial123:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-17T20:10:13.634 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-17T20:10:13.658 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-17T20:10:13.659 DEBUG:teuthology.orchestra.run.trial123:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-17T20:10:13.780 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-17T20:10:13.791 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-17T20:10:13.791 DEBUG:teuthology.orchestra.run.trial123:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T20:10:13.807 INFO:teuthology.orchestra.run.trial123.stderr:bash: line 1: ntpq: command not found 2026-02-17T20:10:13.834 INFO:teuthology.orchestra.run.trial123.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T20:10:13.834 INFO:teuthology.orchestra.run.trial123.stdout:=============================================================================== 2026-02-17T20:10:13.834 INFO:teuthology.orchestra.run.trial123.stdout:^+ sensei.ruselabs.com 2 6 77 48 +2572us[+2572us] +/- 37ms 2026-02-17T20:10:13.834 INFO:teuthology.orchestra.run.trial123.stdout:^+ 198-12-95-197-host.coloc> 2 6 77 49 +2710us[+6268us] +/- 87ms 2026-02-17T20:10:13.834 INFO:teuthology.orchestra.run.trial123.stdout:^? triangle.kansas.net 3 7 10 177 +1562us[+2194us] +/- 53ms 2026-02-17T20:10:13.834 INFO:teuthology.orchestra.run.trial123.stdout:^* 172-104-28-175.ip.linode> 2 6 77 49 -2358us[+1200us] +/- 58ms 2026-02-17T20:10:13.835 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-17T20:10:13.848 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-17T20:10:13.848 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-17T20:10:13.860 DEBUG:teuthology.orchestra.run.trial123:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-17T20:10:13.921 DEBUG:teuthology.orchestra.run.trial123:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T20:10:13.986 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T20:10:13.986 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-17T20:10:14.006 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-17T20:10:14.023 INFO:teuthology.task.internal:Duration was 252.329716 seconds 2026-02-17T20:10:14.023 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-17T20:10:14.041 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-17T20:10:14.041 DEBUG:teuthology.orchestra.run.trial123:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T20:10:14.078 INFO:teuthology.orchestra.run.trial123.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T20:10:14.423 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-17T20:10:14.424 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial123.front.sepia.ceph.com 2026-02-17T20:10:14.424 DEBUG:teuthology.orchestra.run.trial123:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T20:10:14.482 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-17T20:10:14.482 DEBUG:teuthology.orchestra.run.trial123:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T20:10:14.564 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-17T20:10:14.564 DEBUG:teuthology.orchestra.run.trial123:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T20:10:14.627 INFO:teuthology.orchestra.run.trial123.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T20:10:14.627 INFO:teuthology.orchestra.run.trial123.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T20:10:14.628 INFO:teuthology.orchestra.run.trial123.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T20:10:14.629 INFO:teuthology.orchestra.run.trial123.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-17T20:10:14.629 INFO:teuthology.orchestra.run.trial123.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T20:10:14.631 INFO:teuthology.orchestra.run.trial123.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 87.7% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T20:10:14.633 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-17T20:10:14.653 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-17T20:10:14.653 DEBUG:teuthology.orchestra.run.trial123:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T20:10:14.698 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-17T20:10:14.718 DEBUG:teuthology.orchestra.run.trial123:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T20:10:14.763 INFO:teuthology.orchestra.run.trial123.stdout:kernel.core_pattern = core 2026-02-17T20:10:14.781 DEBUG:teuthology.orchestra.run.trial123:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T20:10:14.837 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T20:10:14.837 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-17T20:10:14.857 INFO:teuthology.task.internal:Transferring archived files... 2026-02-17T20:10:14.858 DEBUG:teuthology.misc:Transferring archived files from trial123:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/jcollin-2026-02-17_12:20:44-fs-wip-jcollin-testing-20260217.030412-squid-distro-default-trial/52816/remote/trial123 2026-02-17T20:10:14.858 DEBUG:teuthology.orchestra.run.trial123:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T20:10:14.909 INFO:teuthology.task.internal:Removing archive directory... 2026-02-17T20:10:14.909 DEBUG:teuthology.orchestra.run.trial123:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T20:10:14.959 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-17T20:10:14.980 INFO:teuthology.task.internal:Not uploading archives. 2026-02-17T20:10:14.980 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-17T20:10:15.000 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-17T20:10:15.000 DEBUG:teuthology.orchestra.run.trial123:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T20:10:15.018 INFO:teuthology.orchestra.run.trial123.stdout: 791912 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 20:10 /home/ubuntu/cephtest 2026-02-17T20:10:15.019 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-17T20:10:15.040 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-17T20:10:15.084 INFO:teuthology.run:Summary data: description: fs/upgrade/nofs/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} kernel no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn pg_health} tasks/{0-from/quincy 1-upgrade}} duration: 252.32971572875977 flavor: default owner: scheduled_jcollin@soko04.front.sepia.ceph.com success: true 2026-02-17T20:10:15.084 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T20:10:15.214 INFO:teuthology.run:pass