2026-02-20T16:24:36.217 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-20T16:24:36.235 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-20T16:24:36.325 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/yuriw-2026-02-20_16:06:46-upgrade-wip-pdonnell-testing-20260219.182737-tentacle-distro-default-trial/60844 branch: wip-pdonnell-testing-20260219.182737-tentacle description: upgrade/cephfs/nofs/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} kernel no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn pg_health} tasks/{0-from/squid 1-upgrade}} email: yweinste@redhat.com first_in_suite: false flavor: default job_id: '60844' kernel: sha1: distro last_in_suite: false machine_type: trial meta: - desc: 'install ceph/squid latest ' name: yuriw-2026-02-20_16:06:46-upgrade-wip-pdonnell-testing-20260219.182737-tentacle-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20260219.182737-tentacle ceph: cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: global: bluestore warn on legacy statfs: false bluestore warn on no per pool omap: false mon pg warn min per osd: 0 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon warn on osd down out interval zero: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - is offline because no MDS - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - BLUESTORE_SLOW_OP_ALERT - slow operation indications in BlueStore - experiencing slow operations in BlueStore - MGR_MODULE_ERROR - OSD_DOWN - osd.* is down - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - osds down - osd.* is down - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - pg .* is stuck inactive - pg .* is .*degraded - pg .* is stuck peering - scrub mismatch - ScrubResult - wrongly marked - \(POOL_APP_NOT_ENABLED\) - \(SLOW_OPS\) - overall HEALTH_ - \(MON_MSGR2_NOT_ENABLED\) - slow request sha1: f7870454149f22574086dd2ff55d050585136531 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: f7870454149f22574086dd2ff55d050585136531 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20260219.182737-tentacle sha1: f7870454149f22574086dd2ff55d050585136531 owner: scheduled_yuriw@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 seed: 6167 sha1: f7870454149f22574086dd2ff55d050585136531 sleep_before_teardown: 0 subset: 111/120000 suite: upgrade suite_branch: wip-pdonnell-testing-20260219.182737-tentacle suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_f7870454149f22574086dd2ff55d050585136531/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: f7870454149f22574086dd2ff55d050585136531 targets: trial057.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKtsusqfyOtnd80xdVZl9vaBER3VrUldVZngawWsMaJ1lMLd2s+JvqE6S9Ns66RKqOxpcDQXtO0IHbexJ9OeZqM= tasks: - install: branch: squid exclude_packages: - librados3 - ceph-mgr-dashboard - ceph-mgr-diskprediction-local - ceph-mgr-rook - ceph-mgr-cephadm - cephadm - ceph-volume extra_packages: - librados2 - print: '**** done installing squid' - ceph: conf: global: mon warn on pool no app: false ms bind msgr2: false log-ignorelist: - overall HEALTH_ - \(FS_ - \(MDS_ - \(OSD_ - \(MON_DOWN\) - \(CACHE_POOL_ - \(POOL_ - \(MGR_DOWN\) - \(PG_ - \(SMALLER_PGP_NUM\) - Monitor daemon marked osd - Behind on trimming - Manager daemon - exec: osd.0: - ceph osd set-require-min-compat-client squid - print: '**** done ceph' - print: '*** upgrading, no cephfs present' - exec: mon.a: - ceph fs dump - install.upgrade: mon.a: null - print: '**** done install.upgrade' - ceph.restart: daemons: - mon.* - mgr.* mon-health-to-clog: false wait-for-healthy: false - ceph.healthy: null - ceph.restart: daemons: - osd.* wait-for-healthy: false wait-for-osds-up: true - exec: mon.a: - ceph versions - ceph osd dump -f json-pretty - ceph fs dump - ceph osd require-osd-release tentacle - for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done - ceph.healthy: null - print: '**** done ceph.restart' teuthology: fragments_dropped: [] meta: {} postmerge: - "local branch = yaml.kernel.branch\nif branch and not yaml.kernel.branch:find\ \ \"-all$\" then\n log.debug(\"removing default kernel specification: %s\", yaml.kernel)\n\ \ py_attrgetter(yaml.kernel).pop('branch', nil)\n py_attrgetter(yaml.kernel).pop('deb',\ \ nil)\n py_attrgetter(yaml.kernel).pop('flavor', nil)\n py_attrgetter(yaml.kernel).pop('kdb',\ \ nil)\n py_attrgetter(yaml.kernel).pop('koji', nil)\n py_attrgetter(yaml.kernel).pop('koji_task',\ \ nil)\n py_attrgetter(yaml.kernel).pop('rpm', nil)\n py_attrgetter(yaml.kernel).pop('sha1',\ \ nil)\n py_attrgetter(yaml.kernel).pop('tag', nil)\nend\n" teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-20_16:06:46 tube: trial user: yuriw verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.1540699 2026-02-20T16:24:36.326 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_f7870454149f22574086dd2ff55d050585136531/qa; will attempt to use it 2026-02-20T16:24:36.326 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_f7870454149f22574086dd2ff55d050585136531/qa/tasks 2026-02-20T16:24:36.326 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-20T16:24:36.328 INFO:teuthology.task.internal:Checking packages... 2026-02-20T16:24:36.328 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'f7870454149f22574086dd2ff55d050585136531' 2026-02-20T16:24:36.328 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-20T16:24:36.328 INFO:teuthology.packaging:ref: None 2026-02-20T16:24:36.328 INFO:teuthology.packaging:tag: None 2026-02-20T16:24:36.328 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20260219.182737-tentacle 2026-02-20T16:24:36.328 INFO:teuthology.packaging:sha1: f7870454149f22574086dd2ff55d050585136531 2026-02-20T16:24:36.328 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20260219.182737-tentacle 2026-02-20T16:24:36.454 INFO:teuthology.task.internal:Found packages for ceph version 20.2.0-677.gf7870454 2026-02-20T16:24:36.456 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-20T16:24:36.467 INFO:teuthology.task.internal:no buildpackages task found 2026-02-20T16:24:36.467 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-20T16:24:36.481 INFO:teuthology.task.internal:Saving configuration 2026-02-20T16:24:36.499 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-20T16:24:36.512 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-20T16:24:37.567 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial057.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-20_16:06:46-upgrade-wip-pdonnell-testing-20260219.182737-tentacle-distro-default-trial/60844', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-20 16:21:04.627838', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKtsusqfyOtnd80xdVZl9vaBER3VrUldVZngawWsMaJ1lMLd2s+JvqE6S9Ns66RKqOxpcDQXtO0IHbexJ9OeZqM='} 2026-02-20T16:24:37.567 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-20T16:24:37.578 INFO:teuthology.task.internal:roles: ubuntu@trial057.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2026-02-20T16:24:37.578 INFO:teuthology.run_tasks:Running task console_log... 2026-02-20T16:24:37.672 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x72800170f6a0>, signals=[15]) 2026-02-20T16:24:37.672 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-20T16:24:37.683 INFO:teuthology.task.internal:Opening connections... 2026-02-20T16:24:37.683 DEBUG:teuthology.task.internal:connecting to ubuntu@trial057.front.sepia.ceph.com 2026-02-20T16:24:37.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T16:24:37.748 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-20T16:24:37.759 DEBUG:teuthology.orchestra.run.trial057:> uname -m 2026-02-20T16:24:37.823 INFO:teuthology.orchestra.run.trial057.stdout:x86_64 2026-02-20T16:24:37.823 DEBUG:teuthology.orchestra.run.trial057:> cat /etc/os-release 2026-02-20T16:24:37.879 INFO:teuthology.orchestra.run.trial057.stdout:NAME="CentOS Stream" 2026-02-20T16:24:37.879 INFO:teuthology.orchestra.run.trial057.stdout:VERSION="9" 2026-02-20T16:24:37.880 INFO:teuthology.orchestra.run.trial057.stdout:ID="centos" 2026-02-20T16:24:37.880 INFO:teuthology.orchestra.run.trial057.stdout:ID_LIKE="rhel fedora" 2026-02-20T16:24:37.880 INFO:teuthology.orchestra.run.trial057.stdout:VERSION_ID="9" 2026-02-20T16:24:37.880 INFO:teuthology.orchestra.run.trial057.stdout:PLATFORM_ID="platform:el9" 2026-02-20T16:24:37.880 INFO:teuthology.orchestra.run.trial057.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-20T16:24:37.880 INFO:teuthology.orchestra.run.trial057.stdout:ANSI_COLOR="0;31" 2026-02-20T16:24:37.880 INFO:teuthology.orchestra.run.trial057.stdout:LOGO="fedora-logo-icon" 2026-02-20T16:24:37.880 INFO:teuthology.orchestra.run.trial057.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-20T16:24:37.880 INFO:teuthology.orchestra.run.trial057.stdout:HOME_URL="https://centos.org/" 2026-02-20T16:24:37.880 INFO:teuthology.orchestra.run.trial057.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-20T16:24:37.880 INFO:teuthology.orchestra.run.trial057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-20T16:24:37.880 INFO:teuthology.orchestra.run.trial057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-20T16:24:37.880 INFO:teuthology.lock.ops:Updating trial057.front.sepia.ceph.com on lock server 2026-02-20T16:24:37.968 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-20T16:24:37.981 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-20T16:24:37.992 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-20T16:24:37.992 DEBUG:teuthology.orchestra.run.trial057:> test '!' -e /home/ubuntu/cephtest 2026-02-20T16:24:38.007 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-20T16:24:38.019 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-20T16:24:38.019 DEBUG:teuthology.orchestra.run.trial057:> test -z $(ls -A /var/lib/ceph) 2026-02-20T16:24:38.064 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-20T16:24:38.171 INFO:teuthology.run_tasks:Running task kernel... 2026-02-20T16:24:38.192 INFO:teuthology.task.kernel:normalize config orig: {'sha1': 'distro'} 2026-02-20T16:24:38.192 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro'}}, timeout 300 2026-02-20T16:24:38.192 DEBUG:teuthology.orchestra.run.trial057:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-20T16:24:38.207 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T16:24:38.207 DEBUG:teuthology.orchestra.run.trial057:> uname -r 2026-02-20T16:24:38.263 INFO:teuthology.orchestra.run.trial057.stdout:5.14.0-681.el9.x86_64 2026-02-20T16:24:38.264 INFO:teuthology.task.kernel:Running kernel on trial057: 5.14.0-681.el9.x86_64 2026-02-20T16:24:38.264 DEBUG:teuthology.orchestra.run.trial057:> sudo yum install -y kernel 2026-02-20T16:24:40.291 INFO:teuthology.orchestra.run.trial057.stdout:CentOS Stream 9 - BaseOS 5.4 MB/s | 8.9 MB 00:01 2026-02-20T16:24:43.582 INFO:teuthology.orchestra.run.trial057.stdout:CentOS Stream 9 - AppStream 9.7 MB/s | 27 MB 00:02 2026-02-20T16:24:46.253 INFO:teuthology.orchestra.run.trial057.stdout:CentOS Stream 9 - CRB 27 MB/s | 7.8 MB 00:00 2026-02-20T16:24:47.828 INFO:teuthology.orchestra.run.trial057.stdout:CentOS Stream 9 - Extras packages 23 kB/s | 20 kB 00:00 2026-02-20T16:24:49.038 INFO:teuthology.orchestra.run.trial057.stdout:Extra Packages for Enterprise Linux 18 MB/s | 20 MB 00:01 2026-02-20T16:24:52.178 INFO:teuthology.orchestra.run.trial057.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-20T16:24:53.189 INFO:teuthology.orchestra.run.trial057.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-20T16:24:53.189 INFO:teuthology.orchestra.run.trial057.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-20T16:24:53.208 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-20T16:24:53.209 INFO:teuthology.orchestra.run.trial057.stdout:Nothing to do. 2026-02-20T16:24:53.209 INFO:teuthology.orchestra.run.trial057.stdout:Complete! 2026-02-20T16:24:53.233 DEBUG:teuthology.orchestra.run.trial057:> echo no | sudo yum reinstall kernel || true 2026-02-20T16:24:53.533 INFO:teuthology.orchestra.run.trial057.stdout:Last metadata expiration check: 0:00:01 ago on Fri 20 Feb 2026 04:24:52 PM UTC. 2026-02-20T16:24:53.613 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-20T16:24:53.614 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-20T16:24:53.614 INFO:teuthology.orchestra.run.trial057.stdout: Package Architecture Version Repository Size 2026-02-20T16:24:53.614 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-20T16:24:53.614 INFO:teuthology.orchestra.run.trial057.stdout:Reinstalling: 2026-02-20T16:24:53.614 INFO:teuthology.orchestra.run.trial057.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-20T16:24:53.614 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:24:53.615 INFO:teuthology.orchestra.run.trial057.stdout:Transaction Summary 2026-02-20T16:24:53.615 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-20T16:24:53.615 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:24:53.615 INFO:teuthology.orchestra.run.trial057.stdout:Total download size: 803 k 2026-02-20T16:24:53.615 INFO:teuthology.orchestra.run.trial057.stdout:Installed size: 0 2026-02-20T16:24:53.615 INFO:teuthology.orchestra.run.trial057.stderr:Operation aborted. 2026-02-20T16:24:53.633 INFO:teuthology.orchestra.run.trial057.stdout:Is this ok [y/N]: 2026-02-20T16:24:53.633 DEBUG:teuthology.orchestra.run.trial057:> sudo yum reinstall -y kernel || true 2026-02-20T16:24:53.929 INFO:teuthology.orchestra.run.trial057.stdout:Last metadata expiration check: 0:00:01 ago on Fri 20 Feb 2026 04:24:52 PM UTC. 2026-02-20T16:24:54.008 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-20T16:24:54.009 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-20T16:24:54.009 INFO:teuthology.orchestra.run.trial057.stdout: Package Architecture Version Repository Size 2026-02-20T16:24:54.009 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-20T16:24:54.009 INFO:teuthology.orchestra.run.trial057.stdout:Reinstalling: 2026-02-20T16:24:54.009 INFO:teuthology.orchestra.run.trial057.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-20T16:24:54.009 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:24:54.009 INFO:teuthology.orchestra.run.trial057.stdout:Transaction Summary 2026-02-20T16:24:54.009 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-20T16:24:54.009 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:24:54.009 INFO:teuthology.orchestra.run.trial057.stdout:Total download size: 803 k 2026-02-20T16:24:54.009 INFO:teuthology.orchestra.run.trial057.stdout:Installed size: 0 2026-02-20T16:24:54.009 INFO:teuthology.orchestra.run.trial057.stdout:Downloading Packages: 2026-02-20T16:24:54.299 INFO:teuthology.orchestra.run.trial057.stdout:kernel-5.14.0-681.el9.x86_64.rpm 4.0 MB/s | 803 kB 00:00 2026-02-20T16:24:54.299 INFO:teuthology.orchestra.run.trial057.stdout:-------------------------------------------------------------------------------- 2026-02-20T16:24:54.299 INFO:teuthology.orchestra.run.trial057.stdout:Total 2.7 MB/s | 803 kB 00:00 2026-02-20T16:24:54.309 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction check 2026-02-20T16:24:54.342 INFO:teuthology.orchestra.run.trial057.stdout:Transaction check succeeded. 2026-02-20T16:24:54.342 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction test 2026-02-20T16:24:54.346 INFO:teuthology.orchestra.run.trial057.stdout:Transaction test succeeded. 2026-02-20T16:24:54.346 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction 2026-02-20T16:24:54.370 INFO:teuthology.orchestra.run.trial057.stdout: Preparing : 1/1 2026-02-20T16:24:54.374 INFO:teuthology.orchestra.run.trial057.stdout: Reinstalling : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-20T16:24:54.374 INFO:teuthology.orchestra.run.trial057.stdout: Cleanup : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T16:24:54.485 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T16:24:54.485 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-20T16:24:54.540 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T16:24:54.540 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:24:54.540 INFO:teuthology.orchestra.run.trial057.stdout:Reinstalled: 2026-02-20T16:24:54.541 INFO:teuthology.orchestra.run.trial057.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-20T16:24:54.541 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:24:54.541 INFO:teuthology.orchestra.run.trial057.stdout:Complete! 2026-02-20T16:24:54.566 DEBUG:teuthology.orchestra.run.trial057:> rpm -q kernel | sort -rV | head -n 1 2026-02-20T16:24:54.590 INFO:teuthology.orchestra.run.trial057.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-20T16:24:54.590 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-20T16:24:54.590 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2026-02-20T16:24:54.590 DEBUG:teuthology.parallel:result is None 2026-02-20T16:24:54.590 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-20T16:24:54.602 INFO:teuthology.task.internal:Creating test directory... 2026-02-20T16:24:54.602 DEBUG:teuthology.orchestra.run.trial057:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-20T16:24:54.646 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-20T16:24:54.658 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-20T16:24:54.670 INFO:teuthology.task.internal:Creating archive directory... 2026-02-20T16:24:54.671 DEBUG:teuthology.orchestra.run.trial057:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-20T16:24:54.707 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-20T16:24:54.719 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-20T16:24:54.719 DEBUG:teuthology.orchestra.run.trial057:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-20T16:24:54.766 INFO:teuthology.orchestra.run.trial057.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-20T16:24:54.775 INFO:teuthology.orchestra.run.trial057.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-20T16:24:54.777 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-20T16:24:54.788 INFO:teuthology.task.internal:Configuring sudo... 2026-02-20T16:24:54.788 DEBUG:teuthology.orchestra.run.trial057:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-20T16:24:54.841 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-20T16:24:54.860 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-20T16:24:54.860 DEBUG:teuthology.orchestra.run.trial057:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-20T16:24:54.897 DEBUG:teuthology.orchestra.run.trial057:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T16:24:55.087 DEBUG:teuthology.orchestra.run.trial057:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T16:24:55.112 DEBUG:teuthology.orchestra.run.trial057:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T16:24:55.261 DEBUG:teuthology.orchestra.run.trial057:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T16:24:55.285 DEBUG:teuthology.orchestra.run.trial057:> set -ex 2026-02-20T16:24:55.285 DEBUG:teuthology.orchestra.run.trial057:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-20T16:24:55.349 DEBUG:teuthology.orchestra.run.trial057:> sudo service rsyslog restart 2026-02-20T16:24:55.416 INFO:teuthology.orchestra.run.trial057.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-20T16:24:55.944 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-20T16:24:55.956 INFO:teuthology.task.internal:Starting timer... 2026-02-20T16:24:55.956 INFO:teuthology.run_tasks:Running task pcp... 2026-02-20T16:24:55.976 INFO:teuthology.run_tasks:Running task selinux... 2026-02-20T16:24:55.991 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2026-02-20T16:24:55.991 DEBUG:teuthology.orchestra.run.trial057:> sudo service auditd rotate 2026-02-20T16:24:56.020 INFO:teuthology.orchestra.run.trial057.stdout:Rotating logs: 2026-02-20T16:24:56.022 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-20T16:24:56.022 DEBUG:teuthology.orchestra.run.trial057:> /usr/sbin/getenforce 2026-02-20T16:24:56.078 INFO:teuthology.orchestra.run.trial057.stdout:Permissive 2026-02-20T16:24:56.078 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial057.front.sepia.ceph.com': 'permissive'} 2026-02-20T16:24:56.079 DEBUG:teuthology.orchestra.run.trial057:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2026-02-20T16:24:56.142 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T16:24:56.143 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-20T16:24:56.143 DEBUG:teuthology.orchestra.run.trial057:> sudo /usr/sbin/setenforce permissive 2026-02-20T16:24:56.206 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-20T16:24:56.221 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-20T16:24:56.233 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-20T16:24:56.234 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial057.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-20T16:27:37.677 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial057.front.sepia.ceph.com')] 2026-02-20T16:27:37.678 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial057.front.sepia.ceph.com' 2026-02-20T16:27:37.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T16:27:37.789 DEBUG:teuthology.orchestra.run.trial057:> true 2026-02-20T16:27:37.869 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial057.front.sepia.ceph.com' 2026-02-20T16:27:37.870 INFO:teuthology.run_tasks:Running task clock... 2026-02-20T16:27:37.885 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-20T16:27:37.885 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-20T16:27:37.885 DEBUG:teuthology.orchestra.run.trial057:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-20T16:27:37.939 INFO:teuthology.orchestra.run.trial057.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-20T16:27:37.951 INFO:teuthology.orchestra.run.trial057.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-20T16:27:37.971 INFO:teuthology.orchestra.run.trial057.stderr:sudo: ntpd: command not found 2026-02-20T16:27:37.981 INFO:teuthology.orchestra.run.trial057.stdout:506 Cannot talk to daemon 2026-02-20T16:27:37.993 INFO:teuthology.orchestra.run.trial057.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-20T16:27:38.004 INFO:teuthology.orchestra.run.trial057.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-20T16:27:38.051 INFO:teuthology.orchestra.run.trial057.stderr:bash: line 1: ntpq: command not found 2026-02-20T16:27:38.053 INFO:teuthology.orchestra.run.trial057.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-20T16:27:38.053 INFO:teuthology.orchestra.run.trial057.stdout:=============================================================================== 2026-02-20T16:27:38.054 INFO:teuthology.run_tasks:Running task install... 2026-02-20T16:27:38.069 DEBUG:teuthology.task.install:project ceph 2026-02-20T16:27:38.069 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'f7870454149f22574086dd2ff55d050585136531'}} 2026-02-20T16:27:38.069 DEBUG:teuthology.task.install:config {'branch': 'squid', 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-volume'], 'extra_packages': ['librados2'], 'flavor': 'default', 'sha1': 'f7870454149f22574086dd2ff55d050585136531'} 2026-02-20T16:27:38.069 INFO:teuthology.task.install:Using flavor: default 2026-02-20T16:27:38.078 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-20T16:27:38.079 INFO:teuthology.task.install:extra packages: ['librados2'] 2026-02-20T16:27:38.079 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'squid', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-volume'], 'extra_packages': ['librados2'], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f7870454149f22574086dd2ff55d050585136531', 'tag': None, 'wait_for_package': False} 2026-02-20T16:27:38.080 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-20T16:27:38.080 INFO:teuthology.packaging:ref: None 2026-02-20T16:27:38.080 INFO:teuthology.packaging:tag: None 2026-02-20T16:27:38.080 INFO:teuthology.packaging:branch: squid 2026-02-20T16:27:38.080 INFO:teuthology.packaging:sha1: f7870454149f22574086dd2ff55d050585136531 2026-02-20T16:27:38.080 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2026-02-20T16:27:38.273 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/283431c091dafc302f5753f809d0bd1eddce0869/centos/9/flavors/default/ 2026-02-20T16:27:38.273 INFO:teuthology.task.install.rpm:Package version is 19.2.3-672.g283431c0 2026-02-20T16:27:38.395 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/283431c091dafc302f5753f809d0bd1eddce0869/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/283431c091dafc302f5753f809d0bd1eddce0869/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/283431c091dafc302f5753f809d0bd1eddce0869/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-20T16:27:38.395 DEBUG:teuthology.orchestra.run.trial057:> set -ex 2026-02-20T16:27:38.395 DEBUG:teuthology.orchestra.run.trial057:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-20T16:27:38.421 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-immutable-object-cache, ceph-mgr, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, librados2 on remote rpm x86_64 2026-02-20T16:27:38.421 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-20T16:27:38.421 INFO:teuthology.packaging:ref: None 2026-02-20T16:27:38.421 INFO:teuthology.packaging:tag: None 2026-02-20T16:27:38.421 INFO:teuthology.packaging:branch: squid 2026-02-20T16:27:38.421 INFO:teuthology.packaging:sha1: f7870454149f22574086dd2ff55d050585136531 2026-02-20T16:27:38.421 DEBUG:teuthology.orchestra.run.trial057:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/squid/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-20T16:27:38.485 DEBUG:teuthology.orchestra.run.trial057:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-20T16:27:38.561 DEBUG:teuthology.orchestra.run.trial057:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-20T16:27:38.625 INFO:teuthology.orchestra.run.trial057.stdout:check_obsoletes = 1 2026-02-20T16:27:38.627 DEBUG:teuthology.orchestra.run.trial057:> sudo yum clean all 2026-02-20T16:27:38.784 INFO:teuthology.orchestra.run.trial057.stdout:41 files removed 2026-02-20T16:27:38.799 DEBUG:teuthology.orchestra.run.trial057:> sudo yum -y install ceph-radosgw 2026-02-20T16:27:39.069 INFO:teuthology.orchestra.run.trial057.stdout:ceph packages for x86_64 658 kB/s | 84 kB 00:00 2026-02-20T16:27:39.200 INFO:teuthology.orchestra.run.trial057.stdout:ceph noarch packages 110 kB/s | 12 kB 00:00 2026-02-20T16:27:39.337 INFO:teuthology.orchestra.run.trial057.stdout:ceph source packages 16 kB/s | 1.9 kB 00:00 2026-02-20T16:27:40.944 INFO:teuthology.orchestra.run.trial057.stdout:CentOS Stream 9 - BaseOS 5.6 MB/s | 8.9 MB 00:01 2026-02-20T16:28:00.176 INFO:teuthology.orchestra.run.trial057.stdout:CentOS Stream 9 - AppStream 1.4 MB/s | 27 MB 00:18 2026-02-20T16:28:04.523 INFO:teuthology.orchestra.run.trial057.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 7.8 MB 00:01 2026-02-20T16:28:05.355 INFO:teuthology.orchestra.run.trial057.stdout:CentOS Stream 9 - Extras packages 183 kB/s | 20 kB 00:00 2026-02-20T16:28:06.143 INFO:teuthology.orchestra.run.trial057.stdout:Extra Packages for Enterprise Linux 28 MB/s | 20 MB 00:00 2026-02-20T16:28:09.354 INFO:teuthology.orchestra.run.trial057.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-20T16:28:10.548 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-20T16:28:10.549 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-20T16:28:10.549 INFO:teuthology.orchestra.run.trial057.stdout: Package Arch Version Repository Size 2026-02-20T16:28:10.549 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-20T16:28:10.549 INFO:teuthology.orchestra.run.trial057.stdout:Installing: 2026-02-20T16:28:10.549 INFO:teuthology.orchestra.run.trial057.stdout: ceph-radosgw x86_64 2:19.2.3-672.g283431c0.el9 ceph 11 M 2026-02-20T16:28:10.549 INFO:teuthology.orchestra.run.trial057.stdout:Upgrading: 2026-02-20T16:28:10.550 INFO:teuthology.orchestra.run.trial057.stdout: librados2 x86_64 2:19.2.3-672.g283431c0.el9 ceph 3.4 M 2026-02-20T16:28:10.550 INFO:teuthology.orchestra.run.trial057.stdout: librbd1 x86_64 2:19.2.3-672.g283431c0.el9 ceph 3.2 M 2026-02-20T16:28:10.550 INFO:teuthology.orchestra.run.trial057.stdout:Installing dependencies: 2026-02-20T16:28:10.550 INFO:teuthology.orchestra.run.trial057.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-20T16:28:10.550 INFO:teuthology.orchestra.run.trial057.stdout: ceph-base x86_64 2:19.2.3-672.g283431c0.el9 ceph 5.5 M 2026-02-20T16:28:10.550 INFO:teuthology.orchestra.run.trial057.stdout: ceph-common x86_64 2:19.2.3-672.g283431c0.el9 ceph 22 M 2026-02-20T16:28:10.550 INFO:teuthology.orchestra.run.trial057.stdout: ceph-selinux x86_64 2:19.2.3-672.g283431c0.el9 ceph 25 k 2026-02-20T16:28:10.550 INFO:teuthology.orchestra.run.trial057.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-20T16:28:10.550 INFO:teuthology.orchestra.run.trial057.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-20T16:28:10.550 INFO:teuthology.orchestra.run.trial057.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-20T16:28:10.550 INFO:teuthology.orchestra.run.trial057.stdout: libcephfs2 x86_64 2:19.2.3-672.g283431c0.el9 ceph 1.0 M 2026-02-20T16:28:10.550 INFO:teuthology.orchestra.run.trial057.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-20T16:28:10.550 INFO:teuthology.orchestra.run.trial057.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-20T16:28:10.550 INFO:teuthology.orchestra.run.trial057.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-20T16:28:10.550 INFO:teuthology.orchestra.run.trial057.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-20T16:28:10.550 INFO:teuthology.orchestra.run.trial057.stdout: libradosstriper1 x86_64 2:19.2.3-672.g283431c0.el9 ceph 504 k 2026-02-20T16:28:10.550 INFO:teuthology.orchestra.run.trial057.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-20T16:28:10.550 INFO:teuthology.orchestra.run.trial057.stdout: librgw2 x86_64 2:19.2.3-672.g283431c0.el9 ceph 5.4 M 2026-02-20T16:28:10.550 INFO:teuthology.orchestra.run.trial057.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-20T16:28:10.550 INFO:teuthology.orchestra.run.trial057.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-20T16:28:10.550 INFO:teuthology.orchestra.run.trial057.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-20T16:28:10.550 INFO:teuthology.orchestra.run.trial057.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-20T16:28:10.551 INFO:teuthology.orchestra.run.trial057.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-20T16:28:10.551 INFO:teuthology.orchestra.run.trial057.stdout: python3-ceph-argparse x86_64 2:19.2.3-672.g283431c0.el9 ceph 45 k 2026-02-20T16:28:10.551 INFO:teuthology.orchestra.run.trial057.stdout: python3-ceph-common x86_64 2:19.2.3-672.g283431c0.el9 ceph 142 k 2026-02-20T16:28:10.551 INFO:teuthology.orchestra.run.trial057.stdout: python3-cephfs x86_64 2:19.2.3-672.g283431c0.el9 ceph 165 k 2026-02-20T16:28:10.551 INFO:teuthology.orchestra.run.trial057.stdout: python3-rados x86_64 2:19.2.3-672.g283431c0.el9 ceph 323 k 2026-02-20T16:28:10.551 INFO:teuthology.orchestra.run.trial057.stdout: python3-rbd x86_64 2:19.2.3-672.g283431c0.el9 ceph 302 k 2026-02-20T16:28:10.551 INFO:teuthology.orchestra.run.trial057.stdout: python3-rgw x86_64 2:19.2.3-672.g283431c0.el9 ceph 100 k 2026-02-20T16:28:10.551 INFO:teuthology.orchestra.run.trial057.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-20T16:28:10.551 INFO:teuthology.orchestra.run.trial057.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-20T16:28:10.551 INFO:teuthology.orchestra.run.trial057.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-20T16:28:10.551 INFO:teuthology.orchestra.run.trial057.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-20T16:28:10.551 INFO:teuthology.orchestra.run.trial057.stdout:Installing weak dependencies: 2026-02-20T16:28:10.551 INFO:teuthology.orchestra.run.trial057.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-20T16:28:10.551 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:10.551 INFO:teuthology.orchestra.run.trial057.stdout:Transaction Summary 2026-02-20T16:28:10.551 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-20T16:28:10.551 INFO:teuthology.orchestra.run.trial057.stdout:Install 32 Packages 2026-02-20T16:28:10.551 INFO:teuthology.orchestra.run.trial057.stdout:Upgrade 2 Packages 2026-02-20T16:28:10.551 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:10.552 INFO:teuthology.orchestra.run.trial057.stdout:Total download size: 62 M 2026-02-20T16:28:10.552 INFO:teuthology.orchestra.run.trial057.stdout:Downloading Packages: 2026-02-20T16:28:11.869 INFO:teuthology.orchestra.run.trial057.stdout:(1/34): ceph-base-19.2.3-672.g283431c0.el9.x86_ 6.2 MB/s | 5.5 MB 00:00 2026-02-20T16:28:11.898 INFO:teuthology.orchestra.run.trial057.stdout:(2/34): ceph-selinux-19.2.3-672.g283431c0.el9.x 863 kB/s | 25 kB 00:00 2026-02-20T16:28:12.004 INFO:teuthology.orchestra.run.trial057.stdout:(3/34): libcephfs2-19.2.3-672.g283431c0.el9.x86 9.2 MB/s | 1.0 MB 00:00 2026-02-20T16:28:12.074 INFO:teuthology.orchestra.run.trial057.stdout:(4/34): libradosstriper1-19.2.3-672.g283431c0.e 7.0 MB/s | 504 kB 00:00 2026-02-20T16:28:12.469 INFO:teuthology.orchestra.run.trial057.stdout:(5/34): librgw2-19.2.3-672.g283431c0.el9.x86_64 14 MB/s | 5.4 MB 00:00 2026-02-20T16:28:12.506 INFO:teuthology.orchestra.run.trial057.stdout:(6/34): python3-ceph-argparse-19.2.3-672.g28343 1.2 MB/s | 45 kB 00:00 2026-02-20T16:28:12.546 INFO:teuthology.orchestra.run.trial057.stdout:(7/34): python3-ceph-common-19.2.3-672.g283431c 3.5 MB/s | 142 kB 00:00 2026-02-20T16:28:12.587 INFO:teuthology.orchestra.run.trial057.stdout:(8/34): python3-cephfs-19.2.3-672.g283431c0.el9 3.9 MB/s | 165 kB 00:00 2026-02-20T16:28:12.632 INFO:teuthology.orchestra.run.trial057.stdout:(9/34): python3-rados-19.2.3-672.g283431c0.el9. 7.1 MB/s | 323 kB 00:00 2026-02-20T16:28:12.677 INFO:teuthology.orchestra.run.trial057.stdout:(10/34): python3-rbd-19.2.3-672.g283431c0.el9.x 6.6 MB/s | 302 kB 00:00 2026-02-20T16:28:12.719 INFO:teuthology.orchestra.run.trial057.stdout:(11/34): python3-rgw-19.2.3-672.g283431c0.el9.x 2.3 MB/s | 100 kB 00:00 2026-02-20T16:28:12.836 INFO:teuthology.orchestra.run.trial057.stdout:(12/34): mailcap-2.1.49-5.el9.noarch.rpm 283 kB/s | 33 kB 00:00 2026-02-20T16:28:12.872 INFO:teuthology.orchestra.run.trial057.stdout:(13/34): ceph-radosgw-19.2.3-672.g283431c0.el9. 5.7 MB/s | 11 MB 00:01 2026-02-20T16:28:12.926 INFO:teuthology.orchestra.run.trial057.stdout:(14/34): pciutils-3.7.0-7.el9.x86_64.rpm 1.0 MB/s | 93 kB 00:00 2026-02-20T16:28:13.111 INFO:teuthology.orchestra.run.trial057.stdout:(15/34): ceph-common-19.2.3-672.g283431c0.el9.x 10 MB/s | 22 MB 00:02 2026-02-20T16:28:13.439 INFO:teuthology.orchestra.run.trial057.stdout:(16/34): boost-program-options-1.75.0-13.el9.x8 183 kB/s | 104 kB 00:00 2026-02-20T16:28:13.522 INFO:teuthology.orchestra.run.trial057.stdout:(17/34): librabbitmq-0.11.0-7.el9.x86_64.rpm 549 kB/s | 45 kB 00:00 2026-02-20T16:28:13.578 INFO:teuthology.orchestra.run.trial057.stdout:(18/34): libnbd-1.20.3-4.el9.x86_64.rpm 251 kB/s | 164 kB 00:00 2026-02-20T16:28:13.745 INFO:teuthology.orchestra.run.trial057.stdout:(19/34): libpmemobj-1.12.1-1.el9.x86_64.rpm 253 kB/s | 160 kB 00:00 2026-02-20T16:28:13.972 INFO:teuthology.orchestra.run.trial057.stdout:(20/34): lttng-ust-2.12.0-6.el9.x86_64.rpm 744 kB/s | 292 kB 00:00 2026-02-20T16:28:14.055 INFO:teuthology.orchestra.run.trial057.stdout:(21/34): qatlib-service-25.08.0-2.el9.x86_64.rp 448 kB/s | 37 kB 00:00 2026-02-20T16:28:14.061 INFO:teuthology.orchestra.run.trial057.stdout:(22/34): qatlib-25.08.0-2.el9.x86_64.rpm 758 kB/s | 240 kB 00:00 2026-02-20T16:28:14.138 INFO:teuthology.orchestra.run.trial057.stdout:(23/34): qatzip-libs-1.3.1-1.el9.x86_64.rpm 802 kB/s | 66 kB 00:00 2026-02-20T16:28:14.303 INFO:teuthology.orchestra.run.trial057.stdout:(24/34): librdkafka-1.6.1-102.el9.x86_64.rpm 848 kB/s | 662 kB 00:00 2026-02-20T16:28:14.575 INFO:teuthology.orchestra.run.trial057.stdout:(25/34): gperftools-libs-2.9.1-3.el9.x86_64.rpm 599 kB/s | 308 kB 00:00 2026-02-20T16:28:14.581 INFO:teuthology.orchestra.run.trial057.stdout:(26/34): libarrow-doc-9.0.0-15.el9.noarch.rpm 89 kB/s | 25 kB 00:00 2026-02-20T16:28:14.649 INFO:teuthology.orchestra.run.trial057.stdout:(27/34): liboath-2.6.12-1.el9.x86_64.rpm 665 kB/s | 49 kB 00:00 2026-02-20T16:28:14.731 INFO:teuthology.orchestra.run.trial057.stdout:(28/34): libunwind-1.6.2-1.el9.x86_64.rpm 447 kB/s | 67 kB 00:00 2026-02-20T16:28:14.849 INFO:teuthology.orchestra.run.trial057.stdout:(29/34): parquet-libs-9.0.0-15.el9.x86_64.rpm 4.1 MB/s | 838 kB 00:00 2026-02-20T16:28:14.900 INFO:teuthology.orchestra.run.trial057.stdout:(30/34): re2-20211101-20.el9.x86_64.rpm 1.1 MB/s | 191 kB 00:00 2026-02-20T16:28:14.908 INFO:teuthology.orchestra.run.trial057.stdout:(31/34): libarrow-9.0.0-15.el9.x86_64.rpm 5.7 MB/s | 4.4 MB 00:00 2026-02-20T16:28:15.015 INFO:teuthology.orchestra.run.trial057.stdout:(32/34): thrift-0.15.0-4.el9.x86_64.rpm 9.5 MB/s | 1.6 MB 00:00 2026-02-20T16:28:15.049 INFO:teuthology.orchestra.run.trial057.stdout:(33/34): librbd1-19.2.3-672.g283431c0.el9.x86_6 23 MB/s | 3.2 MB 00:00 2026-02-20T16:28:15.059 INFO:teuthology.orchestra.run.trial057.stdout:(34/34): librados2-19.2.3-672.g283431c0.el9.x86 22 MB/s | 3.4 MB 00:00 2026-02-20T16:28:15.062 INFO:teuthology.orchestra.run.trial057.stdout:-------------------------------------------------------------------------------- 2026-02-20T16:28:15.062 INFO:teuthology.orchestra.run.trial057.stdout:Total 14 MB/s | 62 MB 00:04 2026-02-20T16:28:15.150 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction check 2026-02-20T16:28:15.166 INFO:teuthology.orchestra.run.trial057.stdout:Transaction check succeeded. 2026-02-20T16:28:15.166 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction test 2026-02-20T16:28:15.414 INFO:teuthology.orchestra.run.trial057.stdout:Transaction test succeeded. 2026-02-20T16:28:15.414 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction 2026-02-20T16:28:15.696 INFO:teuthology.orchestra.run.trial057.stdout: Preparing : 1/1 2026-02-20T16:28:15.705 INFO:teuthology.orchestra.run.trial057.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/36 2026-02-20T16:28:15.707 INFO:teuthology.orchestra.run.trial057.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/36 2026-02-20T16:28:15.719 INFO:teuthology.orchestra.run.trial057.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/36 2026-02-20T16:28:15.869 INFO:teuthology.orchestra.run.trial057.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/36 2026-02-20T16:28:15.874 INFO:teuthology.orchestra.run.trial057.stdout: Upgrading : librados2-2:19.2.3-672.g283431c0.el9.x86_64 5/36 2026-02-20T16:28:15.903 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: librados2-2:19.2.3-672.g283431c0.el9.x86_64 5/36 2026-02-20T16:28:15.947 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-rados-2:19.2.3-672.g283431c0.el9.x86_64 6/36 2026-02-20T16:28:15.948 INFO:teuthology.orchestra.run.trial057.stdout: Installing : libcephfs2-2:19.2.3-672.g283431c0.el9.x86_64 7/36 2026-02-20T16:28:15.960 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: libcephfs2-2:19.2.3-672.g283431c0.el9.x86_64 7/36 2026-02-20T16:28:15.965 INFO:teuthology.orchestra.run.trial057.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/36 2026-02-20T16:28:15.974 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-ceph-argparse-2:19.2.3-672.g283431c0.el9.x 9/36 2026-02-20T16:28:15.998 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-cephfs-2:19.2.3-672.g283431c0.el9.x86_64 10/36 2026-02-20T16:28:15.998 INFO:teuthology.orchestra.run.trial057.stdout: Installing : libradosstriper1-2:19.2.3-672.g283431c0.el9.x86_64 11/36 2026-02-20T16:28:16.012 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: libradosstriper1-2:19.2.3-672.g283431c0.el9.x86_64 11/36 2026-02-20T16:28:16.044 INFO:teuthology.orchestra.run.trial057.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/36 2026-02-20T16:28:16.049 INFO:teuthology.orchestra.run.trial057.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/36 2026-02-20T16:28:16.055 INFO:teuthology.orchestra.run.trial057.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/36 2026-02-20T16:28:16.057 INFO:teuthology.orchestra.run.trial057.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/36 2026-02-20T16:28:16.060 INFO:teuthology.orchestra.run.trial057.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/36 2026-02-20T16:28:16.065 INFO:teuthology.orchestra.run.trial057.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/36 2026-02-20T16:28:16.205 INFO:teuthology.orchestra.run.trial057.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/36 2026-02-20T16:28:16.206 INFO:teuthology.orchestra.run.trial057.stdout: Upgrading : librbd1-2:19.2.3-672.g283431c0.el9.x86_64 19/36 2026-02-20T16:28:16.231 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: librbd1-2:19.2.3-672.g283431c0.el9.x86_64 19/36 2026-02-20T16:28:16.233 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-rbd-2:19.2.3-672.g283431c0.el9.x86_64 20/36 2026-02-20T16:28:16.240 INFO:teuthology.orchestra.run.trial057.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/36 2026-02-20T16:28:16.465 INFO:teuthology.orchestra.run.trial057.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/36 2026-02-20T16:28:16.466 INFO:teuthology.orchestra.run.trial057.stdout: Installing : librgw2-2:19.2.3-672.g283431c0.el9.x86_64 23/36 2026-02-20T16:28:16.482 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: librgw2-2:19.2.3-672.g283431c0.el9.x86_64 23/36 2026-02-20T16:28:16.487 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-rgw-2:19.2.3-672.g283431c0.el9.x86_64 24/36 2026-02-20T16:28:16.494 INFO:teuthology.orchestra.run.trial057.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/36 2026-02-20T16:28:16.497 INFO:teuthology.orchestra.run.trial057.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/36 2026-02-20T16:28:16.498 INFO:teuthology.orchestra.run.trial057.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-20T16:28:16.516 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-20T16:28:16.518 INFO:teuthology.orchestra.run.trial057.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/36 2026-02-20T16:28:16.544 INFO:teuthology.orchestra.run.trial057.stdout: Installing : mailcap-2.1.49-5.el9.noarch 29/36 2026-02-20T16:28:16.545 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-ceph-common-2:19.2.3-672.g283431c0.el9.x86 30/36 2026-02-20T16:28:17.521 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-common-2:19.2.3-672.g283431c0.el9.x86_64 31/36 2026-02-20T16:28:17.523 INFO:teuthology.orchestra.run.trial057.stdout: Installing : ceph-common-2:19.2.3-672.g283431c0.el9.x86_64 31/36 2026-02-20T16:28:17.806 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-common-2:19.2.3-672.g283431c0.el9.x86_64 31/36 2026-02-20T16:28:17.809 INFO:teuthology.orchestra.run.trial057.stdout: Installing : ceph-base-2:19.2.3-672.g283431c0.el9.x86_64 32/36 2026-02-20T16:28:17.845 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-base-2:19.2.3-672.g283431c0.el9.x86_64 32/36 2026-02-20T16:28:17.846 INFO:teuthology.orchestra.run.trial057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-20T16:28:17.846 INFO:teuthology.orchestra.run.trial057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-20T16:28:17.846 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:17.849 INFO:teuthology.orchestra.run.trial057.stdout: Installing : ceph-selinux-2:19.2.3-672.g283431c0.el9.x86_64 33/36 2026-02-20T16:28:22.405 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-selinux-2:19.2.3-672.g283431c0.el9.x86_64 33/36 2026-02-20T16:28:22.406 INFO:teuthology.orchestra.run.trial057.stdout:skipping the directory /sys 2026-02-20T16:28:22.406 INFO:teuthology.orchestra.run.trial057.stdout:skipping the directory /proc 2026-02-20T16:28:22.406 INFO:teuthology.orchestra.run.trial057.stdout:skipping the directory /mnt 2026-02-20T16:28:22.406 INFO:teuthology.orchestra.run.trial057.stdout:skipping the directory /var/tmp 2026-02-20T16:28:22.406 INFO:teuthology.orchestra.run.trial057.stdout:skipping the directory /home 2026-02-20T16:28:22.407 INFO:teuthology.orchestra.run.trial057.stdout:skipping the directory /root 2026-02-20T16:28:22.407 INFO:teuthology.orchestra.run.trial057.stdout:skipping the directory /tmp 2026-02-20T16:28:22.407 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:22.855 INFO:teuthology.orchestra.run.trial057.stdout: Installing : ceph-radosgw-2:19.2.3-672.g283431c0.el9.x86_64 34/36 2026-02-20T16:28:22.878 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-672.g283431c0.el9.x86_64 34/36 2026-02-20T16:28:22.878 INFO:teuthology.orchestra.run.trial057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T16:28:22.878 INFO:teuthology.orchestra.run.trial057.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-20T16:28:22.879 INFO:teuthology.orchestra.run.trial057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-20T16:28:22.879 INFO:teuthology.orchestra.run.trial057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-20T16:28:22.879 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:22.880 INFO:teuthology.orchestra.run.trial057.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-20T16:28:22.891 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-20T16:28:22.891 INFO:teuthology.orchestra.run.trial057.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-20T16:28:22.945 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-20T16:28:22.945 INFO:teuthology.orchestra.run.trial057.stdout:Creating group 'qat' with GID 992. 2026-02-20T16:28:22.945 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:23.224 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-base-2:19.2.3-672.g283431c0.el9.x86_64 1/36 2026-02-20T16:28:23.224 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-common-2:19.2.3-672.g283431c0.el9.x86_64 2/36 2026-02-20T16:28:23.225 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-radosgw-2:19.2.3-672.g283431c0.el9.x86_64 3/36 2026-02-20T16:28:23.225 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-selinux-2:19.2.3-672.g283431c0.el9.x86_64 4/36 2026-02-20T16:28:23.225 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : libcephfs2-2:19.2.3-672.g283431c0.el9.x86_64 5/36 2026-02-20T16:28:23.225 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : libradosstriper1-2:19.2.3-672.g283431c0.el9.x86_64 6/36 2026-02-20T16:28:23.225 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : librgw2-2:19.2.3-672.g283431c0.el9.x86_64 7/36 2026-02-20T16:28:23.225 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-ceph-argparse-2:19.2.3-672.g283431c0.el9.x 8/36 2026-02-20T16:28:23.225 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-ceph-common-2:19.2.3-672.g283431c0.el9.x86 9/36 2026-02-20T16:28:23.225 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-cephfs-2:19.2.3-672.g283431c0.el9.x86_64 10/36 2026-02-20T16:28:23.225 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-rados-2:19.2.3-672.g283431c0.el9.x86_64 11/36 2026-02-20T16:28:23.225 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-rbd-2:19.2.3-672.g283431c0.el9.x86_64 12/36 2026-02-20T16:28:23.225 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-rgw-2:19.2.3-672.g283431c0.el9.x86_64 13/36 2026-02-20T16:28:23.226 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/36 2026-02-20T16:28:23.226 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 15/36 2026-02-20T16:28:23.226 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 16/36 2026-02-20T16:28:23.226 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 17/36 2026-02-20T16:28:23.226 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 18/36 2026-02-20T16:28:23.226 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/36 2026-02-20T16:28:23.226 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 20/36 2026-02-20T16:28:23.226 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 21/36 2026-02-20T16:28:23.227 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 22/36 2026-02-20T16:28:23.227 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 23/36 2026-02-20T16:28:23.227 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 24/36 2026-02-20T16:28:23.227 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 25/36 2026-02-20T16:28:23.227 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 26/36 2026-02-20T16:28:23.227 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 27/36 2026-02-20T16:28:23.227 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 28/36 2026-02-20T16:28:23.227 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 29/36 2026-02-20T16:28:23.227 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 30/36 2026-02-20T16:28:23.227 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : re2-1:20211101-20.el9.x86_64 31/36 2026-02-20T16:28:23.227 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 32/36 2026-02-20T16:28:23.227 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : librados2-2:19.2.3-672.g283431c0.el9.x86_64 33/36 2026-02-20T16:28:23.227 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 34/36 2026-02-20T16:28:23.228 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : librbd1-2:19.2.3-672.g283431c0.el9.x86_64 35/36 2026-02-20T16:28:23.285 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 36/36 2026-02-20T16:28:23.285 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:23.285 INFO:teuthology.orchestra.run.trial057.stdout:Upgraded: 2026-02-20T16:28:23.285 INFO:teuthology.orchestra.run.trial057.stdout: librados2-2:19.2.3-672.g283431c0.el9.x86_64 2026-02-20T16:28:23.285 INFO:teuthology.orchestra.run.trial057.stdout: librbd1-2:19.2.3-672.g283431c0.el9.x86_64 2026-02-20T16:28:23.285 INFO:teuthology.orchestra.run.trial057.stdout:Installed: 2026-02-20T16:28:23.286 INFO:teuthology.orchestra.run.trial057.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-20T16:28:23.286 INFO:teuthology.orchestra.run.trial057.stdout: ceph-base-2:19.2.3-672.g283431c0.el9.x86_64 2026-02-20T16:28:23.286 INFO:teuthology.orchestra.run.trial057.stdout: ceph-common-2:19.2.3-672.g283431c0.el9.x86_64 2026-02-20T16:28:23.286 INFO:teuthology.orchestra.run.trial057.stdout: ceph-radosgw-2:19.2.3-672.g283431c0.el9.x86_64 2026-02-20T16:28:23.286 INFO:teuthology.orchestra.run.trial057.stdout: ceph-selinux-2:19.2.3-672.g283431c0.el9.x86_64 2026-02-20T16:28:23.286 INFO:teuthology.orchestra.run.trial057.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-20T16:28:23.286 INFO:teuthology.orchestra.run.trial057.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-20T16:28:23.286 INFO:teuthology.orchestra.run.trial057.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-20T16:28:23.286 INFO:teuthology.orchestra.run.trial057.stdout: libcephfs2-2:19.2.3-672.g283431c0.el9.x86_64 2026-02-20T16:28:23.286 INFO:teuthology.orchestra.run.trial057.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-20T16:28:23.286 INFO:teuthology.orchestra.run.trial057.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-20T16:28:23.286 INFO:teuthology.orchestra.run.trial057.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-20T16:28:23.287 INFO:teuthology.orchestra.run.trial057.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-20T16:28:23.287 INFO:teuthology.orchestra.run.trial057.stdout: libradosstriper1-2:19.2.3-672.g283431c0.el9.x86_64 2026-02-20T16:28:23.287 INFO:teuthology.orchestra.run.trial057.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-20T16:28:23.287 INFO:teuthology.orchestra.run.trial057.stdout: librgw2-2:19.2.3-672.g283431c0.el9.x86_64 2026-02-20T16:28:23.287 INFO:teuthology.orchestra.run.trial057.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-20T16:28:23.287 INFO:teuthology.orchestra.run.trial057.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-20T16:28:23.287 INFO:teuthology.orchestra.run.trial057.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-20T16:28:23.287 INFO:teuthology.orchestra.run.trial057.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-20T16:28:23.287 INFO:teuthology.orchestra.run.trial057.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-20T16:28:23.287 INFO:teuthology.orchestra.run.trial057.stdout: python3-ceph-argparse-2:19.2.3-672.g283431c0.el9.x86_64 2026-02-20T16:28:23.287 INFO:teuthology.orchestra.run.trial057.stdout: python3-ceph-common-2:19.2.3-672.g283431c0.el9.x86_64 2026-02-20T16:28:23.287 INFO:teuthology.orchestra.run.trial057.stdout: python3-cephfs-2:19.2.3-672.g283431c0.el9.x86_64 2026-02-20T16:28:23.288 INFO:teuthology.orchestra.run.trial057.stdout: python3-rados-2:19.2.3-672.g283431c0.el9.x86_64 2026-02-20T16:28:23.288 INFO:teuthology.orchestra.run.trial057.stdout: python3-rbd-2:19.2.3-672.g283431c0.el9.x86_64 2026-02-20T16:28:23.288 INFO:teuthology.orchestra.run.trial057.stdout: python3-rgw-2:19.2.3-672.g283431c0.el9.x86_64 2026-02-20T16:28:23.288 INFO:teuthology.orchestra.run.trial057.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-20T16:28:23.288 INFO:teuthology.orchestra.run.trial057.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-20T16:28:23.288 INFO:teuthology.orchestra.run.trial057.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-20T16:28:23.289 INFO:teuthology.orchestra.run.trial057.stdout: re2-1:20211101-20.el9.x86_64 2026-02-20T16:28:23.289 INFO:teuthology.orchestra.run.trial057.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-20T16:28:23.289 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:23.289 INFO:teuthology.orchestra.run.trial057.stdout:Complete! 2026-02-20T16:28:23.328 DEBUG:teuthology.orchestra.run.trial057:> sudo yum -y install ceph-test 2026-02-20T16:28:23.635 INFO:teuthology.orchestra.run.trial057.stdout:Last metadata expiration check: 0:00:14 ago on Fri 20 Feb 2026 04:28:09 PM UTC. 2026-02-20T16:28:23.717 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-20T16:28:23.718 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-20T16:28:23.718 INFO:teuthology.orchestra.run.trial057.stdout: Package Arch Version Repository Size 2026-02-20T16:28:23.718 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-20T16:28:23.718 INFO:teuthology.orchestra.run.trial057.stdout:Installing: 2026-02-20T16:28:23.719 INFO:teuthology.orchestra.run.trial057.stdout: ceph-test x86_64 2:19.2.3-672.g283431c0.el9 ceph 50 M 2026-02-20T16:28:23.719 INFO:teuthology.orchestra.run.trial057.stdout:Installing dependencies: 2026-02-20T16:28:23.719 INFO:teuthology.orchestra.run.trial057.stdout: libcephsqlite x86_64 2:19.2.3-672.g283431c0.el9 ceph 163 k 2026-02-20T16:28:23.719 INFO:teuthology.orchestra.run.trial057.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-20T16:28:23.719 INFO:teuthology.orchestra.run.trial057.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-20T16:28:23.719 INFO:teuthology.orchestra.run.trial057.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-20T16:28:23.719 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:23.719 INFO:teuthology.orchestra.run.trial057.stdout:Transaction Summary 2026-02-20T16:28:23.719 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-20T16:28:23.719 INFO:teuthology.orchestra.run.trial057.stdout:Install 5 Packages 2026-02-20T16:28:23.719 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:23.720 INFO:teuthology.orchestra.run.trial057.stdout:Total download size: 50 M 2026-02-20T16:28:23.720 INFO:teuthology.orchestra.run.trial057.stdout:Installed size: 213 M 2026-02-20T16:28:23.720 INFO:teuthology.orchestra.run.trial057.stdout:Downloading Packages: 2026-02-20T16:28:23.841 INFO:teuthology.orchestra.run.trial057.stdout:(1/5): libxslt-1.1.34-12.el9.x86_64.rpm 3.7 MB/s | 233 kB 00:00 2026-02-20T16:28:23.859 INFO:teuthology.orchestra.run.trial057.stdout:(2/5): socat-1.7.4.1-8.el9.x86_64.rpm 16 MB/s | 303 kB 00:00 2026-02-20T16:28:23.866 INFO:teuthology.orchestra.run.trial057.stdout:(3/5): libcephsqlite-19.2.3-672.g283431c0.el9.x 1.8 MB/s | 163 kB 00:00 2026-02-20T16:28:23.869 INFO:teuthology.orchestra.run.trial057.stdout:(4/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 6.4 MB/s | 64 kB 00:00 2026-02-20T16:28:24.792 INFO:teuthology.orchestra.run.trial057.stdout:(5/5): ceph-test-19.2.3-672.g283431c0.el9.x86_6 49 MB/s | 50 MB 00:01 2026-02-20T16:28:24.793 INFO:teuthology.orchestra.run.trial057.stdout:-------------------------------------------------------------------------------- 2026-02-20T16:28:24.794 INFO:teuthology.orchestra.run.trial057.stdout:Total 47 MB/s | 50 MB 00:01 2026-02-20T16:28:24.819 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction check 2026-02-20T16:28:24.828 INFO:teuthology.orchestra.run.trial057.stdout:Transaction check succeeded. 2026-02-20T16:28:24.828 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction test 2026-02-20T16:28:25.013 INFO:teuthology.orchestra.run.trial057.stdout:Transaction test succeeded. 2026-02-20T16:28:25.013 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction 2026-02-20T16:28:25.224 INFO:teuthology.orchestra.run.trial057.stdout: Preparing : 1/1 2026-02-20T16:28:25.229 INFO:teuthology.orchestra.run.trial057.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-20T16:28:25.233 INFO:teuthology.orchestra.run.trial057.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-20T16:28:25.241 INFO:teuthology.orchestra.run.trial057.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-20T16:28:25.242 INFO:teuthology.orchestra.run.trial057.stdout: Installing : libcephsqlite-2:19.2.3-672.g283431c0.el9.x86_64 4/5 2026-02-20T16:28:27.523 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: libcephsqlite-2:19.2.3-672.g283431c0.el9.x86_64 4/5 2026-02-20T16:28:27.541 INFO:teuthology.orchestra.run.trial057.stdout: Installing : ceph-test-2:19.2.3-672.g283431c0.el9.x86_64 5/5 2026-02-20T16:28:27.752 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-test-2:19.2.3-672.g283431c0.el9.x86_64 5/5 2026-02-20T16:28:27.752 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-test-2:19.2.3-672.g283431c0.el9.x86_64 1/5 2026-02-20T16:28:27.752 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : libcephsqlite-2:19.2.3-672.g283431c0.el9.x86_64 2/5 2026-02-20T16:28:27.752 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-20T16:28:27.752 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-20T16:28:27.805 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-20T16:28:27.806 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:27.806 INFO:teuthology.orchestra.run.trial057.stdout:Installed: 2026-02-20T16:28:27.806 INFO:teuthology.orchestra.run.trial057.stdout: ceph-test-2:19.2.3-672.g283431c0.el9.x86_64 2026-02-20T16:28:27.806 INFO:teuthology.orchestra.run.trial057.stdout: libcephsqlite-2:19.2.3-672.g283431c0.el9.x86_64 2026-02-20T16:28:27.806 INFO:teuthology.orchestra.run.trial057.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-20T16:28:27.806 INFO:teuthology.orchestra.run.trial057.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-20T16:28:27.806 INFO:teuthology.orchestra.run.trial057.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-20T16:28:27.806 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:27.807 INFO:teuthology.orchestra.run.trial057.stdout:Complete! 2026-02-20T16:28:27.837 DEBUG:teuthology.orchestra.run.trial057:> sudo yum -y install ceph 2026-02-20T16:28:28.142 INFO:teuthology.orchestra.run.trial057.stdout:Last metadata expiration check: 0:00:19 ago on Fri 20 Feb 2026 04:28:09 PM UTC. 2026-02-20T16:28:28.226 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-20T16:28:28.227 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-20T16:28:28.228 INFO:teuthology.orchestra.run.trial057.stdout: Package Arch Version Repository Size 2026-02-20T16:28:28.228 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-20T16:28:28.228 INFO:teuthology.orchestra.run.trial057.stdout:Installing: 2026-02-20T16:28:28.228 INFO:teuthology.orchestra.run.trial057.stdout: ceph x86_64 2:19.2.3-672.g283431c0.el9 ceph 6.5 k 2026-02-20T16:28:28.228 INFO:teuthology.orchestra.run.trial057.stdout:Installing dependencies: 2026-02-20T16:28:28.228 INFO:teuthology.orchestra.run.trial057.stdout: ceph-mds x86_64 2:19.2.3-672.g283431c0.el9 ceph 2.4 M 2026-02-20T16:28:28.228 INFO:teuthology.orchestra.run.trial057.stdout: ceph-mgr x86_64 2:19.2.3-672.g283431c0.el9 ceph 1.1 M 2026-02-20T16:28:28.228 INFO:teuthology.orchestra.run.trial057.stdout: ceph-mgr-modules-core noarch 2:19.2.3-672.g283431c0.el9 ceph-noarch 253 k 2026-02-20T16:28:28.229 INFO:teuthology.orchestra.run.trial057.stdout: ceph-mon x86_64 2:19.2.3-672.g283431c0.el9 ceph 4.7 M 2026-02-20T16:28:28.229 INFO:teuthology.orchestra.run.trial057.stdout: ceph-osd x86_64 2:19.2.3-672.g283431c0.el9 ceph 17 M 2026-02-20T16:28:28.229 INFO:teuthology.orchestra.run.trial057.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-20T16:28:28.229 INFO:teuthology.orchestra.run.trial057.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-20T16:28:28.229 INFO:teuthology.orchestra.run.trial057.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-20T16:28:28.229 INFO:teuthology.orchestra.run.trial057.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-20T16:28:28.229 INFO:teuthology.orchestra.run.trial057.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-20T16:28:28.229 INFO:teuthology.orchestra.run.trial057.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-20T16:28:28.229 INFO:teuthology.orchestra.run.trial057.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-20T16:28:28.229 INFO:teuthology.orchestra.run.trial057.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-20T16:28:28.229 INFO:teuthology.orchestra.run.trial057.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-20T16:28:28.229 INFO:teuthology.orchestra.run.trial057.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-20T16:28:28.229 INFO:teuthology.orchestra.run.trial057.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-20T16:28:28.230 INFO:teuthology.orchestra.run.trial057.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-20T16:28:28.230 INFO:teuthology.orchestra.run.trial057.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-20T16:28:28.230 INFO:teuthology.orchestra.run.trial057.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-20T16:28:28.230 INFO:teuthology.orchestra.run.trial057.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-20T16:28:28.230 INFO:teuthology.orchestra.run.trial057.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-20T16:28:28.230 INFO:teuthology.orchestra.run.trial057.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-20T16:28:28.230 INFO:teuthology.orchestra.run.trial057.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-20T16:28:28.230 INFO:teuthology.orchestra.run.trial057.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-20T16:28:28.230 INFO:teuthology.orchestra.run.trial057.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-20T16:28:28.230 INFO:teuthology.orchestra.run.trial057.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-20T16:28:28.230 INFO:teuthology.orchestra.run.trial057.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-20T16:28:28.230 INFO:teuthology.orchestra.run.trial057.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-20T16:28:28.231 INFO:teuthology.orchestra.run.trial057.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-20T16:28:28.231 INFO:teuthology.orchestra.run.trial057.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-20T16:28:28.231 INFO:teuthology.orchestra.run.trial057.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-20T16:28:28.231 INFO:teuthology.orchestra.run.trial057.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-20T16:28:28.231 INFO:teuthology.orchestra.run.trial057.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-20T16:28:28.231 INFO:teuthology.orchestra.run.trial057.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-20T16:28:28.231 INFO:teuthology.orchestra.run.trial057.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-20T16:28:28.231 INFO:teuthology.orchestra.run.trial057.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-20T16:28:28.231 INFO:teuthology.orchestra.run.trial057.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-20T16:28:28.231 INFO:teuthology.orchestra.run.trial057.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-20T16:28:28.231 INFO:teuthology.orchestra.run.trial057.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-20T16:28:28.231 INFO:teuthology.orchestra.run.trial057.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-20T16:28:28.231 INFO:teuthology.orchestra.run.trial057.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-20T16:28:28.232 INFO:teuthology.orchestra.run.trial057.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-20T16:28:28.232 INFO:teuthology.orchestra.run.trial057.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-20T16:28:28.232 INFO:teuthology.orchestra.run.trial057.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-20T16:28:28.232 INFO:teuthology.orchestra.run.trial057.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-20T16:28:28.232 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:28.232 INFO:teuthology.orchestra.run.trial057.stdout:Transaction Summary 2026-02-20T16:28:28.232 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-20T16:28:28.232 INFO:teuthology.orchestra.run.trial057.stdout:Install 46 Packages 2026-02-20T16:28:28.232 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:28.233 INFO:teuthology.orchestra.run.trial057.stdout:Total download size: 31 M 2026-02-20T16:28:28.233 INFO:teuthology.orchestra.run.trial057.stdout:Installed size: 111 M 2026-02-20T16:28:28.233 INFO:teuthology.orchestra.run.trial057.stdout:Downloading Packages: 2026-02-20T16:28:28.548 INFO:teuthology.orchestra.run.trial057.stdout:(1/46): ceph-19.2.3-672.g283431c0.el9.x86_64.rp 110 kB/s | 6.5 kB 00:00 2026-02-20T16:28:28.613 INFO:teuthology.orchestra.run.trial057.stdout:(2/46): ceph-mgr-19.2.3-672.g283431c0.el9.x86_6 8.6 MB/s | 1.1 MB 00:00 2026-02-20T16:28:28.679 INFO:teuthology.orchestra.run.trial057.stdout:(3/46): ceph-mds-19.2.3-672.g283431c0.el9.x86_6 13 MB/s | 2.4 MB 00:00 2026-02-20T16:28:28.728 INFO:teuthology.orchestra.run.trial057.stdout:(4/46): ceph-mgr-modules-core-19.2.3-672.g28343 5.0 MB/s | 253 kB 00:00 2026-02-20T16:28:28.763 INFO:teuthology.orchestra.run.trial057.stdout:(5/46): ledmon-libs-1.1.0-3.el9.x86_64.rpm 1.1 MB/s | 40 kB 00:00 2026-02-20T16:28:28.784 INFO:teuthology.orchestra.run.trial057.stdout:(6/46): ceph-mon-19.2.3-672.g283431c0.el9.x86_6 20 MB/s | 4.7 MB 00:00 2026-02-20T16:28:28.784 INFO:teuthology.orchestra.run.trial057.stdout:(7/46): libconfig-1.7.2-9.el9.x86_64.rpm 3.4 MB/s | 72 kB 00:00 2026-02-20T16:28:28.829 INFO:teuthology.orchestra.run.trial057.stdout:(8/46): python3-cryptography-36.0.1-5.el9.x86_6 28 MB/s | 1.2 MB 00:00 2026-02-20T16:28:28.836 INFO:teuthology.orchestra.run.trial057.stdout:(9/46): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 253 kB 00:00 2026-02-20T16:28:28.840 INFO:teuthology.orchestra.run.trial057.stdout:(10/46): python3-ply-3.11-14.el9.noarch.rpm 9.6 MB/s | 106 kB 00:00 2026-02-20T16:28:28.848 INFO:teuthology.orchestra.run.trial057.stdout:(11/46): python3-pycparser-2.20-6.el9.noarch.rp 11 MB/s | 135 kB 00:00 2026-02-20T16:28:28.850 INFO:teuthology.orchestra.run.trial057.stdout:(12/46): python3-pyparsing-2.4.7-9.el9.noarch.r 15 MB/s | 150 kB 00:00 2026-02-20T16:28:28.860 INFO:teuthology.orchestra.run.trial057.stdout:(13/46): python3-requests-2.25.1-10.el9.noarch. 11 MB/s | 126 kB 00:00 2026-02-20T16:28:28.861 INFO:teuthology.orchestra.run.trial057.stdout:(14/46): python3-urllib3-1.26.5-7.el9.noarch.rp 19 MB/s | 218 kB 00:00 2026-02-20T16:28:28.872 INFO:teuthology.orchestra.run.trial057.stdout:(15/46): unzip-6.0-59.el9.x86_64.rpm 15 MB/s | 182 kB 00:00 2026-02-20T16:28:28.873 INFO:teuthology.orchestra.run.trial057.stdout:(16/46): zip-3.0-35.el9.x86_64.rpm 23 MB/s | 266 kB 00:00 2026-02-20T16:28:29.032 INFO:teuthology.orchestra.run.trial057.stdout:(17/46): ceph-osd-19.2.3-672.g283431c0.el9.x86_ 41 MB/s | 17 MB 00:00 2026-02-20T16:28:29.443 INFO:teuthology.orchestra.run.trial057.stdout:(18/46): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 432 kB/s | 246 kB 00:00 2026-02-20T16:28:29.502 INFO:teuthology.orchestra.run.trial057.stdout:(19/46): lua-5.4.4-4.el9.x86_64.rpm 299 kB/s | 188 kB 00:00 2026-02-20T16:28:29.579 INFO:teuthology.orchestra.run.trial057.stdout:(20/46): python3-libstoragemgmt-1.10.1-1.el9.x8 323 kB/s | 177 kB 00:00 2026-02-20T16:28:29.671 INFO:teuthology.orchestra.run.trial057.stdout:(21/46): python3-markupsafe-1.1.1-12.el9.x86_64 206 kB/s | 35 kB 00:00 2026-02-20T16:28:29.827 INFO:teuthology.orchestra.run.trial057.stdout:(22/46): python3-mako-1.1.4-6.el9.noarch.rpm 449 kB/s | 172 kB 00:00 2026-02-20T16:28:29.882 INFO:teuthology.orchestra.run.trial057.stdout:(23/46): python3-toml-0.10.2-6.el9.noarch.rpm 197 kB/s | 42 kB 00:00 2026-02-20T16:28:29.981 INFO:teuthology.orchestra.run.trial057.stdout:(24/46): python3-packaging-20.9-5.el9.noarch.rp 192 kB/s | 77 kB 00:00 2026-02-20T16:28:30.281 INFO:teuthology.orchestra.run.trial057.stdout:(25/46): lua-devel-5.4.4-4.el9.x86_64.rpm 49 kB/s | 22 kB 00:00 2026-02-20T16:28:33.408 INFO:teuthology.orchestra.run.trial057.stdout:(26/46): python3-autocommand-2.2.2-8.el9.noarch 8.6 kB/s | 29 kB 00:03 2026-02-20T16:28:33.568 INFO:teuthology.orchestra.run.trial057.stdout:(27/46): python3-backports-tarfile-1.2.0-1.el9. 18 kB/s | 60 kB 00:03 2026-02-20T16:28:33.586 INFO:teuthology.orchestra.run.trial057.stdout:(28/46): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 244 kB/s | 43 kB 00:00 2026-02-20T16:28:33.801 INFO:teuthology.orchestra.run.trial057.stdout:(29/46): luarocks-3.9.2-5.el9.noarch.rpm 39 kB/s | 151 kB 00:03 2026-02-20T16:28:33.890 INFO:teuthology.orchestra.run.trial057.stdout:(30/46): python3-jaraco-8.2.1-3.el9.noarch.rpm 121 kB/s | 11 kB 00:00 2026-02-20T16:28:33.977 INFO:teuthology.orchestra.run.trial057.stdout:(31/46): python3-jaraco-classes-3.2.1-5.el9.noa 202 kB/s | 18 kB 00:00 2026-02-20T16:28:34.063 INFO:teuthology.orchestra.run.trial057.stdout:(32/46): python3-jaraco-collections-3.0.0-8.el9 268 kB/s | 23 kB 00:00 2026-02-20T16:28:34.177 INFO:teuthology.orchestra.run.trial057.stdout:(33/46): python3-jaraco-context-6.0.1-3.el9.noa 174 kB/s | 20 kB 00:00 2026-02-20T16:28:34.204 INFO:teuthology.orchestra.run.trial057.stdout:(34/46): python3-cherrypy-18.6.1-2.el9.noarch.r 580 kB/s | 358 kB 00:00 2026-02-20T16:28:34.256 INFO:teuthology.orchestra.run.trial057.stdout:(35/46): python3-jaraco-functools-3.5.0-2.el9.n 243 kB/s | 19 kB 00:00 2026-02-20T16:28:34.289 INFO:teuthology.orchestra.run.trial057.stdout:(36/46): python3-jaraco-text-4.0.0-2.el9.noarch 311 kB/s | 26 kB 00:00 2026-02-20T16:28:34.343 INFO:teuthology.orchestra.run.trial057.stdout:(37/46): python3-logutils-0.3.5-21.el9.noarch.r 535 kB/s | 46 kB 00:00 2026-02-20T16:28:34.441 INFO:teuthology.orchestra.run.trial057.stdout:(38/46): python3-cheroot-10.0.1-4.el9.noarch.rp 199 kB/s | 173 kB 00:00 2026-02-20T16:28:34.452 INFO:teuthology.orchestra.run.trial057.stdout:(39/46): python3-more-itertools-8.12.0-2.el9.no 485 kB/s | 79 kB 00:00 2026-02-20T16:28:34.520 INFO:teuthology.orchestra.run.trial057.stdout:(40/46): python3-portend-3.1.0-2.el9.noarch.rpm 206 kB/s | 16 kB 00:00 2026-02-20T16:28:34.615 INFO:teuthology.orchestra.run.trial057.stdout:(41/46): python3-pyOpenSSL-21.0.0-1.el9.noarch. 551 kB/s | 90 kB 00:00 2026-02-20T16:28:34.670 INFO:teuthology.orchestra.run.trial057.stdout:(42/46): python3-pecan-1.4.2-3.el9.noarch.rpm 832 kB/s | 272 kB 00:00 2026-02-20T16:28:34.686 INFO:teuthology.orchestra.run.trial057.stdout:(43/46): python3-tempora-5.0.0-2.el9.noarch.rpm 216 kB/s | 36 kB 00:00 2026-02-20T16:28:34.767 INFO:teuthology.orchestra.run.trial057.stdout:(44/46): python3-zc-lockfile-2.0-10.el9.noarch. 248 kB/s | 20 kB 00:00 2026-02-20T16:28:34.937 INFO:teuthology.orchestra.run.trial057.stdout:(45/46): python3-webob-1.8.8-2.el9.noarch.rpm 716 kB/s | 230 kB 00:00 2026-02-20T16:28:35.235 INFO:teuthology.orchestra.run.trial057.stdout:(46/46): python3-werkzeug-2.0.3-3.el9.1.noarch. 756 kB/s | 427 kB 00:00 2026-02-20T16:28:35.238 INFO:teuthology.orchestra.run.trial057.stdout:-------------------------------------------------------------------------------- 2026-02-20T16:28:35.238 INFO:teuthology.orchestra.run.trial057.stdout:Total 4.5 MB/s | 31 MB 00:07 2026-02-20T16:28:35.390 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction check 2026-02-20T16:28:35.409 INFO:teuthology.orchestra.run.trial057.stdout:Transaction check succeeded. 2026-02-20T16:28:35.409 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction test 2026-02-20T16:28:35.560 INFO:teuthology.orchestra.run.trial057.stdout:Transaction test succeeded. 2026-02-20T16:28:35.560 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction 2026-02-20T16:28:35.758 INFO:teuthology.orchestra.run.trial057.stdout: Preparing : 1/1 2026-02-20T16:28:35.760 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/46 2026-02-20T16:28:35.764 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/46 2026-02-20T16:28:35.769 INFO:teuthology.orchestra.run.trial057.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/46 2026-02-20T16:28:35.771 INFO:teuthology.orchestra.run.trial057.stdout: Installing : unzip-6.0-59.el9.x86_64 4/46 2026-02-20T16:28:35.777 INFO:teuthology.orchestra.run.trial057.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 5/46 2026-02-20T16:28:35.801 INFO:teuthology.orchestra.run.trial057.stdout: Installing : zip-3.0-35.el9.x86_64 6/46 2026-02-20T16:28:35.804 INFO:teuthology.orchestra.run.trial057.stdout: Installing : luarocks-3.9.2-5.el9.noarch 7/46 2026-02-20T16:28:35.809 INFO:teuthology.orchestra.run.trial057.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 8/46 2026-02-20T16:28:35.814 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 9/46 2026-02-20T16:28:35.844 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 10/46 2026-02-20T16:28:35.866 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 11/46 2026-02-20T16:28:35.875 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 12/46 2026-02-20T16:28:35.881 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 13/46 2026-02-20T16:28:35.884 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 14/46 2026-02-20T16:28:35.890 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 15/46 2026-02-20T16:28:35.895 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 16/46 2026-02-20T16:28:35.899 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 17/46 2026-02-20T16:28:35.905 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 18/46 2026-02-20T16:28:35.908 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 19/46 2026-02-20T16:28:35.915 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 20/46 2026-02-20T16:28:35.918 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 21/46 2026-02-20T16:28:35.923 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 22/46 2026-02-20T16:28:35.947 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/46 2026-02-20T16:28:36.002 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 24/46 2026-02-20T16:28:36.026 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 25/46 2026-02-20T16:28:36.038 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 26/46 2026-02-20T16:28:36.043 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 27/46 2026-02-20T16:28:36.053 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 28/46 2026-02-20T16:28:36.059 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-packaging-20.9-5.el9.noarch 29/46 2026-02-20T16:28:36.073 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-ply-3.11-14.el9.noarch 30/46 2026-02-20T16:28:36.088 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 31/46 2026-02-20T16:28:36.163 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 32/46 2026-02-20T16:28:36.171 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 33/46 2026-02-20T16:28:36.194 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 34/46 2026-02-20T16:28:36.223 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 35/46 2026-02-20T16:28:36.229 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 36/46 2026-02-20T16:28:36.273 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 37/46 2026-02-20T16:28:36.323 INFO:teuthology.orchestra.run.trial057.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-672.g283431c0.el9.n 38/46 2026-02-20T16:28:36.324 INFO:teuthology.orchestra.run.trial057.stdout: Installing : ceph-mgr-2:19.2.3-672.g283431c0.el9.x86_64 39/46 2026-02-20T16:28:36.348 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-mgr-2:19.2.3-672.g283431c0.el9.x86_64 39/46 2026-02-20T16:28:36.348 INFO:teuthology.orchestra.run.trial057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T16:28:36.348 INFO:teuthology.orchestra.run.trial057.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-20T16:28:36.348 INFO:teuthology.orchestra.run.trial057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-20T16:28:36.348 INFO:teuthology.orchestra.run.trial057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-20T16:28:36.348 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:36.353 INFO:teuthology.orchestra.run.trial057.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 40/46 2026-02-20T16:28:36.372 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 41/46 2026-02-20T16:28:36.372 INFO:teuthology.orchestra.run.trial057.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-20T16:28:36.372 INFO:teuthology.orchestra.run.trial057.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-20T16:28:36.372 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:36.380 INFO:teuthology.orchestra.run.trial057.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 41/46 2026-02-20T16:28:36.404 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 41/46 2026-02-20T16:28:36.405 INFO:teuthology.orchestra.run.trial057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-20T16:28:36.405 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:37.114 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 42/46 2026-02-20T16:28:37.115 INFO:teuthology.orchestra.run.trial057.stdout: Installing : ceph-osd-2:19.2.3-672.g283431c0.el9.x86_64 43/46 2026-02-20T16:28:37.140 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-osd-2:19.2.3-672.g283431c0.el9.x86_64 43/46 2026-02-20T16:28:37.140 INFO:teuthology.orchestra.run.trial057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T16:28:37.140 INFO:teuthology.orchestra.run.trial057.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-20T16:28:37.140 INFO:teuthology.orchestra.run.trial057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-20T16:28:37.140 INFO:teuthology.orchestra.run.trial057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-20T16:28:37.140 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:37.346 INFO:teuthology.orchestra.run.trial057.stdout: Installing : ceph-mon-2:19.2.3-672.g283431c0.el9.x86_64 44/46 2026-02-20T16:28:37.368 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-mon-2:19.2.3-672.g283431c0.el9.x86_64 44/46 2026-02-20T16:28:37.368 INFO:teuthology.orchestra.run.trial057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T16:28:37.368 INFO:teuthology.orchestra.run.trial057.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-20T16:28:37.368 INFO:teuthology.orchestra.run.trial057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-20T16:28:37.369 INFO:teuthology.orchestra.run.trial057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-20T16:28:37.369 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:37.469 INFO:teuthology.orchestra.run.trial057.stdout: Installing : ceph-mds-2:19.2.3-672.g283431c0.el9.x86_64 45/46 2026-02-20T16:28:37.490 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-mds-2:19.2.3-672.g283431c0.el9.x86_64 45/46 2026-02-20T16:28:37.491 INFO:teuthology.orchestra.run.trial057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T16:28:37.491 INFO:teuthology.orchestra.run.trial057.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-20T16:28:37.491 INFO:teuthology.orchestra.run.trial057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-20T16:28:37.491 INFO:teuthology.orchestra.run.trial057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-20T16:28:37.491 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:37.508 INFO:teuthology.orchestra.run.trial057.stdout: Installing : ceph-2:19.2.3-672.g283431c0.el9.x86_64 46/46 2026-02-20T16:28:37.832 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-2:19.2.3-672.g283431c0.el9.x86_64 46/46 2026-02-20T16:28:37.832 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-2:19.2.3-672.g283431c0.el9.x86_64 1/46 2026-02-20T16:28:37.832 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-mds-2:19.2.3-672.g283431c0.el9.x86_64 2/46 2026-02-20T16:28:37.832 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-mgr-2:19.2.3-672.g283431c0.el9.x86_64 3/46 2026-02-20T16:28:37.832 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-mon-2:19.2.3-672.g283431c0.el9.x86_64 4/46 2026-02-20T16:28:37.832 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-osd-2:19.2.3-672.g283431c0.el9.x86_64 5/46 2026-02-20T16:28:37.832 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-672.g283431c0.el9.n 6/46 2026-02-20T16:28:37.832 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 7/46 2026-02-20T16:28:37.832 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 8/46 2026-02-20T16:28:37.832 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 9/46 2026-02-20T16:28:37.832 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 10/46 2026-02-20T16:28:37.832 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-ply-3.11-14.el9.noarch 11/46 2026-02-20T16:28:37.832 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 12/46 2026-02-20T16:28:37.832 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 13/46 2026-02-20T16:28:37.832 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 14/46 2026-02-20T16:28:37.832 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 15/46 2026-02-20T16:28:37.832 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : unzip-6.0-59.el9.x86_64 16/46 2026-02-20T16:28:37.832 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : zip-3.0-35.el9.x86_64 17/46 2026-02-20T16:28:37.832 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 18/46 2026-02-20T16:28:37.832 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : lua-5.4.4-4.el9.x86_64 19/46 2026-02-20T16:28:37.832 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 20/46 2026-02-20T16:28:37.832 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 21/46 2026-02-20T16:28:37.832 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 22/46 2026-02-20T16:28:37.832 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 23/46 2026-02-20T16:28:37.832 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 24/46 2026-02-20T16:28:37.832 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 25/46 2026-02-20T16:28:37.832 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 26/46 2026-02-20T16:28:37.832 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 27/46 2026-02-20T16:28:37.832 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 28/46 2026-02-20T16:28:37.833 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 29/46 2026-02-20T16:28:37.833 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 30/46 2026-02-20T16:28:37.833 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 31/46 2026-02-20T16:28:37.833 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 32/46 2026-02-20T16:28:37.833 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 33/46 2026-02-20T16:28:37.833 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 34/46 2026-02-20T16:28:37.833 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 35/46 2026-02-20T16:28:37.833 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 36/46 2026-02-20T16:28:37.833 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 37/46 2026-02-20T16:28:37.833 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 38/46 2026-02-20T16:28:37.833 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 39/46 2026-02-20T16:28:37.833 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 40/46 2026-02-20T16:28:37.833 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 41/46 2026-02-20T16:28:37.833 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 42/46 2026-02-20T16:28:37.833 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 43/46 2026-02-20T16:28:37.833 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 44/46 2026-02-20T16:28:37.833 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 45/46 2026-02-20T16:28:37.892 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 46/46 2026-02-20T16:28:37.892 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:37.892 INFO:teuthology.orchestra.run.trial057.stdout:Installed: 2026-02-20T16:28:37.892 INFO:teuthology.orchestra.run.trial057.stdout: ceph-2:19.2.3-672.g283431c0.el9.x86_64 2026-02-20T16:28:37.892 INFO:teuthology.orchestra.run.trial057.stdout: ceph-mds-2:19.2.3-672.g283431c0.el9.x86_64 2026-02-20T16:28:37.892 INFO:teuthology.orchestra.run.trial057.stdout: ceph-mgr-2:19.2.3-672.g283431c0.el9.x86_64 2026-02-20T16:28:37.892 INFO:teuthology.orchestra.run.trial057.stdout: ceph-mgr-modules-core-2:19.2.3-672.g283431c0.el9.noarch 2026-02-20T16:28:37.892 INFO:teuthology.orchestra.run.trial057.stdout: ceph-mon-2:19.2.3-672.g283431c0.el9.x86_64 2026-02-20T16:28:37.892 INFO:teuthology.orchestra.run.trial057.stdout: ceph-osd-2:19.2.3-672.g283431c0.el9.x86_64 2026-02-20T16:28:37.892 INFO:teuthology.orchestra.run.trial057.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-20T16:28:37.892 INFO:teuthology.orchestra.run.trial057.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-20T16:28:37.892 INFO:teuthology.orchestra.run.trial057.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-20T16:28:37.892 INFO:teuthology.orchestra.run.trial057.stdout: lua-5.4.4-4.el9.x86_64 2026-02-20T16:28:37.893 INFO:teuthology.orchestra.run.trial057.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-20T16:28:37.893 INFO:teuthology.orchestra.run.trial057.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-20T16:28:37.893 INFO:teuthology.orchestra.run.trial057.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-20T16:28:37.893 INFO:teuthology.orchestra.run.trial057.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-20T16:28:37.893 INFO:teuthology.orchestra.run.trial057.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-20T16:28:37.893 INFO:teuthology.orchestra.run.trial057.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-20T16:28:37.893 INFO:teuthology.orchestra.run.trial057.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-20T16:28:37.893 INFO:teuthology.orchestra.run.trial057.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-20T16:28:37.893 INFO:teuthology.orchestra.run.trial057.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-20T16:28:37.893 INFO:teuthology.orchestra.run.trial057.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-20T16:28:37.893 INFO:teuthology.orchestra.run.trial057.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-20T16:28:37.893 INFO:teuthology.orchestra.run.trial057.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-20T16:28:37.893 INFO:teuthology.orchestra.run.trial057.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-20T16:28:37.893 INFO:teuthology.orchestra.run.trial057.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-20T16:28:37.893 INFO:teuthology.orchestra.run.trial057.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-20T16:28:37.893 INFO:teuthology.orchestra.run.trial057.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-20T16:28:37.893 INFO:teuthology.orchestra.run.trial057.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-20T16:28:37.893 INFO:teuthology.orchestra.run.trial057.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-20T16:28:37.893 INFO:teuthology.orchestra.run.trial057.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-20T16:28:37.893 INFO:teuthology.orchestra.run.trial057.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-20T16:28:37.893 INFO:teuthology.orchestra.run.trial057.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-20T16:28:37.893 INFO:teuthology.orchestra.run.trial057.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-20T16:28:37.893 INFO:teuthology.orchestra.run.trial057.stdout: python3-ply-3.11-14.el9.noarch 2026-02-20T16:28:37.893 INFO:teuthology.orchestra.run.trial057.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-20T16:28:37.893 INFO:teuthology.orchestra.run.trial057.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-20T16:28:37.893 INFO:teuthology.orchestra.run.trial057.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-20T16:28:37.893 INFO:teuthology.orchestra.run.trial057.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-20T16:28:37.893 INFO:teuthology.orchestra.run.trial057.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-20T16:28:37.893 INFO:teuthology.orchestra.run.trial057.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-20T16:28:37.893 INFO:teuthology.orchestra.run.trial057.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-20T16:28:37.893 INFO:teuthology.orchestra.run.trial057.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-20T16:28:37.893 INFO:teuthology.orchestra.run.trial057.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-20T16:28:37.893 INFO:teuthology.orchestra.run.trial057.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-20T16:28:37.893 INFO:teuthology.orchestra.run.trial057.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-20T16:28:37.893 INFO:teuthology.orchestra.run.trial057.stdout: unzip-6.0-59.el9.x86_64 2026-02-20T16:28:37.893 INFO:teuthology.orchestra.run.trial057.stdout: zip-3.0-35.el9.x86_64 2026-02-20T16:28:37.893 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:37.893 INFO:teuthology.orchestra.run.trial057.stdout:Complete! 2026-02-20T16:28:37.931 DEBUG:teuthology.orchestra.run.trial057:> sudo yum -y install ceph-base 2026-02-20T16:28:38.244 INFO:teuthology.orchestra.run.trial057.stdout:Last metadata expiration check: 0:00:29 ago on Fri 20 Feb 2026 04:28:09 PM UTC. 2026-02-20T16:28:38.308 INFO:teuthology.orchestra.run.trial057.stdout:Package ceph-base-2:19.2.3-672.g283431c0.el9.x86_64 is already installed. 2026-02-20T16:28:38.325 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-20T16:28:38.326 INFO:teuthology.orchestra.run.trial057.stdout:Nothing to do. 2026-02-20T16:28:38.326 INFO:teuthology.orchestra.run.trial057.stdout:Complete! 2026-02-20T16:28:38.347 DEBUG:teuthology.orchestra.run.trial057:> sudo yum -y install ceph-immutable-object-cache 2026-02-20T16:28:38.649 INFO:teuthology.orchestra.run.trial057.stdout:Last metadata expiration check: 0:00:29 ago on Fri 20 Feb 2026 04:28:09 PM UTC. 2026-02-20T16:28:38.730 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-20T16:28:38.730 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-20T16:28:38.730 INFO:teuthology.orchestra.run.trial057.stdout: Package Arch Version Repo Size 2026-02-20T16:28:38.731 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-20T16:28:38.731 INFO:teuthology.orchestra.run.trial057.stdout:Installing: 2026-02-20T16:28:38.731 INFO:teuthology.orchestra.run.trial057.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-672.g283431c0.el9 ceph 145 k 2026-02-20T16:28:38.731 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:38.731 INFO:teuthology.orchestra.run.trial057.stdout:Transaction Summary 2026-02-20T16:28:38.731 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-20T16:28:38.731 INFO:teuthology.orchestra.run.trial057.stdout:Install 1 Package 2026-02-20T16:28:38.731 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:38.731 INFO:teuthology.orchestra.run.trial057.stdout:Total download size: 145 k 2026-02-20T16:28:38.731 INFO:teuthology.orchestra.run.trial057.stdout:Installed size: 435 k 2026-02-20T16:28:38.732 INFO:teuthology.orchestra.run.trial057.stdout:Downloading Packages: 2026-02-20T16:28:38.815 INFO:teuthology.orchestra.run.trial057.stdout:ceph-immutable-object-cache-19.2.3-672.g283431c 1.7 MB/s | 145 kB 00:00 2026-02-20T16:28:38.816 INFO:teuthology.orchestra.run.trial057.stdout:-------------------------------------------------------------------------------- 2026-02-20T16:28:38.816 INFO:teuthology.orchestra.run.trial057.stdout:Total 1.7 MB/s | 145 kB 00:00 2026-02-20T16:28:38.816 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction check 2026-02-20T16:28:38.819 INFO:teuthology.orchestra.run.trial057.stdout:Transaction check succeeded. 2026-02-20T16:28:38.819 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction test 2026-02-20T16:28:38.845 INFO:teuthology.orchestra.run.trial057.stdout:Transaction test succeeded. 2026-02-20T16:28:38.845 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction 2026-02-20T16:28:38.894 INFO:teuthology.orchestra.run.trial057.stdout: Preparing : 1/1 2026-02-20T16:28:38.895 INFO:teuthology.orchestra.run.trial057.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-672.g283431c0.e 1/1 2026-02-20T16:28:38.917 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-672.g283431c0.e 1/1 2026-02-20T16:28:38.918 INFO:teuthology.orchestra.run.trial057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T16:28:38.918 INFO:teuthology.orchestra.run.trial057.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-20T16:28:38.918 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:39.221 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-672.g283431c0.e 1/1 2026-02-20T16:28:39.221 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:39.221 INFO:teuthology.orchestra.run.trial057.stdout:Installed: 2026-02-20T16:28:39.221 INFO:teuthology.orchestra.run.trial057.stdout: ceph-immutable-object-cache-2:19.2.3-672.g283431c0.el9.x86_64 2026-02-20T16:28:39.221 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:39.221 INFO:teuthology.orchestra.run.trial057.stdout:Complete! 2026-02-20T16:28:39.247 DEBUG:teuthology.orchestra.run.trial057:> sudo yum -y install ceph-mgr 2026-02-20T16:28:39.554 INFO:teuthology.orchestra.run.trial057.stdout:Last metadata expiration check: 0:00:30 ago on Fri 20 Feb 2026 04:28:09 PM UTC. 2026-02-20T16:28:39.618 INFO:teuthology.orchestra.run.trial057.stdout:Package ceph-mgr-2:19.2.3-672.g283431c0.el9.x86_64 is already installed. 2026-02-20T16:28:39.635 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-20T16:28:39.636 INFO:teuthology.orchestra.run.trial057.stdout:Nothing to do. 2026-02-20T16:28:39.636 INFO:teuthology.orchestra.run.trial057.stdout:Complete! 2026-02-20T16:28:39.657 DEBUG:teuthology.orchestra.run.trial057:> sudo yum -y install ceph-fuse 2026-02-20T16:28:39.964 INFO:teuthology.orchestra.run.trial057.stdout:Last metadata expiration check: 0:00:30 ago on Fri 20 Feb 2026 04:28:09 PM UTC. 2026-02-20T16:28:40.047 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-20T16:28:40.047 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-20T16:28:40.047 INFO:teuthology.orchestra.run.trial057.stdout: Package Architecture Version Repository Size 2026-02-20T16:28:40.047 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-20T16:28:40.047 INFO:teuthology.orchestra.run.trial057.stdout:Installing: 2026-02-20T16:28:40.047 INFO:teuthology.orchestra.run.trial057.stdout: ceph-fuse x86_64 2:19.2.3-672.g283431c0.el9 ceph 1.2 M 2026-02-20T16:28:40.048 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:40.048 INFO:teuthology.orchestra.run.trial057.stdout:Transaction Summary 2026-02-20T16:28:40.048 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-20T16:28:40.048 INFO:teuthology.orchestra.run.trial057.stdout:Install 1 Package 2026-02-20T16:28:40.048 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:40.048 INFO:teuthology.orchestra.run.trial057.stdout:Total download size: 1.2 M 2026-02-20T16:28:40.048 INFO:teuthology.orchestra.run.trial057.stdout:Installed size: 3.6 M 2026-02-20T16:28:40.048 INFO:teuthology.orchestra.run.trial057.stdout:Downloading Packages: 2026-02-20T16:28:40.708 INFO:teuthology.orchestra.run.trial057.stdout:ceph-fuse-19.2.3-672.g283431c0.el9.x86_64.rpm 1.7 MB/s | 1.2 MB 00:00 2026-02-20T16:28:40.709 INFO:teuthology.orchestra.run.trial057.stdout:-------------------------------------------------------------------------------- 2026-02-20T16:28:40.709 INFO:teuthology.orchestra.run.trial057.stdout:Total 1.7 MB/s | 1.2 MB 00:00 2026-02-20T16:28:40.709 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction check 2026-02-20T16:28:40.713 INFO:teuthology.orchestra.run.trial057.stdout:Transaction check succeeded. 2026-02-20T16:28:40.713 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction test 2026-02-20T16:28:40.742 INFO:teuthology.orchestra.run.trial057.stdout:Transaction test succeeded. 2026-02-20T16:28:40.742 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction 2026-02-20T16:28:40.836 INFO:teuthology.orchestra.run.trial057.stdout: Preparing : 1/1 2026-02-20T16:28:40.852 INFO:teuthology.orchestra.run.trial057.stdout: Installing : ceph-fuse-2:19.2.3-672.g283431c0.el9.x86_64 1/1 2026-02-20T16:28:41.064 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-fuse-2:19.2.3-672.g283431c0.el9.x86_64 1/1 2026-02-20T16:28:41.119 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-fuse-2:19.2.3-672.g283431c0.el9.x86_64 1/1 2026-02-20T16:28:41.119 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:41.119 INFO:teuthology.orchestra.run.trial057.stdout:Installed: 2026-02-20T16:28:41.119 INFO:teuthology.orchestra.run.trial057.stdout: ceph-fuse-2:19.2.3-672.g283431c0.el9.x86_64 2026-02-20T16:28:41.119 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:41.119 INFO:teuthology.orchestra.run.trial057.stdout:Complete! 2026-02-20T16:28:41.146 DEBUG:teuthology.orchestra.run.trial057:> sudo yum -y install librados-devel 2026-02-20T16:28:41.455 INFO:teuthology.orchestra.run.trial057.stdout:Last metadata expiration check: 0:00:32 ago on Fri 20 Feb 2026 04:28:09 PM UTC. 2026-02-20T16:28:41.538 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-20T16:28:41.538 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-20T16:28:41.538 INFO:teuthology.orchestra.run.trial057.stdout: Package Arch Version Repo Size 2026-02-20T16:28:41.538 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-20T16:28:41.538 INFO:teuthology.orchestra.run.trial057.stdout:Installing: 2026-02-20T16:28:41.538 INFO:teuthology.orchestra.run.trial057.stdout: librados-devel x86_64 2:19.2.3-672.g283431c0.el9 ceph 126 k 2026-02-20T16:28:41.538 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:41.539 INFO:teuthology.orchestra.run.trial057.stdout:Transaction Summary 2026-02-20T16:28:41.539 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-20T16:28:41.539 INFO:teuthology.orchestra.run.trial057.stdout:Install 1 Package 2026-02-20T16:28:41.539 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:41.539 INFO:teuthology.orchestra.run.trial057.stdout:Total download size: 126 k 2026-02-20T16:28:41.539 INFO:teuthology.orchestra.run.trial057.stdout:Installed size: 456 k 2026-02-20T16:28:41.539 INFO:teuthology.orchestra.run.trial057.stdout:Downloading Packages: 2026-02-20T16:28:41.627 INFO:teuthology.orchestra.run.trial057.stdout:librados-devel-19.2.3-672.g283431c0.el9.x86_64. 1.4 MB/s | 126 kB 00:00 2026-02-20T16:28:41.628 INFO:teuthology.orchestra.run.trial057.stdout:-------------------------------------------------------------------------------- 2026-02-20T16:28:41.628 INFO:teuthology.orchestra.run.trial057.stdout:Total 1.4 MB/s | 126 kB 00:00 2026-02-20T16:28:41.628 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction check 2026-02-20T16:28:41.630 INFO:teuthology.orchestra.run.trial057.stdout:Transaction check succeeded. 2026-02-20T16:28:41.630 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction test 2026-02-20T16:28:41.656 INFO:teuthology.orchestra.run.trial057.stdout:Transaction test succeeded. 2026-02-20T16:28:41.656 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction 2026-02-20T16:28:41.705 INFO:teuthology.orchestra.run.trial057.stdout: Preparing : 1/1 2026-02-20T16:28:41.720 INFO:teuthology.orchestra.run.trial057.stdout: Installing : librados-devel-2:19.2.3-672.g283431c0.el9.x86_64 1/1 2026-02-20T16:28:41.798 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: librados-devel-2:19.2.3-672.g283431c0.el9.x86_64 1/1 2026-02-20T16:28:41.853 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : librados-devel-2:19.2.3-672.g283431c0.el9.x86_64 1/1 2026-02-20T16:28:41.853 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:41.853 INFO:teuthology.orchestra.run.trial057.stdout:Installed: 2026-02-20T16:28:41.853 INFO:teuthology.orchestra.run.trial057.stdout: librados-devel-2:19.2.3-672.g283431c0.el9.x86_64 2026-02-20T16:28:41.854 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:41.854 INFO:teuthology.orchestra.run.trial057.stdout:Complete! 2026-02-20T16:28:41.881 DEBUG:teuthology.orchestra.run.trial057:> sudo yum -y install libcephfs2 2026-02-20T16:28:42.190 INFO:teuthology.orchestra.run.trial057.stdout:Last metadata expiration check: 0:00:33 ago on Fri 20 Feb 2026 04:28:09 PM UTC. 2026-02-20T16:28:42.255 INFO:teuthology.orchestra.run.trial057.stdout:Package libcephfs2-2:19.2.3-672.g283431c0.el9.x86_64 is already installed. 2026-02-20T16:28:42.272 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-20T16:28:42.273 INFO:teuthology.orchestra.run.trial057.stdout:Nothing to do. 2026-02-20T16:28:42.273 INFO:teuthology.orchestra.run.trial057.stdout:Complete! 2026-02-20T16:28:42.295 DEBUG:teuthology.orchestra.run.trial057:> sudo yum -y install libcephfs-devel 2026-02-20T16:28:42.599 INFO:teuthology.orchestra.run.trial057.stdout:Last metadata expiration check: 0:00:33 ago on Fri 20 Feb 2026 04:28:09 PM UTC. 2026-02-20T16:28:42.681 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-20T16:28:42.682 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-20T16:28:42.682 INFO:teuthology.orchestra.run.trial057.stdout: Package Arch Version Repo Size 2026-02-20T16:28:42.682 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-20T16:28:42.682 INFO:teuthology.orchestra.run.trial057.stdout:Installing: 2026-02-20T16:28:42.682 INFO:teuthology.orchestra.run.trial057.stdout: libcephfs-devel x86_64 2:19.2.3-672.g283431c0.el9 ceph 34 k 2026-02-20T16:28:42.682 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:42.682 INFO:teuthology.orchestra.run.trial057.stdout:Transaction Summary 2026-02-20T16:28:42.682 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-20T16:28:42.682 INFO:teuthology.orchestra.run.trial057.stdout:Install 1 Package 2026-02-20T16:28:42.683 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:42.683 INFO:teuthology.orchestra.run.trial057.stdout:Total download size: 34 k 2026-02-20T16:28:42.683 INFO:teuthology.orchestra.run.trial057.stdout:Installed size: 153 k 2026-02-20T16:28:42.683 INFO:teuthology.orchestra.run.trial057.stdout:Downloading Packages: 2026-02-20T16:28:42.805 INFO:teuthology.orchestra.run.trial057.stdout:libcephfs-devel-19.2.3-672.g283431c0.el9.x86_64 274 kB/s | 34 kB 00:00 2026-02-20T16:28:42.806 INFO:teuthology.orchestra.run.trial057.stdout:-------------------------------------------------------------------------------- 2026-02-20T16:28:42.806 INFO:teuthology.orchestra.run.trial057.stdout:Total 270 kB/s | 34 kB 00:00 2026-02-20T16:28:42.806 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction check 2026-02-20T16:28:42.808 INFO:teuthology.orchestra.run.trial057.stdout:Transaction check succeeded. 2026-02-20T16:28:42.808 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction test 2026-02-20T16:28:42.811 INFO:teuthology.orchestra.run.trial057.stdout:Transaction test succeeded. 2026-02-20T16:28:42.811 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction 2026-02-20T16:28:42.831 INFO:teuthology.orchestra.run.trial057.stdout: Preparing : 1/1 2026-02-20T16:28:42.846 INFO:teuthology.orchestra.run.trial057.stdout: Installing : libcephfs-devel-2:19.2.3-672.g283431c0.el9.x86_64 1/1 2026-02-20T16:28:42.898 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-672.g283431c0.el9.x86_64 1/1 2026-02-20T16:28:42.952 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : libcephfs-devel-2:19.2.3-672.g283431c0.el9.x86_64 1/1 2026-02-20T16:28:42.952 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:42.952 INFO:teuthology.orchestra.run.trial057.stdout:Installed: 2026-02-20T16:28:42.952 INFO:teuthology.orchestra.run.trial057.stdout: libcephfs-devel-2:19.2.3-672.g283431c0.el9.x86_64 2026-02-20T16:28:42.952 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:42.953 INFO:teuthology.orchestra.run.trial057.stdout:Complete! 2026-02-20T16:28:42.981 DEBUG:teuthology.orchestra.run.trial057:> sudo yum -y install librados2 2026-02-20T16:28:43.282 INFO:teuthology.orchestra.run.trial057.stdout:Last metadata expiration check: 0:00:34 ago on Fri 20 Feb 2026 04:28:09 PM UTC. 2026-02-20T16:28:43.346 INFO:teuthology.orchestra.run.trial057.stdout:Package librados2-2:19.2.3-672.g283431c0.el9.x86_64 is already installed. 2026-02-20T16:28:43.363 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-20T16:28:43.364 INFO:teuthology.orchestra.run.trial057.stdout:Nothing to do. 2026-02-20T16:28:43.364 INFO:teuthology.orchestra.run.trial057.stdout:Complete! 2026-02-20T16:28:43.385 DEBUG:teuthology.orchestra.run.trial057:> sudo yum -y install librbd1 2026-02-20T16:28:43.696 INFO:teuthology.orchestra.run.trial057.stdout:Last metadata expiration check: 0:00:34 ago on Fri 20 Feb 2026 04:28:09 PM UTC. 2026-02-20T16:28:43.762 INFO:teuthology.orchestra.run.trial057.stdout:Package librbd1-2:19.2.3-672.g283431c0.el9.x86_64 is already installed. 2026-02-20T16:28:43.779 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-20T16:28:43.780 INFO:teuthology.orchestra.run.trial057.stdout:Nothing to do. 2026-02-20T16:28:43.780 INFO:teuthology.orchestra.run.trial057.stdout:Complete! 2026-02-20T16:28:43.801 DEBUG:teuthology.orchestra.run.trial057:> sudo yum -y install python3-rados 2026-02-20T16:28:44.106 INFO:teuthology.orchestra.run.trial057.stdout:Last metadata expiration check: 0:00:35 ago on Fri 20 Feb 2026 04:28:09 PM UTC. 2026-02-20T16:28:44.171 INFO:teuthology.orchestra.run.trial057.stdout:Package python3-rados-2:19.2.3-672.g283431c0.el9.x86_64 is already installed. 2026-02-20T16:28:44.188 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-20T16:28:44.189 INFO:teuthology.orchestra.run.trial057.stdout:Nothing to do. 2026-02-20T16:28:44.189 INFO:teuthology.orchestra.run.trial057.stdout:Complete! 2026-02-20T16:28:44.211 DEBUG:teuthology.orchestra.run.trial057:> sudo yum -y install python3-rgw 2026-02-20T16:28:44.514 INFO:teuthology.orchestra.run.trial057.stdout:Last metadata expiration check: 0:00:35 ago on Fri 20 Feb 2026 04:28:09 PM UTC. 2026-02-20T16:28:44.579 INFO:teuthology.orchestra.run.trial057.stdout:Package python3-rgw-2:19.2.3-672.g283431c0.el9.x86_64 is already installed. 2026-02-20T16:28:44.596 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-20T16:28:44.596 INFO:teuthology.orchestra.run.trial057.stdout:Nothing to do. 2026-02-20T16:28:44.596 INFO:teuthology.orchestra.run.trial057.stdout:Complete! 2026-02-20T16:28:44.617 DEBUG:teuthology.orchestra.run.trial057:> sudo yum -y install python3-cephfs 2026-02-20T16:28:44.918 INFO:teuthology.orchestra.run.trial057.stdout:Last metadata expiration check: 0:00:35 ago on Fri 20 Feb 2026 04:28:09 PM UTC. 2026-02-20T16:28:44.983 INFO:teuthology.orchestra.run.trial057.stdout:Package python3-cephfs-2:19.2.3-672.g283431c0.el9.x86_64 is already installed. 2026-02-20T16:28:45.000 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-20T16:28:45.001 INFO:teuthology.orchestra.run.trial057.stdout:Nothing to do. 2026-02-20T16:28:45.001 INFO:teuthology.orchestra.run.trial057.stdout:Complete! 2026-02-20T16:28:45.022 DEBUG:teuthology.orchestra.run.trial057:> sudo yum -y install python3-rbd 2026-02-20T16:28:45.329 INFO:teuthology.orchestra.run.trial057.stdout:Last metadata expiration check: 0:00:36 ago on Fri 20 Feb 2026 04:28:09 PM UTC. 2026-02-20T16:28:45.394 INFO:teuthology.orchestra.run.trial057.stdout:Package python3-rbd-2:19.2.3-672.g283431c0.el9.x86_64 is already installed. 2026-02-20T16:28:45.411 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-20T16:28:45.412 INFO:teuthology.orchestra.run.trial057.stdout:Nothing to do. 2026-02-20T16:28:45.412 INFO:teuthology.orchestra.run.trial057.stdout:Complete! 2026-02-20T16:28:45.434 DEBUG:teuthology.orchestra.run.trial057:> sudo yum -y install rbd-fuse 2026-02-20T16:28:45.744 INFO:teuthology.orchestra.run.trial057.stdout:Last metadata expiration check: 0:00:36 ago on Fri 20 Feb 2026 04:28:09 PM UTC. 2026-02-20T16:28:45.827 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-20T16:28:45.827 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-20T16:28:45.827 INFO:teuthology.orchestra.run.trial057.stdout: Package Architecture Version Repository Size 2026-02-20T16:28:45.827 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-20T16:28:45.827 INFO:teuthology.orchestra.run.trial057.stdout:Installing: 2026-02-20T16:28:45.827 INFO:teuthology.orchestra.run.trial057.stdout: rbd-fuse x86_64 2:19.2.3-672.g283431c0.el9 ceph 85 k 2026-02-20T16:28:45.827 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:45.827 INFO:teuthology.orchestra.run.trial057.stdout:Transaction Summary 2026-02-20T16:28:45.828 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-20T16:28:45.828 INFO:teuthology.orchestra.run.trial057.stdout:Install 1 Package 2026-02-20T16:28:45.828 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:45.828 INFO:teuthology.orchestra.run.trial057.stdout:Total download size: 85 k 2026-02-20T16:28:45.828 INFO:teuthology.orchestra.run.trial057.stdout:Installed size: 231 k 2026-02-20T16:28:45.828 INFO:teuthology.orchestra.run.trial057.stdout:Downloading Packages: 2026-02-20T16:28:45.917 INFO:teuthology.orchestra.run.trial057.stdout:rbd-fuse-19.2.3-672.g283431c0.el9.x86_64.rpm 952 kB/s | 85 kB 00:00 2026-02-20T16:28:45.917 INFO:teuthology.orchestra.run.trial057.stdout:-------------------------------------------------------------------------------- 2026-02-20T16:28:45.917 INFO:teuthology.orchestra.run.trial057.stdout:Total 945 kB/s | 85 kB 00:00 2026-02-20T16:28:45.917 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction check 2026-02-20T16:28:45.920 INFO:teuthology.orchestra.run.trial057.stdout:Transaction check succeeded. 2026-02-20T16:28:45.920 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction test 2026-02-20T16:28:45.946 INFO:teuthology.orchestra.run.trial057.stdout:Transaction test succeeded. 2026-02-20T16:28:45.947 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction 2026-02-20T16:28:45.992 INFO:teuthology.orchestra.run.trial057.stdout: Preparing : 1/1 2026-02-20T16:28:46.008 INFO:teuthology.orchestra.run.trial057.stdout: Installing : rbd-fuse-2:19.2.3-672.g283431c0.el9.x86_64 1/1 2026-02-20T16:28:46.084 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: rbd-fuse-2:19.2.3-672.g283431c0.el9.x86_64 1/1 2026-02-20T16:28:46.140 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : rbd-fuse-2:19.2.3-672.g283431c0.el9.x86_64 1/1 2026-02-20T16:28:46.140 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:46.140 INFO:teuthology.orchestra.run.trial057.stdout:Installed: 2026-02-20T16:28:46.140 INFO:teuthology.orchestra.run.trial057.stdout: rbd-fuse-2:19.2.3-672.g283431c0.el9.x86_64 2026-02-20T16:28:46.140 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:46.140 INFO:teuthology.orchestra.run.trial057.stdout:Complete! 2026-02-20T16:28:46.170 DEBUG:teuthology.orchestra.run.trial057:> sudo yum -y install rbd-mirror 2026-02-20T16:28:46.474 INFO:teuthology.orchestra.run.trial057.stdout:Last metadata expiration check: 0:00:37 ago on Fri 20 Feb 2026 04:28:09 PM UTC. 2026-02-20T16:28:46.556 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-20T16:28:46.556 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-20T16:28:46.556 INFO:teuthology.orchestra.run.trial057.stdout: Package Arch Version Repo Size 2026-02-20T16:28:46.556 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-20T16:28:46.556 INFO:teuthology.orchestra.run.trial057.stdout:Installing: 2026-02-20T16:28:46.556 INFO:teuthology.orchestra.run.trial057.stdout: rbd-mirror x86_64 2:19.2.3-672.g283431c0.el9 ceph 3.1 M 2026-02-20T16:28:46.557 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:46.557 INFO:teuthology.orchestra.run.trial057.stdout:Transaction Summary 2026-02-20T16:28:46.557 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-20T16:28:46.557 INFO:teuthology.orchestra.run.trial057.stdout:Install 1 Package 2026-02-20T16:28:46.557 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:46.557 INFO:teuthology.orchestra.run.trial057.stdout:Total download size: 3.1 M 2026-02-20T16:28:46.557 INFO:teuthology.orchestra.run.trial057.stdout:Installed size: 13 M 2026-02-20T16:28:46.557 INFO:teuthology.orchestra.run.trial057.stdout:Downloading Packages: 2026-02-20T16:28:46.705 INFO:teuthology.orchestra.run.trial057.stdout:rbd-mirror-19.2.3-672.g283431c0.el9.x86_64.rpm 21 MB/s | 3.1 MB 00:00 2026-02-20T16:28:46.706 INFO:teuthology.orchestra.run.trial057.stdout:-------------------------------------------------------------------------------- 2026-02-20T16:28:46.706 INFO:teuthology.orchestra.run.trial057.stdout:Total 21 MB/s | 3.1 MB 00:00 2026-02-20T16:28:46.706 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction check 2026-02-20T16:28:46.710 INFO:teuthology.orchestra.run.trial057.stdout:Transaction check succeeded. 2026-02-20T16:28:46.710 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction test 2026-02-20T16:28:46.745 INFO:teuthology.orchestra.run.trial057.stdout:Transaction test succeeded. 2026-02-20T16:28:46.745 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction 2026-02-20T16:28:46.934 INFO:teuthology.orchestra.run.trial057.stdout: Preparing : 1/1 2026-02-20T16:28:46.936 INFO:teuthology.orchestra.run.trial057.stdout: Installing : rbd-mirror-2:19.2.3-672.g283431c0.el9.x86_64 1/1 2026-02-20T16:28:46.959 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: rbd-mirror-2:19.2.3-672.g283431c0.el9.x86_64 1/1 2026-02-20T16:28:46.959 INFO:teuthology.orchestra.run.trial057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T16:28:46.959 INFO:teuthology.orchestra.run.trial057.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-20T16:28:46.959 INFO:teuthology.orchestra.run.trial057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-20T16:28:46.959 INFO:teuthology.orchestra.run.trial057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-20T16:28:46.959 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:47.265 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : rbd-mirror-2:19.2.3-672.g283431c0.el9.x86_64 1/1 2026-02-20T16:28:47.265 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:47.265 INFO:teuthology.orchestra.run.trial057.stdout:Installed: 2026-02-20T16:28:47.265 INFO:teuthology.orchestra.run.trial057.stdout: rbd-mirror-2:19.2.3-672.g283431c0.el9.x86_64 2026-02-20T16:28:47.265 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:47.265 INFO:teuthology.orchestra.run.trial057.stdout:Complete! 2026-02-20T16:28:47.295 DEBUG:teuthology.orchestra.run.trial057:> sudo yum -y install rbd-nbd 2026-02-20T16:28:47.609 INFO:teuthology.orchestra.run.trial057.stdout:Last metadata expiration check: 0:00:38 ago on Fri 20 Feb 2026 04:28:09 PM UTC. 2026-02-20T16:28:47.692 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-20T16:28:47.692 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-20T16:28:47.692 INFO:teuthology.orchestra.run.trial057.stdout: Package Architecture Version Repository Size 2026-02-20T16:28:47.692 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-20T16:28:47.692 INFO:teuthology.orchestra.run.trial057.stdout:Installing: 2026-02-20T16:28:47.693 INFO:teuthology.orchestra.run.trial057.stdout: rbd-nbd x86_64 2:19.2.3-672.g283431c0.el9 ceph 171 k 2026-02-20T16:28:47.693 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:47.693 INFO:teuthology.orchestra.run.trial057.stdout:Transaction Summary 2026-02-20T16:28:47.693 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-20T16:28:47.693 INFO:teuthology.orchestra.run.trial057.stdout:Install 1 Package 2026-02-20T16:28:47.693 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:47.693 INFO:teuthology.orchestra.run.trial057.stdout:Total download size: 171 k 2026-02-20T16:28:47.693 INFO:teuthology.orchestra.run.trial057.stdout:Installed size: 494 k 2026-02-20T16:28:47.693 INFO:teuthology.orchestra.run.trial057.stdout:Downloading Packages: 2026-02-20T16:28:47.778 INFO:teuthology.orchestra.run.trial057.stdout:rbd-nbd-19.2.3-672.g283431c0.el9.x86_64.rpm 2.0 MB/s | 171 kB 00:00 2026-02-20T16:28:47.778 INFO:teuthology.orchestra.run.trial057.stdout:-------------------------------------------------------------------------------- 2026-02-20T16:28:47.778 INFO:teuthology.orchestra.run.trial057.stdout:Total 1.9 MB/s | 171 kB 00:00 2026-02-20T16:28:47.779 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction check 2026-02-20T16:28:47.782 INFO:teuthology.orchestra.run.trial057.stdout:Transaction check succeeded. 2026-02-20T16:28:47.782 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction test 2026-02-20T16:28:47.808 INFO:teuthology.orchestra.run.trial057.stdout:Transaction test succeeded. 2026-02-20T16:28:47.808 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction 2026-02-20T16:28:47.858 INFO:teuthology.orchestra.run.trial057.stdout: Preparing : 1/1 2026-02-20T16:28:47.873 INFO:teuthology.orchestra.run.trial057.stdout: Installing : rbd-nbd-2:19.2.3-672.g283431c0.el9.x86_64 1/1 2026-02-20T16:28:47.952 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: rbd-nbd-2:19.2.3-672.g283431c0.el9.x86_64 1/1 2026-02-20T16:28:48.006 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : rbd-nbd-2:19.2.3-672.g283431c0.el9.x86_64 1/1 2026-02-20T16:28:48.006 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:48.007 INFO:teuthology.orchestra.run.trial057.stdout:Installed: 2026-02-20T16:28:48.007 INFO:teuthology.orchestra.run.trial057.stdout: rbd-nbd-2:19.2.3-672.g283431c0.el9.x86_64 2026-02-20T16:28:48.007 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:48.007 INFO:teuthology.orchestra.run.trial057.stdout:Complete! 2026-02-20T16:28:48.034 DEBUG:teuthology.orchestra.run.trial057:> sudo yum -y install librados2 2026-02-20T16:28:48.347 INFO:teuthology.orchestra.run.trial057.stdout:Last metadata expiration check: 0:00:39 ago on Fri 20 Feb 2026 04:28:09 PM UTC. 2026-02-20T16:28:48.412 INFO:teuthology.orchestra.run.trial057.stdout:Package librados2-2:19.2.3-672.g283431c0.el9.x86_64 is already installed. 2026-02-20T16:28:48.429 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-20T16:28:48.430 INFO:teuthology.orchestra.run.trial057.stdout:Nothing to do. 2026-02-20T16:28:48.430 INFO:teuthology.orchestra.run.trial057.stdout:Complete! 2026-02-20T16:28:48.455 DEBUG:teuthology.parallel:result is None 2026-02-20T16:28:48.455 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-20T16:28:48.456 INFO:teuthology.packaging:ref: None 2026-02-20T16:28:48.456 INFO:teuthology.packaging:tag: None 2026-02-20T16:28:48.456 INFO:teuthology.packaging:branch: squid 2026-02-20T16:28:48.456 INFO:teuthology.packaging:sha1: f7870454149f22574086dd2ff55d050585136531 2026-02-20T16:28:48.456 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2026-02-20T16:28:48.664 DEBUG:teuthology.orchestra.run.trial057:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-20T16:28:48.687 INFO:teuthology.orchestra.run.trial057.stdout:19.2.3-672.g283431c0.el9 2026-02-20T16:28:48.688 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-672.g283431c0.el9 2026-02-20T16:28:48.688 INFO:teuthology.task.install:The correct ceph version 19.2.3-672.g283431c0 is installed. 2026-02-20T16:28:48.691 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-20T16:28:48.691 DEBUG:teuthology.orchestra.run.trial057:> set -ex 2026-02-20T16:28:48.691 DEBUG:teuthology.orchestra.run.trial057:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-20T16:28:48.753 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-20T16:28:48.754 DEBUG:teuthology.orchestra.run.trial057:> set -ex 2026-02-20T16:28:48.754 DEBUG:teuthology.orchestra.run.trial057:> sudo dd of=/usr/bin/daemon-helper 2026-02-20T16:28:48.818 DEBUG:teuthology.orchestra.run.trial057:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-20T16:28:48.883 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-20T16:28:48.883 DEBUG:teuthology.orchestra.run.trial057:> set -ex 2026-02-20T16:28:48.883 DEBUG:teuthology.orchestra.run.trial057:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-20T16:28:48.946 DEBUG:teuthology.orchestra.run.trial057:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-20T16:28:49.009 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-20T16:28:49.009 DEBUG:teuthology.orchestra.run.trial057:> set -ex 2026-02-20T16:28:49.009 DEBUG:teuthology.orchestra.run.trial057:> sudo dd of=/usr/bin/stdin-killer 2026-02-20T16:28:49.073 DEBUG:teuthology.orchestra.run.trial057:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-20T16:28:49.139 INFO:teuthology.run_tasks:Running task print... 2026-02-20T16:28:49.154 INFO:teuthology.task.print:**** done installing squid 2026-02-20T16:28:49.154 INFO:teuthology.run_tasks:Running task ceph... 2026-02-20T16:28:49.266 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-20T16:28:49.266 DEBUG:teuthology.orchestra.run.trial057:> sudo chmod 777 /var/log/ceph 2026-02-20T16:28:49.291 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-20T16:28:49.291 DEBUG:teuthology.orchestra.run.trial057:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-20T16:28:49.354 INFO:tasks.ceph:Creating extra log directories... 2026-02-20T16:28:49.354 DEBUG:teuthology.orchestra.run.trial057:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-20T16:28:49.430 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-20T16:28:49.430 INFO:tasks.ceph:config {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'is offline because no MDS', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'BLUESTORE_SLOW_OP_ALERT', 'slow operation indications in BlueStore', 'experiencing slow operations in BlueStore', 'MGR_MODULE_ERROR', 'OSD_DOWN', 'osd.* is down', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'osds down', 'osd.* is down', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'pg .* is stuck inactive', 'pg .* is .*degraded', 'pg .* is stuck peering', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-20T16:28:49.430 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-20_16:06:46-upgrade-wip-pdonnell-testing-20260219.182737-tentacle-distro-default-trial/60844', 'branch': 'wip-pdonnell-testing-20260219.182737-tentacle', 'description': 'upgrade/cephfs/nofs/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} kernel no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn pg_health} tasks/{0-from/squid 1-upgrade}}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'flavor': 'default', 'job_id': '60844', 'kernel': {'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'meta': [{'desc': 'install ceph/squid latest\n'}], 'name': 'yuriw-2026-02-20_16:06:46-upgrade-wip-pdonnell-testing-20260219.182737-tentacle-distro-default-trial', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20260219.182737-tentacle'}, 'ceph': {'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'global': {'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'is offline because no MDS', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'BLUESTORE_SLOW_OP_ALERT', 'slow operation indications in BlueStore', 'experiencing slow operations in BlueStore', 'MGR_MODULE_ERROR', 'OSD_DOWN', 'osd.* is down', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'osds down', 'osd.* is down', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'pg .* is stuck inactive', 'pg .* is .*degraded', 'pg .* is stuck peering', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request'], 'sha1': 'f7870454149f22574086dd2ff55d050585136531'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'f7870454149f22574086dd2ff55d050585136531'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20260219.182737-tentacle', 'sha1': 'f7870454149f22574086dd2ff55d050585136531'}}, 'owner': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'priority': 69, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 6167, 'sha1': 'f7870454149f22574086dd2ff55d050585136531', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'upgrade', 'suite_branch': 'wip-pdonnell-testing-20260219.182737-tentacle', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_f7870454149f22574086dd2ff55d050585136531/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'f7870454149f22574086dd2ff55d050585136531', 'targets': {'trial057.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKtsusqfyOtnd80xdVZl9vaBER3VrUldVZngawWsMaJ1lMLd2s+JvqE6S9Ns66RKqOxpcDQXtO0IHbexJ9OeZqM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'branch': 'squid', 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-volume'], 'extra_packages': ['librados2'], 'flavor': 'default', 'sha1': 'f7870454149f22574086dd2ff55d050585136531'}}, {'print': '**** done installing squid'}, {'ceph': {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'log-ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'is offline because no MDS', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'BLUESTORE_SLOW_OP_ALERT', 'slow operation indications in BlueStore', 'experiencing slow operations in BlueStore', 'MGR_MODULE_ERROR', 'OSD_DOWN', 'osd.* is down', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'osds down', 'osd.* is down', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'pg .* is stuck inactive', 'pg .* is .*degraded', 'pg .* is stuck peering', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request'], 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'sha1': 'f7870454149f22574086dd2ff55d050585136531', 'cluster': 'ceph'}}, {'exec': {'osd.0': ['ceph osd set-require-min-compat-client squid']}}, {'print': '**** done ceph'}, {'print': '*** upgrading, no cephfs present'}, {'exec': {'mon.a': ['ceph fs dump']}}, {'install.upgrade': {'mon.a': None}}, {'print': '**** done install.upgrade'}, {'ceph.restart': {'daemons': ['mon.*', 'mgr.*'], 'mon-health-to-clog': False, 'wait-for-healthy': False}}, {'ceph.healthy': None}, {'ceph.restart': {'daemons': ['osd.*'], 'wait-for-healthy': False, 'wait-for-osds-up': True}}, {'exec': {'mon.a': ['ceph versions', 'ceph osd dump -f json-pretty', 'ceph fs dump', 'ceph osd require-osd-release tentacle', 'for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done']}}, {'ceph.healthy': None}, {'print': '**** done ceph.restart'}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local branch = yaml.kernel.branch\nif branch and not yaml.kernel.branch:find "-all$" then\n log.debug("removing default kernel specification: %s", yaml.kernel)\n py_attrgetter(yaml.kernel).pop(\'branch\', nil)\n py_attrgetter(yaml.kernel).pop(\'deb\', nil)\n py_attrgetter(yaml.kernel).pop(\'flavor\', nil)\n py_attrgetter(yaml.kernel).pop(\'kdb\', nil)\n py_attrgetter(yaml.kernel).pop(\'koji\', nil)\n py_attrgetter(yaml.kernel).pop(\'koji_task\', nil)\n py_attrgetter(yaml.kernel).pop(\'rpm\', nil)\n py_attrgetter(yaml.kernel).pop(\'sha1\', nil)\n py_attrgetter(yaml.kernel).pop(\'tag\', nil)\nend\n']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'fa17720d0088c3ac28e473468bfc79eeaff5cd38', 'timestamp': '2026-02-20_16:06:46', 'tube': 'trial', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.1540699'} 2026-02-20T16:28:49.431 DEBUG:teuthology.orchestra.run.trial057:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-20T16:28:49.475 DEBUG:teuthology.orchestra.run.trial057:> sudo install -d -m0777 -- /var/run/ceph 2026-02-20T16:28:49.539 DEBUG:teuthology.orchestra.run.trial057:> set -ex 2026-02-20T16:28:49.540 DEBUG:teuthology.orchestra.run.trial057:> dd if=/scratch_devs of=/dev/stdout 2026-02-20T16:28:49.595 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-20T16:28:49.595 DEBUG:teuthology.orchestra.run.trial057:> stat /dev/vg_nvme/lv_1 2026-02-20T16:28:49.652 INFO:teuthology.orchestra.run.trial057.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-20T16:28:49.652 INFO:teuthology.orchestra.run.trial057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T16:28:49.652 INFO:teuthology.orchestra.run.trial057.stdout:Device: 6h/6d Inode: 908 Links: 1 2026-02-20T16:28:49.652 INFO:teuthology.orchestra.run.trial057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T16:28:49.652 INFO:teuthology.orchestra.run.trial057.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T16:28:49.652 INFO:teuthology.orchestra.run.trial057.stdout:Access: 2026-02-20 16:28:47.099247803 +0000 2026-02-20T16:28:49.652 INFO:teuthology.orchestra.run.trial057.stdout:Modify: 2026-02-20 16:27:28.123624017 +0000 2026-02-20T16:28:49.652 INFO:teuthology.orchestra.run.trial057.stdout:Change: 2026-02-20 16:27:28.123624017 +0000 2026-02-20T16:28:49.652 INFO:teuthology.orchestra.run.trial057.stdout: Birth: 2026-02-20 16:27:28.123624017 +0000 2026-02-20T16:28:49.653 DEBUG:teuthology.orchestra.run.trial057:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-20T16:28:49.715 INFO:teuthology.orchestra.run.trial057.stderr:1+0 records in 2026-02-20T16:28:49.715 INFO:teuthology.orchestra.run.trial057.stderr:1+0 records out 2026-02-20T16:28:49.715 INFO:teuthology.orchestra.run.trial057.stderr:512 bytes copied, 0.000161731 s, 3.2 MB/s 2026-02-20T16:28:49.716 DEBUG:teuthology.orchestra.run.trial057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-20T16:28:49.773 DEBUG:teuthology.orchestra.run.trial057:> stat /dev/vg_nvme/lv_2 2026-02-20T16:28:49.830 INFO:teuthology.orchestra.run.trial057.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-20T16:28:49.831 INFO:teuthology.orchestra.run.trial057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T16:28:49.831 INFO:teuthology.orchestra.run.trial057.stdout:Device: 6h/6d Inode: 936 Links: 1 2026-02-20T16:28:49.831 INFO:teuthology.orchestra.run.trial057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T16:28:49.831 INFO:teuthology.orchestra.run.trial057.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T16:28:49.831 INFO:teuthology.orchestra.run.trial057.stdout:Access: 2026-02-20 16:28:47.100247794 +0000 2026-02-20T16:28:49.831 INFO:teuthology.orchestra.run.trial057.stdout:Modify: 2026-02-20 16:27:28.353621403 +0000 2026-02-20T16:28:49.831 INFO:teuthology.orchestra.run.trial057.stdout:Change: 2026-02-20 16:27:28.353621403 +0000 2026-02-20T16:28:49.831 INFO:teuthology.orchestra.run.trial057.stdout: Birth: 2026-02-20 16:27:28.353621403 +0000 2026-02-20T16:28:49.832 DEBUG:teuthology.orchestra.run.trial057:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-20T16:28:49.893 INFO:teuthology.orchestra.run.trial057.stderr:1+0 records in 2026-02-20T16:28:49.893 INFO:teuthology.orchestra.run.trial057.stderr:1+0 records out 2026-02-20T16:28:49.893 INFO:teuthology.orchestra.run.trial057.stderr:512 bytes copied, 0.000141193 s, 3.6 MB/s 2026-02-20T16:28:49.895 DEBUG:teuthology.orchestra.run.trial057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-20T16:28:49.952 DEBUG:teuthology.orchestra.run.trial057:> stat /dev/vg_nvme/lv_3 2026-02-20T16:28:50.008 INFO:teuthology.orchestra.run.trial057.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-20T16:28:50.008 INFO:teuthology.orchestra.run.trial057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T16:28:50.008 INFO:teuthology.orchestra.run.trial057.stdout:Device: 6h/6d Inode: 963 Links: 1 2026-02-20T16:28:50.008 INFO:teuthology.orchestra.run.trial057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T16:28:50.008 INFO:teuthology.orchestra.run.trial057.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T16:28:50.009 INFO:teuthology.orchestra.run.trial057.stdout:Access: 2026-02-20 16:28:47.100247794 +0000 2026-02-20T16:28:50.009 INFO:teuthology.orchestra.run.trial057.stdout:Modify: 2026-02-20 16:27:28.611618469 +0000 2026-02-20T16:28:50.009 INFO:teuthology.orchestra.run.trial057.stdout:Change: 2026-02-20 16:27:28.611618469 +0000 2026-02-20T16:28:50.009 INFO:teuthology.orchestra.run.trial057.stdout: Birth: 2026-02-20 16:27:28.611618469 +0000 2026-02-20T16:28:50.009 DEBUG:teuthology.orchestra.run.trial057:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-20T16:28:50.070 INFO:teuthology.orchestra.run.trial057.stderr:1+0 records in 2026-02-20T16:28:50.071 INFO:teuthology.orchestra.run.trial057.stderr:1+0 records out 2026-02-20T16:28:50.071 INFO:teuthology.orchestra.run.trial057.stderr:512 bytes copied, 0.000144258 s, 3.5 MB/s 2026-02-20T16:28:50.072 DEBUG:teuthology.orchestra.run.trial057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-20T16:28:50.129 DEBUG:teuthology.orchestra.run.trial057:> stat /dev/vg_nvme/lv_4 2026-02-20T16:28:50.185 INFO:teuthology.orchestra.run.trial057.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-20T16:28:50.185 INFO:teuthology.orchestra.run.trial057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T16:28:50.185 INFO:teuthology.orchestra.run.trial057.stdout:Device: 6h/6d Inode: 992 Links: 1 2026-02-20T16:28:50.185 INFO:teuthology.orchestra.run.trial057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T16:28:50.185 INFO:teuthology.orchestra.run.trial057.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T16:28:50.186 INFO:teuthology.orchestra.run.trial057.stdout:Access: 2026-02-20 16:28:47.100247794 +0000 2026-02-20T16:28:50.186 INFO:teuthology.orchestra.run.trial057.stdout:Modify: 2026-02-20 16:27:28.868615547 +0000 2026-02-20T16:28:50.186 INFO:teuthology.orchestra.run.trial057.stdout:Change: 2026-02-20 16:27:28.868615547 +0000 2026-02-20T16:28:50.186 INFO:teuthology.orchestra.run.trial057.stdout: Birth: 2026-02-20 16:27:28.868615547 +0000 2026-02-20T16:28:50.186 DEBUG:teuthology.orchestra.run.trial057:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-20T16:28:50.249 INFO:teuthology.orchestra.run.trial057.stderr:1+0 records in 2026-02-20T16:28:50.249 INFO:teuthology.orchestra.run.trial057.stderr:1+0 records out 2026-02-20T16:28:50.249 INFO:teuthology.orchestra.run.trial057.stderr:512 bytes copied, 0.000180987 s, 2.8 MB/s 2026-02-20T16:28:50.250 DEBUG:teuthology.orchestra.run.trial057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-20T16:28:50.310 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-20T16:28:50.310 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial057.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2026-02-20T16:28:50.310 INFO:tasks.ceph:Generating config... 2026-02-20T16:28:50.312 INFO:tasks.ceph:[global] mon warn on pool no app = False 2026-02-20T16:28:50.313 INFO:tasks.ceph:[global] ms bind msgr2 = False 2026-02-20T16:28:50.313 INFO:tasks.ceph:[global] bluestore warn on legacy statfs = False 2026-02-20T16:28:50.313 INFO:tasks.ceph:[global] bluestore warn on no per pool omap = False 2026-02-20T16:28:50.313 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2026-02-20T16:28:50.313 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-20T16:28:50.313 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-20T16:28:50.313 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-20T16:28:50.313 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-20T16:28:50.314 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-20T16:28:50.314 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2026-02-20T16:28:50.314 INFO:tasks.ceph:[mon] mon warn on osd down out interval zero = False 2026-02-20T16:28:50.314 INFO:tasks.ceph:[osd] bdev async discard = True 2026-02-20T16:28:50.314 INFO:tasks.ceph:[osd] bdev enable discard = True 2026-02-20T16:28:50.314 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2026-02-20T16:28:50.314 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2026-02-20T16:28:50.314 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2026-02-20T16:28:50.314 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2026-02-20T16:28:50.314 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2026-02-20T16:28:50.315 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-20T16:28:50.315 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-20T16:28:50.315 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2026-02-20T16:28:50.315 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2026-02-20T16:28:50.315 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2026-02-20T16:28:50.315 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2026-02-20T16:28:50.315 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2026-02-20T16:28:50.315 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2026-02-20T16:28:50.315 INFO:tasks.ceph:Setting up mon.a... 2026-02-20T16:28:50.316 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-20T16:28:50.383 INFO:teuthology.orchestra.run.trial057.stdout:creating /etc/ceph/ceph.keyring 2026-02-20T16:28:50.385 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-20T16:28:50.461 DEBUG:teuthology.orchestra.run.trial057:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-20T16:28:50.525 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.57'), ('mon.b', '[v2:10.20.193.57:3301,v1:10.20.193.57:6790]'), ('mon.c', '[v2:10.20.193.57:3302,v1:10.20.193.57:6791]')] 2026-02-20T16:28:50.525 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.57,[v2:10.20.193.57:3301,v1:10.20.193.57:6790],[v2:10.20.193.57:3302,v1:10.20.193.57:6791]', 'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': 'true', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon warn on osd down out interval zero': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}} 2026-02-20T16:28:50.527 DEBUG:teuthology.orchestra.run.trial057:> set -ex 2026-02-20T16:28:50.527 DEBUG:teuthology.orchestra.run.trial057:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-20T16:28:50.582 DEBUG:teuthology.orchestra.run.trial057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.57 --addv b '[v2:10.20.193.57:3301,v1:10.20.193.57:6790]' --addv c '[v2:10.20.193.57:3302,v1:10.20.193.57:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2026-02-20T16:28:50.655 INFO:teuthology.orchestra.run.trial057.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-20T16:28:50.655 INFO:teuthology.orchestra.run.trial057.stdout:monmaptool: generated fsid 3b3c5c1a-0a2b-40b9-ac1d-921ada466f9e 2026-02-20T16:28:50.655 INFO:teuthology.orchestra.run.trial057.stdout:setting min_mon_release = quincy 2026-02-20T16:28:50.656 INFO:teuthology.orchestra.run.trial057.stdout:epoch 0 2026-02-20T16:28:50.656 INFO:teuthology.orchestra.run.trial057.stdout:fsid 3b3c5c1a-0a2b-40b9-ac1d-921ada466f9e 2026-02-20T16:28:50.656 INFO:teuthology.orchestra.run.trial057.stdout:last_changed 2026-02-20T16:28:50.658966+0000 2026-02-20T16:28:50.656 INFO:teuthology.orchestra.run.trial057.stdout:created 2026-02-20T16:28:50.658966+0000 2026-02-20T16:28:50.656 INFO:teuthology.orchestra.run.trial057.stdout:min_mon_release 17 (quincy) 2026-02-20T16:28:50.656 INFO:teuthology.orchestra.run.trial057.stdout:election_strategy: 1 2026-02-20T16:28:50.656 INFO:teuthology.orchestra.run.trial057.stdout:0: [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] mon.a 2026-02-20T16:28:50.656 INFO:teuthology.orchestra.run.trial057.stdout:1: [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] mon.b 2026-02-20T16:28:50.656 INFO:teuthology.orchestra.run.trial057.stdout:2: [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] mon.c 2026-02-20T16:28:50.656 INFO:teuthology.orchestra.run.trial057.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2026-02-20T16:28:50.658 DEBUG:teuthology.orchestra.run.trial057:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-20T16:28:50.716 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 3b3c5c1a-0a2b-40b9-ac1d-921ada466f9e... 2026-02-20T16:28:50.717 DEBUG:teuthology.orchestra.run.trial057:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-20T16:28:50.795 INFO:teuthology.orchestra.run.trial057.stdout:[global] 2026-02-20T16:28:50.796 INFO:teuthology.orchestra.run.trial057.stdout: chdir = "" 2026-02-20T16:28:50.796 INFO:teuthology.orchestra.run.trial057.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-20T16:28:50.796 INFO:teuthology.orchestra.run.trial057.stdout: auth supported = cephx 2026-02-20T16:28:50.796 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:50.796 INFO:teuthology.orchestra.run.trial057.stdout: filestore xattr use omap = true 2026-02-20T16:28:50.796 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:50.796 INFO:teuthology.orchestra.run.trial057.stdout: mon clock drift allowed = 1.000 2026-02-20T16:28:50.796 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:50.797 INFO:teuthology.orchestra.run.trial057.stdout: osd crush chooseleaf type = 0 2026-02-20T16:28:50.797 INFO:teuthology.orchestra.run.trial057.stdout: auth debug = true 2026-02-20T16:28:50.797 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:50.797 INFO:teuthology.orchestra.run.trial057.stdout: ms die on old message = true 2026-02-20T16:28:50.797 INFO:teuthology.orchestra.run.trial057.stdout: ms die on bug = true 2026-02-20T16:28:50.797 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:50.797 INFO:teuthology.orchestra.run.trial057.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-20T16:28:50.797 INFO:teuthology.orchestra.run.trial057.stdout: mon pg warn max object skew = 0 2026-02-20T16:28:50.797 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:50.797 INFO:teuthology.orchestra.run.trial057.stdout: # disable pg_autoscaler by default for new pools 2026-02-20T16:28:50.797 INFO:teuthology.orchestra.run.trial057.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-20T16:28:50.798 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:50.798 INFO:teuthology.orchestra.run.trial057.stdout: osd pool default size = 2 2026-02-20T16:28:50.798 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:50.798 INFO:teuthology.orchestra.run.trial057.stdout: mon osd allow primary affinity = true 2026-02-20T16:28:50.798 INFO:teuthology.orchestra.run.trial057.stdout: mon osd allow pg remap = true 2026-02-20T16:28:50.798 INFO:teuthology.orchestra.run.trial057.stdout: mon warn on legacy crush tunables = false 2026-02-20T16:28:50.798 INFO:teuthology.orchestra.run.trial057.stdout: mon warn on crush straw calc version zero = false 2026-02-20T16:28:50.798 INFO:teuthology.orchestra.run.trial057.stdout: mon warn on no sortbitwise = false 2026-02-20T16:28:50.798 INFO:teuthology.orchestra.run.trial057.stdout: mon warn on osd down out interval zero = false 2026-02-20T16:28:50.798 INFO:teuthology.orchestra.run.trial057.stdout: mon warn on too few osds = false 2026-02-20T16:28:50.798 INFO:teuthology.orchestra.run.trial057.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-20T16:28:50.798 INFO:teuthology.orchestra.run.trial057.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-20T16:28:50.798 INFO:teuthology.orchestra.run.trial057.stdout: mon_allow_pool_size_one = true 2026-02-20T16:28:50.799 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:50.799 INFO:teuthology.orchestra.run.trial057.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-20T16:28:50.799 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:50.799 INFO:teuthology.orchestra.run.trial057.stdout: osd default data pool replay window = 5 2026-02-20T16:28:50.799 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:50.799 INFO:teuthology.orchestra.run.trial057.stdout: mon allow pool delete = true 2026-02-20T16:28:50.799 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:50.799 INFO:teuthology.orchestra.run.trial057.stdout: mon cluster log file level = debug 2026-02-20T16:28:50.799 INFO:teuthology.orchestra.run.trial057.stdout: debug asserts on shutdown = true 2026-02-20T16:28:50.799 INFO:teuthology.orchestra.run.trial057.stdout: mon health detail to clog = false 2026-02-20T16:28:50.799 INFO:teuthology.orchestra.run.trial057.stdout: mon host = "10.20.193.57,[v2:10.20.193.57:3301,v1:10.20.193.57:6790],[v2:10.20.193.57:3302,v1:10.20.193.57:6791]" 2026-02-20T16:28:50.799 INFO:teuthology.orchestra.run.trial057.stdout: mon warn on pool no app = False 2026-02-20T16:28:50.800 INFO:teuthology.orchestra.run.trial057.stdout: ms bind msgr2 = False 2026-02-20T16:28:50.800 INFO:teuthology.orchestra.run.trial057.stdout: bluestore warn on legacy statfs = False 2026-02-20T16:28:50.800 INFO:teuthology.orchestra.run.trial057.stdout: bluestore warn on no per pool omap = False 2026-02-20T16:28:50.800 INFO:teuthology.orchestra.run.trial057.stdout: mon pg warn min per osd = 0 2026-02-20T16:28:50.800 INFO:teuthology.orchestra.run.trial057.stdout: fsid = 3b3c5c1a-0a2b-40b9-ac1d-921ada466f9e 2026-02-20T16:28:50.800 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:50.800 INFO:teuthology.orchestra.run.trial057.stdout:[osd] 2026-02-20T16:28:50.800 INFO:teuthology.orchestra.run.trial057.stdout: osd journal size = 100 2026-02-20T16:28:50.800 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:50.800 INFO:teuthology.orchestra.run.trial057.stdout: osd scrub load threshold = 5.0 2026-02-20T16:28:50.800 INFO:teuthology.orchestra.run.trial057.stdout: osd scrub max interval = 600 2026-02-20T16:28:50.800 INFO:teuthology.orchestra.run.trial057.stdout: osd mclock profile = high_recovery_ops 2026-02-20T16:28:50.801 INFO:teuthology.orchestra.run.trial057.stdout: osd mclock skip benchmark = true 2026-02-20T16:28:50.801 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:50.801 INFO:teuthology.orchestra.run.trial057.stdout: osd recover clone overlap = true 2026-02-20T16:28:50.801 INFO:teuthology.orchestra.run.trial057.stdout: osd recovery max chunk = 1048576 2026-02-20T16:28:50.801 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:50.801 INFO:teuthology.orchestra.run.trial057.stdout: osd debug shutdown = true 2026-02-20T16:28:50.801 INFO:teuthology.orchestra.run.trial057.stdout: osd debug op order = true 2026-02-20T16:28:50.801 INFO:teuthology.orchestra.run.trial057.stdout: osd debug verify stray on activate = true 2026-02-20T16:28:50.801 INFO:teuthology.orchestra.run.trial057.stdout: osd debug trim objects = true 2026-02-20T16:28:50.801 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:50.801 INFO:teuthology.orchestra.run.trial057.stdout: osd open classes on start = true 2026-02-20T16:28:50.801 INFO:teuthology.orchestra.run.trial057.stdout: osd debug pg log writeout = true 2026-02-20T16:28:50.802 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:50.802 INFO:teuthology.orchestra.run.trial057.stdout: osd deep scrub update digest min age = 30 2026-02-20T16:28:50.802 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:50.802 INFO:teuthology.orchestra.run.trial057.stdout: osd map max advance = 10 2026-02-20T16:28:50.802 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:50.802 INFO:teuthology.orchestra.run.trial057.stdout: journal zero on create = true 2026-02-20T16:28:50.802 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:50.802 INFO:teuthology.orchestra.run.trial057.stdout: filestore ondisk finisher threads = 3 2026-02-20T16:28:50.802 INFO:teuthology.orchestra.run.trial057.stdout: filestore apply finisher threads = 3 2026-02-20T16:28:50.802 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:50.802 INFO:teuthology.orchestra.run.trial057.stdout: bdev debug aio = true 2026-02-20T16:28:50.802 INFO:teuthology.orchestra.run.trial057.stdout: osd debug misdirected ops = true 2026-02-20T16:28:50.802 INFO:teuthology.orchestra.run.trial057.stdout: bdev async discard = True 2026-02-20T16:28:50.803 INFO:teuthology.orchestra.run.trial057.stdout: bdev enable discard = True 2026-02-20T16:28:50.803 INFO:teuthology.orchestra.run.trial057.stdout: bluestore allocator = bitmap 2026-02-20T16:28:50.803 INFO:teuthology.orchestra.run.trial057.stdout: bluestore block size = 96636764160 2026-02-20T16:28:50.803 INFO:teuthology.orchestra.run.trial057.stdout: bluestore fsck on mount = True 2026-02-20T16:28:50.803 INFO:teuthology.orchestra.run.trial057.stdout: debug bluefs = 1/20 2026-02-20T16:28:50.803 INFO:teuthology.orchestra.run.trial057.stdout: debug bluestore = 1/20 2026-02-20T16:28:50.803 INFO:teuthology.orchestra.run.trial057.stdout: debug ms = 1 2026-02-20T16:28:50.803 INFO:teuthology.orchestra.run.trial057.stdout: debug osd = 20 2026-02-20T16:28:50.803 INFO:teuthology.orchestra.run.trial057.stdout: debug rocksdb = 4/10 2026-02-20T16:28:50.803 INFO:teuthology.orchestra.run.trial057.stdout: mon osd backfillfull_ratio = 0.85 2026-02-20T16:28:50.803 INFO:teuthology.orchestra.run.trial057.stdout: mon osd full ratio = 0.9 2026-02-20T16:28:50.803 INFO:teuthology.orchestra.run.trial057.stdout: mon osd nearfull ratio = 0.8 2026-02-20T16:28:50.803 INFO:teuthology.orchestra.run.trial057.stdout: osd failsafe full ratio = 0.95 2026-02-20T16:28:50.804 INFO:teuthology.orchestra.run.trial057.stdout: osd objectstore = bluestore 2026-02-20T16:28:50.804 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:50.804 INFO:teuthology.orchestra.run.trial057.stdout:[mgr] 2026-02-20T16:28:50.804 INFO:teuthology.orchestra.run.trial057.stdout: debug ms = 1 2026-02-20T16:28:50.804 INFO:teuthology.orchestra.run.trial057.stdout: debug mgr = 20 2026-02-20T16:28:50.804 INFO:teuthology.orchestra.run.trial057.stdout: debug mon = 20 2026-02-20T16:28:50.804 INFO:teuthology.orchestra.run.trial057.stdout: debug auth = 20 2026-02-20T16:28:50.804 INFO:teuthology.orchestra.run.trial057.stdout: mon reweight min pgs per osd = 4 2026-02-20T16:28:50.804 INFO:teuthology.orchestra.run.trial057.stdout: mon reweight min bytes per osd = 10 2026-02-20T16:28:50.804 INFO:teuthology.orchestra.run.trial057.stdout: mgr/telemetry/nag = false 2026-02-20T16:28:50.804 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:50.804 INFO:teuthology.orchestra.run.trial057.stdout:[mon] 2026-02-20T16:28:50.805 INFO:teuthology.orchestra.run.trial057.stdout: debug ms = 1 2026-02-20T16:28:50.805 INFO:teuthology.orchestra.run.trial057.stdout: debug mon = 20 2026-02-20T16:28:50.805 INFO:teuthology.orchestra.run.trial057.stdout: debug paxos = 20 2026-02-20T16:28:50.805 INFO:teuthology.orchestra.run.trial057.stdout: debug auth = 20 2026-02-20T16:28:50.805 INFO:teuthology.orchestra.run.trial057.stdout: mon data avail warn = 5 2026-02-20T16:28:50.805 INFO:teuthology.orchestra.run.trial057.stdout: mon mgr mkfs grace = 240 2026-02-20T16:28:50.805 INFO:teuthology.orchestra.run.trial057.stdout: mon reweight min pgs per osd = 4 2026-02-20T16:28:50.805 INFO:teuthology.orchestra.run.trial057.stdout: mon osd reporter subtree level = osd 2026-02-20T16:28:50.805 INFO:teuthology.orchestra.run.trial057.stdout: mon osd prime pg temp = true 2026-02-20T16:28:50.805 INFO:teuthology.orchestra.run.trial057.stdout: mon reweight min bytes per osd = 10 2026-02-20T16:28:50.805 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:50.805 INFO:teuthology.orchestra.run.trial057.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-20T16:28:50.805 INFO:teuthology.orchestra.run.trial057.stdout: auth mon ticket ttl = 660 # 11m 2026-02-20T16:28:50.806 INFO:teuthology.orchestra.run.trial057.stdout: auth service ticket ttl = 240 # 4m 2026-02-20T16:28:50.806 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:50.806 INFO:teuthology.orchestra.run.trial057.stdout: # don't complain about insecure global_id in the test suite 2026-02-20T16:28:50.806 INFO:teuthology.orchestra.run.trial057.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-20T16:28:50.806 INFO:teuthology.orchestra.run.trial057.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-20T16:28:50.806 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:50.806 INFO:teuthology.orchestra.run.trial057.stdout: # 1m isn't quite enough 2026-02-20T16:28:50.806 INFO:teuthology.orchestra.run.trial057.stdout: mon_down_mkfs_grace = 2m 2026-02-20T16:28:50.806 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:50.806 INFO:teuthology.orchestra.run.trial057.stdout: mon_warn_on_filestore_osds = false 2026-02-20T16:28:50.806 INFO:teuthology.orchestra.run.trial057.stdout: mon down mkfs grace = 300 2026-02-20T16:28:50.806 INFO:teuthology.orchestra.run.trial057.stdout: mon warn on osd down out interval zero = False 2026-02-20T16:28:50.807 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:28:50.807 INFO:teuthology.orchestra.run.trial057.stdout:[client] 2026-02-20T16:28:50.807 INFO:teuthology.orchestra.run.trial057.stdout: rgw cache enabled = true 2026-02-20T16:28:50.807 INFO:teuthology.orchestra.run.trial057.stdout: rgw enable ops log = true 2026-02-20T16:28:50.807 INFO:teuthology.orchestra.run.trial057.stdout: rgw enable usage log = true 2026-02-20T16:28:50.807 INFO:teuthology.orchestra.run.trial057.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-20T16:28:50.807 INFO:teuthology.orchestra.run.trial057.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-20T16:28:50.807 INFO:teuthology.orchestra.run.trial057.stdout:[mon.a] 2026-02-20T16:28:50.807 INFO:teuthology.orchestra.run.trial057.stdout:[mon.b] 2026-02-20T16:28:50.807 INFO:teuthology.orchestra.run.trial057.stdout:[mon.c] 2026-02-20T16:28:50.808 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-20T16:28:50.809 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-20T16:28:50.891 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-20T16:28:50.891 DEBUG:teuthology.orchestra.run.trial057:> set -ex 2026-02-20T16:28:50.891 DEBUG:teuthology.orchestra.run.trial057:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-20T16:28:50.948 DEBUG:teuthology.orchestra.run.trial057:> set -ex 2026-02-20T16:28:50.949 DEBUG:teuthology.orchestra.run.trial057:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-20T16:28:51.005 INFO:tasks.ceph:Sending monmap to node ubuntu@trial057.front.sepia.ceph.com 2026-02-20T16:28:51.005 DEBUG:teuthology.orchestra.run.trial057:> set -ex 2026-02-20T16:28:51.005 DEBUG:teuthology.orchestra.run.trial057:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-20T16:28:51.005 DEBUG:teuthology.orchestra.run.trial057:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-20T16:28:51.078 DEBUG:teuthology.orchestra.run.trial057:> set -ex 2026-02-20T16:28:51.078 DEBUG:teuthology.orchestra.run.trial057:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-20T16:28:51.134 INFO:tasks.ceph:Setting up mon nodes... 2026-02-20T16:28:51.135 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-20T16:28:51.135 DEBUG:teuthology.orchestra.run.trial057:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-20T16:28:51.217 INFO:teuthology.orchestra.run.trial057.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-20T16:28:51.220 DEBUG:teuthology.orchestra.run.trial057:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2026-02-20T16:28:51.303 INFO:teuthology.orchestra.run.trial057.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2026-02-20T16:28:51.305 INFO:tasks.ceph:Setting up mds nodes... 2026-02-20T16:28:51.305 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-20T16:28:51.306 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-20T16:28:51.306 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial057.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2026-02-20T16:28:51.306 DEBUG:teuthology.orchestra.run.trial057:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-20T16:28:51.371 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-20T16:28:51.371 INFO:tasks.ceph:role: osd.0 2026-02-20T16:28:51.371 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial057.front.sepia.ceph.com 2026-02-20T16:28:51.371 DEBUG:teuthology.orchestra.run.trial057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-20T16:28:51.436 INFO:teuthology.orchestra.run.trial057.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-20T16:28:51.436 INFO:teuthology.orchestra.run.trial057.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-20T16:28:51.436 INFO:teuthology.orchestra.run.trial057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-20T16:28:51.436 INFO:teuthology.orchestra.run.trial057.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-20T16:28:51.436 INFO:teuthology.orchestra.run.trial057.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-20T16:28:51.436 INFO:teuthology.orchestra.run.trial057.stdout: = sunit=0 swidth=0 blks 2026-02-20T16:28:51.437 INFO:teuthology.orchestra.run.trial057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-20T16:28:51.437 INFO:teuthology.orchestra.run.trial057.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-20T16:28:51.437 INFO:teuthology.orchestra.run.trial057.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-20T16:28:51.437 INFO:teuthology.orchestra.run.trial057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-20T16:28:52.011 INFO:teuthology.orchestra.run.trial057.stdout:Discarding blocks...Done. 2026-02-20T16:28:52.013 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial057.front.sepia.ceph.com -o noatime 2026-02-20T16:28:52.013 DEBUG:teuthology.orchestra.run.trial057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-20T16:28:52.082 DEBUG:teuthology.orchestra.run.trial057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-20T16:28:52.150 DEBUG:teuthology.orchestra.run.trial057:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-20T16:28:52.214 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-20T16:28:52.215 INFO:tasks.ceph:role: osd.1 2026-02-20T16:28:52.215 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial057.front.sepia.ceph.com 2026-02-20T16:28:52.215 DEBUG:teuthology.orchestra.run.trial057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-20T16:28:52.280 INFO:teuthology.orchestra.run.trial057.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-20T16:28:52.280 INFO:teuthology.orchestra.run.trial057.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-20T16:28:52.280 INFO:teuthology.orchestra.run.trial057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-20T16:28:52.280 INFO:teuthology.orchestra.run.trial057.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-20T16:28:52.280 INFO:teuthology.orchestra.run.trial057.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-20T16:28:52.280 INFO:teuthology.orchestra.run.trial057.stdout: = sunit=0 swidth=0 blks 2026-02-20T16:28:52.280 INFO:teuthology.orchestra.run.trial057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-20T16:28:52.280 INFO:teuthology.orchestra.run.trial057.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-20T16:28:52.281 INFO:teuthology.orchestra.run.trial057.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-20T16:28:52.281 INFO:teuthology.orchestra.run.trial057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-20T16:28:52.839 INFO:teuthology.orchestra.run.trial057.stdout:Discarding blocks...Done. 2026-02-20T16:28:52.841 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial057.front.sepia.ceph.com -o noatime 2026-02-20T16:28:52.841 DEBUG:teuthology.orchestra.run.trial057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-20T16:28:52.909 DEBUG:teuthology.orchestra.run.trial057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-20T16:28:52.975 DEBUG:teuthology.orchestra.run.trial057:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-20T16:28:53.040 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-20T16:28:53.040 INFO:tasks.ceph:role: osd.2 2026-02-20T16:28:53.040 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial057.front.sepia.ceph.com 2026-02-20T16:28:53.040 DEBUG:teuthology.orchestra.run.trial057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-20T16:28:53.105 INFO:teuthology.orchestra.run.trial057.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-20T16:28:53.105 INFO:teuthology.orchestra.run.trial057.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-20T16:28:53.105 INFO:teuthology.orchestra.run.trial057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-20T16:28:53.105 INFO:teuthology.orchestra.run.trial057.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-20T16:28:53.105 INFO:teuthology.orchestra.run.trial057.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-20T16:28:53.105 INFO:teuthology.orchestra.run.trial057.stdout: = sunit=0 swidth=0 blks 2026-02-20T16:28:53.105 INFO:teuthology.orchestra.run.trial057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-20T16:28:53.106 INFO:teuthology.orchestra.run.trial057.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-20T16:28:53.106 INFO:teuthology.orchestra.run.trial057.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-20T16:28:53.106 INFO:teuthology.orchestra.run.trial057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-20T16:28:53.660 INFO:teuthology.orchestra.run.trial057.stdout:Discarding blocks...Done. 2026-02-20T16:28:53.663 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial057.front.sepia.ceph.com -o noatime 2026-02-20T16:28:53.663 DEBUG:teuthology.orchestra.run.trial057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2026-02-20T16:28:53.732 DEBUG:teuthology.orchestra.run.trial057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-20T16:28:53.799 DEBUG:teuthology.orchestra.run.trial057:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2026-02-20T16:28:53.863 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-20T16:28:53.864 INFO:tasks.ceph:role: osd.3 2026-02-20T16:28:53.864 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial057.front.sepia.ceph.com 2026-02-20T16:28:53.864 DEBUG:teuthology.orchestra.run.trial057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-20T16:28:53.928 INFO:teuthology.orchestra.run.trial057.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-20T16:28:53.928 INFO:teuthology.orchestra.run.trial057.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-20T16:28:53.928 INFO:teuthology.orchestra.run.trial057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-20T16:28:53.928 INFO:teuthology.orchestra.run.trial057.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-20T16:28:53.928 INFO:teuthology.orchestra.run.trial057.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-20T16:28:53.929 INFO:teuthology.orchestra.run.trial057.stdout: = sunit=0 swidth=0 blks 2026-02-20T16:28:53.929 INFO:teuthology.orchestra.run.trial057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-20T16:28:53.929 INFO:teuthology.orchestra.run.trial057.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-20T16:28:53.929 INFO:teuthology.orchestra.run.trial057.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-20T16:28:53.929 INFO:teuthology.orchestra.run.trial057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-20T16:28:54.483 INFO:teuthology.orchestra.run.trial057.stdout:Discarding blocks...Done. 2026-02-20T16:28:54.486 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial057.front.sepia.ceph.com -o noatime 2026-02-20T16:28:54.486 DEBUG:teuthology.orchestra.run.trial057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2026-02-20T16:28:54.554 DEBUG:teuthology.orchestra.run.trial057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2026-02-20T16:28:54.621 DEBUG:teuthology.orchestra.run.trial057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-20T16:28:54.702 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:28:54.703+0000 7f82887f9780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-20T16:28:54.702 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:28:54.703+0000 7f82887f9780 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-20T16:28:54.702 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:28:54.703+0000 7f82887f9780 -1 bdev(0x564b258a5800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2026-02-20T16:28:54.702 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:28:54.703+0000 7f82887f9780 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-20T16:28:58.587 DEBUG:teuthology.orchestra.run.trial057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-20T16:28:58.653 DEBUG:teuthology.orchestra.run.trial057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-20T16:28:58.732 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:28:58.733+0000 7f9949564780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-20T16:28:58.732 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:28:58.734+0000 7f9949564780 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-20T16:28:58.732 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:28:58.734+0000 7f9949564780 -1 bdev(0x55ff291c9800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2026-02-20T16:28:58.732 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:28:58.734+0000 7f9949564780 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-20T16:29:02.631 DEBUG:teuthology.orchestra.run.trial057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-20T16:29:02.696 DEBUG:teuthology.orchestra.run.trial057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-20T16:29:02.774 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:02.776+0000 7f3c377a3780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2026-02-20T16:29:02.775 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:02.776+0000 7f3c377a3780 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2026-02-20T16:29:02.775 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:02.777+0000 7f3c377a3780 -1 bdev(0x559509aed800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2026-02-20T16:29:02.775 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:02.777+0000 7f3c377a3780 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2026-02-20T16:29:06.669 DEBUG:teuthology.orchestra.run.trial057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-20T16:29:06.733 DEBUG:teuthology.orchestra.run.trial057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-20T16:29:06.811 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:06.811+0000 7fb088db4780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2026-02-20T16:29:06.811 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:06.811+0000 7fb088db4780 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2026-02-20T16:29:06.811 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:06.811+0000 7fb088db4780 -1 bdev(0x5558e35fb800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2026-02-20T16:29:06.812 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:06.812+0000 7fb088db4780 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2026-02-20T16:29:10.704 DEBUG:teuthology.orchestra.run.trial057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2026-02-20T16:29:10.770 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-20T16:29:10.770 DEBUG:teuthology.orchestra.run.trial057:> set -ex 2026-02-20T16:29:10.770 DEBUG:teuthology.orchestra.run.trial057:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-20T16:29:10.834 DEBUG:teuthology.orchestra.run.trial057:> set -ex 2026-02-20T16:29:10.834 DEBUG:teuthology.orchestra.run.trial057:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2026-02-20T16:29:10.898 DEBUG:teuthology.orchestra.run.trial057:> set -ex 2026-02-20T16:29:10.898 DEBUG:teuthology.orchestra.run.trial057:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-20T16:29:10.961 DEBUG:teuthology.orchestra.run.trial057:> set -ex 2026-02-20T16:29:10.961 DEBUG:teuthology.orchestra.run.trial057:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-20T16:29:11.026 DEBUG:teuthology.orchestra.run.trial057:> set -ex 2026-02-20T16:29:11.026 DEBUG:teuthology.orchestra.run.trial057:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-20T16:29:11.090 DEBUG:teuthology.orchestra.run.trial057:> set -ex 2026-02-20T16:29:11.090 DEBUG:teuthology.orchestra.run.trial057:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2026-02-20T16:29:11.154 INFO:tasks.ceph:Adding keys to all mons... 2026-02-20T16:29:11.154 DEBUG:teuthology.orchestra.run.trial057:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-20T16:29:11.216 INFO:teuthology.orchestra.run.trial057.stdout:[mgr.x] 2026-02-20T16:29:11.216 INFO:teuthology.orchestra.run.trial057.stdout: key = AQDDi5hpvKAtDRAAfdVUMahXj7RO2+ERYNcteQ== 2026-02-20T16:29:11.216 INFO:teuthology.orchestra.run.trial057.stdout:[mgr.y] 2026-02-20T16:29:11.216 INFO:teuthology.orchestra.run.trial057.stdout: key = AQDDi5hpB0dMEhAA2yMqhTdD9ApAYghNIeFNPw== 2026-02-20T16:29:11.216 INFO:teuthology.orchestra.run.trial057.stdout:[osd.0] 2026-02-20T16:29:11.216 INFO:teuthology.orchestra.run.trial057.stdout: key = AQDGi5hpDA4DKhAAzxDTXkhf8Zt1yuFjX4IYqA== 2026-02-20T16:29:11.216 INFO:teuthology.orchestra.run.trial057.stdout:[osd.1] 2026-02-20T16:29:11.216 INFO:teuthology.orchestra.run.trial057.stdout: key = AQDKi5hpfOPIKxAAiMKiMGmfJk/uxDKLzkcMFw== 2026-02-20T16:29:11.216 INFO:teuthology.orchestra.run.trial057.stdout:[osd.2] 2026-02-20T16:29:11.217 INFO:teuthology.orchestra.run.trial057.stdout: key = AQDOi5hpNlJVLhAA5LBxgwNsnW0EYlTd2EjMMQ== 2026-02-20T16:29:11.217 INFO:teuthology.orchestra.run.trial057.stdout:[osd.3] 2026-02-20T16:29:11.217 INFO:teuthology.orchestra.run.trial057.stdout: key = AQDSi5hpqN55MBAAaJ8GXV0SVWDDaRjR70I+WA== 2026-02-20T16:29:11.218 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-20T16:29:11.297 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-20T16:29:11.378 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-20T16:29:11.457 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-20T16:29:11.535 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-20T16:29:11.616 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-20T16:29:11.697 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-20T16:29:11.697 DEBUG:teuthology.orchestra.run.trial057:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-20T16:29:11.762 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-20T16:29:11.844 DEBUG:teuthology.orchestra.run.trial057:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-20T16:29:11.908 DEBUG:teuthology.orchestra.run.trial057:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2026-02-20T16:29:11.972 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-20T16:29:12.053 DEBUG:teuthology.orchestra.run.trial057:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2026-02-20T16:29:12.118 DEBUG:teuthology.orchestra.run.trial057:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2026-02-20T16:29:12.183 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-20T16:29:12.265 DEBUG:teuthology.orchestra.run.trial057:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2026-02-20T16:29:12.330 DEBUG:teuthology.orchestra.run.trial057:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-20T16:29:12.387 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-20T16:29:12.387 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-20T16:29:12.388 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-20T16:29:12.429 INFO:tasks.ceph.mon.a:Started 2026-02-20T16:29:12.429 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-20T16:29:12.429 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-20T16:29:12.432 INFO:tasks.ceph.mon.b:Started 2026-02-20T16:29:12.432 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-20T16:29:12.432 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-20T16:29:12.434 INFO:tasks.ceph.mon.c:Started 2026-02-20T16:29:12.435 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-20T16:29:12.435 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-20T16:29:12.435 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-20T16:29:12.439 INFO:tasks.ceph.mgr.x:Started 2026-02-20T16:29:12.439 INFO:tasks.ceph.mgr.y:Restarting daemon 2026-02-20T16:29:12.440 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2026-02-20T16:29:12.442 INFO:tasks.ceph.mgr.y:Started 2026-02-20T16:29:12.443 INFO:tasks.ceph:setting config [client] client_mount_timeout = 600 2026-02-20T16:29:12.443 DEBUG:teuthology.orchestra.run.trial057:> sudo ceph --cluster ceph config set client client_mount_timeout 600 2026-02-20T16:29:12.446 INFO:tasks.ceph:setting config [client] debug_client = 20 2026-02-20T16:29:12.446 DEBUG:teuthology.orchestra.run.trial057:> sudo ceph --cluster ceph config set client debug_client 20 2026-02-20T16:29:12.490 INFO:tasks.ceph:setting config [client] debug_ms = 1 2026-02-20T16:29:12.490 DEBUG:teuthology.orchestra.run.trial057:> sudo ceph --cluster ceph config set client debug_ms 1 2026-02-20T16:29:12.532 INFO:tasks.ceph:setting config [client] rados_mon_op_timeout = 900 2026-02-20T16:29:12.533 DEBUG:teuthology.orchestra.run.trial057:> sudo ceph --cluster ceph config set client rados_mon_op_timeout 900 2026-02-20T16:29:12.576 INFO:tasks.ceph:setting config [client] rados_osd_op_timeout = 900 2026-02-20T16:29:12.577 DEBUG:teuthology.orchestra.run.trial057:> sudo ceph --cluster ceph config set client rados_osd_op_timeout 900 2026-02-20T16:29:12.621 INFO:tasks.ceph:setting config [mds] debug_mds = 20 2026-02-20T16:29:12.621 DEBUG:teuthology.orchestra.run.trial057:> sudo ceph --cluster ceph config set mds debug_mds 20 2026-02-20T16:29:12.665 INFO:tasks.ceph:setting config [mds] debug_mds_balancer = 20 2026-02-20T16:29:12.665 DEBUG:teuthology.orchestra.run.trial057:> sudo ceph --cluster ceph config set mds debug_mds_balancer 20 2026-02-20T16:29:12.709 INFO:tasks.ceph:setting config [mds] debug_ms = 2 2026-02-20T16:29:12.709 DEBUG:teuthology.orchestra.run.trial057:> sudo ceph --cluster ceph config set mds debug_ms 2 2026-02-20T16:29:12.751 INFO:tasks.ceph:setting config [mds] mds_debug_frag = True 2026-02-20T16:29:12.752 DEBUG:teuthology.orchestra.run.trial057:> sudo ceph --cluster ceph config set mds mds_debug_frag True 2026-02-20T16:29:12.795 INFO:tasks.ceph:setting config [mds] mds_debug_scatterstat = True 2026-02-20T16:29:12.796 DEBUG:teuthology.orchestra.run.trial057:> sudo ceph --cluster ceph config set mds mds_debug_scatterstat True 2026-02-20T16:29:12.838 INFO:tasks.ceph:setting config [mds] mds_op_complaint_time = 180 2026-02-20T16:29:12.839 DEBUG:teuthology.orchestra.run.trial057:> sudo ceph --cluster ceph config set mds mds_op_complaint_time 180 2026-02-20T16:29:12.882 INFO:tasks.ceph:setting config [mds] mds_verify_scatter = True 2026-02-20T16:29:12.882 DEBUG:teuthology.orchestra.run.trial057:> sudo ceph --cluster ceph config set mds mds_verify_scatter True 2026-02-20T16:29:12.924 INFO:tasks.ceph:setting config [mds] osd_op_complaint_time = 180 2026-02-20T16:29:12.925 DEBUG:teuthology.orchestra.run.trial057:> sudo ceph --cluster ceph config set mds osd_op_complaint_time 180 2026-02-20T16:29:12.967 INFO:tasks.ceph:setting config [mds] rados_mon_op_timeout = 900 2026-02-20T16:29:12.968 DEBUG:teuthology.orchestra.run.trial057:> sudo ceph --cluster ceph config set mds rados_mon_op_timeout 900 2026-02-20T16:29:13.010 INFO:tasks.ceph:setting config [mds] rados_osd_op_timeout = 900 2026-02-20T16:29:13.010 DEBUG:teuthology.orchestra.run.trial057:> sudo ceph --cluster ceph config set mds rados_osd_op_timeout 900 2026-02-20T16:29:13.054 INFO:tasks.ceph:setting config [mgr] client_mount_timeout = 30 2026-02-20T16:29:13.054 DEBUG:teuthology.orchestra.run.trial057:> sudo ceph --cluster ceph config set mgr client_mount_timeout 30 2026-02-20T16:29:13.096 INFO:tasks.ceph:setting config [mgr] debug_client = 20 2026-02-20T16:29:13.097 DEBUG:teuthology.orchestra.run.trial057:> sudo ceph --cluster ceph config set mgr debug_client 20 2026-02-20T16:29:13.139 INFO:tasks.ceph:setting config [mgr] debug_mgr = 20 2026-02-20T16:29:13.140 DEBUG:teuthology.orchestra.run.trial057:> sudo ceph --cluster ceph config set mgr debug_mgr 20 2026-02-20T16:29:13.183 INFO:tasks.ceph:setting config [mgr] debug_ms = 1 2026-02-20T16:29:13.184 DEBUG:teuthology.orchestra.run.trial057:> sudo ceph --cluster ceph config set mgr debug_ms 1 2026-02-20T16:29:13.228 INFO:tasks.ceph:setting config [mgr] mon_warn_on_pool_no_app = False 2026-02-20T16:29:13.228 DEBUG:teuthology.orchestra.run.trial057:> sudo ceph --cluster ceph config set mgr mon_warn_on_pool_no_app False 2026-02-20T16:29:13.270 INFO:tasks.ceph:setting config [mon] mon_op_complaint_time = 120 2026-02-20T16:29:13.271 DEBUG:teuthology.orchestra.run.trial057:> sudo ceph --cluster ceph config set mon mon_op_complaint_time 120 2026-02-20T16:29:13.313 INFO:tasks.ceph:setting config [osd] osd_op_complaint_time = 180 2026-02-20T16:29:13.314 DEBUG:teuthology.orchestra.run.trial057:> sudo ceph --cluster ceph config set osd osd_op_complaint_time 180 2026-02-20T16:29:13.358 DEBUG:tasks.ceph:set 22 configs 2026-02-20T16:29:13.358 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='trial057') 2026-02-20T16:29:22.552 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.550+0000 7fddd67fc640 1 -- 10.20.193.57:0/121159187 <== mon.1 v2:10.20.193.57:3301/0 8 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v7)=0 v7) ==== 109+0+0 (secure 0 0 0) 0x7fdddc025730 con 0x7fdde8090540 2026-02-20T16:29:22.553 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.551+0000 7fddefea0640 1 -- 10.20.193.57:0/121159187 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fdde8090540 msgr2=0x7fdde8090920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:22.553 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.551+0000 7fddefea0640 1 --2- 10.20.193.57:0/121159187 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fdde8090540 0x7fdde8090920 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdddc012770 tx=0x7fdddc012c40 comp rx=0 tx=0).stop 2026-02-20T16:29:22.553 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.551+0000 7fddefea0640 1 -- 10.20.193.57:0/121159187 shutdown_connections 2026-02-20T16:29:22.553 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.551+0000 7fddefea0640 1 --2- 10.20.193.57:0/121159187 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fdde81c9aa0 0x7fdde81c9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.553 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.551+0000 7fddefea0640 1 --2- 10.20.193.57:0/121159187 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fdde8090540 0x7fdde8090920 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.553 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.551+0000 7fddefea0640 1 --2- 10.20.193.57:0/121159187 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fdde80953e0 0x7fdde8090000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.553 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.551+0000 7fddefea0640 1 -- 10.20.193.57:0/121159187 >> 10.20.193.57:0/121159187 conn(0x7fdde809b4c0 msgr2=0x7fdde809b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:22.553 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.551+0000 7fddefea0640 1 -- 10.20.193.57:0/121159187 shutdown_connections 2026-02-20T16:29:22.553 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.551+0000 7fddefea0640 1 -- 10.20.193.57:0/121159187 wait complete. 2026-02-20T16:29:22.554 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.551+0000 7f681affd640 1 -- 10.20.193.57:0/2804534015 <== mon.2 v2:10.20.193.57:3302/0 8 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v8)=0 v8) ==== 108+0+0 (secure 0 0 0) 0x7f681c00f5c0 con 0x7f683408fc40 2026-02-20T16:29:22.554 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.552+0000 7f585d7fa640 1 -- 10.20.193.57:0/3160729835 <== mon.0 v2:10.20.193.57:3300/0 8 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v9)=0 v9) ==== 123+0+0 (secure 0 0 0) 0x7f586809c8f0 con 0x7f586808e320 2026-02-20T16:29:22.554 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.552+0000 7f585d7fa640 1 -- 10.20.193.57:0/3160729835 <== mon.0 v2:10.20.193.57:3300/0 9 ==== config(2 keys) ==== 54+0+0 (secure 0 0 0) 0x7f585001c790 con 0x7f586808e320 2026-02-20T16:29:22.554 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.552+0000 7f6838ffd640 1 -- 10.20.193.57:0/2804534015 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f683408fc40 msgr2=0x7f68341c6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:22.555 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.552+0000 7f6838ffd640 1 --2- 10.20.193.57:0/2804534015 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f683408fc40 0x7f68341c6120 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f681c002fd0 tx=0x7f681c012be0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.555 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.552+0000 7f6838ffd640 1 -- 10.20.193.57:0/2804534015 shutdown_connections 2026-02-20T16:29:22.555 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.552+0000 7f6838ffd640 1 --2- 10.20.193.57:0/2804534015 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f683408d0f0 0x7f683408d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.555 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.552+0000 7f6838ffd640 1 --2- 10.20.193.57:0/2804534015 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f683408fc40 0x7f68341c6120 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.555 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.552+0000 7f6838ffd640 1 --2- 10.20.193.57:0/2804534015 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f683406e390 0x7f68341c5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.555 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.552+0000 7f6838ffd640 1 -- 10.20.193.57:0/2804534015 >> 10.20.193.57:0/2804534015 conn(0x7f683409f340 msgr2=0x7f683409c410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:22.555 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.553+0000 7f6ee0ff9640 1 -- 10.20.193.57:0/3095421812 <== mon.1 v2:10.20.193.57:3301/0 8 ==== config(2 keys) ==== 54+0+0 (secure 0 0 0) 0x7f6ed8022980 con 0x7f6ee4128590 2026-02-20T16:29:22.555 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.553+0000 7f6838ffd640 1 -- 10.20.193.57:0/2804534015 shutdown_connections 2026-02-20T16:29:22.555 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.553+0000 7f6838ffd640 1 -- 10.20.193.57:0/2804534015 wait complete. 2026-02-20T16:29:22.555 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.553+0000 7f586edfd640 1 -- 10.20.193.57:0/3160729835 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f586808e320 msgr2=0x7f58681c5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:22.555 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.553+0000 7f586edfd640 1 --2- 10.20.193.57:0/3160729835 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f586808e320 0x7f58681c5c20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5850012750 tx=0x7f5850012c20 comp rx=0 tx=0).stop 2026-02-20T16:29:22.555 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.553+0000 7f586edfd640 1 -- 10.20.193.57:0/3160729835 shutdown_connections 2026-02-20T16:29:22.555 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.553+0000 7f586edfd640 1 --2- 10.20.193.57:0/3160729835 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f58681c6160 0x7f58681c65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.555 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.553+0000 7f586edfd640 1 --2- 10.20.193.57:0/3160729835 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f586808e320 0x7f58681c5c20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.555 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.553+0000 7f586edfd640 1 --2- 10.20.193.57:0/3160729835 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f586808da00 0x7f586808dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.555 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.553+0000 7f586edfd640 1 -- 10.20.193.57:0/3160729835 >> 10.20.193.57:0/3160729835 conn(0x7f586809f340 msgr2=0x7f5868129770 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:22.555 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.553+0000 7f586edfd640 1 -- 10.20.193.57:0/3160729835 shutdown_connections 2026-02-20T16:29:22.555 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.554+0000 7f586edfd640 1 -- 10.20.193.57:0/3160729835 wait complete. 2026-02-20T16:29:22.564 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='trial057') 2026-02-20T16:29:22.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.569+0000 7f6eea628640 1 -- 10.20.193.57:0/3095421812 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f6ee4090990 con 0x7f6ee4128590 2026-02-20T16:29:22.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.571+0000 7f6ee0ff9640 1 -- 10.20.193.57:0/3095421812 <== mon.1 v2:10.20.193.57:3301/0 9 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v10)=0 v10) ==== 125+0+0 (secure 0 0 0) 0x7f6ee4125ef0 con 0x7f6ee4128590 2026-02-20T16:29:22.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.572+0000 7f6eea628640 1 -- 10.20.193.57:0/3095421812 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f6ee4128590 msgr2=0x7f6ee408d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:22.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.572+0000 7f6eea628640 1 --2- 10.20.193.57:0/3095421812 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f6ee4128590 0x7f6ee408d0d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6ed80097b0 tx=0x7f6ed801a810 comp rx=0 tx=0).stop 2026-02-20T16:29:22.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.572+0000 7f6eea628640 1 -- 10.20.193.57:0/3095421812 shutdown_connections 2026-02-20T16:29:22.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.572+0000 7f6eea628640 1 --2- 10.20.193.57:0/3095421812 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f6ee4128590 0x7f6ee408d0d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.572+0000 7f6eea628640 1 --2- 10.20.193.57:0/3095421812 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f6ee4070e20 0x7f6ee41c3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.572+0000 7f6eea628640 1 --2- 10.20.193.57:0/3095421812 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f6ec00037b0 0x7f6ee41c3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.572+0000 7f6eea628640 1 -- 10.20.193.57:0/3095421812 >> 10.20.193.57:0/3095421812 conn(0x7f6ee409a000 msgr2=0x7f6ee4071c90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:22.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.572+0000 7f6eea628640 1 -- 10.20.193.57:0/3095421812 shutdown_connections 2026-02-20T16:29:22.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.572+0000 7f6eea628640 1 -- 10.20.193.57:0/3095421812 wait complete. 2026-02-20T16:29:22.593 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.591+0000 7f5ae2f6e640 1 -- 10.20.193.57:0/3546535703 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f5ac0003750 msgr2=0x7f5ac0005bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:22.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.591+0000 7f5ae2f6e640 1 --2- 10.20.193.57:0/3546535703 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f5ac0003750 0x7f5ac0005bc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5acc004370 tx=0x7f5acc0308c0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.591+0000 7f5ae2f6e640 1 -- 10.20.193.57:0/3546535703 shutdown_connections 2026-02-20T16:29:22.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.591+0000 7f5ae2f6e640 1 --2- 10.20.193.57:0/3546535703 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f5ac0003750 0x7f5ac0005bc0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.591+0000 7f5ae2f6e640 1 --2- 10.20.193.57:0/3546535703 >> v2:10.20.193.57:3300/0 conn(0x7f5adc06e390 0x7f5ac000e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.591+0000 7f5ae2f6e640 1 --2- 10.20.193.57:0/3546535703 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f5adc06ecb0 0x7f5ac0008510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.591+0000 7f5ae2f6e640 1 -- 10.20.193.57:0/3546535703 >> 10.20.193.57:0/3546535703 conn(0x7f5adc09f340 msgr2=0x7f5adc09f750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:22.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.591+0000 7f5ae2f6e640 1 -- 10.20.193.57:0/3546535703 shutdown_connections 2026-02-20T16:29:22.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.591+0000 7f5ae2f6e640 1 -- 10.20.193.57:0/3546535703 wait complete. 2026-02-20T16:29:22.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.592+0000 7f5ae2f6e640 1 Processor -- start 2026-02-20T16:29:22.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.592+0000 7f5ae2f6e640 1 -- start start 2026-02-20T16:29:22.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.592+0000 7f5ae2f6e640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f5ac0003750 0x7f5adc1310c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:22.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.592+0000 7f5ae2f6e640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f5adc06e390 0x7f5adc131600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:22.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.592+0000 7f5ae2f6e640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f5adc06ecb0 0x7f5adc131b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:22.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.592+0000 7f5ae2f6e640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f5adc06eae0 con 0x7f5adc06e390 2026-02-20T16:29:22.597 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.592+0000 7f5ae2f6e640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f5adc12ed90 con 0x7f5adc06ecb0 2026-02-20T16:29:22.597 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.592+0000 7f5ae2f6e640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f5adc12f4d0 con 0x7f5ac0003750 2026-02-20T16:29:22.597 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.592+0000 7f5ae0ce3640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f5ac0003750 0x7f5adc1310c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:22.597 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.592+0000 7f5ae14e4640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f5adc06ecb0 0x7f5adc131b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:22.597 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.592+0000 7f5ad3fff640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f5adc06e390 0x7f5adc131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:22.597 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.592+0000 7f5ae0ce3640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f5ac0003750 0x7f5adc1310c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3302/0 says I am v2:10.20.193.57:46592/0 (socket says 10.20.193.57:46592) 2026-02-20T16:29:22.597 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.592+0000 7f5ae0ce3640 1 -- 10.20.193.57:0/3117756529 learned_addr learned my addr 10.20.193.57:0/3117756529 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:29:22.597 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.592+0000 7f5ae14e4640 1 -- 10.20.193.57:0/3117756529 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f5ac0003750 msgr2=0x7f5adc1310c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:22.597 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.592+0000 7f5ae14e4640 1 --2- 10.20.193.57:0/3117756529 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f5ac0003750 0x7f5adc1310c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.597 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.592+0000 7f5ae14e4640 1 -- 10.20.193.57:0/3117756529 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f5adc06e390 msgr2=0x7f5adc131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:22.597 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.592+0000 7f5ae14e4640 1 --2- 10.20.193.57:0/3117756529 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f5adc06e390 0x7f5adc131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.597 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.592+0000 7f5ae14e4640 1 -- 10.20.193.57:0/3117756529 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5adc133160 con 0x7f5adc06ecb0 2026-02-20T16:29:22.597 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.592+0000 7f5ae14e4640 1 --2- 10.20.193.57:0/3117756529 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f5adc06ecb0 0x7f5adc131b40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8006300 tx=0x7f5ad8006700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:29:22.597 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.592+0000 7f5ad17fa640 1 -- 10.20.193.57:0/3117756529 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad80129f0 con 0x7f5adc06ecb0 2026-02-20T16:29:22.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.592+0000 7f5ad17fa640 1 -- 10.20.193.57:0/3117756529 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(2 keys) ==== 54+0+0 (secure 0 0 0) 0x7f5ad8012b90 con 0x7f5adc06ecb0 2026-02-20T16:29:22.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.592+0000 7f5ae2f6e640 1 -- 10.20.193.57:0/3117756529 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5adc133b40 con 0x7f5adc06ecb0 2026-02-20T16:29:22.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.592+0000 7f5ad17fa640 1 -- 10.20.193.57:0/3117756529 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad8004070 con 0x7f5adc06ecb0 2026-02-20T16:29:22.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.592+0000 7f5ae2f6e640 1 -- 10.20.193.57:0/3117756529 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5adc1c6280 con 0x7f5adc06ecb0 2026-02-20T16:29:22.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.592+0000 7f5ad17fa640 1 -- 10.20.193.57:0/3117756529 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f5ad8025030 con 0x7f5adc06ecb0 2026-02-20T16:29:22.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.592+0000 7f5ad17fa640 1 -- 10.20.193.57:0/3117756529 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7f5ad801dba0 con 0x7f5adc06ecb0 2026-02-20T16:29:22.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.593+0000 7f5ae2f6e640 1 -- 10.20.193.57:0/3117756529 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5adc098f70 con 0x7f5adc06ecb0 2026-02-20T16:29:22.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.594+0000 7f5ad17fa640 1 -- 10.20.193.57:0/3117756529 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f5ad801dda0 con 0x7f5adc06ecb0 2026-02-20T16:29:22.624 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.621+0000 7faab4505640 1 -- 10.20.193.57:0/3866247630 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7faaac070e20 msgr2=0x7faa8c00c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:22.624 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.621+0000 7faab4505640 1 --2- 10.20.193.57:0/3866247630 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7faaac070e20 0x7faa8c00c620 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7faa9c004ec0 tx=0x7faa9c030ce0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.624 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.621+0000 7faab4505640 1 -- 10.20.193.57:0/3866247630 shutdown_connections 2026-02-20T16:29:22.624 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.621+0000 7faab4505640 1 --2- 10.20.193.57:0/3866247630 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7faaac070e20 0x7faa8c00c620 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.624 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.621+0000 7faab4505640 1 --2- 10.20.193.57:0/3866247630 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7faa8c003750 0x7faa8c00c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.624 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.621+0000 7faab4505640 1 --2- 10.20.193.57:0/3866247630 >> v2:10.20.193.57:3300/0 conn(0x7faaac130f50 0x7faa8c00bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.624 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.621+0000 7faab4505640 1 -- 10.20.193.57:0/3866247630 >> 10.20.193.57:0/3866247630 conn(0x7faaac09a000 msgr2=0x7faaac0977c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:22.624 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.621+0000 7faab4505640 1 -- 10.20.193.57:0/3866247630 shutdown_connections 2026-02-20T16:29:22.624 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.621+0000 7faab4505640 1 -- 10.20.193.57:0/3866247630 wait complete. 2026-02-20T16:29:22.625 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.621+0000 7f5ae2f6e640 1 -- 10.20.193.57:0/3117756529 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f5adc1338e0 con 0x7f5adc06ecb0 2026-02-20T16:29:22.627 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.622+0000 7faab4505640 1 Processor -- start 2026-02-20T16:29:22.627 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.622+0000 7faab4505640 1 -- start start 2026-02-20T16:29:22.627 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.622+0000 7faab4505640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7faa8c003750 0x7faaac08c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:22.627 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.622+0000 7faab4505640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7faaac070e20 0x7faaac08ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:22.627 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.622+0000 7faab4505640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7faaac128590 0x7faaac1c6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:22.627 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.622+0000 7faab4505640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7faaac12bb70 con 0x7faa8c003750 2026-02-20T16:29:22.627 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.622+0000 7faab4505640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7faaac12b9f0 con 0x7faaac128590 2026-02-20T16:29:22.627 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.622+0000 7faab4505640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7faaac12bcf0 con 0x7faaac070e20 2026-02-20T16:29:22.628 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.622+0000 7faab1a79640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7faaac070e20 0x7faaac08ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:22.628 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.622+0000 7faab227a640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7faa8c003750 0x7faaac08c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:22.628 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.622+0000 7faab2a7b640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7faaac128590 0x7faaac1c6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:22.628 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.622+0000 7faab1a79640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7faaac070e20 0x7faaac08ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3302/0 says I am v2:10.20.193.57:46598/0 (socket says 10.20.193.57:46598) 2026-02-20T16:29:22.628 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.622+0000 7faab1a79640 1 -- 10.20.193.57:0/1836909484 learned_addr learned my addr 10.20.193.57:0/1836909484 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:29:22.628 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.622+0000 7faab227a640 1 -- 10.20.193.57:0/1836909484 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7faaac070e20 msgr2=0x7faaac08ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:22.628 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.622+0000 7faab227a640 1 --2- 10.20.193.57:0/1836909484 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7faaac070e20 0x7faaac08ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.628 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.622+0000 7faab227a640 1 -- 10.20.193.57:0/1836909484 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7faaac128590 msgr2=0x7faaac1c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:22.628 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.622+0000 7faab227a640 1 --2- 10.20.193.57:0/1836909484 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7faaac128590 0x7faaac1c6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.628 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.622+0000 7faab227a640 1 -- 10.20.193.57:0/1836909484 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaac125130 con 0x7faa8c003750 2026-02-20T16:29:22.628 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.622+0000 7faab227a640 1 --2- 10.20.193.57:0/1836909484 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7faa8c003750 0x7faaac08c8f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7faa9c039000 tx=0x7faa9c0029a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:29:22.629 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.623+0000 7faa92ffd640 1 -- 10.20.193.57:0/1836909484 <== mon.0 v2:10.20.193.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa9c03a030 con 0x7faa8c003750 2026-02-20T16:29:22.629 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.623+0000 7faa92ffd640 1 -- 10.20.193.57:0/1836909484 <== mon.0 v2:10.20.193.57:3300/0 2 ==== config(2 keys) ==== 54+0+0 (secure 0 0 0) 0x7faa9c003920 con 0x7faa8c003750 2026-02-20T16:29:22.629 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.623+0000 7faab4505640 1 -- 10.20.193.57:0/1836909484 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaac08c4a0 con 0x7faa8c003750 2026-02-20T16:29:22.629 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.623+0000 7faa92ffd640 1 -- 10.20.193.57:0/1836909484 <== mon.0 v2:10.20.193.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa9c003d50 con 0x7faa8c003750 2026-02-20T16:29:22.629 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.623+0000 7f5ad17fa640 1 -- 10.20.193.57:0/3117756529 <== mon.1 v2:10.20.193.57:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v11)=0 v11) ==== 119+0+0 (secure 0 0 0) 0x7f5ad8004300 con 0x7f5adc06ecb0 2026-02-20T16:29:22.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.623+0000 7faab4505640 1 -- 10.20.193.57:0/1836909484 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaac08d370 con 0x7faa8c003750 2026-02-20T16:29:22.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.623+0000 7faa92ffd640 1 -- 10.20.193.57:0/1836909484 <== mon.0 v2:10.20.193.57:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7faa9c045070 con 0x7faa8c003750 2026-02-20T16:29:22.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.623+0000 7faa92ffd640 1 -- 10.20.193.57:0/1836909484 <== mon.0 v2:10.20.193.57:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7faa9c03ec80 con 0x7faa8c003750 2026-02-20T16:29:22.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.624+0000 7f5ae2f6e640 1 -- 10.20.193.57:0/3117756529 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f5adc06ecb0 msgr2=0x7f5adc131b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:22.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.624+0000 7f5ae2f6e640 1 --2- 10.20.193.57:0/3117756529 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f5adc06ecb0 0x7f5adc131b40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8006300 tx=0x7f5ad8006700 comp rx=0 tx=0).stop 2026-02-20T16:29:22.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.624+0000 7f5ae2f6e640 1 -- 10.20.193.57:0/3117756529 shutdown_connections 2026-02-20T16:29:22.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.624+0000 7f5ae2f6e640 1 --2- 10.20.193.57:0/3117756529 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f5adc06ecb0 0x7f5adc131b40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.624+0000 7f5ae2f6e640 1 --2- 10.20.193.57:0/3117756529 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f5adc06e390 0x7f5adc131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.624+0000 7f5ae2f6e640 1 --2- 10.20.193.57:0/3117756529 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f5ac0003750 0x7f5adc1310c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.624+0000 7f5ae2f6e640 1 -- 10.20.193.57:0/3117756529 >> 10.20.193.57:0/3117756529 conn(0x7f5adc09f340 msgr2=0x7f5adc129770 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:22.632 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.624+0000 7f5ae2f6e640 1 -- 10.20.193.57:0/3117756529 shutdown_connections 2026-02-20T16:29:22.632 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.624+0000 7f5ae2f6e640 1 -- 10.20.193.57:0/3117756529 wait complete. 2026-02-20T16:29:22.632 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.624+0000 7faab4505640 1 -- 10.20.193.57:0/1836909484 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaac09aff0 con 0x7faa8c003750 2026-02-20T16:29:22.632 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.625+0000 7faa92ffd640 1 -- 10.20.193.57:0/1836909484 <== mon.0 v2:10.20.193.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7faaac09aff0 con 0x7faa8c003750 2026-02-20T16:29:22.637 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.632+0000 7fcf6d213640 1 -- 10.20.193.57:0/48462689 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fcf6806ecb0 msgr2=0x7fcf4c00e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:22.637 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.632+0000 7fcf6d213640 1 --2- 10.20.193.57:0/48462689 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fcf6806ecb0 0x7fcf4c00e7a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c005f70 tx=0x7fcf5c030d90 comp rx=0 tx=0).stop 2026-02-20T16:29:22.637 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.632+0000 7fcf6d213640 1 -- 10.20.193.57:0/48462689 shutdown_connections 2026-02-20T16:29:22.637 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.632+0000 7fcf6d213640 1 --2- 10.20.193.57:0/48462689 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fcf6806ecb0 0x7fcf4c00e7a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.638 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.632+0000 7fcf6d213640 1 --2- 10.20.193.57:0/48462689 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fcf6812f080 0x7fcf4c007b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.638 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.632+0000 7fcf6d213640 1 --2- 10.20.193.57:0/48462689 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fcf6806e390 0x7fcf4c0075a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.638 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.632+0000 7fcf6d213640 1 -- 10.20.193.57:0/48462689 >> 10.20.193.57:0/48462689 conn(0x7fcf6809f340 msgr2=0x7fcf6809f750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:22.638 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.632+0000 7fcf6d213640 1 -- 10.20.193.57:0/48462689 shutdown_connections 2026-02-20T16:29:22.638 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.632+0000 7fcf6d213640 1 -- 10.20.193.57:0/48462689 wait complete. 2026-02-20T16:29:22.638 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.633+0000 7fcf6d213640 1 Processor -- start 2026-02-20T16:29:22.638 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.633+0000 7fcf6d213640 1 -- start start 2026-02-20T16:29:22.638 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.633+0000 7fcf6d213640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fcf4c003780 0x7fcf68127ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:22.638 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.633+0000 7fcf6d213640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fcf6806e390 0x7fcf68128530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:22.638 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.633+0000 7fcf6d213640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fcf6806ecb0 0x7fcf68128a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:22.638 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.633+0000 7fcf6d213640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6812ed00 con 0x7fcf6806e390 2026-02-20T16:29:22.638 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.633+0000 7fcf6d213640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7fcf6812eb80 con 0x7fcf6806ecb0 2026-02-20T16:29:22.639 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.633+0000 7fcf6d213640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7fcf6812ee80 con 0x7fcf4c003780 2026-02-20T16:29:22.639 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.633+0000 7fcf66d76640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fcf4c003780 0x7fcf68127ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:22.639 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.633+0000 7fcf66575640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fcf6806e390 0x7fcf68128530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:22.639 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.633+0000 7fcf66d76640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fcf4c003780 0x7fcf68127ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3302/0 says I am v2:10.20.193.57:46604/0 (socket says 10.20.193.57:46604) 2026-02-20T16:29:22.639 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.633+0000 7fcf66d76640 1 -- 10.20.193.57:0/2630822193 learned_addr learned my addr 10.20.193.57:0/2630822193 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:29:22.639 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.633+0000 7fcf66575640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fcf6806e390 0x7fcf68128530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:36758/0 (socket says 10.20.193.57:36758) 2026-02-20T16:29:22.639 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.633+0000 7fcf67577640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fcf6806ecb0 0x7fcf68128a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:22.639 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.633+0000 7fcf66d76640 1 -- 10.20.193.57:0/2630822193 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fcf6806ecb0 msgr2=0x7fcf68128a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:22.639 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.633+0000 7fcf66d76640 1 --2- 10.20.193.57:0/2630822193 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fcf6806ecb0 0x7fcf68128a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.639 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.633+0000 7fcf66d76640 1 -- 10.20.193.57:0/2630822193 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fcf6806e390 msgr2=0x7fcf68128530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:22.639 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.633+0000 7fcf66d76640 1 --2- 10.20.193.57:0/2630822193 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fcf6806e390 0x7fcf68128530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.639 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.633+0000 7fcf66d76640 1 -- 10.20.193.57:0/2630822193 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf680982f0 con 0x7fcf4c003780 2026-02-20T16:29:22.640 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.633+0000 7fcf67577640 1 --2- 10.20.193.57:0/2630822193 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fcf6806ecb0 0x7fcf68128a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:29:22.640 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.633+0000 7fcf66d76640 1 --2- 10.20.193.57:0/2630822193 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fcf4c003780 0x7fcf68127ff0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c0312c0 tx=0x7fcf5c004830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:29:22.640 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.633+0000 7fcf477fe640 1 -- 10.20.193.57:0/2630822193 <== mon.2 v2:10.20.193.57:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c0315d0 con 0x7fcf4c003780 2026-02-20T16:29:22.640 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.633+0000 7fcf477fe640 1 -- 10.20.193.57:0/2630822193 <== mon.2 v2:10.20.193.57:3302/0 2 ==== config(2 keys) ==== 54+0+0 (secure 0 0 0) 0x7fcf5c03cd60 con 0x7fcf4c003780 2026-02-20T16:29:22.640 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.633+0000 7fcf6d213640 1 -- 10.20.193.57:0/2630822193 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf6808d220 con 0x7fcf4c003780 2026-02-20T16:29:22.640 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.633+0000 7fcf477fe640 1 -- 10.20.193.57:0/2630822193 <== mon.2 v2:10.20.193.57:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c0048a0 con 0x7fcf4c003780 2026-02-20T16:29:22.640 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.633+0000 7fcf6d213640 1 -- 10.20.193.57:0/2630822193 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf6808d690 con 0x7fcf4c003780 2026-02-20T16:29:22.640 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.634+0000 7fcf477fe640 1 -- 10.20.193.57:0/2630822193 <== mon.2 v2:10.20.193.57:3302/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fcf5c044070 con 0x7fcf4c003780 2026-02-20T16:29:22.640 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.634+0000 7fcf477fe640 1 -- 10.20.193.57:0/2630822193 <== mon.2 v2:10.20.193.57:3302/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7fcf5c04e740 con 0x7fcf4c003780 2026-02-20T16:29:22.640 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.634+0000 7fcf6d213640 1 -- 10.20.193.57:0/2630822193 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf6806f1f0 con 0x7fcf4c003780 2026-02-20T16:29:22.640 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.635+0000 7fcf477fe640 1 -- 10.20.193.57:0/2630822193 <== mon.2 v2:10.20.193.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7fcf5c045d40 con 0x7fcf4c003780 2026-02-20T16:29:22.655 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.653+0000 7faab4505640 1 -- 10.20.193.57:0/1836909484 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7faaac12c150 con 0x7faa8c003750 2026-02-20T16:29:22.656 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.654+0000 7faa92ffd640 1 -- 10.20.193.57:0/1836909484 <== mon.0 v2:10.20.193.57:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v12)=0 v12) ==== 121+0+0 (secure 0 0 0) 0x7faa9c03e400 con 0x7faa8c003750 2026-02-20T16:29:22.657 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.654+0000 7faab4505640 1 -- 10.20.193.57:0/1836909484 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7faa8c003750 msgr2=0x7faaac08c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:22.657 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.654+0000 7faab4505640 1 --2- 10.20.193.57:0/1836909484 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7faa8c003750 0x7faaac08c8f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7faa9c039000 tx=0x7faa9c0029a0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.657 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.654+0000 7faab4505640 1 -- 10.20.193.57:0/1836909484 shutdown_connections 2026-02-20T16:29:22.657 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.654+0000 7faab4505640 1 --2- 10.20.193.57:0/1836909484 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7faaac128590 0x7faaac1c6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.657 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.655+0000 7faab4505640 1 --2- 10.20.193.57:0/1836909484 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7faaac070e20 0x7faaac08ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.657 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.655+0000 7faab4505640 1 --2- 10.20.193.57:0/1836909484 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7faa8c003750 0x7faaac08c8f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.658 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.655+0000 7faab4505640 1 -- 10.20.193.57:0/1836909484 >> 10.20.193.57:0/1836909484 conn(0x7faaac09a000 msgr2=0x7faaac1260d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:22.658 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.655+0000 7faab4505640 1 -- 10.20.193.57:0/1836909484 shutdown_connections 2026-02-20T16:29:22.658 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.655+0000 7faab4505640 1 -- 10.20.193.57:0/1836909484 wait complete. 2026-02-20T16:29:22.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.664+0000 7fcf6d213640 1 -- 10.20.193.57:0/2630822193 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fcf68050a10 con 0x7fcf4c003780 2026-02-20T16:29:22.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.665+0000 7fcf477fe640 1 -- 10.20.193.57:0/2630822193 <== mon.2 v2:10.20.193.57:3302/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v13)=0 v13) ==== 121+0+0 (secure 0 0 0) 0x7fcf5c04e940 con 0x7fcf4c003780 2026-02-20T16:29:22.668 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.666+0000 7fcf6d213640 1 -- 10.20.193.57:0/2630822193 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fcf4c003780 msgr2=0x7fcf68127ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:22.668 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.666+0000 7fcf6d213640 1 --2- 10.20.193.57:0/2630822193 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fcf4c003780 0x7fcf68127ff0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c0312c0 tx=0x7fcf5c004830 comp rx=0 tx=0).stop 2026-02-20T16:29:22.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.666+0000 7fcf6d213640 1 -- 10.20.193.57:0/2630822193 shutdown_connections 2026-02-20T16:29:22.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.666+0000 7fcf6d213640 1 --2- 10.20.193.57:0/2630822193 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fcf6806ecb0 0x7fcf68128a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.666+0000 7fcf6d213640 1 --2- 10.20.193.57:0/2630822193 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fcf6806e390 0x7fcf68128530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.666+0000 7fcf6d213640 1 --2- 10.20.193.57:0/2630822193 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fcf4c003780 0x7fcf68127ff0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.666+0000 7fcf6d213640 1 -- 10.20.193.57:0/2630822193 >> 10.20.193.57:0/2630822193 conn(0x7fcf6809f340 msgr2=0x7fcf68099510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:22.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.666+0000 7fcf6d213640 1 -- 10.20.193.57:0/2630822193 shutdown_connections 2026-02-20T16:29:22.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.666+0000 7fcf6d213640 1 -- 10.20.193.57:0/2630822193 wait complete. 2026-02-20T16:29:22.676 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.674+0000 7f2bfd681640 1 -- 10.20.193.57:0/4236128868 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f2bf8097030 msgr2=0x7f2bdc00e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:22.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.674+0000 7f2bfd681640 1 --2- 10.20.193.57:0/4236128868 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f2bf8097030 0x7f2bdc00e570 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2bec002950 tx=0x7f2bec030ba0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.674+0000 7f2bfd681640 1 -- 10.20.193.57:0/4236128868 shutdown_connections 2026-02-20T16:29:22.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.674+0000 7f2bfd681640 1 --2- 10.20.193.57:0/4236128868 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f2bf8097030 0x7f2bdc00e570 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.674+0000 7f2bfd681640 1 --2- 10.20.193.57:0/4236128868 >> v2:10.20.193.57:3300/0 conn(0x7f2bf8096710 0x7f2bdc00c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.674+0000 7f2bfd681640 1 --2- 10.20.193.57:0/4236128868 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f2bdc003770 0x7f2bdc009ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.674+0000 7f2bfd681640 1 -- 10.20.193.57:0/4236128868 >> 10.20.193.57:0/4236128868 conn(0x7f2bf809a000 msgr2=0x7f2bf80977c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:22.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.674+0000 7f2bfd681640 1 -- 10.20.193.57:0/4236128868 shutdown_connections 2026-02-20T16:29:22.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.674+0000 7f2bfd681640 1 -- 10.20.193.57:0/4236128868 wait complete. 2026-02-20T16:29:22.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.675+0000 7f2bfd681640 1 Processor -- start 2026-02-20T16:29:22.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.675+0000 7f2bfd681640 1 -- start start 2026-02-20T16:29:22.680 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.675+0000 7f2bfd681640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f2bdc003770 0x7f2bf81c6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:22.680 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.675+0000 7f2bfd681640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f2bf806e2f0 0x7f2bf81c6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:22.680 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.675+0000 7f2bfd681640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f2bf8096710 0x7f2bf8090380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:22.680 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.675+0000 7f2bfd681640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf8098ee0 con 0x7f2bdc003770 2026-02-20T16:29:22.680 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.675+0000 7f2bfd681640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f2bf8096db0 con 0x7f2bf806e2f0 2026-02-20T16:29:22.680 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.675+0000 7f2bfd681640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f2bf8099060 con 0x7f2bf8096710 2026-02-20T16:29:22.680 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.675+0000 7f2bf6ffd640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f2bdc003770 0x7f2bf81c6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:22.680 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.675+0000 7f2bf67fc640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f2bf806e2f0 0x7f2bf81c6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:22.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.675+0000 7f2bf77fe640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f2bf8096710 0x7f2bf8090380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:22.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.675+0000 7f2bf6ffd640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f2bdc003770 0x7f2bf81c6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:36770/0 (socket says 10.20.193.57:36770) 2026-02-20T16:29:22.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.675+0000 7f2bf6ffd640 1 -- 10.20.193.57:0/209503174 learned_addr learned my addr 10.20.193.57:0/209503174 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:29:22.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.675+0000 7f2bf67fc640 1 -- 10.20.193.57:0/209503174 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f2bf8096710 msgr2=0x7f2bf8090380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:22.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.675+0000 7f2bf67fc640 1 --2- 10.20.193.57:0/209503174 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f2bf8096710 0x7f2bf8090380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.675+0000 7f2bf67fc640 1 -- 10.20.193.57:0/209503174 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f2bdc003770 msgr2=0x7f2bf81c6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:22.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.675+0000 7f2bf67fc640 1 --2- 10.20.193.57:0/209503174 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f2bdc003770 0x7f2bf81c6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.675+0000 7f2bf67fc640 1 -- 10.20.193.57:0/209503174 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bf8091df0 con 0x7f2bf806e2f0 2026-02-20T16:29:22.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.675+0000 7f2bf67fc640 1 --2- 10.20.193.57:0/209503174 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f2bf806e2f0 0x7f2bf81c6a60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2be00126d0 tx=0x7f2be0012ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:29:22.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.675+0000 7f2bd77fe640 1 -- 10.20.193.57:0/209503174 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be0010bc0 con 0x7f2bf806e2f0 2026-02-20T16:29:22.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.675+0000 7f2bd77fe640 1 -- 10.20.193.57:0/209503174 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(2 keys) ==== 54+0+0 (secure 0 0 0) 0x7f2be0010d60 con 0x7f2bf806e2f0 2026-02-20T16:29:22.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.675+0000 7f2bfd681640 1 -- 10.20.193.57:0/209503174 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bf81c6fa0 con 0x7f2bf806e2f0 2026-02-20T16:29:22.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.675+0000 7f2bd77fe640 1 -- 10.20.193.57:0/209503174 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be0004b00 con 0x7f2bf806e2f0 2026-02-20T16:29:22.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.675+0000 7f2bfd681640 1 -- 10.20.193.57:0/209503174 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bf80930b0 con 0x7f2bf806e2f0 2026-02-20T16:29:22.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.675+0000 7f2bd77fe640 1 -- 10.20.193.57:0/209503174 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f2be0012ce0 con 0x7f2bf806e2f0 2026-02-20T16:29:22.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.675+0000 7f2bd77fe640 1 -- 10.20.193.57:0/209503174 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7f2be001bbf0 con 0x7f2bf806e2f0 2026-02-20T16:29:22.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.676+0000 7f2bfd681640 1 -- 10.20.193.57:0/209503174 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bf80994c0 con 0x7f2bf806e2f0 2026-02-20T16:29:22.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.677+0000 7f2bd77fe640 1 -- 10.20.193.57:0/209503174 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f2be001b410 con 0x7f2bf806e2f0 2026-02-20T16:29:22.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.704+0000 7f2bfd681640 1 -- 10.20.193.57:0/209503174 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f2bf8074840 con 0x7f2bf806e2f0 2026-02-20T16:29:22.708 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.706+0000 7f2bd77fe640 1 -- 10.20.193.57:0/209503174 <== mon.1 v2:10.20.193.57:3301/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v14)=0 v14) ==== 120+0+0 (secure 0 0 0) 0x7f2be00055e0 con 0x7f2bf806e2f0 2026-02-20T16:29:22.709 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.707+0000 7f2bfd681640 1 -- 10.20.193.57:0/209503174 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f2bf806e2f0 msgr2=0x7f2bf81c6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:22.709 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.707+0000 7f2bfd681640 1 --2- 10.20.193.57:0/209503174 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f2bf806e2f0 0x7f2bf81c6a60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2be00126d0 tx=0x7f2be0012ba0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.709 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.707+0000 7f2bfd681640 1 -- 10.20.193.57:0/209503174 shutdown_connections 2026-02-20T16:29:22.710 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.707+0000 7f2bfd681640 1 --2- 10.20.193.57:0/209503174 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f2bf8096710 0x7f2bf8090380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.710 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.707+0000 7f2bfd681640 1 --2- 10.20.193.57:0/209503174 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f2bf806e2f0 0x7f2bf81c6a60 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.710 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.707+0000 7f2bfd681640 1 --2- 10.20.193.57:0/209503174 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f2bdc003770 0x7f2bf81c6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.710 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.707+0000 7f2bfd681640 1 -- 10.20.193.57:0/209503174 >> 10.20.193.57:0/209503174 conn(0x7f2bf809a000 msgr2=0x7f2bf80713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:22.710 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.707+0000 7f2bfd681640 1 -- 10.20.193.57:0/209503174 shutdown_connections 2026-02-20T16:29:22.710 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.707+0000 7f2bfd681640 1 -- 10.20.193.57:0/209503174 wait complete. 2026-02-20T16:29:22.720 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.718+0000 7f91ad327640 1 -- 10.20.193.57:0/3103908338 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f91a812c8c0 msgr2=0x7f918c00e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:22.720 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.718+0000 7f91ad327640 1 --2- 10.20.193.57:0/3103908338 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f91a812c8c0 0x7f918c00e680 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f919c002950 tx=0x7f919c030bc0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.720 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.718+0000 7f91ad327640 1 -- 10.20.193.57:0/3103908338 shutdown_connections 2026-02-20T16:29:22.721 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.718+0000 7f91ad327640 1 --2- 10.20.193.57:0/3103908338 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f91a812c8c0 0x7f918c00e680 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.721 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.718+0000 7f91ad327640 1 --2- 10.20.193.57:0/3103908338 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f91a812d1e0 0x7f918c00c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.721 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.718+0000 7f91ad327640 1 --2- 10.20.193.57:0/3103908338 >> v2:10.20.193.57:3300/0 conn(0x7f918c0037d0 0x7f918c009be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.721 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.718+0000 7f91ad327640 1 -- 10.20.193.57:0/3103908338 >> 10.20.193.57:0/3103908338 conn(0x7f91a809f450 msgr2=0x7f91a809f860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:22.721 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.718+0000 7f91ad327640 1 -- 10.20.193.57:0/3103908338 shutdown_connections 2026-02-20T16:29:22.721 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.718+0000 7f91ad327640 1 -- 10.20.193.57:0/3103908338 wait complete. 2026-02-20T16:29:22.724 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.719+0000 7f91ad327640 1 Processor -- start 2026-02-20T16:29:22.724 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.719+0000 7f91ad327640 1 -- start start 2026-02-20T16:29:22.724 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.719+0000 7f91ad327640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f918c0037d0 0x7f91a806ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:22.724 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.719+0000 7f91ad327640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f91a8129900 0x7f91a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:22.724 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.719+0000 7f91ad327640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f91a812c8c0 0x7f91a806e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:22.724 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.719+0000 7f91ad327640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f91a8129580 con 0x7f918c0037d0 2026-02-20T16:29:22.724 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.719+0000 7f91ad327640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f91a8129400 con 0x7f91a8129900 2026-02-20T16:29:22.724 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.719+0000 7f91ad327640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f91a8129700 con 0x7f91a812c8c0 2026-02-20T16:29:22.724 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.719+0000 7f91a67fc640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f91a8129900 0x7f91a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:22.724 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.719+0000 7f91a6ffd640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f918c0037d0 0x7f91a806ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:22.725 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.719+0000 7f91a67fc640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f91a8129900 0x7f91a806e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3301/0 says I am v2:10.20.193.57:58502/0 (socket says 10.20.193.57:58502) 2026-02-20T16:29:22.725 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.719+0000 7f91a67fc640 1 -- 10.20.193.57:0/3288923031 learned_addr learned my addr 10.20.193.57:0/3288923031 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:29:22.725 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.719+0000 7f91a77fe640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f91a812c8c0 0x7f91a806e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:22.725 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.719+0000 7f91a67fc640 1 -- 10.20.193.57:0/3288923031 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f91a812c8c0 msgr2=0x7f91a806e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:22.725 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.719+0000 7f91a67fc640 1 --2- 10.20.193.57:0/3288923031 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f91a812c8c0 0x7f91a806e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.725 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.719+0000 7f91a67fc640 1 -- 10.20.193.57:0/3288923031 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f918c0037d0 msgr2=0x7f91a806ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:22.725 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.719+0000 7f91a67fc640 1 --2- 10.20.193.57:0/3288923031 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f918c0037d0 0x7f91a806ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.725 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.719+0000 7f91a67fc640 1 -- 10.20.193.57:0/3288923031 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91a8090eb0 con 0x7f91a8129900 2026-02-20T16:29:22.725 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.719+0000 7f91a77fe640 1 --2- 10.20.193.57:0/3288923031 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f91a812c8c0 0x7f91a806e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:29:22.725 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.719+0000 7f91a67fc640 1 --2- 10.20.193.57:0/3288923031 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f91a8129900 0x7f91a806e2f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9190002fd0 tx=0x7f9190012b70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:29:22.725 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.719+0000 7f91877fe640 1 -- 10.20.193.57:0/3288923031 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9190010bc0 con 0x7f91a8129900 2026-02-20T16:29:22.725 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.719+0000 7f91ad327640 1 -- 10.20.193.57:0/3288923031 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91a806fdd0 con 0x7f91a8129900 2026-02-20T16:29:22.726 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.719+0000 7f91877fe640 1 -- 10.20.193.57:0/3288923031 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(2 keys) ==== 54+0+0 (secure 0 0 0) 0x7f9190010d80 con 0x7f91a8129900 2026-02-20T16:29:22.726 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.719+0000 7f91877fe640 1 -- 10.20.193.57:0/3288923031 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9190004b00 con 0x7f91a8129900 2026-02-20T16:29:22.726 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.719+0000 7f91ad327640 1 -- 10.20.193.57:0/3288923031 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f91a81cc750 con 0x7f91a8129900 2026-02-20T16:29:22.726 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.719+0000 7f91877fe640 1 -- 10.20.193.57:0/3288923031 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f919001b410 con 0x7f91a8129900 2026-02-20T16:29:22.726 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.719+0000 7f91877fe640 1 -- 10.20.193.57:0/3288923031 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7f9190024ad0 con 0x7f91a8129900 2026-02-20T16:29:22.726 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.720+0000 7f91ad327640 1 -- 10.20.193.57:0/3288923031 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91a812a000 con 0x7f91a8129900 2026-02-20T16:29:22.726 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.721+0000 7f91877fe640 1 -- 10.20.193.57:0/3288923031 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f9190024cd0 con 0x7f91a8129900 2026-02-20T16:29:22.751 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.749+0000 7f91ad327640 1 -- 10.20.193.57:0/3288923031 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f91a8050a10 con 0x7f91a8129900 2026-02-20T16:29:22.752 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.750+0000 7f91877fe640 1 -- 10.20.193.57:0/3288923031 <== mon.1 v2:10.20.193.57:3301/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v15)=0 v15) ==== 120+0+0 (secure 0 0 0) 0x7f919001b960 con 0x7f91a8129900 2026-02-20T16:29:22.753 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.751+0000 7f91ad327640 1 -- 10.20.193.57:0/3288923031 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f91a8129900 msgr2=0x7f91a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:22.753 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.751+0000 7f91ad327640 1 --2- 10.20.193.57:0/3288923031 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f91a8129900 0x7f91a806e2f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9190002fd0 tx=0x7f9190012b70 comp rx=0 tx=0).stop 2026-02-20T16:29:22.754 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.751+0000 7f91ad327640 1 -- 10.20.193.57:0/3288923031 shutdown_connections 2026-02-20T16:29:22.754 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.751+0000 7f91ad327640 1 --2- 10.20.193.57:0/3288923031 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f91a812c8c0 0x7f91a806e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.754 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.751+0000 7f91ad327640 1 --2- 10.20.193.57:0/3288923031 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f91a8129900 0x7f91a806e2f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.754 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.751+0000 7f91ad327640 1 --2- 10.20.193.57:0/3288923031 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f918c0037d0 0x7f91a806ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.754 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.751+0000 7f91ad327640 1 -- 10.20.193.57:0/3288923031 >> 10.20.193.57:0/3288923031 conn(0x7f91a809f450 msgr2=0x7f91a81281c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:22.754 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.751+0000 7f91ad327640 1 -- 10.20.193.57:0/3288923031 shutdown_connections 2026-02-20T16:29:22.754 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.751+0000 7f91ad327640 1 -- 10.20.193.57:0/3288923031 wait complete. 2026-02-20T16:29:22.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.762+0000 7f65cfb56640 1 -- 10.20.193.57:0/2735822618 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f65c812fc40 msgr2=0x7f65ac00e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:22.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.762+0000 7f65cfb56640 1 --2- 10.20.193.57:0/2735822618 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f65c812fc40 0x7f65ac00e6e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f65b8004ee0 tx=0x7f65b8030e70 comp rx=0 tx=0).stop 2026-02-20T16:29:22.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.762+0000 7f65cfb56640 1 -- 10.20.193.57:0/2735822618 shutdown_connections 2026-02-20T16:29:22.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.762+0000 7f65cfb56640 1 --2- 10.20.193.57:0/2735822618 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f65c812fc40 0x7f65ac00e6e0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.762+0000 7f65cfb56640 1 --2- 10.20.193.57:0/2735822618 >> v2:10.20.193.57:3300/0 conn(0x7f65ac0037d0 0x7f65ac00c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.762+0000 7f65cfb56640 1 --2- 10.20.193.57:0/2735822618 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f65c8132570 0x7f65ac00bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.762+0000 7f65cfb56640 1 -- 10.20.193.57:0/2735822618 >> 10.20.193.57:0/2735822618 conn(0x7f65c809b870 msgr2=0x7f65c809bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:22.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.762+0000 7f65cfb56640 1 -- 10.20.193.57:0/2735822618 shutdown_connections 2026-02-20T16:29:22.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.762+0000 7f65cfb56640 1 -- 10.20.193.57:0/2735822618 wait complete. 2026-02-20T16:29:22.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.763+0000 7f65cfb56640 1 Processor -- start 2026-02-20T16:29:22.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.763+0000 7f65cfb56640 1 -- start start 2026-02-20T16:29:22.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.763+0000 7f65cfb56640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f65ac0037d0 0x7f65c81c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:22.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.763+0000 7f65cfb56640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f65c8129a60 0x7f65c81c4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:22.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.763+0000 7f65cfb56640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f65c812fc40 0x7f65c812d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:22.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.763+0000 7f65cfb56640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f65c8095010 con 0x7f65ac0037d0 2026-02-20T16:29:22.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.763+0000 7f65cfb56640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f65c8094e90 con 0x7f65c812fc40 2026-02-20T16:29:22.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.763+0000 7f65cfb56640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f65c8095190 con 0x7f65c8129a60 2026-02-20T16:29:22.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.763+0000 7f65cd8cb640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f65ac0037d0 0x7f65c81c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:22.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.763+0000 7f65cd0ca640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f65c8129a60 0x7f65c81c4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:22.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.763+0000 7f65cd8cb640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f65ac0037d0 0x7f65c81c48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:36780/0 (socket says 10.20.193.57:36780) 2026-02-20T16:29:22.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.763+0000 7f65cd8cb640 1 -- 10.20.193.57:0/3072385040 learned_addr learned my addr 10.20.193.57:0/3072385040 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:29:22.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.763+0000 7f65ce0cc640 1 --2- 10.20.193.57:0/3072385040 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f65c812fc40 0x7f65c812d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:22.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.763+0000 7f65cd0ca640 1 -- 10.20.193.57:0/3072385040 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f65c812fc40 msgr2=0x7f65c812d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:22.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.763+0000 7f65cd0ca640 1 --2- 10.20.193.57:0/3072385040 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f65c812fc40 0x7f65c812d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.763+0000 7f65cd0ca640 1 -- 10.20.193.57:0/3072385040 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f65ac0037d0 msgr2=0x7f65c81c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:22.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.763+0000 7f65cd0ca640 1 --2- 10.20.193.57:0/3072385040 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f65ac0037d0 0x7f65c81c48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.763+0000 7f65cd0ca640 1 -- 10.20.193.57:0/3072385040 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65c812f320 con 0x7f65c8129a60 2026-02-20T16:29:22.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.763+0000 7f65cd8cb640 1 --2- 10.20.193.57:0/3072385040 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f65ac0037d0 0x7f65c81c48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:29:22.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.763+0000 7f65cd0ca640 1 --2- 10.20.193.57:0/3072385040 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f65c8129a60 0x7f65c81c4e00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f65bc005f50 tx=0x7f65bc012b70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:29:22.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.763+0000 7f65b67fc640 1 -- 10.20.193.57:0/3072385040 <== mon.2 v2:10.20.193.57:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65bc010bc0 con 0x7f65c8129a60 2026-02-20T16:29:22.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.763+0000 7f65b67fc640 1 -- 10.20.193.57:0/3072385040 <== mon.2 v2:10.20.193.57:3302/0 2 ==== config(2 keys) ==== 54+0+0 (secure 0 0 0) 0x7f65bc010d60 con 0x7f65c8129a60 2026-02-20T16:29:22.770 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.763+0000 7f65cfb56640 1 -- 10.20.193.57:0/3072385040 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65c806f9d0 con 0x7f65c8129a60 2026-02-20T16:29:22.770 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.763+0000 7f65b67fc640 1 -- 10.20.193.57:0/3072385040 <== mon.2 v2:10.20.193.57:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65bc004b00 con 0x7f65c8129a60 2026-02-20T16:29:22.770 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.763+0000 7f65cfb56640 1 -- 10.20.193.57:0/3072385040 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f65c81c5340 con 0x7f65c8129a60 2026-02-20T16:29:22.770 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.763+0000 7f65b67fc640 1 -- 10.20.193.57:0/3072385040 <== mon.2 v2:10.20.193.57:3302/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f65bc01b410 con 0x7f65c8129a60 2026-02-20T16:29:22.770 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.763+0000 7f65b67fc640 1 -- 10.20.193.57:0/3072385040 <== mon.2 v2:10.20.193.57:3302/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7f65bc024a20 con 0x7f65c8129a60 2026-02-20T16:29:22.770 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.764+0000 7f65cfb56640 1 -- 10.20.193.57:0/3072385040 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65c80955f0 con 0x7f65c8129a60 2026-02-20T16:29:22.770 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.765+0000 7f65b67fc640 1 -- 10.20.193.57:0/3072385040 <== mon.2 v2:10.20.193.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f65bc01b820 con 0x7f65c8129a60 2026-02-20T16:29:22.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.792+0000 7f65cfb56640 1 -- 10.20.193.57:0/3072385040 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f65c80764d0 con 0x7f65c8129a60 2026-02-20T16:29:22.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.794+0000 7f65b67fc640 1 -- 10.20.193.57:0/3072385040 <== mon.2 v2:10.20.193.57:3302/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v16)=0 v16) ==== 119+0+0 (secure 0 0 0) 0x7f65bc01bc30 con 0x7f65c8129a60 2026-02-20T16:29:22.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.794+0000 7f65cfb56640 1 -- 10.20.193.57:0/3072385040 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f65c8129a60 msgr2=0x7f65c81c4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:22.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.794+0000 7f65cfb56640 1 --2- 10.20.193.57:0/3072385040 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f65c8129a60 0x7f65c81c4e00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f65bc005f50 tx=0x7f65bc012b70 comp rx=0 tx=0).stop 2026-02-20T16:29:22.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.794+0000 7f65cfb56640 1 -- 10.20.193.57:0/3072385040 shutdown_connections 2026-02-20T16:29:22.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.794+0000 7f65cfb56640 1 --2- 10.20.193.57:0/3072385040 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f65c812fc40 0x7f65c812d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.794+0000 7f65cfb56640 1 --2- 10.20.193.57:0/3072385040 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f65c8129a60 0x7f65c81c4e00 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.794+0000 7f65cfb56640 1 --2- 10.20.193.57:0/3072385040 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f65ac0037d0 0x7f65c81c48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.794+0000 7f65cfb56640 1 -- 10.20.193.57:0/3072385040 >> 10.20.193.57:0/3072385040 conn(0x7f65c809b870 msgr2=0x7f65c8130d60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:22.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.794+0000 7f65cfb56640 1 -- 10.20.193.57:0/3072385040 shutdown_connections 2026-02-20T16:29:22.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.794+0000 7f65cfb56640 1 -- 10.20.193.57:0/3072385040 wait complete. 2026-02-20T16:29:22.805 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.803+0000 7f555da4e640 1 -- 10.20.193.57:0/1902063997 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f555812f010 msgr2=0x7f553c00e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:22.805 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.803+0000 7f555da4e640 1 --2- 10.20.193.57:0/1902063997 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f555812f010 0x7f553c00e680 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f554c002900 tx=0x7f554c031520 comp rx=0 tx=0).stop 2026-02-20T16:29:22.805 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.803+0000 7f555da4e640 1 -- 10.20.193.57:0/1902063997 shutdown_connections 2026-02-20T16:29:22.806 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.803+0000 7f555da4e640 1 --2- 10.20.193.57:0/1902063997 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f555812f010 0x7f553c00e680 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.806 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.803+0000 7f555da4e640 1 --2- 10.20.193.57:0/1902063997 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f555809d4d0 0x7f553c00c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.806 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.803+0000 7f555da4e640 1 --2- 10.20.193.57:0/1902063997 >> v2:10.20.193.57:3300/0 conn(0x7f553c0037d0 0x7f553c009be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.806 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.803+0000 7f555da4e640 1 -- 10.20.193.57:0/1902063997 >> 10.20.193.57:0/1902063997 conn(0x7f555806e3a0 msgr2=0x7f555806e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:22.806 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.803+0000 7f555da4e640 1 -- 10.20.193.57:0/1902063997 shutdown_connections 2026-02-20T16:29:22.806 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.803+0000 7f555da4e640 1 -- 10.20.193.57:0/1902063997 wait complete. 2026-02-20T16:29:22.808 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.803+0000 7f555da4e640 1 Processor -- start 2026-02-20T16:29:22.809 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.803+0000 7f555da4e640 1 -- start start 2026-02-20T16:29:22.809 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.804+0000 7f555da4e640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f553c0037d0 0x7f555808d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:22.809 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.804+0000 7f555da4e640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f555809d4d0 0x7f555808dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:22.809 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.804+0000 7f555da4e640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f555812f010 0x7f555808e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:22.809 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.804+0000 7f555da4e640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f555809cdc0 con 0x7f555809d4d0 2026-02-20T16:29:22.809 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.804+0000 7f555da4e640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f555812f710 con 0x7f555812f010 2026-02-20T16:29:22.809 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.804+0000 7f555da4e640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f555809cf40 con 0x7f553c0037d0 2026-02-20T16:29:22.809 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.804+0000 7f5556ffd640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f553c0037d0 0x7f555808d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:22.809 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.804+0000 7f5556ffd640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f553c0037d0 0x7f555808d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3302/0 says I am v2:10.20.193.57:46676/0 (socket says 10.20.193.57:46676) 2026-02-20T16:29:22.809 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.804+0000 7f5556ffd640 1 -- 10.20.193.57:0/1573470925 learned_addr learned my addr 10.20.193.57:0/1573470925 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:29:22.809 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.804+0000 7f55567fc640 1 --2- 10.20.193.57:0/1573470925 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f555809d4d0 0x7f555808dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:22.810 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.804+0000 7f55577fe640 1 --2- 10.20.193.57:0/1573470925 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f555812f010 0x7f555808e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:22.810 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.804+0000 7f5556ffd640 1 -- 10.20.193.57:0/1573470925 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f555812f010 msgr2=0x7f555808e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:22.810 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.804+0000 7f5556ffd640 1 --2- 10.20.193.57:0/1573470925 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f555812f010 0x7f555808e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.810 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.804+0000 7f5556ffd640 1 -- 10.20.193.57:0/1573470925 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f555809d4d0 msgr2=0x7f555808dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:22.810 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.804+0000 7f5556ffd640 1 --2- 10.20.193.57:0/1573470925 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f555809d4d0 0x7f555808dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.810 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.804+0000 7f5556ffd640 1 -- 10.20.193.57:0/1573470925 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5558091050 con 0x7f553c0037d0 2026-02-20T16:29:22.810 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.804+0000 7f5556ffd640 1 --2- 10.20.193.57:0/1573470925 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f553c0037d0 0x7f555808d850 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f554c002a30 tx=0x7f554c033000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:29:22.810 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.804+0000 7f552ffff640 1 -- 10.20.193.57:0/1573470925 <== mon.2 v2:10.20.193.57:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f554c03f040 con 0x7f553c0037d0 2026-02-20T16:29:22.810 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.804+0000 7f552ffff640 1 -- 10.20.193.57:0/1573470925 <== mon.2 v2:10.20.193.57:3302/0 2 ==== config(2 keys) ==== 54+0+0 (secure 0 0 0) 0x7f554c04a070 con 0x7f553c0037d0 2026-02-20T16:29:22.810 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.804+0000 7f555da4e640 1 -- 10.20.193.57:0/1573470925 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55580907e0 con 0x7f553c0037d0 2026-02-20T16:29:22.810 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.804+0000 7f552ffff640 1 -- 10.20.193.57:0/1573470925 <== mon.2 v2:10.20.193.57:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f554c01c0b0 con 0x7f553c0037d0 2026-02-20T16:29:22.811 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.804+0000 7f555da4e640 1 -- 10.20.193.57:0/1573470925 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f5558098080 con 0x7f553c0037d0 2026-02-20T16:29:22.811 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.804+0000 7f552ffff640 1 -- 10.20.193.57:0/1573470925 <== mon.2 v2:10.20.193.57:3302/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f554c042030 con 0x7f553c0037d0 2026-02-20T16:29:22.811 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.804+0000 7f552ffff640 1 -- 10.20.193.57:0/1573470925 <== mon.2 v2:10.20.193.57:3302/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7f554c04f820 con 0x7f553c0037d0 2026-02-20T16:29:22.811 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.805+0000 7f555da4e640 1 -- 10.20.193.57:0/1573470925 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55580982e0 con 0x7f553c0037d0 2026-02-20T16:29:22.811 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.806+0000 7f552ffff640 1 -- 10.20.193.57:0/1573470925 <== mon.2 v2:10.20.193.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f55580982e0 con 0x7f553c0037d0 2026-02-20T16:29:22.836 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.834+0000 7f555da4e640 1 -- 10.20.193.57:0/1573470925 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f555806db60 con 0x7f553c0037d0 2026-02-20T16:29:22.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.836+0000 7f552ffff640 1 -- 10.20.193.57:0/1573470925 <== mon.2 v2:10.20.193.57:3302/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v17)=0 v17) ==== 111+0+0 (secure 0 0 0) 0x7f555806db60 con 0x7f553c0037d0 2026-02-20T16:29:22.838 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.836+0000 7f555da4e640 1 -- 10.20.193.57:0/1573470925 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f553c0037d0 msgr2=0x7f555808d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:22.838 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.836+0000 7f555da4e640 1 --2- 10.20.193.57:0/1573470925 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f553c0037d0 0x7f555808d850 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f554c002a30 tx=0x7f554c033000 comp rx=0 tx=0).stop 2026-02-20T16:29:22.839 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.836+0000 7f555da4e640 1 -- 10.20.193.57:0/1573470925 shutdown_connections 2026-02-20T16:29:22.839 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.836+0000 7f555da4e640 1 --2- 10.20.193.57:0/1573470925 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f555812f010 0x7f555808e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.839 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.836+0000 7f555da4e640 1 --2- 10.20.193.57:0/1573470925 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f555809d4d0 0x7f555808dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.839 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.836+0000 7f555da4e640 1 --2- 10.20.193.57:0/1573470925 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f553c0037d0 0x7f555808d850 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.839 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.836+0000 7f555da4e640 1 -- 10.20.193.57:0/1573470925 >> 10.20.193.57:0/1573470925 conn(0x7f555806e3a0 msgr2=0x7f55581298c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:22.839 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.836+0000 7f555da4e640 1 -- 10.20.193.57:0/1573470925 shutdown_connections 2026-02-20T16:29:22.839 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.836+0000 7f555da4e640 1 -- 10.20.193.57:0/1573470925 wait complete. 2026-02-20T16:29:22.961 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.956+0000 7fad5d3f3640 1 -- 10.20.193.57:0/562651608 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fad580975b0 msgr2=0x7fad3c00e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:22.961 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.956+0000 7fad5d3f3640 1 --2- 10.20.193.57:0/562651608 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fad580975b0 0x7fad3c00e5d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fad4c002900 tx=0x7fad4c031a60 comp rx=0 tx=0).stop 2026-02-20T16:29:22.962 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.956+0000 7fad5d3f3640 1 -- 10.20.193.57:0/562651608 shutdown_connections 2026-02-20T16:29:22.962 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.956+0000 7fad5d3f3640 1 --2- 10.20.193.57:0/562651608 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fad580975b0 0x7fad3c00e5d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.962 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.956+0000 7fad5d3f3640 1 --2- 10.20.193.57:0/562651608 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fad3c003750 0x7fad3c00c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.962 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.956+0000 7fad5d3f3640 1 --2- 10.20.193.57:0/562651608 >> v2:10.20.193.57:3300/0 conn(0x7fad58097ed0 0x7fad3c00bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.962 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.956+0000 7fad5d3f3640 1 -- 10.20.193.57:0/562651608 >> 10.20.193.57:0/562651608 conn(0x7fad5809f6d0 msgr2=0x7fad5809bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:22.962 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.956+0000 7fad5d3f3640 1 -- 10.20.193.57:0/562651608 shutdown_connections 2026-02-20T16:29:22.962 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.956+0000 7fad5d3f3640 1 -- 10.20.193.57:0/562651608 wait complete. 2026-02-20T16:29:22.962 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.957+0000 7fad5d3f3640 1 Processor -- start 2026-02-20T16:29:22.962 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.957+0000 7fad5d3f3640 1 -- start start 2026-02-20T16:29:22.962 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.957+0000 7fad5d3f3640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fad3c003750 0x7fad581b6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:22.962 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.957+0000 7fad5d3f3640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fad580959d0 0x7fad581b72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:22.963 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.957+0000 7fad5d3f3640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fad580975b0 0x7fad581b7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:22.963 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.957+0000 7fad5d3f3640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7fad58095820 con 0x7fad3c003750 2026-02-20T16:29:22.963 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.957+0000 7fad5d3f3640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7fad580956a0 con 0x7fad580959d0 2026-02-20T16:29:22.963 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.957+0000 7fad5d3f3640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7fad58097d00 con 0x7fad580975b0 2026-02-20T16:29:22.963 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.957+0000 7fad567fc640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fad580959d0 0x7fad581b72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:22.963 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.957+0000 7fad56ffd640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fad3c003750 0x7fad581b6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:22.963 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.957+0000 7fad567fc640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fad580959d0 0x7fad581b72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3301/0 says I am v2:10.20.193.57:58568/0 (socket says 10.20.193.57:58568) 2026-02-20T16:29:22.963 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.957+0000 7fad567fc640 1 -- 10.20.193.57:0/75554688 learned_addr learned my addr 10.20.193.57:0/75554688 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:29:22.963 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.957+0000 7fad577fe640 1 --2- 10.20.193.57:0/75554688 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fad580975b0 0x7fad581b7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:22.963 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.957+0000 7fad567fc640 1 -- 10.20.193.57:0/75554688 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fad580975b0 msgr2=0x7fad581b7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:22.963 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.957+0000 7fad567fc640 1 --2- 10.20.193.57:0/75554688 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fad580975b0 0x7fad581b7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.963 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.957+0000 7fad567fc640 1 -- 10.20.193.57:0/75554688 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fad3c003750 msgr2=0x7fad581b6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:22.963 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.957+0000 7fad567fc640 1 --2- 10.20.193.57:0/75554688 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fad3c003750 0x7fad581b6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.964 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.957+0000 7fad567fc640 1 -- 10.20.193.57:0/75554688 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad58090ac0 con 0x7fad580959d0 2026-02-20T16:29:22.964 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.957+0000 7fad56ffd640 1 --2- 10.20.193.57:0/75554688 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fad3c003750 0x7fad581b6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:29:22.964 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.958+0000 7fad567fc640 1 --2- 10.20.193.57:0/75554688 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fad580959d0 0x7fad581b72c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fad40002fd0 tx=0x7fad40012b70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:29:22.964 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.958+0000 7fad377fe640 1 -- 10.20.193.57:0/75554688 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad40010b90 con 0x7fad580959d0 2026-02-20T16:29:22.964 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.958+0000 7fad377fe640 1 -- 10.20.193.57:0/75554688 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(2 keys) ==== 54+0+0 (secure 0 0 0) 0x7fad40010d30 con 0x7fad580959d0 2026-02-20T16:29:22.964 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.958+0000 7fad5d3f3640 1 -- 10.20.193.57:0/75554688 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad58094f30 con 0x7fad580959d0 2026-02-20T16:29:22.964 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.958+0000 7fad377fe640 1 -- 10.20.193.57:0/75554688 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad4001c640 con 0x7fad580959d0 2026-02-20T16:29:22.964 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.958+0000 7fad5d3f3640 1 -- 10.20.193.57:0/75554688 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fad580917c0 con 0x7fad580959d0 2026-02-20T16:29:22.964 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.958+0000 7fad377fe640 1 -- 10.20.193.57:0/75554688 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fad4001cb70 con 0x7fad580959d0 2026-02-20T16:29:22.964 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.958+0000 7fad377fe640 1 -- 10.20.193.57:0/75554688 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7fad4001b780 con 0x7fad580959d0 2026-02-20T16:29:22.964 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.958+0000 7fad5d3f3640 1 -- 10.20.193.57:0/75554688 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad5809a370 con 0x7fad580959d0 2026-02-20T16:29:22.965 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.960+0000 7fad377fe640 1 -- 10.20.193.57:0/75554688 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7fad5809a370 con 0x7fad580959d0 2026-02-20T16:29:22.990 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.988+0000 7fad5d3f3640 1 -- 10.20.193.57:0/75554688 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7fad58096060 con 0x7fad580959d0 2026-02-20T16:29:22.993 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.990+0000 7fad377fe640 1 -- 10.20.193.57:0/75554688 <== mon.1 v2:10.20.193.57:3301/0 7 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7fad4001b9d0 con 0x7fad580959d0 2026-02-20T16:29:22.993 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.990+0000 7fad377fe640 1 -- 10.20.193.57:0/75554688 <== mon.1 v2:10.20.193.57:3301/0 8 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v18)=0 v18) ==== 114+0+0 (secure 0 0 0) 0x7fad58090ac0 con 0x7fad580959d0 2026-02-20T16:29:22.994 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.991+0000 7fad5d3f3640 1 -- 10.20.193.57:0/75554688 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fad580959d0 msgr2=0x7fad581b72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:22.994 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.991+0000 7fad5d3f3640 1 --2- 10.20.193.57:0/75554688 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fad580959d0 0x7fad581b72c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fad40002fd0 tx=0x7fad40012b70 comp rx=0 tx=0).stop 2026-02-20T16:29:22.994 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.991+0000 7fad5d3f3640 1 -- 10.20.193.57:0/75554688 shutdown_connections 2026-02-20T16:29:22.994 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.991+0000 7fad5d3f3640 1 --2- 10.20.193.57:0/75554688 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fad580975b0 0x7fad581b7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.994 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.991+0000 7fad5d3f3640 1 --2- 10.20.193.57:0/75554688 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fad580959d0 0x7fad581b72c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.994 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.991+0000 7fad5d3f3640 1 --2- 10.20.193.57:0/75554688 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fad3c003750 0x7fad581b6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:22.994 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.991+0000 7fad5d3f3640 1 -- 10.20.193.57:0/75554688 >> 10.20.193.57:0/75554688 conn(0x7fad5809f6d0 msgr2=0x7fad5812b220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:22.994 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.991+0000 7fad5d3f3640 1 -- 10.20.193.57:0/75554688 shutdown_connections 2026-02-20T16:29:22.994 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:22.991+0000 7fad5d3f3640 1 -- 10.20.193.57:0/75554688 wait complete. 2026-02-20T16:29:23.001 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='trial057') 2026-02-20T16:29:23.001 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='trial057') 2026-02-20T16:29:23.003 INFO:tasks.ceph.mgr.x.trial057.stderr:2026-02-20T16:29:23.001+0000 7fd315bdb140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-20T16:29:23.004 INFO:tasks.ceph.mgr.y.trial057.stderr:2026-02-20T16:29:23.002+0000 7ffad83a7140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-20T16:29:23.044 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.042+0000 7f9b4479b640 1 -- 10.20.193.57:0/3940530433 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f9b3c1295f0 msgr2=0x7f9b1c00c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:23.044 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.042+0000 7f9b4479b640 1 --2- 10.20.193.57:0/3940530433 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f9b3c1295f0 0x7f9b1c00c300 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c005f70 tx=0x7f9b2c032200 comp rx=0 tx=0).stop 2026-02-20T16:29:23.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.042+0000 7f9b4479b640 1 -- 10.20.193.57:0/3940530433 shutdown_connections 2026-02-20T16:29:23.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.042+0000 7f9b4479b640 1 --2- 10.20.193.57:0/3940530433 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f9b3c1295f0 0x7f9b1c00c300 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.042+0000 7f9b4479b640 1 --2- 10.20.193.57:0/3940530433 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f9b3c071f50 0x7f9b1c0084f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.042+0000 7f9b4479b640 1 --2- 10.20.193.57:0/3940530433 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f9b1c003770 0x7f9b1c005bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.042+0000 7f9b4479b640 1 -- 10.20.193.57:0/3940530433 >> 10.20.193.57:0/3940530433 conn(0x7f9b3c09a000 msgr2=0x7f9b3c0977c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:23.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.042+0000 7f9b4479b640 1 -- 10.20.193.57:0/3940530433 shutdown_connections 2026-02-20T16:29:23.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.042+0000 7f9b4479b640 1 -- 10.20.193.57:0/3940530433 wait complete. 2026-02-20T16:29:23.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.043+0000 7f9b4479b640 1 Processor -- start 2026-02-20T16:29:23.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.043+0000 7f9b4479b640 1 -- start start 2026-02-20T16:29:23.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.043+0000 7f9b4479b640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f9b1c003770 0x7f9b3c08ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:23.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.043+0000 7f9b4479b640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f9b3c071f50 0x7f9b3c08d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:23.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.043+0000 7f9b4479b640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f9b3c1295f0 0x7f9b3c08d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:23.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.043+0000 7f9b4479b640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f9b3c06e3a0 con 0x7f9b3c1295f0 2026-02-20T16:29:23.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.043+0000 7f9b4479b640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f9b3c06e220 con 0x7f9b1c003770 2026-02-20T16:29:23.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.043+0000 7f9b4479b640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f9b3c06e520 con 0x7f9b3c071f50 2026-02-20T16:29:23.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.043+0000 7f9b42d11640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f9b3c1295f0 0x7f9b3c08d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:23.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.043+0000 7f9b42510640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f9b1c003770 0x7f9b3c08ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:23.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.043+0000 7f9b42510640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f9b1c003770 0x7f9b3c08ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3301/0 says I am v2:10.20.193.57:58576/0 (socket says 10.20.193.57:58576) 2026-02-20T16:29:23.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.043+0000 7f9b42d11640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f9b3c1295f0 0x7f9b3c08d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:36850/0 (socket says 10.20.193.57:36850) 2026-02-20T16:29:23.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.043+0000 7f9b42510640 1 -- 10.20.193.57:0/337287093 learned_addr learned my addr 10.20.193.57:0/337287093 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:29:23.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.043+0000 7f9b41d0f640 1 --2- 10.20.193.57:0/337287093 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f9b3c071f50 0x7f9b3c08d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:23.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.043+0000 7f9b42510640 1 -- 10.20.193.57:0/337287093 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f9b3c071f50 msgr2=0x7f9b3c08d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:23.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.043+0000 7f9b42510640 1 --2- 10.20.193.57:0/337287093 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f9b3c071f50 0x7f9b3c08d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.043+0000 7f9b42510640 1 -- 10.20.193.57:0/337287093 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f9b3c1295f0 msgr2=0x7f9b3c08d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:23.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.043+0000 7f9b42510640 1 --2- 10.20.193.57:0/337287093 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f9b3c1295f0 0x7f9b3c08d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.043+0000 7f9b42510640 1 -- 10.20.193.57:0/337287093 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b3c126f40 con 0x7f9b1c003770 2026-02-20T16:29:23.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.043+0000 7f9b42d11640 1 --2- 10.20.193.57:0/337287093 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f9b3c1295f0 0x7f9b3c08d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:29:23.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.044+0000 7f9b42510640 1 --2- 10.20.193.57:0/337287093 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f9b1c003770 0x7f9b3c08ce20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c01b010 tx=0x7f9b2c03af00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:29:23.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.044+0000 7f9b22ffd640 1 -- 10.20.193.57:0/337287093 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c03f040 con 0x7f9b1c003770 2026-02-20T16:29:23.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.044+0000 7f9b22ffd640 1 -- 10.20.193.57:0/337287093 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7f9b2c048070 con 0x7f9b1c003770 2026-02-20T16:29:23.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.044+0000 7f9b4479b640 1 -- 10.20.193.57:0/337287093 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b3c08dde0 con 0x7f9b1c003770 2026-02-20T16:29:23.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.044+0000 7f9b22ffd640 1 -- 10.20.193.57:0/337287093 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c043690 con 0x7f9b1c003770 2026-02-20T16:29:23.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.044+0000 7f9b4479b640 1 -- 10.20.193.57:0/337287093 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b3c08f7d0 con 0x7f9b1c003770 2026-02-20T16:29:23.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.044+0000 7f9b22ffd640 1 -- 10.20.193.57:0/337287093 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f9b2c042070 con 0x7f9b1c003770 2026-02-20T16:29:23.048 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.044+0000 7f9b22ffd640 1 -- 10.20.193.57:0/337287093 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7f9b2c04d4a0 con 0x7f9b1c003770 2026-02-20T16:29:23.048 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.044+0000 7f9b4479b640 1 -- 10.20.193.57:0/337287093 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b3c090410 con 0x7f9b1c003770 2026-02-20T16:29:23.048 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.046+0000 7f9b22ffd640 1 -- 10.20.193.57:0/337287093 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f9b2c019040 con 0x7f9b1c003770 2026-02-20T16:29:23.076 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.074+0000 7f9b4479b640 1 -- 10.20.193.57:0/337287093 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f9b3c12dab0 con 0x7f9b1c003770 2026-02-20T16:29:23.079 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.077+0000 7f9b22ffd640 1 -- 10.20.193.57:0/337287093 <== mon.1 v2:10.20.193.57:3301/0 7 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f9b2c0040c0 con 0x7f9b1c003770 2026-02-20T16:29:23.079 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.077+0000 7f9b22ffd640 1 -- 10.20.193.57:0/337287093 <== mon.1 v2:10.20.193.57:3301/0 8 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v19)=0 v19) ==== 123+0+0 (secure 0 0 0) 0x7f9b2c0026e0 con 0x7f9b1c003770 2026-02-20T16:29:23.079 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.077+0000 7f9b4479b640 1 -- 10.20.193.57:0/337287093 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f9b1c003770 msgr2=0x7f9b3c08ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:23.079 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.077+0000 7f9b4479b640 1 --2- 10.20.193.57:0/337287093 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f9b1c003770 0x7f9b3c08ce20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c01b010 tx=0x7f9b2c03af00 comp rx=0 tx=0).stop 2026-02-20T16:29:23.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.077+0000 7f9b4479b640 1 -- 10.20.193.57:0/337287093 shutdown_connections 2026-02-20T16:29:23.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.077+0000 7f9b4479b640 1 --2- 10.20.193.57:0/337287093 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f9b3c1295f0 0x7f9b3c08d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.077+0000 7f9b4479b640 1 --2- 10.20.193.57:0/337287093 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f9b3c071f50 0x7f9b3c08d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.077+0000 7f9b4479b640 1 --2- 10.20.193.57:0/337287093 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f9b1c003770 0x7f9b3c08ce20 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.077+0000 7f9b4479b640 1 -- 10.20.193.57:0/337287093 >> 10.20.193.57:0/337287093 conn(0x7f9b3c09a000 msgr2=0x7f9b3c09b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:23.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.077+0000 7f9b4479b640 1 -- 10.20.193.57:0/337287093 shutdown_connections 2026-02-20T16:29:23.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.077+0000 7f9b4479b640 1 -- 10.20.193.57:0/337287093 wait complete. 2026-02-20T16:29:23.088 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='trial057') 2026-02-20T16:29:23.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.090+0000 7fb9f1dac640 1 -- 10.20.193.57:0/2471102695 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fb9c80037d0 msgr2=0x7fb9c8005c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:23.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.090+0000 7fb9f1dac640 1 --2- 10.20.193.57:0/2471102695 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fb9c80037d0 0x7fb9c8005c50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8005f50 tx=0x7fb9d8030da0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.090+0000 7fb9f1dac640 1 -- 10.20.193.57:0/2471102695 shutdown_connections 2026-02-20T16:29:23.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.090+0000 7fb9f1dac640 1 --2- 10.20.193.57:0/2471102695 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fb9c80037d0 0x7fb9c8005c50 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.090+0000 7fb9f1dac640 1 --2- 10.20.193.57:0/2471102695 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fb9ec094b90 0x7fb9c800e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.090+0000 7fb9f1dac640 1 --2- 10.20.193.57:0/2471102695 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fb9ec12b840 0x7fb9c800bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.090+0000 7fb9f1dac640 1 -- 10.20.193.57:0/2471102695 >> 10.20.193.57:0/2471102695 conn(0x7fb9ec09bf90 msgr2=0x7fb9ec09c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:23.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.090+0000 7fb9f1dac640 1 -- 10.20.193.57:0/2471102695 shutdown_connections 2026-02-20T16:29:23.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.090+0000 7fb9f1dac640 1 -- 10.20.193.57:0/2471102695 wait complete. 2026-02-20T16:29:23.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.091+0000 7fb9f1dac640 1 Processor -- start 2026-02-20T16:29:23.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.091+0000 7fb9f1dac640 1 -- start start 2026-02-20T16:29:23.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.091+0000 7fb9f1dac640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fb9c80037d0 0x7fb9ec0728e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:23.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.091+0000 7fb9f1dac640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fb9ec094b90 0x7fb9ec072e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:23.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.091+0000 7fb9f1dac640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fb9ec12b840 0x7fb9ec073360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:23.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.091+0000 7fb9f1dac640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7fb9ec12be70 con 0x7fb9ec12b840 2026-02-20T16:29:23.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.091+0000 7fb9f1dac640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7fb9ec094480 con 0x7fb9c80037d0 2026-02-20T16:29:23.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.091+0000 7fb9f1dac640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7fb9ec0942f0 con 0x7fb9ec094b90 2026-02-20T16:29:23.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.091+0000 7fb9ebfff640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fb9ec12b840 0x7fb9ec073360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:23.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.091+0000 7fb9ebfff640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fb9ec12b840 0x7fb9ec073360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:36868/0 (socket says 10.20.193.57:36868) 2026-02-20T16:29:23.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.091+0000 7fb9eaffd640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fb9ec094b90 0x7fb9ec072e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:23.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.091+0000 7fb9ebfff640 1 -- 10.20.193.57:0/1119438741 learned_addr learned my addr 10.20.193.57:0/1119438741 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:29:23.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.091+0000 7fb9eb7fe640 1 --2- 10.20.193.57:0/1119438741 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fb9c80037d0 0x7fb9ec0728e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:23.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.091+0000 7fb9ebfff640 1 -- 10.20.193.57:0/1119438741 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fb9ec094b90 msgr2=0x7fb9ec072e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:23.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.091+0000 7fb9ebfff640 1 --2- 10.20.193.57:0/1119438741 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fb9ec094b90 0x7fb9ec072e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.091+0000 7fb9ebfff640 1 -- 10.20.193.57:0/1119438741 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fb9c80037d0 msgr2=0x7fb9ec0728e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:23.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.091+0000 7fb9ebfff640 1 --2- 10.20.193.57:0/1119438741 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fb9c80037d0 0x7fb9ec0728e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.091+0000 7fb9ebfff640 1 -- 10.20.193.57:0/1119438741 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9ec08e310 con 0x7fb9ec12b840 2026-02-20T16:29:23.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.091+0000 7fb9ebfff640 1 --2- 10.20.193.57:0/1119438741 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fb9ec12b840 0x7fb9ec073360 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb9e00046c0 tx=0x7fb9e001a810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:29:23.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.091+0000 7fb9c7fff640 1 -- 10.20.193.57:0/1119438741 <== mon.0 v2:10.20.193.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e00223f0 con 0x7fb9ec12b840 2026-02-20T16:29:23.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.091+0000 7fb9c7fff640 1 -- 10.20.193.57:0/1119438741 <== mon.0 v2:10.20.193.57:3300/0 2 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7fb9e0022680 con 0x7fb9ec12b840 2026-02-20T16:29:23.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.091+0000 7fb9f1dac640 1 -- 10.20.193.57:0/1119438741 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9ec0738a0 con 0x7fb9ec12b840 2026-02-20T16:29:23.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.091+0000 7fb9c7fff640 1 -- 10.20.193.57:0/1119438741 <== mon.0 v2:10.20.193.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e0022ab0 con 0x7fb9ec12b840 2026-02-20T16:29:23.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.092+0000 7fb9f1dac640 1 -- 10.20.193.57:0/1119438741 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9ec08d9b0 con 0x7fb9ec12b840 2026-02-20T16:29:23.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.092+0000 7fb9c7fff640 1 -- 10.20.193.57:0/1119438741 <== mon.0 v2:10.20.193.57:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fb9e0021070 con 0x7fb9ec12b840 2026-02-20T16:29:23.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.092+0000 7fb9c7fff640 1 -- 10.20.193.57:0/1119438741 <== mon.0 v2:10.20.193.57:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7fb9e0007960 con 0x7fb9ec12b840 2026-02-20T16:29:23.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.092+0000 7fb9f1dac640 1 -- 10.20.193.57:0/1119438741 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9ec12a7a0 con 0x7fb9ec12b840 2026-02-20T16:29:23.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.094+0000 7fb9c7fff640 1 -- 10.20.193.57:0/1119438741 <== mon.0 v2:10.20.193.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7fb9ec12a7a0 con 0x7fb9ec12b840 2026-02-20T16:29:23.125 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.123+0000 7fb9f1dac640 1 -- 10.20.193.57:0/1119438741 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fb9ec094950 con 0x7fb9ec12b840 2026-02-20T16:29:23.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.125+0000 7fb9c7fff640 1 -- 10.20.193.57:0/1119438741 <== mon.0 v2:10.20.193.57:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v20)=0 v20) ==== 123+0+0 (secure 0 0 0) 0x7fb9e0030070 con 0x7fb9ec12b840 2026-02-20T16:29:23.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.125+0000 7fb9c7fff640 1 -- 10.20.193.57:0/1119438741 <== mon.0 v2:10.20.193.57:3300/0 8 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb9e00073e0 con 0x7fb9ec12b840 2026-02-20T16:29:23.128 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.126+0000 7fb9f1dac640 1 -- 10.20.193.57:0/1119438741 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fb9ec12b840 msgr2=0x7fb9ec073360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:23.128 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.126+0000 7fb9f1dac640 1 --2- 10.20.193.57:0/1119438741 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fb9ec12b840 0x7fb9ec073360 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb9e00046c0 tx=0x7fb9e001a810 comp rx=0 tx=0).stop 2026-02-20T16:29:23.128 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.126+0000 7fb9f1dac640 1 -- 10.20.193.57:0/1119438741 shutdown_connections 2026-02-20T16:29:23.129 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.126+0000 7fb9f1dac640 1 --2- 10.20.193.57:0/1119438741 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fb9ec12b840 0x7fb9ec073360 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.129 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.126+0000 7fb9f1dac640 1 --2- 10.20.193.57:0/1119438741 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fb9ec094b90 0x7fb9ec072e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.129 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.126+0000 7fb9f1dac640 1 --2- 10.20.193.57:0/1119438741 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fb9c80037d0 0x7fb9ec0728e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.129 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.126+0000 7fb9f1dac640 1 -- 10.20.193.57:0/1119438741 >> 10.20.193.57:0/1119438741 conn(0x7fb9ec09bf90 msgr2=0x7fb9ec1253e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:23.129 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.126+0000 7fb9f1dac640 1 -- 10.20.193.57:0/1119438741 shutdown_connections 2026-02-20T16:29:23.129 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.126+0000 7fb9f1dac640 1 -- 10.20.193.57:0/1119438741 wait complete. 2026-02-20T16:29:23.136 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.130+0000 7f5292740640 1 -- 10.20.193.57:0/3885516279 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f52680037e0 msgr2=0x7f5268005c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:23.137 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.130+0000 7f5292740640 1 --2- 10.20.193.57:0/3885516279 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f52680037e0 0x7f5268005c80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5278006ce0 tx=0x7f5278030f70 comp rx=0 tx=0).stop 2026-02-20T16:29:23.137 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.130+0000 7f5292740640 1 -- 10.20.193.57:0/3885516279 shutdown_connections 2026-02-20T16:29:23.137 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.130+0000 7f5292740640 1 --2- 10.20.193.57:0/3885516279 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f52680037e0 0x7f5268005c80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.137 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.130+0000 7f5292740640 1 --2- 10.20.193.57:0/3885516279 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f528c1312b0 0x7f526800e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.137 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.130+0000 7f5292740640 1 --2- 10.20.193.57:0/3885516279 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f528c12c330 0x7f526800bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.137 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.130+0000 7f5292740640 1 -- 10.20.193.57:0/3885516279 >> 10.20.193.57:0/3885516279 conn(0x7f528c09bf90 msgr2=0x7f528c09c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:23.137 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.130+0000 7f5292740640 1 -- 10.20.193.57:0/3885516279 shutdown_connections 2026-02-20T16:29:23.137 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.130+0000 7f5292740640 1 -- 10.20.193.57:0/3885516279 wait complete. 2026-02-20T16:29:23.138 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.130+0000 7f5292740640 1 Processor -- start 2026-02-20T16:29:23.138 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.131+0000 7f5292740640 1 -- start start 2026-02-20T16:29:23.138 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.131+0000 7f5292740640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f52680037e0 0x7f528c12fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:23.138 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.131+0000 7f5292740640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f528c12b840 0x7f528c130070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:23.138 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.131+0000 7f5292740640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f528c12c330 0x7f528c1305b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:23.138 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.131+0000 7f5292740640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f528c094850 con 0x7f528c12b840 2026-02-20T16:29:23.138 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.131+0000 7f5292740640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f528c0946d0 con 0x7f528c12c330 2026-02-20T16:29:23.138 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.131+0000 7f5292740640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f528c0949d0 con 0x7f52680037e0 2026-02-20T16:29:23.138 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.131+0000 7f528b7fe640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f528c12b840 0x7f528c130070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:23.138 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.131+0000 7f528bfff640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f52680037e0 0x7f528c12fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:23.138 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.131+0000 7f528b7fe640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f528c12b840 0x7f528c130070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:36882/0 (socket says 10.20.193.57:36882) 2026-02-20T16:29:23.139 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.131+0000 7f528b7fe640 1 -- 10.20.193.57:0/3432976740 learned_addr learned my addr 10.20.193.57:0/3432976740 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:29:23.139 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.131+0000 7f5290cb6640 1 --2- 10.20.193.57:0/3432976740 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f528c12c330 0x7f528c1305b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:23.139 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.131+0000 7f528b7fe640 1 -- 10.20.193.57:0/3432976740 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f52680037e0 msgr2=0x7f528c12fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:23.139 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.131+0000 7f528b7fe640 1 --2- 10.20.193.57:0/3432976740 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f52680037e0 0x7f528c12fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.139 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.131+0000 7f528b7fe640 1 -- 10.20.193.57:0/3432976740 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f528c12c330 msgr2=0x7f528c1305b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:23.139 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.131+0000 7f528b7fe640 1 --2- 10.20.193.57:0/3432976740 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f528c12c330 0x7f528c1305b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.139 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.131+0000 7f528b7fe640 1 -- 10.20.193.57:0/3432976740 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f528c06fd90 con 0x7f528c12b840 2026-02-20T16:29:23.139 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.131+0000 7f528b7fe640 1 --2- 10.20.193.57:0/3432976740 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f528c12b840 0x7f528c130070 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f527c002fd0 tx=0x7f527c012b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:29:23.139 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.131+0000 7f5288ff9640 1 -- 10.20.193.57:0/3432976740 <== mon.0 v2:10.20.193.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f527c010b90 con 0x7f528c12b840 2026-02-20T16:29:23.139 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.131+0000 7f5288ff9640 1 -- 10.20.193.57:0/3432976740 <== mon.0 v2:10.20.193.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f527c010d30 con 0x7f528c12b840 2026-02-20T16:29:23.139 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.131+0000 7f5292740640 1 -- 10.20.193.57:0/3432976740 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f528c06fa30 con 0x7f528c12b840 2026-02-20T16:29:23.139 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.131+0000 7f5288ff9640 1 -- 10.20.193.57:0/3432976740 <== mon.0 v2:10.20.193.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f527c01c680 con 0x7f528c12b840 2026-02-20T16:29:23.140 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.131+0000 7f5292740640 1 -- 10.20.193.57:0/3432976740 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f528c070420 con 0x7f528c12b840 2026-02-20T16:29:23.140 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.131+0000 7f5288ff9640 1 -- 10.20.193.57:0/3432976740 <== mon.0 v2:10.20.193.57:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f527c01cbb0 con 0x7f528c12b840 2026-02-20T16:29:23.140 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.131+0000 7f5288ff9640 1 -- 10.20.193.57:0/3432976740 <== mon.0 v2:10.20.193.57:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7f527c01b790 con 0x7f528c12b840 2026-02-20T16:29:23.140 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.132+0000 7f5292740640 1 -- 10.20.193.57:0/3432976740 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f528c094f60 con 0x7f528c12b840 2026-02-20T16:29:23.140 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.133+0000 7f5288ff9640 1 -- 10.20.193.57:0/3432976740 <== mon.0 v2:10.20.193.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f527c02a070 con 0x7f528c12b840 2026-02-20T16:29:23.141 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='trial057') 2026-02-20T16:29:23.141 INFO:tasks.ceph.mgr.y.trial057.stderr:2026-02-20T16:29:23.137+0000 7ffad83a7140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-20T16:29:23.142 INFO:tasks.ceph.mgr.x.trial057.stderr:2026-02-20T16:29:23.138+0000 7fd315bdb140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-20T16:29:23.163 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.161+0000 7f5292740640 1 -- 10.20.193.57:0/3432976740 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f528c069710 con 0x7f528c12b840 2026-02-20T16:29:23.165 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.163+0000 7f5288ff9640 1 -- 10.20.193.57:0/3432976740 <== mon.0 v2:10.20.193.57:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v21)=0 v21) ==== 108+0+0 (secure 0 0 0) 0x7f528c06fd90 con 0x7f528c12b840 2026-02-20T16:29:23.166 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.163+0000 7f5292740640 1 -- 10.20.193.57:0/3432976740 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f528c12b840 msgr2=0x7f528c130070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:23.166 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.163+0000 7f5292740640 1 --2- 10.20.193.57:0/3432976740 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f528c12b840 0x7f528c130070 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f527c002fd0 tx=0x7f527c012b70 comp rx=0 tx=0).stop 2026-02-20T16:29:23.166 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.163+0000 7f5292740640 1 -- 10.20.193.57:0/3432976740 shutdown_connections 2026-02-20T16:29:23.166 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.163+0000 7f5292740640 1 --2- 10.20.193.57:0/3432976740 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f528c12c330 0x7f528c1305b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.166 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.163+0000 7f5292740640 1 --2- 10.20.193.57:0/3432976740 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f528c12b840 0x7f528c130070 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.166 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.163+0000 7f5292740640 1 --2- 10.20.193.57:0/3432976740 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f52680037e0 0x7f528c12fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.163+0000 7f5292740640 1 -- 10.20.193.57:0/3432976740 >> 10.20.193.57:0/3432976740 conn(0x7f528c09bf90 msgr2=0x7f528c09a400 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:23.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.163+0000 7f5292740640 1 -- 10.20.193.57:0/3432976740 shutdown_connections 2026-02-20T16:29:23.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.163+0000 7f5292740640 1 -- 10.20.193.57:0/3432976740 wait complete. 2026-02-20T16:29:23.167 INFO:tasks.ceph.mgr.y.trial057.stderr:2026-02-20T16:29:23.165+0000 7ffad83a7140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-20T16:29:23.168 INFO:tasks.ceph.mgr.x.trial057.stderr:2026-02-20T16:29:23.165+0000 7fd315bdb140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-20T16:29:23.174 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='trial057') 2026-02-20T16:29:23.179 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.176+0000 7fc96466d640 1 -- 10.20.193.57:0/3159455200 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fc93c0037d0 msgr2=0x7fc93c005c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:23.179 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.176+0000 7fc96466d640 1 --2- 10.20.193.57:0/3159455200 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fc93c0037d0 0x7fc93c005c50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc94c005f50 tx=0x7fc94c030960 comp rx=0 tx=0).stop 2026-02-20T16:29:23.179 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.176+0000 7fc96466d640 1 -- 10.20.193.57:0/3159455200 shutdown_connections 2026-02-20T16:29:23.179 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.176+0000 7fc96466d640 1 --2- 10.20.193.57:0/3159455200 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fc93c0037d0 0x7fc93c005c50 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.179 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.176+0000 7fc96466d640 1 --2- 10.20.193.57:0/3159455200 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fc95c06e390 0x7fc93c00e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.180 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.176+0000 7fc96466d640 1 --2- 10.20.193.57:0/3159455200 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fc95c06ecb0 0x7fc93c0084a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.180 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.176+0000 7fc96466d640 1 -- 10.20.193.57:0/3159455200 >> 10.20.193.57:0/3159455200 conn(0x7fc95c09f340 msgr2=0x7fc95c09f750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:23.180 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.176+0000 7fc96466d640 1 -- 10.20.193.57:0/3159455200 shutdown_connections 2026-02-20T16:29:23.180 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.176+0000 7fc96466d640 1 -- 10.20.193.57:0/3159455200 wait complete. 2026-02-20T16:29:23.180 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.177+0000 7fc96466d640 1 Processor -- start 2026-02-20T16:29:23.180 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.177+0000 7fc96466d640 1 -- start start 2026-02-20T16:29:23.183 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.177+0000 7fc96466d640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fc93c0037d0 0x7fc95c1c2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:23.183 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.177+0000 7fc96466d640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fc95c06e390 0x7fc95c1c34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:23.183 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.177+0000 7fc96466d640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fc95c06ecb0 0x7fc95c1c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:23.183 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.177+0000 7fc96466d640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7fc95c12eb40 con 0x7fc95c06e390 2026-02-20T16:29:23.183 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.177+0000 7fc96466d640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7fc95c06ea10 con 0x7fc95c06ecb0 2026-02-20T16:29:23.183 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.177+0000 7fc96466d640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7fc95c12ecc0 con 0x7fc93c0037d0 2026-02-20T16:29:23.183 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.177+0000 7fc961be1640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fc95c06e390 0x7fc95c1c34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:23.183 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.177+0000 7fc961be1640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fc95c06e390 0x7fc95c1c34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:36898/0 (socket says 10.20.193.57:36898) 2026-02-20T16:29:23.183 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.177+0000 7fc961be1640 1 -- 10.20.193.57:0/718015147 learned_addr learned my addr 10.20.193.57:0/718015147 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:29:23.183 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.177+0000 7fc9623e2640 1 --2- 10.20.193.57:0/718015147 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fc93c0037d0 0x7fc95c1c2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:23.184 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.177+0000 7fc962be3640 1 --2- 10.20.193.57:0/718015147 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fc95c06ecb0 0x7fc95c1c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:23.184 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.177+0000 7fc961be1640 1 -- 10.20.193.57:0/718015147 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fc93c0037d0 msgr2=0x7fc95c1c2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:23.184 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.177+0000 7fc961be1640 1 --2- 10.20.193.57:0/718015147 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fc93c0037d0 0x7fc95c1c2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.184 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.177+0000 7fc961be1640 1 -- 10.20.193.57:0/718015147 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fc95c06ecb0 msgr2=0x7fc95c1c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:23.184 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.177+0000 7fc961be1640 1 --2- 10.20.193.57:0/718015147 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fc95c06ecb0 0x7fc95c1c39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.184 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.177+0000 7fc961be1640 1 -- 10.20.193.57:0/718015147 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc95c08df10 con 0x7fc95c06e390 2026-02-20T16:29:23.184 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.177+0000 7fc9623e2640 1 --2- 10.20.193.57:0/718015147 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fc93c0037d0 0x7fc95c1c2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:29:23.184 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.177+0000 7fc961be1640 1 --2- 10.20.193.57:0/718015147 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fc95c06e390 0x7fc95c1c34a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc950012700 tx=0x7fc950012bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:29:23.184 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.178+0000 7fc942ffd640 1 -- 10.20.193.57:0/718015147 <== mon.0 v2:10.20.193.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc950010d60 con 0x7fc95c06e390 2026-02-20T16:29:23.184 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.178+0000 7fc942ffd640 1 -- 10.20.193.57:0/718015147 <== mon.0 v2:10.20.193.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9500048a0 con 0x7fc95c06e390 2026-02-20T16:29:23.184 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.178+0000 7fc96466d640 1 -- 10.20.193.57:0/718015147 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc95c129560 con 0x7fc95c06e390 2026-02-20T16:29:23.184 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.178+0000 7fc942ffd640 1 -- 10.20.193.57:0/718015147 <== mon.0 v2:10.20.193.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc950004cd0 con 0x7fc95c06e390 2026-02-20T16:29:23.185 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.178+0000 7fc96466d640 1 -- 10.20.193.57:0/718015147 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc95c1c6460 con 0x7fc95c06e390 2026-02-20T16:29:23.185 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.178+0000 7fc942ffd640 1 -- 10.20.193.57:0/718015147 <== mon.0 v2:10.20.193.57:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fc950022030 con 0x7fc95c06e390 2026-02-20T16:29:23.185 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.178+0000 7fc942ffd640 1 -- 10.20.193.57:0/718015147 <== mon.0 v2:10.20.193.57:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7fc950023d90 con 0x7fc95c06e390 2026-02-20T16:29:23.185 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.178+0000 7fc96466d640 1 -- 10.20.193.57:0/718015147 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc95c12ff60 con 0x7fc95c06e390 2026-02-20T16:29:23.185 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.179+0000 7fc942ffd640 1 -- 10.20.193.57:0/718015147 <== mon.0 v2:10.20.193.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7fc9500233f0 con 0x7fc95c06e390 2026-02-20T16:29:23.202 INFO:tasks.ceph.mgr.y.trial057.stderr:2026-02-20T16:29:23.200+0000 7ffad83a7140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-20T16:29:23.202 INFO:tasks.ceph.mgr.x.trial057.stderr:2026-02-20T16:29:23.200+0000 7fd315bdb140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-20T16:29:23.213 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.211+0000 7fc96466d640 1 -- 10.20.193.57:0/718015147 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7fc95c050a10 con 0x7fc95c06e390 2026-02-20T16:29:23.214 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.212+0000 7fc942ffd640 1 -- 10.20.193.57:0/718015147 <== mon.0 v2:10.20.193.57:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v22)=0 v22) ==== 117+0+0 (secure 0 0 0) 0x7fc950005390 con 0x7fc95c06e390 2026-02-20T16:29:23.215 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.213+0000 7fc96466d640 1 -- 10.20.193.57:0/718015147 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fc95c06e390 msgr2=0x7fc95c1c34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:23.216 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.213+0000 7fc96466d640 1 --2- 10.20.193.57:0/718015147 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fc95c06e390 0x7fc95c1c34a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc950012700 tx=0x7fc950012bd0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.216 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.213+0000 7fc96466d640 1 -- 10.20.193.57:0/718015147 shutdown_connections 2026-02-20T16:29:23.216 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.213+0000 7fc96466d640 1 --2- 10.20.193.57:0/718015147 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fc95c06ecb0 0x7fc95c1c39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.216 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.213+0000 7fc96466d640 1 --2- 10.20.193.57:0/718015147 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fc95c06e390 0x7fc95c1c34a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.216 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.213+0000 7fc96466d640 1 --2- 10.20.193.57:0/718015147 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fc93c0037d0 0x7fc95c1c2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.216 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.213+0000 7fc96466d640 1 -- 10.20.193.57:0/718015147 >> 10.20.193.57:0/718015147 conn(0x7fc95c09f340 msgr2=0x7fc95c1b6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:23.216 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.213+0000 7fc96466d640 1 -- 10.20.193.57:0/718015147 shutdown_connections 2026-02-20T16:29:23.216 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.213+0000 7fc96466d640 1 -- 10.20.193.57:0/718015147 wait complete. 2026-02-20T16:29:23.223 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='trial057') 2026-02-20T16:29:23.224 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='trial057') 2026-02-20T16:29:23.224 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='trial057') 2026-02-20T16:29:23.225 INFO:tasks.ceph.mgr.x.trial057.stderr:2026-02-20T16:29:23.223+0000 7fd315bdb140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-20T16:29:23.226 INFO:tasks.ceph.mgr.y.trial057.stderr:2026-02-20T16:29:23.224+0000 7ffad83a7140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-20T16:29:23.252 INFO:tasks.ceph.mgr.x.trial057.stderr:2026-02-20T16:29:23.250+0000 7fd315bdb140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-20T16:29:23.252 INFO:tasks.ceph.mgr.y.trial057.stderr:2026-02-20T16:29:23.250+0000 7ffad83a7140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-20T16:29:23.310 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.304+0000 7f32b47d7640 1 -- 10.20.193.57:0/4116645767 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f32ac070e20 msgr2=0x7f328c00e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:23.310 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.304+0000 7f32b47d7640 1 --2- 10.20.193.57:0/4116645767 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f32ac070e20 0x7f328c00e6f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f329c0029b0 tx=0x7f329c031680 comp rx=0 tx=0).stop 2026-02-20T16:29:23.310 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.304+0000 7f32b47d7640 1 -- 10.20.193.57:0/4116645767 shutdown_connections 2026-02-20T16:29:23.310 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.304+0000 7f32b47d7640 1 --2- 10.20.193.57:0/4116645767 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f32ac070e20 0x7f328c00e6f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.310 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.304+0000 7f32b47d7640 1 --2- 10.20.193.57:0/4116645767 >> v2:10.20.193.57:3300/0 conn(0x7f32ac128590 0x7f328c007a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.310 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.304+0000 7f32b47d7640 1 --2- 10.20.193.57:0/4116645767 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f32ac128eb0 0x7f328c007510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.311 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.304+0000 7f32b47d7640 1 -- 10.20.193.57:0/4116645767 >> 10.20.193.57:0/4116645767 conn(0x7f32ac09a000 msgr2=0x7f32ac0977c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:23.311 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.304+0000 7f32b47d7640 1 -- 10.20.193.57:0/4116645767 shutdown_connections 2026-02-20T16:29:23.311 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.304+0000 7f32b47d7640 1 -- 10.20.193.57:0/4116645767 wait complete. 2026-02-20T16:29:23.311 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.305+0000 7f32b47d7640 1 Processor -- start 2026-02-20T16:29:23.311 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.305+0000 7f32b47d7640 1 -- start start 2026-02-20T16:29:23.311 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.305+0000 7f32b47d7640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f328c0037b0 0x7f32ac090910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:23.311 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.305+0000 7f32b47d7640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f32ac070e20 0x7f32ac090e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:23.311 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.305+0000 7f32b47d7640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f32ac128590 0x7f32ac091390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:23.311 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.305+0000 7f32b47d7640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f32ac12c130 con 0x7f32ac070e20 2026-02-20T16:29:23.311 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.305+0000 7f32b47d7640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f32ac12bfb0 con 0x7f328c0037b0 2026-02-20T16:29:23.311 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.305+0000 7f32b47d7640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f32ac12c2b0 con 0x7f32ac128590 2026-02-20T16:29:23.312 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.305+0000 7f32b254c640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f328c0037b0 0x7f32ac090910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:23.312 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.305+0000 7f32b254c640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f328c0037b0 0x7f32ac090910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3301/0 says I am v2:10.20.193.57:58618/0 (socket says 10.20.193.57:58618) 2026-02-20T16:29:23.312 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.305+0000 7f32b254c640 1 -- 10.20.193.57:0/3491043995 learned_addr learned my addr 10.20.193.57:0/3491043995 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:29:23.312 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.305+0000 7f32b1d4b640 1 --2- 10.20.193.57:0/3491043995 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f32ac070e20 0x7f32ac090e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:23.312 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.305+0000 7f32b2d4d640 1 --2- 10.20.193.57:0/3491043995 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f32ac128590 0x7f32ac091390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:23.312 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.306+0000 7f32b254c640 1 -- 10.20.193.57:0/3491043995 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f32ac128590 msgr2=0x7f32ac091390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:23.312 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.306+0000 7f32b254c640 1 --2- 10.20.193.57:0/3491043995 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f32ac128590 0x7f32ac091390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.312 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.306+0000 7f32b254c640 1 -- 10.20.193.57:0/3491043995 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f32ac070e20 msgr2=0x7f32ac090e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:23.312 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.306+0000 7f32b254c640 1 --2- 10.20.193.57:0/3491043995 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f32ac070e20 0x7f32ac090e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.312 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.306+0000 7f32b254c640 1 -- 10.20.193.57:0/3491043995 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32ac0925f0 con 0x7f328c0037b0 2026-02-20T16:29:23.313 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.306+0000 7f32b254c640 1 --2- 10.20.193.57:0/3491043995 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f328c0037b0 0x7f32ac090910 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f329c03b040 tx=0x7f329c037940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:29:23.313 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.306+0000 7f3292ffd640 1 -- 10.20.193.57:0/3491043995 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329c03d040 con 0x7f328c0037b0 2026-02-20T16:29:23.313 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.306+0000 7f3292ffd640 1 -- 10.20.193.57:0/3491043995 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f329c046070 con 0x7f328c0037b0 2026-02-20T16:29:23.313 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.306+0000 7f32b47d7640 1 -- 10.20.193.57:0/3491043995 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32ac093130 con 0x7f328c0037b0 2026-02-20T16:29:23.313 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.306+0000 7f3292ffd640 1 -- 10.20.193.57:0/3491043995 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329c038e60 con 0x7f328c0037b0 2026-02-20T16:29:23.313 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.306+0000 7f32b47d7640 1 -- 10.20.193.57:0/3491043995 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f32ac0970f0 con 0x7f328c0037b0 2026-02-20T16:29:23.313 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.306+0000 7f3292ffd640 1 -- 10.20.193.57:0/3491043995 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f329c040070 con 0x7f328c0037b0 2026-02-20T16:29:23.313 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.306+0000 7f3292ffd640 1 -- 10.20.193.57:0/3491043995 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7f329c04b9e0 con 0x7f328c0037b0 2026-02-20T16:29:23.313 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.306+0000 7f32b47d7640 1 -- 10.20.193.57:0/3491043995 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32ac12cbb0 con 0x7f328c0037b0 2026-02-20T16:29:23.314 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.308+0000 7f3292ffd640 1 -- 10.20.193.57:0/3491043995 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f329c019040 con 0x7f328c0037b0 2026-02-20T16:29:23.315 INFO:tasks.ceph.mgr.y.trial057.stderr:2026-02-20T16:29:23.313+0000 7ffad83a7140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-20T16:29:23.315 INFO:tasks.ceph.mgr.x.trial057.stderr:2026-02-20T16:29:23.313+0000 7fd315bdb140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-20T16:29:23.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.336+0000 7f32b47d7640 1 -- 10.20.193.57:0/3491043995 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f32ac074840 con 0x7f328c0037b0 2026-02-20T16:29:23.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.338+0000 7f3292ffd640 1 -- 10.20.193.57:0/3491043995 <== mon.1 v2:10.20.193.57:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v23)=0 v23) ==== 122+0+0 (secure 0 0 0) 0x7f329c037d70 con 0x7f328c0037b0 2026-02-20T16:29:23.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.338+0000 7f32b47d7640 1 -- 10.20.193.57:0/3491043995 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f328c0037b0 msgr2=0x7f32ac090910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:23.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.338+0000 7f32b47d7640 1 --2- 10.20.193.57:0/3491043995 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f328c0037b0 0x7f32ac090910 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f329c03b040 tx=0x7f329c037940 comp rx=0 tx=0).stop 2026-02-20T16:29:23.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.338+0000 7f32b47d7640 1 -- 10.20.193.57:0/3491043995 shutdown_connections 2026-02-20T16:29:23.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.338+0000 7f32b47d7640 1 --2- 10.20.193.57:0/3491043995 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f32ac128590 0x7f32ac091390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.338+0000 7f32b47d7640 1 --2- 10.20.193.57:0/3491043995 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f32ac070e20 0x7f32ac090e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.338+0000 7f32b47d7640 1 --2- 10.20.193.57:0/3491043995 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f328c0037b0 0x7f32ac090910 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.338+0000 7f32b47d7640 1 -- 10.20.193.57:0/3491043995 >> 10.20.193.57:0/3491043995 conn(0x7f32ac09a000 msgr2=0x7f32ac071c90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:23.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.338+0000 7f32b47d7640 1 -- 10.20.193.57:0/3491043995 shutdown_connections 2026-02-20T16:29:23.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.338+0000 7f32b47d7640 1 -- 10.20.193.57:0/3491043995 wait complete. 2026-02-20T16:29:23.342 INFO:tasks.ceph.mgr.x.trial057.stderr:2026-02-20T16:29:23.338+0000 7fd315bdb140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-20T16:29:23.343 INFO:tasks.ceph.mgr.y.trial057.stderr:2026-02-20T16:29:23.339+0000 7ffad83a7140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-20T16:29:23.349 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='trial057') 2026-02-20T16:29:23.349 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='trial057') 2026-02-20T16:29:23.349 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='trial057') 2026-02-20T16:29:23.349 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='trial057') 2026-02-20T16:29:23.350 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='trial057') 2026-02-20T16:29:23.350 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='trial057') 2026-02-20T16:29:23.350 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='trial057') 2026-02-20T16:29:23.350 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='trial057') 2026-02-20T16:29:23.350 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='trial057') 2026-02-20T16:29:23.350 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='trial057') 2026-02-20T16:29:23.350 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='trial057') 2026-02-20T16:29:23.350 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='trial057') 2026-02-20T16:29:23.351 DEBUG:teuthology.orchestra.run.trial057:> sudo ceph --cluster ceph config dump 2026-02-20T16:29:23.390 INFO:tasks.ceph.mgr.x.trial057.stderr:2026-02-20T16:29:23.388+0000 7fd315bdb140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-20T16:29:23.392 INFO:tasks.ceph.mgr.y.trial057.stderr:2026-02-20T16:29:23.389+0000 7ffad83a7140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-20T16:29:23.433 INFO:tasks.ceph.mgr.x.trial057.stderr:2026-02-20T16:29:23.431+0000 7fd315bdb140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-20T16:29:23.434 INFO:tasks.ceph.mgr.y.trial057.stderr:2026-02-20T16:29:23.431+0000 7ffad83a7140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-20T16:29:23.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.454+0000 7fb7c235d640 1 -- 10.20.193.57:0/2184079831 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fb7bc12d100 msgr2=0x7fb7bc093470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:23.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.454+0000 7fb7c235d640 1 --2- 10.20.193.57:0/2184079831 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fb7bc12d100 0x7fb7bc093470 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac009a00 tx=0x7fb7ac02f1f0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.454+0000 7fb7c235d640 1 -- 10.20.193.57:0/2184079831 shutdown_connections 2026-02-20T16:29:23.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.454+0000 7fb7c235d640 1 --2- 10.20.193.57:0/2184079831 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fb7bc0939b0 0x7fb7bc093e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.454+0000 7fb7c235d640 1 --2- 10.20.193.57:0/2184079831 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fb7bc12d100 0x7fb7bc093470 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.454+0000 7fb7c235d640 1 --2- 10.20.193.57:0/2184079831 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fb7bc12c7e0 0x7fb7bc12cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.454+0000 7fb7c235d640 1 -- 10.20.193.57:0/2184079831 >> 10.20.193.57:0/2184079831 conn(0x7fb7bc09a280 msgr2=0x7fb7bc097a10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:23.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.454+0000 7fb7c235d640 1 -- 10.20.193.57:0/2184079831 shutdown_connections 2026-02-20T16:29:23.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.454+0000 7fb7c235d640 1 -- 10.20.193.57:0/2184079831 wait complete. 2026-02-20T16:29:23.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.454+0000 7fb7c235d640 1 Processor -- start 2026-02-20T16:29:23.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.454+0000 7fb7c235d640 1 -- start start 2026-02-20T16:29:23.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.454+0000 7fb7c235d640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fb7bc0939b0 0x7fb7bc126860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:23.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.454+0000 7fb7c235d640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fb7bc12c7e0 0x7fb7bc126da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:23.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.454+0000 7fb7c235d640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fb7bc12d100 0x7fb7bc132300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:23.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.454+0000 7fb7c235d640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7fb7bc1344f0 con 0x7fb7bc0939b0 2026-02-20T16:29:23.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.454+0000 7fb7c235d640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7fb7bc134370 con 0x7fb7bc12c7e0 2026-02-20T16:29:23.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.454+0000 7fb7c235d640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7fb7bc134670 con 0x7fb7bc12d100 2026-02-20T16:29:23.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.454+0000 7fb7bbfff640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fb7bc0939b0 0x7fb7bc126860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:23.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.454+0000 7fb7bb7fe640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fb7bc12c7e0 0x7fb7bc126da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:23.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.454+0000 7fb7bbfff640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fb7bc0939b0 0x7fb7bc126860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:36914/0 (socket says 10.20.193.57:36914) 2026-02-20T16:29:23.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.454+0000 7fb7bbfff640 1 -- 10.20.193.57:0/2467301991 learned_addr learned my addr 10.20.193.57:0/2467301991 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:29:23.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.454+0000 7fb7c08d3640 1 --2- 10.20.193.57:0/2467301991 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fb7bc12d100 0x7fb7bc132300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:23.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.454+0000 7fb7bbfff640 1 -- 10.20.193.57:0/2467301991 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fb7bc12d100 msgr2=0x7fb7bc132300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:23.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.454+0000 7fb7bbfff640 1 --2- 10.20.193.57:0/2467301991 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fb7bc12d100 0x7fb7bc132300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.454+0000 7fb7bbfff640 1 -- 10.20.193.57:0/2467301991 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fb7bc12c7e0 msgr2=0x7fb7bc126da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:23.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.454+0000 7fb7bbfff640 1 --2- 10.20.193.57:0/2467301991 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fb7bc12c7e0 0x7fb7bc126da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.454+0000 7fb7bbfff640 1 -- 10.20.193.57:0/2467301991 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7bc06fcc0 con 0x7fb7bc0939b0 2026-02-20T16:29:23.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.454+0000 7fb7bbfff640 1 --2- 10.20.193.57:0/2467301991 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fb7bc0939b0 0x7fb7bc126860 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb7a800d980 tx=0x7fb7a800de50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:29:23.461 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.454+0000 7fb7b8ff9640 1 -- 10.20.193.57:0/2467301991 <== mon.0 v2:10.20.193.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a8014070 con 0x7fb7bc0939b0 2026-02-20T16:29:23.461 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.454+0000 7fb7b8ff9640 1 -- 10.20.193.57:0/2467301991 <== mon.0 v2:10.20.193.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb7a800b900 con 0x7fb7bc0939b0 2026-02-20T16:29:23.461 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.454+0000 7fb7b8ff9640 1 -- 10.20.193.57:0/2467301991 <== mon.0 v2:10.20.193.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a800bd30 con 0x7fb7bc0939b0 2026-02-20T16:29:23.461 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.456+0000 7fb7c235d640 1 -- 10.20.193.57:0/2467301991 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7bc06fa00 con 0x7fb7bc0939b0 2026-02-20T16:29:23.461 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.456+0000 7fb7c235d640 1 -- 10.20.193.57:0/2467301991 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7bc06f090 con 0x7fb7bc0939b0 2026-02-20T16:29:23.461 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.456+0000 7fb7b8ff9640 1 -- 10.20.193.57:0/2467301991 <== mon.0 v2:10.20.193.57:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fb7a80048a0 con 0x7fb7bc0939b0 2026-02-20T16:29:23.461 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.456+0000 7fb7b8ff9640 1 -- 10.20.193.57:0/2467301991 <== mon.0 v2:10.20.193.57:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7fb7a80055a0 con 0x7fb7bc0939b0 2026-02-20T16:29:23.461 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.456+0000 7fb7c235d640 1 -- 10.20.193.57:0/2467301991 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7bc098b30 con 0x7fb7bc0939b0 2026-02-20T16:29:23.462 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.457+0000 7fb7b8ff9640 1 -- 10.20.193.57:0/2467301991 <== mon.0 v2:10.20.193.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7fb7bc098b30 con 0x7fb7bc0939b0 2026-02-20T16:29:23.462 INFO:tasks.ceph.mgr.x.trial057.stderr:2026-02-20T16:29:23.458+0000 7fd315bdb140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-20T16:29:23.462 INFO:tasks.ceph.mgr.y.trial057.stderr:2026-02-20T16:29:23.458+0000 7ffad83a7140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-20T16:29:23.485 INFO:tasks.ceph.mgr.x.trial057.stderr:2026-02-20T16:29:23.484+0000 7fd315bdb140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-20T16:29:23.485 INFO:tasks.ceph.mgr.y.trial057.stderr:2026-02-20T16:29:23.484+0000 7ffad83a7140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-20T16:29:23.486 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.485+0000 7fb7c235d640 1 -- 10.20.193.57:0/2467301991 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fb7bc095fa0 con 0x7fb7bc0939b0 2026-02-20T16:29:23.487 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.485+0000 7fb7b8ff9640 1 -- 10.20.193.57:0/2467301991 <== mon.0 v2:10.20.193.57:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v23) ==== 59+0+1472 (secure 0 0 0) 0x7fb7bc06fcc0 con 0x7fb7bc0939b0 2026-02-20T16:29:23.487 INFO:teuthology.orchestra.run.trial057.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-20T16:29:23.487 INFO:teuthology.orchestra.run.trial057.stdout:mon advanced mon_op_complaint_time 120 2026-02-20T16:29:23.487 INFO:teuthology.orchestra.run.trial057.stdout:mgr advanced client_mount_timeout 30 2026-02-20T16:29:23.488 INFO:teuthology.orchestra.run.trial057.stdout:mgr advanced debug_client 20/20 2026-02-20T16:29:23.488 INFO:teuthology.orchestra.run.trial057.stdout:mgr advanced debug_mgr 20/20 2026-02-20T16:29:23.488 INFO:teuthology.orchestra.run.trial057.stdout:mgr advanced debug_ms 1/1 2026-02-20T16:29:23.488 INFO:teuthology.orchestra.run.trial057.stdout:mgr dev mon_warn_on_pool_no_app false 2026-02-20T16:29:23.488 INFO:teuthology.orchestra.run.trial057.stdout:osd advanced osd_op_complaint_time 180.000000 2026-02-20T16:29:23.488 INFO:teuthology.orchestra.run.trial057.stdout:mds advanced debug_mds 20/20 2026-02-20T16:29:23.488 INFO:teuthology.orchestra.run.trial057.stdout:mds advanced debug_mds_balancer 20/20 2026-02-20T16:29:23.488 INFO:teuthology.orchestra.run.trial057.stdout:mds advanced debug_ms 2/2 2026-02-20T16:29:23.488 INFO:teuthology.orchestra.run.trial057.stdout:mds dev mds_debug_frag true 2026-02-20T16:29:23.488 INFO:teuthology.orchestra.run.trial057.stdout:mds dev mds_debug_scatterstat true 2026-02-20T16:29:23.488 INFO:teuthology.orchestra.run.trial057.stdout:mds advanced mds_op_complaint_time 180.000000 2026-02-20T16:29:23.489 INFO:teuthology.orchestra.run.trial057.stdout:mds dev mds_verify_scatter true 2026-02-20T16:29:23.489 INFO:teuthology.orchestra.run.trial057.stdout:mds advanced osd_op_complaint_time 180.000000 2026-02-20T16:29:23.489 INFO:teuthology.orchestra.run.trial057.stdout:mds advanced rados_mon_op_timeout 900 2026-02-20T16:29:23.489 INFO:teuthology.orchestra.run.trial057.stdout:mds advanced rados_osd_op_timeout 900 2026-02-20T16:29:23.489 INFO:teuthology.orchestra.run.trial057.stdout:client advanced client_mount_timeout 600 2026-02-20T16:29:23.489 INFO:teuthology.orchestra.run.trial057.stdout:client advanced debug_client 20/20 2026-02-20T16:29:23.489 INFO:teuthology.orchestra.run.trial057.stdout:client advanced debug_ms 1/1 2026-02-20T16:29:23.489 INFO:teuthology.orchestra.run.trial057.stdout:client advanced rados_mon_op_timeout 900 2026-02-20T16:29:23.489 INFO:teuthology.orchestra.run.trial057.stdout:client advanced rados_osd_op_timeout 900 2026-02-20T16:29:23.490 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.485+0000 7fb7c235d640 1 -- 10.20.193.57:0/2467301991 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fb7bc0939b0 msgr2=0x7fb7bc126860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:23.490 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.485+0000 7fb7c235d640 1 --2- 10.20.193.57:0/2467301991 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fb7bc0939b0 0x7fb7bc126860 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb7a800d980 tx=0x7fb7a800de50 comp rx=0 tx=0).stop 2026-02-20T16:29:23.490 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.485+0000 7fb7c235d640 1 -- 10.20.193.57:0/2467301991 shutdown_connections 2026-02-20T16:29:23.490 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.485+0000 7fb7c235d640 1 --2- 10.20.193.57:0/2467301991 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fb7bc12d100 0x7fb7bc132300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.491 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.485+0000 7fb7c235d640 1 --2- 10.20.193.57:0/2467301991 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fb7bc12c7e0 0x7fb7bc126da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.491 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.485+0000 7fb7c235d640 1 --2- 10.20.193.57:0/2467301991 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fb7bc0939b0 0x7fb7bc126860 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.491 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.485+0000 7fb7c235d640 1 -- 10.20.193.57:0/2467301991 >> 10.20.193.57:0/2467301991 conn(0x7fb7bc09a280 msgr2=0x7fb7bc129340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:23.491 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.485+0000 7fb7c235d640 1 -- 10.20.193.57:0/2467301991 shutdown_connections 2026-02-20T16:29:23.491 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.485+0000 7fb7c235d640 1 -- 10.20.193.57:0/2467301991 wait complete. 2026-02-20T16:29:23.493 INFO:tasks.ceph:Setting crush tunables to default 2026-02-20T16:29:23.494 DEBUG:teuthology.orchestra.run.trial057:> sudo ceph --cluster ceph osd crush tunables default 2026-02-20T16:29:23.511 INFO:tasks.ceph.mgr.x.trial057.stderr:2026-02-20T16:29:23.510+0000 7fd315bdb140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-20T16:29:23.512 INFO:tasks.ceph.mgr.y.trial057.stderr:2026-02-20T16:29:23.511+0000 7ffad83a7140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-20T16:29:23.535 INFO:tasks.ceph.mgr.x.trial057.stderr:2026-02-20T16:29:23.534+0000 7fd315bdb140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-20T16:29:23.535 INFO:tasks.ceph.mgr.y.trial057.stderr:2026-02-20T16:29:23.534+0000 7ffad83a7140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-20T16:29:23.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.558+0000 7f7d33ac2640 1 -- 10.20.193.57:0/153808121 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f7d2c095070 msgr2=0x7f7d2c131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:23.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.558+0000 7f7d33ac2640 1 --2- 10.20.193.57:0/153808121 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f7d2c095070 0x7f7d2c131d50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7d20009930 tx=0x7f7d2002f110 comp rx=0 tx=0).stop 2026-02-20T16:29:23.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.558+0000 7f7d33ac2640 1 -- 10.20.193.57:0/153808121 shutdown_connections 2026-02-20T16:29:23.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.558+0000 7f7d33ac2640 1 --2- 10.20.193.57:0/153808121 >> v2:10.20.193.57:3300/0 conn(0x7f7d2c132290 0x7f7d2c134680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.558+0000 7f7d33ac2640 1 --2- 10.20.193.57:0/153808121 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f7d2c095070 0x7f7d2c131d50 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.558+0000 7f7d33ac2640 1 -- 10.20.193.57:0/153808121 >> 10.20.193.57:0/153808121 conn(0x7f7d2c09a140 msgr2=0x7f7d2c097a10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:23.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.558+0000 7f7d33ac2640 1 -- 10.20.193.57:0/153808121 shutdown_connections 2026-02-20T16:29:23.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.558+0000 7f7d33ac2640 1 -- 10.20.193.57:0/153808121 wait complete. 2026-02-20T16:29:23.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.559+0000 7f7d33ac2640 1 Processor -- start 2026-02-20T16:29:23.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.559+0000 7f7d33ac2640 1 -- start start 2026-02-20T16:29:23.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.559+0000 7f7d33ac2640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f7d2c094580 0x7f7d2c130840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:23.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.559+0000 7f7d33ac2640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f7d2c095070 0x7f7d2c130d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:23.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.559+0000 7f7d33ac2640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f7d2c132290 0x7f7d2c1312c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:23.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.559+0000 7f7d33ac2640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f7d2c135550 con 0x7f7d2c094580 2026-02-20T16:29:23.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.559+0000 7f7d33ac2640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f7d2c1353d0 con 0x7f7d2c095070 2026-02-20T16:29:23.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.559+0000 7f7d33ac2640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f7d2c1356d0 con 0x7f7d2c132290 2026-02-20T16:29:23.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.559+0000 7f7d31837640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f7d2c094580 0x7f7d2c130840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:23.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.559+0000 7f7d31837640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f7d2c094580 0x7f7d2c130840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:36934/0 (socket says 10.20.193.57:36934) 2026-02-20T16:29:23.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.559+0000 7f7d31036640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f7d2c095070 0x7f7d2c130d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:23.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.559+0000 7f7d31837640 1 -- 10.20.193.57:0/3325311 learned_addr learned my addr 10.20.193.57:0/3325311 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:29:23.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.559+0000 7f7d32038640 1 --2- 10.20.193.57:0/3325311 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f7d2c132290 0x7f7d2c1312c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:23.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.559+0000 7f7d31837640 1 -- 10.20.193.57:0/3325311 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f7d2c132290 msgr2=0x7f7d2c1312c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:23.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.559+0000 7f7d31837640 1 --2- 10.20.193.57:0/3325311 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f7d2c132290 0x7f7d2c1312c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.559+0000 7f7d31837640 1 -- 10.20.193.57:0/3325311 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f7d2c095070 msgr2=0x7f7d2c130d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:23.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.559+0000 7f7d31837640 1 --2- 10.20.193.57:0/3325311 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f7d2c095070 0x7f7d2c130d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.559+0000 7f7d31837640 1 -- 10.20.193.57:0/3325311 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d2c070de0 con 0x7f7d2c094580 2026-02-20T16:29:23.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.559+0000 7f7d31837640 1 --2- 10.20.193.57:0/3325311 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f7d2c094580 0x7f7d2c130840 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c00c700 tx=0x7f7d1c00cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:29:23.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.559+0000 7f7d1a7fc640 1 -- 10.20.193.57:0/3325311 <== mon.0 v2:10.20.193.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c004230 con 0x7f7d2c094580 2026-02-20T16:29:23.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.559+0000 7f7d1a7fc640 1 -- 10.20.193.57:0/3325311 <== mon.0 v2:10.20.193.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d1c0044c0 con 0x7f7d2c094580 2026-02-20T16:29:23.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.559+0000 7f7d33ac2640 1 -- 10.20.193.57:0/3325311 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d2c071620 con 0x7f7d2c094580 2026-02-20T16:29:23.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.559+0000 7f7d1a7fc640 1 -- 10.20.193.57:0/3325311 <== mon.0 v2:10.20.193.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c0038f0 con 0x7f7d2c094580 2026-02-20T16:29:23.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.559+0000 7f7d33ac2640 1 -- 10.20.193.57:0/3325311 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d2c072670 con 0x7f7d2c094580 2026-02-20T16:29:23.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.559+0000 7f7d1a7fc640 1 -- 10.20.193.57:0/3325311 <== mon.0 v2:10.20.193.57:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f7d1c023060 con 0x7f7d2c094580 2026-02-20T16:29:23.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.559+0000 7f7d1a7fc640 1 -- 10.20.193.57:0/3325311 <== mon.0 v2:10.20.193.57:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7f7d1c012910 con 0x7f7d2c094580 2026-02-20T16:29:23.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.560+0000 7f7d33ac2640 1 -- 10.20.193.57:0/3325311 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d2c094960 con 0x7f7d2c094580 2026-02-20T16:29:23.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.561+0000 7f7d1a7fc640 1 -- 10.20.193.57:0/3325311 <== mon.0 v2:10.20.193.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f7d1c012b10 con 0x7f7d2c094580 2026-02-20T16:29:23.591 INFO:tasks.ceph.mgr.x.trial057.stderr:2026-02-20T16:29:23.589+0000 7fd315bdb140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-20T16:29:23.591 INFO:tasks.ceph.mgr.y.trial057.stderr:2026-02-20T16:29:23.590+0000 7ffad83a7140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-20T16:29:23.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.590+0000 7f7d33ac2640 1 -- 10.20.193.57:0/3325311 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f7d2c074840 con 0x7f7d2c094580 2026-02-20T16:29:23.592 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.591+0000 7f7d1a7fc640 1 -- 10.20.193.57:0/3325311 <== mon.0 v2:10.20.193.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f7d1c012cf0 con 0x7f7d2c094580 2026-02-20T16:29:23.592 INFO:teuthology.orchestra.run.trial057.stderr:adjusted tunables profile to default 2026-02-20T16:29:23.593 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.591+0000 7f7d33ac2640 1 -- 10.20.193.57:0/3325311 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f7d2c094580 msgr2=0x7f7d2c130840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:23.593 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.591+0000 7f7d33ac2640 1 --2- 10.20.193.57:0/3325311 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f7d2c094580 0x7f7d2c130840 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c00c700 tx=0x7f7d1c00cbd0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.593 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.591+0000 7f7d33ac2640 1 -- 10.20.193.57:0/3325311 shutdown_connections 2026-02-20T16:29:23.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.591+0000 7f7d33ac2640 1 --2- 10.20.193.57:0/3325311 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f7d2c132290 0x7f7d2c1312c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.591+0000 7f7d33ac2640 1 --2- 10.20.193.57:0/3325311 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f7d2c095070 0x7f7d2c130d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.591+0000 7f7d33ac2640 1 --2- 10.20.193.57:0/3325311 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f7d2c094580 0x7f7d2c130840 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.591+0000 7f7d33ac2640 1 -- 10.20.193.57:0/3325311 >> 10.20.193.57:0/3325311 conn(0x7f7d2c09a140 msgr2=0x7f7d2c12cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:23.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.591+0000 7f7d33ac2640 1 -- 10.20.193.57:0/3325311 shutdown_connections 2026-02-20T16:29:23.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.591+0000 7f7d33ac2640 1 -- 10.20.193.57:0/3325311 wait complete. 2026-02-20T16:29:23.601 INFO:tasks.ceph:check_enable_crimson: False 2026-02-20T16:29:23.601 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-20T16:29:23.602 DEBUG:teuthology.orchestra.run.trial057:> set -ex 2026-02-20T16:29:23.602 DEBUG:teuthology.orchestra.run.trial057:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-20T16:29:23.614 INFO:tasks.ceph.mgr.x.trial057.stderr:2026-02-20T16:29:23.613+0000 7fd315bdb140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-20T16:29:23.615 INFO:tasks.ceph.mgr.y.trial057.stderr:2026-02-20T16:29:23.613+0000 7ffad83a7140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-20T16:29:23.637 DEBUG:teuthology.orchestra.run.trial057:> set -ex 2026-02-20T16:29:23.638 DEBUG:teuthology.orchestra.run.trial057:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-20T16:29:23.638 INFO:tasks.ceph.mgr.x.trial057.stderr:2026-02-20T16:29:23.637+0000 7fd315bdb140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-20T16:29:23.639 INFO:tasks.ceph.mgr.y.trial057.stderr:2026-02-20T16:29:23.637+0000 7ffad83a7140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-20T16:29:23.662 DEBUG:teuthology.orchestra.run.trial057:> set -ex 2026-02-20T16:29:23.662 DEBUG:teuthology.orchestra.run.trial057:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-20T16:29:23.686 INFO:tasks.ceph.mgr.y.trial057.stderr:2026-02-20T16:29:23.684+0000 7ffad83a7140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-20T16:29:23.686 INFO:tasks.ceph.mgr.x.trial057.stderr:2026-02-20T16:29:23.685+0000 7fd315bdb140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-20T16:29:23.707 INFO:tasks.ceph.mgr.y.trial057.stderr:2026-02-20T16:29:23.706+0000 7ffad83a7140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-20T16:29:23.707 INFO:tasks.ceph.mgr.x.trial057.stderr:2026-02-20T16:29:23.706+0000 7fd315bdb140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-20T16:29:23.709 DEBUG:teuthology.orchestra.run.trial057:> set -ex 2026-02-20T16:29:23.709 DEBUG:teuthology.orchestra.run.trial057:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2026-02-20T16:29:23.753 INFO:tasks.ceph.mgr.y.trial057.stderr:2026-02-20T16:29:23.752+0000 7ffad83a7140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-20T16:29:23.754 INFO:tasks.ceph.mgr.x.trial057.stderr:2026-02-20T16:29:23.752+0000 7fd315bdb140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-20T16:29:23.773 DEBUG:teuthology.orchestra.run.trial057:> sudo ceph --cluster ceph osd new a3139827-dc3c-46f9-b211-d376e3dc92f9 0 2026-02-20T16:29:23.825 INFO:tasks.ceph.mgr.x.trial057.stderr:2026-02-20T16:29:23.824+0000 7fd315bdb140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-20T16:29:23.826 INFO:tasks.ceph.mgr.y.trial057.stderr:2026-02-20T16:29:23.824+0000 7ffad83a7140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-20T16:29:23.847 INFO:tasks.ceph.mgr.x.trial057.stderr:2026-02-20T16:29:23.846+0000 7fd315bdb140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-20T16:29:23.848 INFO:tasks.ceph.mgr.y.trial057.stderr:2026-02-20T16:29:23.846+0000 7ffad83a7140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-20T16:29:23.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.879+0000 7f820cfd7640 1 -- 10.20.193.57:0/1799888257 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f820812f0e0 msgr2=0x7f820812f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:23.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.879+0000 7f820cfd7640 1 --2- 10.20.193.57:0/1799888257 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f820812f0e0 0x7f820812f4c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f81fc009990 tx=0x7f81fc02f110 comp rx=0 tx=0).stop 2026-02-20T16:29:23.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.879+0000 7f820cfd7640 1 -- 10.20.193.57:0/1799888257 shutdown_connections 2026-02-20T16:29:23.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.879+0000 7f820cfd7640 1 --2- 10.20.193.57:0/1799888257 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f820809d910 0x7f8208136fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.879+0000 7f820cfd7640 1 --2- 10.20.193.57:0/1799888257 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f820812f0e0 0x7f820812f4c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.879+0000 7f820cfd7640 1 -- 10.20.193.57:0/1799888257 >> 10.20.193.57:0/1799888257 conn(0x7f820806e3a0 msgr2=0x7f820806e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:23.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.879+0000 7f820cfd7640 1 -- 10.20.193.57:0/1799888257 shutdown_connections 2026-02-20T16:29:23.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.879+0000 7f820cfd7640 1 -- 10.20.193.57:0/1799888257 wait complete. 2026-02-20T16:29:23.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.880+0000 7f820cfd7640 1 Processor -- start 2026-02-20T16:29:23.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.880+0000 7f820cfd7640 1 -- start start 2026-02-20T16:29:23.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.880+0000 7f820cfd7640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f820809cdc0 0x7f8208097720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:23.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.880+0000 7f820cfd7640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f820809d910 0x7f8208097c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:23.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.880+0000 7f820cfd7640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f820812f0e0 0x7f82081309f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:23.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.880+0000 7f820cfd7640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f82081379b0 con 0x7f820812f0e0 2026-02-20T16:29:23.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.880+0000 7f820cfd7640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f8208137830 con 0x7f820809cdc0 2026-02-20T16:29:23.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.880+0000 7f820cfd7640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f8208137b30 con 0x7f820809d910 2026-02-20T16:29:23.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.880+0000 7f8206575640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f820809cdc0 0x7f8208097720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:23.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.880+0000 7f8205d74640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f820809d910 0x7f8208097c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:23.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.880+0000 7f8206575640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f820809cdc0 0x7f8208097720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3301/0 says I am v2:10.20.193.57:58666/0 (socket says 10.20.193.57:58666) 2026-02-20T16:29:23.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.880+0000 7f8206575640 1 -- 10.20.193.57:0/3379830301 learned_addr learned my addr 10.20.193.57:0/3379830301 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:29:23.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.880+0000 7f8206d76640 1 --2- 10.20.193.57:0/3379830301 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f820812f0e0 0x7f82081309f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:23.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.880+0000 7f8206575640 1 -- 10.20.193.57:0/3379830301 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f820809d910 msgr2=0x7f8208097c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:23.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.880+0000 7f8206575640 1 --2- 10.20.193.57:0/3379830301 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f820809d910 0x7f8208097c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.880+0000 7f8206575640 1 -- 10.20.193.57:0/3379830301 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f820812f0e0 msgr2=0x7f82081309f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:23.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.880+0000 7f8206575640 1 --2- 10.20.193.57:0/3379830301 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f820812f0e0 0x7f82081309f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.880+0000 7f8206575640 1 -- 10.20.193.57:0/3379830301 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82081296b0 con 0x7f820809cdc0 2026-02-20T16:29:23.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.880+0000 7f8205d74640 1 --2- 10.20.193.57:0/3379830301 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f820809d910 0x7f8208097c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:29:23.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.880+0000 7f8206575640 1 --2- 10.20.193.57:0/3379830301 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f820809cdc0 0x7f8208097720 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f81fc009ac0 tx=0x7f81fc002910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:29:23.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.880+0000 7f81eeffd640 1 -- 10.20.193.57:0/3379830301 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81fc004550 con 0x7f820809cdc0 2026-02-20T16:29:23.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.880+0000 7f81eeffd640 1 -- 10.20.193.57:0/3379830301 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f81fc002c90 con 0x7f820809cdc0 2026-02-20T16:29:23.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.880+0000 7f820cfd7640 1 -- 10.20.193.57:0/3379830301 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8208132510 con 0x7f820809cdc0 2026-02-20T16:29:23.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.880+0000 7f81eeffd640 1 -- 10.20.193.57:0/3379830301 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81fc004ae0 con 0x7f820809cdc0 2026-02-20T16:29:23.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.880+0000 7f820cfd7640 1 -- 10.20.193.57:0/3379830301 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f82080981a0 con 0x7f820809cdc0 2026-02-20T16:29:23.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.880+0000 7f81eeffd640 1 -- 10.20.193.57:0/3379830301 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f81fc0053b0 con 0x7f820809cdc0 2026-02-20T16:29:23.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.880+0000 7f81eeffd640 1 -- 10.20.193.57:0/3379830301 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 720+0+0 (secure 0 0 0) 0x7f81fc038d80 con 0x7f820809cdc0 2026-02-20T16:29:23.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.881+0000 7f820cfd7640 1 -- 10.20.193.57:0/3379830301 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82081331a0 con 0x7f820809cdc0 2026-02-20T16:29:23.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.882+0000 7f81eeffd640 1 -- 10.20.193.57:0/3379830301 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f81fc04f080 con 0x7f820809cdc0 2026-02-20T16:29:23.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.914+0000 7f820cfd7640 1 -- 10.20.193.57:0/3379830301 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a3139827-dc3c-46f9-b211-d376e3dc92f9", "id": 0} v 0) -- 0x7f820812cb00 con 0x7f820809cdc0 2026-02-20T16:29:23.917 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.916+0000 7f81eeffd640 1 -- 10.20.193.57:0/3379830301 <== mon.1 v2:10.20.193.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a3139827-dc3c-46f9-b211-d376e3dc92f9", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f820812cb00 con 0x7f820809cdc0 2026-02-20T16:29:23.918 INFO:teuthology.orchestra.run.trial057.stdout:0 2026-02-20T16:29:23.919 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.917+0000 7f820cfd7640 1 -- 10.20.193.57:0/3379830301 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f820809cdc0 msgr2=0x7f8208097720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:23.919 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.917+0000 7f820cfd7640 1 --2- 10.20.193.57:0/3379830301 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f820809cdc0 0x7f8208097720 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f81fc009ac0 tx=0x7f81fc002910 comp rx=0 tx=0).stop 2026-02-20T16:29:23.919 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.917+0000 7f820cfd7640 1 -- 10.20.193.57:0/3379830301 shutdown_connections 2026-02-20T16:29:23.919 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.917+0000 7f820cfd7640 1 --2- 10.20.193.57:0/3379830301 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f820812f0e0 0x7f82081309f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.919 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.917+0000 7f820cfd7640 1 --2- 10.20.193.57:0/3379830301 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f820809d910 0x7f8208097c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.919 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.917+0000 7f820cfd7640 1 --2- 10.20.193.57:0/3379830301 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f820809cdc0 0x7f8208097720 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:23.919 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.917+0000 7f820cfd7640 1 -- 10.20.193.57:0/3379830301 >> 10.20.193.57:0/3379830301 conn(0x7f820806e3a0 msgr2=0x7f820812e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:23.920 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.917+0000 7f820cfd7640 1 -- 10.20.193.57:0/3379830301 shutdown_connections 2026-02-20T16:29:23.920 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:23.917+0000 7f820cfd7640 1 -- 10.20.193.57:0/3379830301 wait complete. 2026-02-20T16:29:23.926 DEBUG:teuthology.orchestra.run.trial057:> sudo ceph --cluster ceph osd new 00e7cb17-534c-4ac2-8486-585b3b8db0c3 1 2026-02-20T16:29:24.014 INFO:tasks.ceph.mgr.x.trial057.stderr:2026-02-20T16:29:24.013+0000 7fd315bdb140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-20T16:29:24.015 INFO:tasks.ceph.mgr.y.trial057.stderr:2026-02-20T16:29:24.013+0000 7ffad83a7140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-20T16:29:24.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.032+0000 7f2383ac9640 1 -- 10.20.193.57:0/4154244636 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f237c131fa0 msgr2=0x7f237c134390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:24.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.032+0000 7f2383ac9640 1 --2- 10.20.193.57:0/4154244636 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f237c131fa0 0x7f237c134390 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2370009930 tx=0x7f237002f110 comp rx=0 tx=0).stop 2026-02-20T16:29:24.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.032+0000 7f2383ac9640 1 -- 10.20.193.57:0/4154244636 shutdown_connections 2026-02-20T16:29:24.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.032+0000 7f2383ac9640 1 --2- 10.20.193.57:0/4154244636 >> v2:10.20.193.57:3300/0 conn(0x7f237c1348d0 0x7f237c136cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:24.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.032+0000 7f2383ac9640 1 --2- 10.20.193.57:0/4154244636 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f237c131fa0 0x7f237c134390 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:24.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.032+0000 7f2383ac9640 1 -- 10.20.193.57:0/4154244636 >> 10.20.193.57:0/4154244636 conn(0x7f237c06e3a0 msgr2=0x7f237c06e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:24.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.032+0000 7f2383ac9640 1 -- 10.20.193.57:0/4154244636 shutdown_connections 2026-02-20T16:29:24.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.032+0000 7f2383ac9640 1 -- 10.20.193.57:0/4154244636 wait complete. 2026-02-20T16:29:24.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.032+0000 7f2383ac9640 1 Processor -- start 2026-02-20T16:29:24.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.032+0000 7f2383ac9640 1 -- start start 2026-02-20T16:29:24.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.032+0000 7f2383ac9640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f237c12f0e0 0x7f237c1296b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:24.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.032+0000 7f2383ac9640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f237c131fa0 0x7f237c129bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:24.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.032+0000 7f2383ac9640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f237c1348d0 0x7f237c12a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:24.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.032+0000 7f2383ac9640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f237c137a00 con 0x7f237c12f0e0 2026-02-20T16:29:24.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.032+0000 7f2383ac9640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f237c137880 con 0x7f237c1348d0 2026-02-20T16:29:24.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.032+0000 7f2383ac9640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f237c137b80 con 0x7f237c131fa0 2026-02-20T16:29:24.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.032+0000 7f238203f640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f237c1348d0 0x7f237c12a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:24.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.032+0000 7f238103d640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f237c131fa0 0x7f237c129bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:24.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.032+0000 7f238183e640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f237c12f0e0 0x7f237c1296b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:24.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.032+0000 7f238103d640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f237c131fa0 0x7f237c129bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3302/0 says I am v2:10.20.193.57:46828/0 (socket says 10.20.193.57:46828) 2026-02-20T16:29:24.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.032+0000 7f238203f640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f237c1348d0 0x7f237c12a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3301/0 says I am v2:10.20.193.57:58770/0 (socket says 10.20.193.57:58770) 2026-02-20T16:29:24.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.032+0000 7f238103d640 1 -- 10.20.193.57:0/1372987760 learned_addr learned my addr 10.20.193.57:0/1372987760 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:29:24.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.033+0000 7f238203f640 1 -- 10.20.193.57:0/1372987760 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f237c131fa0 msgr2=0x7f237c129bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:24.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.033+0000 7f238203f640 1 --2- 10.20.193.57:0/1372987760 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f237c131fa0 0x7f237c129bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:24.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.033+0000 7f238203f640 1 -- 10.20.193.57:0/1372987760 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f237c12f0e0 msgr2=0x7f237c1296b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:24.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.033+0000 7f238203f640 1 --2- 10.20.193.57:0/1372987760 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f237c12f0e0 0x7f237c1296b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:24.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.033+0000 7f238203f640 1 -- 10.20.193.57:0/1372987760 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f237c134400 con 0x7f237c1348d0 2026-02-20T16:29:24.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.033+0000 7f238203f640 1 --2- 10.20.193.57:0/1372987760 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f237c1348d0 0x7f237c12a130 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f237800ef90 tx=0x7f237800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:29:24.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.033+0000 7f236a7fc640 1 -- 10.20.193.57:0/1372987760 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2378019070 con 0x7f237c1348d0 2026-02-20T16:29:24.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.033+0000 7f236a7fc640 1 -- 10.20.193.57:0/1372987760 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23780090d0 con 0x7f237c1348d0 2026-02-20T16:29:24.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.033+0000 7f2383ac9640 1 -- 10.20.193.57:0/1372987760 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f237c126510 con 0x7f237c1348d0 2026-02-20T16:29:24.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.033+0000 7f236a7fc640 1 -- 10.20.193.57:0/1372987760 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2378002a60 con 0x7f237c1348d0 2026-02-20T16:29:24.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.033+0000 7f2383ac9640 1 -- 10.20.193.57:0/1372987760 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f237c1ccce0 con 0x7f237c1348d0 2026-02-20T16:29:24.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.034+0000 7f236a7fc640 1 -- 10.20.193.57:0/1372987760 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 2) ==== 31101+0+0 (secure 0 0 0) 0x7f2378002c00 con 0x7f237c1348d0 2026-02-20T16:29:24.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.034+0000 7f236a7fc640 1 -- 10.20.193.57:0/1372987760 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 835+0+0 (secure 0 0 0) 0x7f2378038d60 con 0x7f237c1348d0 2026-02-20T16:29:24.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.034+0000 7f2383ac9640 1 -- 10.20.193.57:0/1372987760 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f237c12f4c0 con 0x7f237c1348d0 2026-02-20T16:29:24.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.035+0000 7f236a7fc640 1 -- 10.20.193.57:0/1372987760 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f2378010040 con 0x7f237c1348d0 2026-02-20T16:29:24.068 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.067+0000 7f2383ac9640 1 -- 10.20.193.57:0/1372987760 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00e7cb17-534c-4ac2-8486-585b3b8db0c3", "id": 1} v 0) -- 0x7f237c050a10 con 0x7f237c1348d0 2026-02-20T16:29:24.070 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.069+0000 7f236a7fc640 1 -- 10.20.193.57:0/1372987760 <== mon.1 v2:10.20.193.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00e7cb17-534c-4ac2-8486-585b3b8db0c3", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f2378007500 con 0x7f237c1348d0 2026-02-20T16:29:24.071 INFO:teuthology.orchestra.run.trial057.stdout:1 2026-02-20T16:29:24.072 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.069+0000 7f2383ac9640 1 -- 10.20.193.57:0/1372987760 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f237c1348d0 msgr2=0x7f237c12a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:24.072 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.069+0000 7f2383ac9640 1 --2- 10.20.193.57:0/1372987760 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f237c1348d0 0x7f237c12a130 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f237800ef90 tx=0x7f237800c490 comp rx=0 tx=0).stop 2026-02-20T16:29:24.072 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.069+0000 7f2383ac9640 1 -- 10.20.193.57:0/1372987760 shutdown_connections 2026-02-20T16:29:24.072 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.069+0000 7f2383ac9640 1 --2- 10.20.193.57:0/1372987760 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f237c1348d0 0x7f237c12a130 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:24.072 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.069+0000 7f2383ac9640 1 --2- 10.20.193.57:0/1372987760 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f237c131fa0 0x7f237c129bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:24.072 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.069+0000 7f2383ac9640 1 --2- 10.20.193.57:0/1372987760 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f237c12f0e0 0x7f237c1296b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:24.072 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.069+0000 7f2383ac9640 1 -- 10.20.193.57:0/1372987760 >> 10.20.193.57:0/1372987760 conn(0x7f237c06e3a0 msgr2=0x7f237c09a240 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:24.072 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.069+0000 7f2383ac9640 1 -- 10.20.193.57:0/1372987760 shutdown_connections 2026-02-20T16:29:24.072 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.069+0000 7f2383ac9640 1 -- 10.20.193.57:0/1372987760 wait complete. 2026-02-20T16:29:24.079 DEBUG:teuthology.orchestra.run.trial057:> sudo ceph --cluster ceph osd new d0b55b31-45df-4c58-bf11-a72d44f21a00 2 2026-02-20T16:29:24.149 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.145+0000 7fa7a8e0f640 1 -- 10.20.193.57:0/3826539788 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fa7a4071cf0 msgr2=0x7fa7a4131e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:24.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.145+0000 7fa7a8e0f640 1 --2- 10.20.193.57:0/3826539788 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fa7a4071cf0 0x7fa7a4131e60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa794009960 tx=0x7fa79402f140 comp rx=0 tx=0).stop 2026-02-20T16:29:24.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.145+0000 7fa7a8e0f640 1 -- 10.20.193.57:0/3826539788 shutdown_connections 2026-02-20T16:29:24.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.145+0000 7fa7a8e0f640 1 --2- 10.20.193.57:0/3826539788 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fa7a406e810 0x7fa7a41343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:24.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.145+0000 7fa7a8e0f640 1 --2- 10.20.193.57:0/3826539788 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fa7a4071cf0 0x7fa7a4131e60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:24.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.145+0000 7fa7a8e0f640 1 -- 10.20.193.57:0/3826539788 >> 10.20.193.57:0/3826539788 conn(0x7fa7a4099df0 msgr2=0x7fa7a40976c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:24.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.145+0000 7fa7a8e0f640 1 -- 10.20.193.57:0/3826539788 shutdown_connections 2026-02-20T16:29:24.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.145+0000 7fa7a8e0f640 1 -- 10.20.193.57:0/3826539788 wait complete. 2026-02-20T16:29:24.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.146+0000 7fa7a8e0f640 1 Processor -- start 2026-02-20T16:29:24.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.146+0000 7fa7a8e0f640 1 -- start start 2026-02-20T16:29:24.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.146+0000 7fa7a8e0f640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fa7a406dd20 0x7fa7a4096230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:24.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.146+0000 7fa7a8e0f640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fa7a406e810 0x7fa7a4096770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:24.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.146+0000 7fa7a8e0f640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fa7a4071cf0 0x7fa7a406eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:24.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.146+0000 7fa7a8e0f640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a4135780 con 0x7fa7a4071cf0 2026-02-20T16:29:24.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.146+0000 7fa7a8e0f640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7fa7a4135600 con 0x7fa7a406dd20 2026-02-20T16:29:24.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.146+0000 7fa7a8e0f640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7fa7a4135900 con 0x7fa7a406e810 2026-02-20T16:29:24.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.146+0000 7fa7a37fe640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fa7a406dd20 0x7fa7a4096230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:24.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.146+0000 7fa7a2ffd640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fa7a406e810 0x7fa7a4096770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:24.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.146+0000 7fa7a2ffd640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fa7a406e810 0x7fa7a4096770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3302/0 says I am v2:10.20.193.57:46844/0 (socket says 10.20.193.57:46844) 2026-02-20T16:29:24.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.146+0000 7fa7a2ffd640 1 -- 10.20.193.57:0/1222860368 learned_addr learned my addr 10.20.193.57:0/1222860368 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:29:24.152 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.146+0000 7fa7a3fff640 1 --2- 10.20.193.57:0/1222860368 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fa7a4071cf0 0x7fa7a406eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:24.152 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.146+0000 7fa7a2ffd640 1 -- 10.20.193.57:0/1222860368 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fa7a406dd20 msgr2=0x7fa7a4096230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:24.152 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.146+0000 7fa7a2ffd640 1 --2- 10.20.193.57:0/1222860368 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fa7a406dd20 0x7fa7a4096230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:24.152 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.146+0000 7fa7a2ffd640 1 -- 10.20.193.57:0/1222860368 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fa7a4071cf0 msgr2=0x7fa7a406eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:24.152 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.146+0000 7fa7a2ffd640 1 --2- 10.20.193.57:0/1222860368 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fa7a4071cf0 0x7fa7a406eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:24.152 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.146+0000 7fa7a2ffd640 1 -- 10.20.193.57:0/1222860368 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7a4093f10 con 0x7fa7a406e810 2026-02-20T16:29:24.152 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.146+0000 7fa7a37fe640 1 --2- 10.20.193.57:0/1222860368 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fa7a406dd20 0x7fa7a4096230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:29:24.152 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.147+0000 7fa7a2ffd640 1 --2- 10.20.193.57:0/1222860368 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fa7a406e810 0x7fa7a4096770 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa794009880 tx=0x7fa794002910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:29:24.152 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.147+0000 7fa77ffff640 1 -- 10.20.193.57:0/1222860368 <== mon.2 v2:10.20.193.57:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa794002d10 con 0x7fa7a406e810 2026-02-20T16:29:24.152 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.147+0000 7fa77ffff640 1 -- 10.20.193.57:0/1222860368 <== mon.2 v2:10.20.193.57:3302/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa7940048a0 con 0x7fa7a406e810 2026-02-20T16:29:24.152 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.147+0000 7fa7a8e0f640 1 -- 10.20.193.57:0/1222860368 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7a40730d0 con 0x7fa7a406e810 2026-02-20T16:29:24.152 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.147+0000 7fa77ffff640 1 -- 10.20.193.57:0/1222860368 <== mon.2 v2:10.20.193.57:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa794004cf0 con 0x7fa7a406e810 2026-02-20T16:29:24.153 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.147+0000 7fa7a8e0f640 1 -- 10.20.193.57:0/1222860368 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7a406f3e0 con 0x7fa7a406e810 2026-02-20T16:29:24.153 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.147+0000 7fa77ffff640 1 -- 10.20.193.57:0/1222860368 <== mon.2 v2:10.20.193.57:3302/0 4 ==== mgrmap(e 2) ==== 31101+0+0 (secure 0 0 0) 0x7fa794004e90 con 0x7fa7a406e810 2026-02-20T16:29:24.153 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.147+0000 7fa7a8e0f640 1 -- 10.20.193.57:0/1222860368 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7a40709d0 con 0x7fa7a406e810 2026-02-20T16:29:24.153 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.147+0000 7fa77ffff640 1 -- 10.20.193.57:0/1222860368 <== mon.2 v2:10.20.193.57:3302/0 5 ==== osd_map(4..4 src has 1..4) ==== 950+0+0 (secure 0 0 0) 0x7fa79405d520 con 0x7fa7a406e810 2026-02-20T16:29:24.153 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.149+0000 7fa77ffff640 1 -- 10.20.193.57:0/1222860368 <== mon.2 v2:10.20.193.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7fa7a4093f10 con 0x7fa7a406e810 2026-02-20T16:29:24.181 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.180+0000 7fa7a8e0f640 1 -- 10.20.193.57:0/1222860368 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_command({"prefix": "osd new", "uuid": "d0b55b31-45df-4c58-bf11-a72d44f21a00", "id": 2} v 0) -- 0x7fa7a406e100 con 0x7fa7a406e810 2026-02-20T16:29:24.184 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.183+0000 7fa77ffff640 1 -- 10.20.193.57:0/1222860368 <== mon.2 v2:10.20.193.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d0b55b31-45df-4c58-bf11-a72d44f21a00", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fa7940493a0 con 0x7fa7a406e810 2026-02-20T16:29:24.184 INFO:teuthology.orchestra.run.trial057.stdout:2 2026-02-20T16:29:24.185 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.183+0000 7fa7a8e0f640 1 -- 10.20.193.57:0/1222860368 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fa7a406e810 msgr2=0x7fa7a4096770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:24.185 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.183+0000 7fa7a8e0f640 1 --2- 10.20.193.57:0/1222860368 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fa7a406e810 0x7fa7a4096770 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa794009880 tx=0x7fa794002910 comp rx=0 tx=0).stop 2026-02-20T16:29:24.185 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.183+0000 7fa7a8e0f640 1 -- 10.20.193.57:0/1222860368 shutdown_connections 2026-02-20T16:29:24.185 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.183+0000 7fa7a8e0f640 1 --2- 10.20.193.57:0/1222860368 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fa7a4071cf0 0x7fa7a406eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:24.185 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.183+0000 7fa7a8e0f640 1 --2- 10.20.193.57:0/1222860368 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fa7a406e810 0x7fa7a4096770 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:24.186 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.183+0000 7fa7a8e0f640 1 --2- 10.20.193.57:0/1222860368 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fa7a406dd20 0x7fa7a4096230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:24.186 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.183+0000 7fa7a8e0f640 1 -- 10.20.193.57:0/1222860368 >> 10.20.193.57:0/1222860368 conn(0x7fa7a4099df0 msgr2=0x7fa7a4133090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:24.186 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.183+0000 7fa7a8e0f640 1 -- 10.20.193.57:0/1222860368 shutdown_connections 2026-02-20T16:29:24.186 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.183+0000 7fa7a8e0f640 1 -- 10.20.193.57:0/1222860368 wait complete. 2026-02-20T16:29:24.192 DEBUG:teuthology.orchestra.run.trial057:> sudo ceph --cluster ceph osd new b3bfbbd8-cfaf-4360-9a5b-c52e89ac3f75 3 2026-02-20T16:29:24.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.257+0000 7f9012d16640 1 -- 10.20.193.57:0/953978125 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f900c1324a0 msgr2=0x7f900c134890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:24.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.257+0000 7f9012d16640 1 --2- 10.20.193.57:0/953978125 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f900c1324a0 0x7f900c134890 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9008009fc0 tx=0x7f900802f3d0 comp rx=0 tx=0).stop 2026-02-20T16:29:24.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.257+0000 7f9012d16640 1 -- 10.20.193.57:0/953978125 shutdown_connections 2026-02-20T16:29:24.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.257+0000 7f9012d16640 1 --2- 10.20.193.57:0/953978125 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f900c1324a0 0x7f900c134890 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:24.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.257+0000 7f9012d16640 1 --2- 10.20.193.57:0/953978125 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f900c12fb70 0x7f900c131f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:24.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.257+0000 7f9012d16640 1 -- 10.20.193.57:0/953978125 >> 10.20.193.57:0/953978125 conn(0x7f900c09a140 msgr2=0x7f900c097a10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:24.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.257+0000 7f9012d16640 1 -- 10.20.193.57:0/953978125 shutdown_connections 2026-02-20T16:29:24.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.257+0000 7f9012d16640 1 -- 10.20.193.57:0/953978125 wait complete. 2026-02-20T16:29:24.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.257+0000 7f9012d16640 1 Processor -- start 2026-02-20T16:29:24.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.257+0000 7f9012d16640 1 -- start start 2026-02-20T16:29:24.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.258+0000 7f9012d16640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f900c12ccf0 0x7f900c128ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:24.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.258+0000 7f9012d16640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f900c12fb70 0x7f900c129010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:24.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.258+0000 7f9012d16640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f900c1324a0 0x7f900c129550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:24.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.258+0000 7f9012d16640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f900c135800 con 0x7f900c1324a0 2026-02-20T16:29:24.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.258+0000 7f9012d16640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f900c135680 con 0x7f900c12ccf0 2026-02-20T16:29:24.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.258+0000 7f9012d16640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f900c135980 con 0x7f900c12fb70 2026-02-20T16:29:24.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.258+0000 7f901128c640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f900c1324a0 0x7f900c129550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:24.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.258+0000 7f9010a8b640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f900c12ccf0 0x7f900c128ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:24.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.258+0000 7f9003fff640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f900c12fb70 0x7f900c129010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:24.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.258+0000 7f901128c640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f900c1324a0 0x7f900c129550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:37036/0 (socket says 10.20.193.57:37036) 2026-02-20T16:29:24.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.258+0000 7f9003fff640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f900c12fb70 0x7f900c129010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3302/0 says I am v2:10.20.193.57:46858/0 (socket says 10.20.193.57:46858) 2026-02-20T16:29:24.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.258+0000 7f9010a8b640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f900c12ccf0 0x7f900c128ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3301/0 says I am v2:10.20.193.57:58814/0 (socket says 10.20.193.57:58814) 2026-02-20T16:29:24.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.258+0000 7f901128c640 1 -- 10.20.193.57:0/469013503 learned_addr learned my addr 10.20.193.57:0/469013503 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:29:24.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.258+0000 7f9010a8b640 1 -- 10.20.193.57:0/469013503 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f900c12fb70 msgr2=0x7f900c129010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:24.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.258+0000 7f9010a8b640 1 --2- 10.20.193.57:0/469013503 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f900c12fb70 0x7f900c129010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:24.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.258+0000 7f9010a8b640 1 -- 10.20.193.57:0/469013503 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f900c1324a0 msgr2=0x7f900c129550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:24.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.258+0000 7f9010a8b640 1 --2- 10.20.193.57:0/469013503 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f900c1324a0 0x7f900c129550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:24.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.258+0000 7f9010a8b640 1 -- 10.20.193.57:0/469013503 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f900c126880 con 0x7f900c12ccf0 2026-02-20T16:29:24.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.258+0000 7f901128c640 1 --2- 10.20.193.57:0/469013503 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f900c1324a0 0x7f900c129550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:29:24.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.258+0000 7f9010a8b640 1 --2- 10.20.193.57:0/469013503 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f900c12ccf0 0x7f900c128ad0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc00c460 tx=0x7f8ffc00c930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:29:24.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.258+0000 7f90017fa640 1 -- 10.20.193.57:0/469013503 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc005480 con 0x7f900c12ccf0 2026-02-20T16:29:24.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.258+0000 7f90017fa640 1 -- 10.20.193.57:0/469013503 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ffc0036f0 con 0x7f900c12ccf0 2026-02-20T16:29:24.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.258+0000 7f9012d16640 1 -- 10.20.193.57:0/469013503 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f900c06f190 con 0x7f900c12ccf0 2026-02-20T16:29:24.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.258+0000 7f90017fa640 1 -- 10.20.193.57:0/469013503 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc003b40 con 0x7f900c12ccf0 2026-02-20T16:29:24.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.258+0000 7f9012d16640 1 -- 10.20.193.57:0/469013503 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f900c073f30 con 0x7f900c12ccf0 2026-02-20T16:29:24.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.258+0000 7f90017fa640 1 -- 10.20.193.57:0/469013503 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 2) ==== 31101+0+0 (secure 0 0 0) 0x7f8ffc003ce0 con 0x7f900c12ccf0 2026-02-20T16:29:24.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.258+0000 7f9012d16640 1 -- 10.20.193.57:0/469013503 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f900c12d0d0 con 0x7f900c12ccf0 2026-02-20T16:29:24.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.259+0000 7f90017fa640 1 -- 10.20.193.57:0/469013503 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1065+0+0 (secure 0 0 0) 0x7f8ffc0383e0 con 0x7f900c12ccf0 2026-02-20T16:29:24.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.260+0000 7f90017fa640 1 -- 10.20.193.57:0/469013503 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f8ffc01b7e0 con 0x7f900c12ccf0 2026-02-20T16:29:24.294 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.293+0000 7f9012d16640 1 -- 10.20.193.57:0/469013503 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b3bfbbd8-cfaf-4360-9a5b-c52e89ac3f75", "id": 3} v 0) -- 0x7f900c074840 con 0x7f900c12ccf0 2026-02-20T16:29:24.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.295+0000 7f90017fa640 1 -- 10.20.193.57:0/469013503 <== mon.1 v2:10.20.193.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b3bfbbd8-cfaf-4360-9a5b-c52e89ac3f75", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f8ffc010300 con 0x7f900c12ccf0 2026-02-20T16:29:24.297 INFO:teuthology.orchestra.run.trial057.stdout:3 2026-02-20T16:29:24.298 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.296+0000 7f9012d16640 1 -- 10.20.193.57:0/469013503 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f900c12ccf0 msgr2=0x7f900c128ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:24.298 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.296+0000 7f9012d16640 1 --2- 10.20.193.57:0/469013503 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f900c12ccf0 0x7f900c128ad0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc00c460 tx=0x7f8ffc00c930 comp rx=0 tx=0).stop 2026-02-20T16:29:24.298 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.296+0000 7f9012d16640 1 -- 10.20.193.57:0/469013503 shutdown_connections 2026-02-20T16:29:24.298 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.296+0000 7f9012d16640 1 --2- 10.20.193.57:0/469013503 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f900c1324a0 0x7f900c129550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:24.298 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.296+0000 7f9012d16640 1 --2- 10.20.193.57:0/469013503 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f900c12fb70 0x7f900c129010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:24.298 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.296+0000 7f9012d16640 1 --2- 10.20.193.57:0/469013503 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f900c12ccf0 0x7f900c128ad0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:24.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.296+0000 7f9012d16640 1 -- 10.20.193.57:0/469013503 >> 10.20.193.57:0/469013503 conn(0x7f900c09a140 msgr2=0x7f900c09b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:24.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.296+0000 7f9012d16640 1 -- 10.20.193.57:0/469013503 shutdown_connections 2026-02-20T16:29:24.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.296+0000 7f9012d16640 1 -- 10.20.193.57:0/469013503 wait complete. 2026-02-20T16:29:24.305 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-20T16:29:24.305 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2026-02-20T16:29:24.307 INFO:tasks.ceph.osd.0:Started 2026-02-20T16:29:24.308 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-20T16:29:24.308 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2026-02-20T16:29:24.313 INFO:tasks.ceph.osd.1:Started 2026-02-20T16:29:24.313 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-20T16:29:24.314 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2026-02-20T16:29:24.322 INFO:tasks.ceph.osd.2:Started 2026-02-20T16:29:24.323 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-20T16:29:24.323 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2026-02-20T16:29:24.331 INFO:tasks.ceph.osd.3:Started 2026-02-20T16:29:24.331 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-20T16:29:24.410 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.403+0000 7f825cbcb640 1 -- 10.20.193.57:0/2007150695 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8258094580 msgr2=0x7f8258094960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:24.410 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.403+0000 7f825cbcb640 1 --2- 10.20.193.57:0/2007150695 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8258094580 0x7f8258094960 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f824c009a30 tx=0x7f824c02f260 comp rx=0 tx=0).stop 2026-02-20T16:29:24.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.403+0000 7f825cbcb640 1 -- 10.20.193.57:0/2007150695 shutdown_connections 2026-02-20T16:29:24.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.403+0000 7f825cbcb640 1 --2- 10.20.193.57:0/2007150695 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f82580964a0 0x7f8258094ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:24.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.403+0000 7f825cbcb640 1 --2- 10.20.193.57:0/2007150695 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8258094580 0x7f8258094960 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:24.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.403+0000 7f825cbcb640 1 -- 10.20.193.57:0/2007150695 >> 10.20.193.57:0/2007150695 conn(0x7f825809a280 msgr2=0x7f8258097a10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:24.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.404+0000 7f825cbcb640 1 -- 10.20.193.57:0/2007150695 shutdown_connections 2026-02-20T16:29:24.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.404+0000 7f825cbcb640 1 -- 10.20.193.57:0/2007150695 wait complete. 2026-02-20T16:29:24.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.404+0000 7f825cbcb640 1 Processor -- start 2026-02-20T16:29:24.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.404+0000 7f825cbcb640 1 -- start start 2026-02-20T16:29:24.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.404+0000 7f825cbcb640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8258094580 0x7f8258072400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:24.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.404+0000 7f825cbcb640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f82580964a0 0x7f8258072940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:24.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.404+0000 7f825cbcb640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f82581331c0 0x7f8258072e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:24.413 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.404+0000 7f825cbcb640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f82581379c0 con 0x7f82581331c0 2026-02-20T16:29:24.413 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.404+0000 7f825cbcb640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f8258137840 con 0x7f8258094580 2026-02-20T16:29:24.413 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.404+0000 7f825cbcb640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f8258137b40 con 0x7f82580964a0 2026-02-20T16:29:24.413 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.404+0000 7f8256575640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8258094580 0x7f8258072400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:24.413 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.404+0000 7f8255d74640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f82580964a0 0x7f8258072940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:24.413 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.404+0000 7f8256575640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8258094580 0x7f8258072400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3301/0 says I am v2:10.20.193.57:58870/0 (socket says 10.20.193.57:58870) 2026-02-20T16:29:24.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.404+0000 7f8256d76640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f82581331c0 0x7f8258072e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:24.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.404+0000 7f8256575640 1 -- 10.20.193.57:0/3841873960 learned_addr learned my addr 10.20.193.57:0/3841873960 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:29:24.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.404+0000 7f8256575640 1 -- 10.20.193.57:0/3841873960 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f82580964a0 msgr2=0x7f8258072940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:24.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.404+0000 7f8256575640 1 --2- 10.20.193.57:0/3841873960 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f82580964a0 0x7f8258072940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:24.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.404+0000 7f8256575640 1 -- 10.20.193.57:0/3841873960 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f82581331c0 msgr2=0x7f8258072e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:24.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.404+0000 7f8256575640 1 --2- 10.20.193.57:0/3841873960 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f82581331c0 0x7f8258072e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:24.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.404+0000 7f8256575640 1 -- 10.20.193.57:0/3841873960 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8258122f20 con 0x7f8258094580 2026-02-20T16:29:24.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.404+0000 7f8255d74640 1 --2- 10.20.193.57:0/3841873960 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f82580964a0 0x7f8258072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:29:24.415 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.404+0000 7f8256d76640 1 --2- 10.20.193.57:0/3841873960 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f82581331c0 0x7f8258072e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:29:24.415 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.405+0000 7f8256575640 1 --2- 10.20.193.57:0/3841873960 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8258094580 0x7f8258072400 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f824c009b60 tx=0x7f824c002910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:29:24.415 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.405+0000 7f823effd640 1 -- 10.20.193.57:0/3841873960 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f824c002c10 con 0x7f8258094580 2026-02-20T16:29:24.415 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.405+0000 7f823effd640 1 -- 10.20.193.57:0/3841873960 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f824c002db0 con 0x7f8258094580 2026-02-20T16:29:24.415 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.405+0000 7f825cbcb640 1 -- 10.20.193.57:0/3841873960 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82580733c0 con 0x7f8258094580 2026-02-20T16:29:24.415 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.405+0000 7f823effd640 1 -- 10.20.193.57:0/3841873960 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f824c004ae0 con 0x7f8258094580 2026-02-20T16:29:24.415 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.405+0000 7f825cbcb640 1 -- 10.20.193.57:0/3841873960 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8258123390 con 0x7f8258094580 2026-02-20T16:29:24.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.405+0000 7f823effd640 1 -- 10.20.193.57:0/3841873960 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 2) ==== 31101+0+0 (secure 0 0 0) 0x7f824c038470 con 0x7f8258094580 2026-02-20T16:29:24.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.405+0000 7f823effd640 1 -- 10.20.193.57:0/3841873960 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1180+0+0 (secure 0 0 0) 0x7f824c05d0e0 con 0x7f8258094580 2026-02-20T16:29:24.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.405+0000 7f825cbcb640 1 -- 10.20.193.57:0/3841873960 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8258094960 con 0x7f8258094580 2026-02-20T16:29:24.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.407+0000 7f823effd640 1 -- 10.20.193.57:0/3841873960 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f824c008ea0 con 0x7f8258094580 2026-02-20T16:29:24.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.436+0000 7f825cbcb640 1 -- 10.20.193.57:0/3841873960 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8258050a10 con 0x7f8258094580 2026-02-20T16:29:24.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.436+0000 7f823effd640 1 -- 10.20.193.57:0/3841873960 <== mon.1 v2:10.20.193.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4148 (secure 0 0 0) 0x7f824c04a450 con 0x7f8258094580 2026-02-20T16:29:24.438 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:29:24.439 INFO:teuthology.orchestra.run.trial057.stdout:{"epoch":6,"fsid":"3b3c5c1a-0a2b-40b9-ac1d-921ada466f9e","created":"2026-02-20T16:29:22.501479+0000","modified":"2026-02-20T16:29:24.294147+0000","last_up_change":"0.000000","last_in_change":"2026-02-20T16:29:24.294147+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a3139827-dc3c-46f9-b211-d376e3dc92f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00e7cb17-534c-4ac2-8486-585b3b8db0c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d0b55b31-45df-4c58-bf11-a72d44f21a00","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b3bfbbd8-cfaf-4360-9a5b-c52e89ac3f75","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T16:29:24.441 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.437+0000 7f825cbcb640 1 -- 10.20.193.57:0/3841873960 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8258094580 msgr2=0x7f8258072400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:24.441 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.437+0000 7f825cbcb640 1 --2- 10.20.193.57:0/3841873960 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8258094580 0x7f8258072400 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f824c009b60 tx=0x7f824c002910 comp rx=0 tx=0).stop 2026-02-20T16:29:24.441 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.437+0000 7f825cbcb640 1 -- 10.20.193.57:0/3841873960 shutdown_connections 2026-02-20T16:29:24.441 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.437+0000 7f825cbcb640 1 --2- 10.20.193.57:0/3841873960 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f82581331c0 0x7f8258072e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:24.441 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.437+0000 7f825cbcb640 1 --2- 10.20.193.57:0/3841873960 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f82580964a0 0x7f8258072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:24.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.437+0000 7f825cbcb640 1 --2- 10.20.193.57:0/3841873960 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8258094580 0x7f8258072400 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:24.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.437+0000 7f825cbcb640 1 -- 10.20.193.57:0/3841873960 >> 10.20.193.57:0/3841873960 conn(0x7f825809a280 msgr2=0x7f825809b200 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:24.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.437+0000 7f825cbcb640 1 -- 10.20.193.57:0/3841873960 shutdown_connections 2026-02-20T16:29:24.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:24.437+0000 7f825cbcb640 1 -- 10.20.193.57:0/3841873960 wait complete. 2026-02-20T16:29:24.445 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-20T16:29:24.445 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-20T16:29:24.848 DEBUG:teuthology.orchestra.run.trial057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-20T16:29:24.912 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:24.908+0000 7f364c16e640 1 -- 10.20.193.57:0/2544092329 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f3644099350 msgr2=0x7f3644096bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:24.913 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:24.908+0000 7f364c16e640 1 --2- 10.20.193.57:0/2544092329 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f3644099350 0x7f3644096bd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3634009960 tx=0x7f363402f140 comp rx=0 tx=0).stop 2026-02-20T16:29:24.913 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:24.908+0000 7f364c16e640 1 -- 10.20.193.57:0/2544092329 shutdown_connections 2026-02-20T16:29:24.913 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:24.908+0000 7f364c16e640 1 --2- 10.20.193.57:0/2544092329 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f3644097530 0x7f3644136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:24.913 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:24.908+0000 7f364c16e640 1 --2- 10.20.193.57:0/2544092329 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f3644099350 0x7f3644096bd0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:24.913 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:24.908+0000 7f364c16e640 1 -- 10.20.193.57:0/2544092329 >> 10.20.193.57:0/2544092329 conn(0x7f364409d530 msgr2=0x7f364409d940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:24.913 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:24.908+0000 7f364c16e640 1 -- 10.20.193.57:0/2544092329 shutdown_connections 2026-02-20T16:29:24.913 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:24.908+0000 7f364c16e640 1 -- 10.20.193.57:0/2544092329 wait complete. 2026-02-20T16:29:24.913 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:24.908+0000 7f364c16e640 1 Processor -- start 2026-02-20T16:29:24.913 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:24.908+0000 7f364c16e640 1 -- start start 2026-02-20T16:29:24.914 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:24.909+0000 7f364c16e640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f3644097110 0x7f3644071780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:24.914 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:24.909+0000 7f364c16e640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f3644097530 0x7f3644071cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:24.914 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:24.909+0000 7f364c16e640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f3644099350 0x7f3644072200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:24.914 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:24.909+0000 7f364c16e640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f36441379d0 con 0x7f3644097530 2026-02-20T16:29:24.914 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:24.909+0000 7f364c16e640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f3644137850 con 0x7f3644099350 2026-02-20T16:29:24.914 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:24.909+0000 7f364c16e640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f3644137b50 con 0x7f3644097110 2026-02-20T16:29:24.914 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:24.909+0000 7f3649ee3640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f3644097110 0x7f3644071780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:24.914 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:24.909+0000 7f36496e2640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f3644097530 0x7f3644071cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:24.914 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:24.909+0000 7f3649ee3640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f3644097110 0x7f3644071780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3302/0 says I am v2:10.20.193.57:46952/0 (socket says 10.20.193.57:46952) 2026-02-20T16:29:24.914 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:24.909+0000 7f364a6e4640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f3644099350 0x7f3644072200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:24.914 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:24.909+0000 7f3649ee3640 1 -- 10.20.193.57:0/3465775857 learned_addr learned my addr 10.20.193.57:0/3465775857 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:29:24.914 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:24.909+0000 7f3649ee3640 1 -- 10.20.193.57:0/3465775857 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f3644099350 msgr2=0x7f3644072200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:24.915 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:24.909+0000 7f3649ee3640 1 --2- 10.20.193.57:0/3465775857 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f3644099350 0x7f3644072200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:24.915 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:24.909+0000 7f3649ee3640 1 -- 10.20.193.57:0/3465775857 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f3644097530 msgr2=0x7f3644071cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:24.915 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:24.909+0000 7f3649ee3640 1 --2- 10.20.193.57:0/3465775857 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f3644097530 0x7f3644071cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:24.915 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:24.909+0000 7f3649ee3640 1 -- 10.20.193.57:0/3465775857 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3644074df0 con 0x7f3644097110 2026-02-20T16:29:24.915 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:24.909+0000 7f3649ee3640 1 --2- 10.20.193.57:0/3465775857 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f3644097110 0x7f3644071780 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3634009880 tx=0x7f3634002910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:29:24.915 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:24.909+0000 7f36327fc640 1 -- 10.20.193.57:0/3465775857 <== mon.2 v2:10.20.193.57:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3634004530 con 0x7f3644097110 2026-02-20T16:29:24.915 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:24.909+0000 7f36327fc640 1 -- 10.20.193.57:0/3465775857 <== mon.2 v2:10.20.193.57:3302/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3634002d10 con 0x7f3644097110 2026-02-20T16:29:24.915 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:24.909+0000 7f364c16e640 1 -- 10.20.193.57:0/3465775857 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36440732a0 con 0x7f3644097110 2026-02-20T16:29:24.915 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:24.909+0000 7f36327fc640 1 -- 10.20.193.57:0/3465775857 <== mon.2 v2:10.20.193.57:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3634004b00 con 0x7f3644097110 2026-02-20T16:29:24.915 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:24.909+0000 7f364c16e640 1 -- 10.20.193.57:0/3465775857 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f36441ccef0 con 0x7f3644097110 2026-02-20T16:29:24.915 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:24.910+0000 7f36327fc640 1 -- 10.20.193.57:0/3465775857 <== mon.2 v2:10.20.193.57:3302/0 4 ==== mgrmap(e 2) ==== 31101+0+0 (secure 0 0 0) 0x7f3634038470 con 0x7f3644097110 2026-02-20T16:29:24.915 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:24.910+0000 7f364c16e640 1 -- 10.20.193.57:0/3465775857 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3644073ad0 con 0x7f3644097110 2026-02-20T16:29:24.916 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:24.910+0000 7f36327fc640 1 -- 10.20.193.57:0/3465775857 <== mon.2 v2:10.20.193.57:3302/0 5 ==== osd_map(6..6 src has 1..6) ==== 1180+0+0 (secure 0 0 0) 0x7f363405d440 con 0x7f3644097110 2026-02-20T16:29:24.916 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:24.911+0000 7f36327fc640 1 -- 10.20.193.57:0/3465775857 <== mon.2 v2:10.20.193.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f3634038b70 con 0x7f3644097110 2026-02-20T16:29:24.939 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:24.938+0000 7f364c16e640 1 -- 10.20.193.57:0/3465775857 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f36440956a0 con 0x7f3644097110 2026-02-20T16:29:24.940 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:24.938+0000 7f36327fc640 1 -- 10.20.193.57:0/3465775857 <== mon.2 v2:10.20.193.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4148 (secure 0 0 0) 0x7f3634050050 con 0x7f3644097110 2026-02-20T16:29:24.940 INFO:teuthology.misc.health.trial057.stdout: 2026-02-20T16:29:24.940 INFO:teuthology.misc.health.trial057.stdout:{"epoch":6,"fsid":"3b3c5c1a-0a2b-40b9-ac1d-921ada466f9e","created":"2026-02-20T16:29:22.501479+0000","modified":"2026-02-20T16:29:24.294147+0000","last_up_change":"0.000000","last_in_change":"2026-02-20T16:29:24.294147+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a3139827-dc3c-46f9-b211-d376e3dc92f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00e7cb17-534c-4ac2-8486-585b3b8db0c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d0b55b31-45df-4c58-bf11-a72d44f21a00","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b3bfbbd8-cfaf-4360-9a5b-c52e89ac3f75","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T16:29:24.941 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:24.938+0000 7f364c16e640 1 -- 10.20.193.57:0/3465775857 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f3644097110 msgr2=0x7f3644071780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:24.941 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:24.938+0000 7f364c16e640 1 --2- 10.20.193.57:0/3465775857 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f3644097110 0x7f3644071780 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3634009880 tx=0x7f3634002910 comp rx=0 tx=0).stop 2026-02-20T16:29:24.941 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:24.938+0000 7f364c16e640 1 -- 10.20.193.57:0/3465775857 shutdown_connections 2026-02-20T16:29:24.941 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:24.938+0000 7f364c16e640 1 --2- 10.20.193.57:0/3465775857 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f3644099350 0x7f3644072200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:24.941 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:24.938+0000 7f364c16e640 1 --2- 10.20.193.57:0/3465775857 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f3644097530 0x7f3644071cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:24.942 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:24.938+0000 7f364c16e640 1 --2- 10.20.193.57:0/3465775857 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f3644097110 0x7f3644071780 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:24.942 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:24.938+0000 7f364c16e640 1 -- 10.20.193.57:0/3465775857 >> 10.20.193.57:0/3465775857 conn(0x7f364409d530 msgr2=0x7f3644094090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:24.942 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:24.938+0000 7f364c16e640 1 -- 10.20.193.57:0/3465775857 shutdown_connections 2026-02-20T16:29:24.942 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:24.938+0000 7f364c16e640 1 -- 10.20.193.57:0/3465775857 wait complete. 2026-02-20T16:29:24.945 DEBUG:teuthology.misc:0 of 4 OSDs are up 2026-02-20T16:29:25.025 INFO:tasks.ceph.mgr.y.trial057.stderr:2026-02-20T16:29:25.023+0000 7ffac1234640 -1 mgr.server handle_report got status from non-daemon mon.b 2026-02-20T16:29:25.025 INFO:tasks.ceph.mgr.y.trial057.stderr:2026-02-20T16:29:25.023+0000 7ffac1234640 -1 mgr.server handle_report got status from non-daemon mon.c 2026-02-20T16:29:26.207 INFO:tasks.ceph.osd.0.trial057.stderr:2026-02-20T16:29:26.205+0000 7fddee59c780 -1 Falling back to public interface 2026-02-20T16:29:26.227 INFO:tasks.ceph.osd.1.trial057.stderr:2026-02-20T16:29:26.225+0000 7fcc3f1ab780 -1 Falling back to public interface 2026-02-20T16:29:26.247 INFO:tasks.ceph.osd.2.trial057.stderr:2026-02-20T16:29:26.246+0000 7f10125a3780 -1 Falling back to public interface 2026-02-20T16:29:26.251 INFO:tasks.ceph.osd.3.trial057.stderr:2026-02-20T16:29:26.250+0000 7fe2c05f7780 -1 Falling back to public interface 2026-02-20T16:29:30.668 INFO:tasks.ceph.osd.0.trial057.stderr:2026-02-20T16:29:30.667+0000 7fddee59c780 -1 osd.0 0 log_to_monitors true 2026-02-20T16:29:30.725 INFO:tasks.ceph.osd.1.trial057.stderr:2026-02-20T16:29:30.723+0000 7fcc3f1ab780 -1 osd.1 0 log_to_monitors true 2026-02-20T16:29:30.761 INFO:tasks.ceph.osd.2.trial057.stderr:2026-02-20T16:29:30.760+0000 7f10125a3780 -1 osd.2 0 log_to_monitors true 2026-02-20T16:29:30.792 INFO:tasks.ceph.osd.3.trial057.stderr:2026-02-20T16:29:30.791+0000 7fe2c05f7780 -1 osd.3 0 log_to_monitors true 2026-02-20T16:29:31.349 DEBUG:teuthology.orchestra.run.trial057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-20T16:29:31.417 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:31.412+0000 7f597f105640 1 -- 10.20.193.57:0/1915069449 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f597812b5b0 msgr2=0x7f597812b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:31.417 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:31.412+0000 7f597f105640 1 --2- 10.20.193.57:0/1915069449 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f597812b5b0 0x7f597812b990 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5968009a00 tx=0x7f596802f280 comp rx=0 tx=0).stop 2026-02-20T16:29:31.417 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:31.412+0000 7f597f105640 1 -- 10.20.193.57:0/1915069449 shutdown_connections 2026-02-20T16:29:31.417 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:31.412+0000 7f597f105640 1 --2- 10.20.193.57:0/1915069449 >> v2:10.20.193.57:3300/0 conn(0x7f597812bed0 0x7f5978095410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:31.417 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:31.412+0000 7f597f105640 1 --2- 10.20.193.57:0/1915069449 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f597812b5b0 0x7f597812b990 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:31.418 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:31.412+0000 7f597f105640 1 -- 10.20.193.57:0/1915069449 >> 10.20.193.57:0/1915069449 conn(0x7f597809d5a0 msgr2=0x7f597809d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:31.418 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:31.412+0000 7f597f105640 1 -- 10.20.193.57:0/1915069449 shutdown_connections 2026-02-20T16:29:31.418 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:31.412+0000 7f597f105640 1 -- 10.20.193.57:0/1915069449 wait complete. 2026-02-20T16:29:31.418 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:31.413+0000 7f597f105640 1 Processor -- start 2026-02-20T16:29:31.418 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:31.413+0000 7f597f105640 1 -- start start 2026-02-20T16:29:31.418 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:31.413+0000 7f597f105640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f5978095950 0x7f597808da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:31.418 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:31.413+0000 7f597f105640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f597812b5b0 0x7f597808dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:31.418 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:31.413+0000 7f597f105640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f597812bed0 0x7f59781c6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:31.418 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:31.413+0000 7f597f105640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f5978095240 con 0x7f597812b5b0 2026-02-20T16:29:31.418 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:31.413+0000 7f597f105640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f59780950c0 con 0x7f597812bed0 2026-02-20T16:29:31.418 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:31.413+0000 7f597f105640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f5978133610 con 0x7f5978095950 2026-02-20T16:29:31.418 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:31.413+0000 7f596ffff640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f597812b5b0 0x7f597808dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:31.419 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:31.413+0000 7f596ffff640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f597812b5b0 0x7f597808dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:54540/0 (socket says 10.20.193.57:54540) 2026-02-20T16:29:31.419 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:31.413+0000 7f597d67b640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f597812bed0 0x7f59781c6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:31.419 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:31.413+0000 7f596ffff640 1 -- 10.20.193.57:0/3153585583 learned_addr learned my addr 10.20.193.57:0/3153585583 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:29:31.419 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:31.413+0000 7f597ce7a640 1 --2- 10.20.193.57:0/3153585583 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f5978095950 0x7f597808da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:31.419 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:31.413+0000 7f596ffff640 1 -- 10.20.193.57:0/3153585583 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f5978095950 msgr2=0x7f597808da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:31.419 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:31.413+0000 7f596ffff640 1 --2- 10.20.193.57:0/3153585583 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f5978095950 0x7f597808da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:31.419 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:31.413+0000 7f596ffff640 1 -- 10.20.193.57:0/3153585583 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f597812bed0 msgr2=0x7f59781c6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:31.419 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:31.413+0000 7f596ffff640 1 --2- 10.20.193.57:0/3153585583 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f597812bed0 0x7f59781c6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:31.419 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:31.413+0000 7f596ffff640 1 -- 10.20.193.57:0/3153585583 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59780742a0 con 0x7f597812b5b0 2026-02-20T16:29:31.419 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:31.413+0000 7f597d67b640 1 --2- 10.20.193.57:0/3153585583 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f597812bed0 0x7f59781c6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:29:31.419 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:31.413+0000 7f596ffff640 1 --2- 10.20.193.57:0/3153585583 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f597812b5b0 0x7f597808dfd0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f596000ea40 tx=0x7f596000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:29:31.419 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:31.413+0000 7f596d7fa640 1 -- 10.20.193.57:0/3153585583 <== mon.0 v2:10.20.193.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f596000ce30 con 0x7f597812b5b0 2026-02-20T16:29:31.420 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:31.413+0000 7f596d7fa640 1 -- 10.20.193.57:0/3153585583 <== mon.0 v2:10.20.193.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f59600040d0 con 0x7f597812b5b0 2026-02-20T16:29:31.420 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:31.413+0000 7f597f105640 1 -- 10.20.193.57:0/3153585583 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f597808f230 con 0x7f597812b5b0 2026-02-20T16:29:31.420 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:31.413+0000 7f596d7fa640 1 -- 10.20.193.57:0/3153585583 <== mon.0 v2:10.20.193.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59600044e0 con 0x7f597812b5b0 2026-02-20T16:29:31.420 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:31.413+0000 7f597f105640 1 -- 10.20.193.57:0/3153585583 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f597808e510 con 0x7f597812b5b0 2026-02-20T16:29:31.420 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:31.414+0000 7f597f105640 1 -- 10.20.193.57:0/3153585583 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5978097c10 con 0x7f597812b5b0 2026-02-20T16:29:31.420 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:31.414+0000 7f596d7fa640 1 -- 10.20.193.57:0/3153585583 <== mon.0 v2:10.20.193.57:3300/0 4 ==== mgrmap(e 4) ==== 62001+0+0 (secure 0 0 0) 0x7f5960020030 con 0x7f597812b5b0 2026-02-20T16:29:31.420 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:31.414+0000 7f596d7fa640 1 -- 10.20.193.57:0/3153585583 <== mon.0 v2:10.20.193.57:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1271+0+0 (secure 0 0 0) 0x7f5960066ba0 con 0x7f597812b5b0 2026-02-20T16:29:31.421 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:31.416+0000 7f596d7fa640 1 -- 10.20.193.57:0/3153585583 <== mon.0 v2:10.20.193.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f5978097c10 con 0x7f597812b5b0 2026-02-20T16:29:31.488 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:31.486+0000 7f597f105640 1 -- 10.20.193.57:0/3153585583 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5978134f20 con 0x7f597812b5b0 2026-02-20T16:29:31.488 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:31.486+0000 7f596d7fa640 1 -- 10.20.193.57:0/3153585583 <== mon.0 v2:10.20.193.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v7) ==== 74+0+4148 (secure 0 0 0) 0x7f59600410e0 con 0x7f597812b5b0 2026-02-20T16:29:31.488 INFO:teuthology.misc.health.trial057.stdout: 2026-02-20T16:29:31.489 INFO:teuthology.misc.health.trial057.stdout:{"epoch":7,"fsid":"3b3c5c1a-0a2b-40b9-ac1d-921ada466f9e","created":"2026-02-20T16:29:22.501479+0000","modified":"2026-02-20T16:29:30.719971+0000","last_up_change":"0.000000","last_in_change":"2026-02-20T16:29:24.294147+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a3139827-dc3c-46f9-b211-d376e3dc92f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00e7cb17-534c-4ac2-8486-585b3b8db0c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d0b55b31-45df-4c58-bf11-a72d44f21a00","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b3bfbbd8-cfaf-4360-9a5b-c52e89ac3f75","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T16:29:31.490 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:31.487+0000 7f597f105640 1 -- 10.20.193.57:0/3153585583 >> v1:10.20.193.57:6800/4138285113 conn(0x7f594804f700 legacy=0x7f5948051bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:31.490 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:31.487+0000 7f597f105640 1 -- 10.20.193.57:0/3153585583 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f597812b5b0 msgr2=0x7f597808dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:31.490 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:31.487+0000 7f597f105640 1 --2- 10.20.193.57:0/3153585583 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f597812b5b0 0x7f597808dfd0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f596000ea40 tx=0x7f596000ef10 comp rx=0 tx=0).stop 2026-02-20T16:29:31.490 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:31.487+0000 7f597f105640 1 -- 10.20.193.57:0/3153585583 shutdown_connections 2026-02-20T16:29:31.490 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:31.487+0000 7f597f105640 1 --2- 10.20.193.57:0/3153585583 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f597812bed0 0x7f59781c6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:31.490 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:31.487+0000 7f597f105640 1 --2- 10.20.193.57:0/3153585583 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f597812b5b0 0x7f597808dfd0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:31.490 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:31.487+0000 7f597f105640 1 --2- 10.20.193.57:0/3153585583 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f5978095950 0x7f597808da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:31.490 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:31.487+0000 7f597f105640 1 -- 10.20.193.57:0/3153585583 >> 10.20.193.57:0/3153585583 conn(0x7f597809d5a0 msgr2=0x7f5978133a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:31.491 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:31.487+0000 7f597f105640 1 -- 10.20.193.57:0/3153585583 shutdown_connections 2026-02-20T16:29:31.491 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:31.487+0000 7f597f105640 1 -- 10.20.193.57:0/3153585583 wait complete. 2026-02-20T16:29:31.496 DEBUG:teuthology.misc:0 of 4 OSDs are up 2026-02-20T16:29:31.726 INFO:tasks.ceph.osd.0.trial057.stderr:2026-02-20T16:29:31.725+0000 7fdde9d09640 -1 osd.0 0 waiting for initial osdmap 2026-02-20T16:29:31.728 INFO:tasks.ceph.osd.0.trial057.stderr:2026-02-20T16:29:31.726+0000 7fdde233c640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T16:29:32.728 INFO:tasks.ceph.osd.3.trial057.stderr:2026-02-20T16:29:32.726+0000 7fe2bbd62640 -1 osd.3 0 waiting for initial osdmap 2026-02-20T16:29:32.728 INFO:tasks.ceph.osd.2.trial057.stderr:2026-02-20T16:29:32.727+0000 7f100dd10640 -1 osd.2 0 waiting for initial osdmap 2026-02-20T16:29:32.729 INFO:tasks.ceph.osd.1.trial057.stderr:2026-02-20T16:29:32.727+0000 7fcc3a916640 -1 osd.1 0 waiting for initial osdmap 2026-02-20T16:29:32.730 INFO:tasks.ceph.osd.2.trial057.stderr:2026-02-20T16:29:32.729+0000 7f1006343640 -1 osd.2 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T16:29:32.730 INFO:tasks.ceph.osd.1.trial057.stderr:2026-02-20T16:29:32.729+0000 7fcc32f49640 -1 osd.1 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T16:29:32.731 INFO:tasks.ceph.osd.3.trial057.stderr:2026-02-20T16:29:32.729+0000 7fe2b4395640 -1 osd.3 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T16:29:37.898 DEBUG:teuthology.orchestra.run.trial057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-20T16:29:37.964 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:37.960+0000 7f199fe81640 1 -- 10.20.193.57:0/3330015419 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f199812c890 msgr2=0x7f199812cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:37.964 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:37.960+0000 7f199fe81640 1 --2- 10.20.193.57:0/3330015419 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f199812c890 0x7f199812cda0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1988009930 tx=0x7f198802f110 comp rx=0 tx=0).stop 2026-02-20T16:29:37.964 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:37.960+0000 7f199fe81640 1 -- 10.20.193.57:0/3330015419 shutdown_connections 2026-02-20T16:29:37.964 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:37.960+0000 7f199fe81640 1 --2- 10.20.193.57:0/3330015419 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f1998129390 0x7f19981297e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:37.965 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:37.960+0000 7f199fe81640 1 --2- 10.20.193.57:0/3330015419 >> v2:10.20.193.57:3300/0 conn(0x7f19980970c0 0x7f199812d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:37.965 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:37.960+0000 7f199fe81640 1 --2- 10.20.193.57:0/3330015419 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f199812c890 0x7f199812cda0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:37.965 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:37.960+0000 7f199fe81640 1 -- 10.20.193.57:0/3330015419 >> 10.20.193.57:0/3330015419 conn(0x7f199809d5a0 msgr2=0x7f199809d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:37.965 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:37.960+0000 7f199fe81640 1 -- 10.20.193.57:0/3330015419 shutdown_connections 2026-02-20T16:29:37.965 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:37.960+0000 7f199fe81640 1 -- 10.20.193.57:0/3330015419 wait complete. 2026-02-20T16:29:37.965 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:37.960+0000 7f199fe81640 1 Processor -- start 2026-02-20T16:29:37.965 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:37.960+0000 7f199fe81640 1 -- start start 2026-02-20T16:29:37.965 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:37.961+0000 7f199fe81640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f19980970c0 0x7f19981289e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:37.965 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:37.961+0000 7f199fe81640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f1998129390 0x7f199806dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:37.965 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:37.961+0000 7f199fe81640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f199812c890 0x7f199806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:37.965 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:37.961+0000 7f199fe81640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f19981344c0 con 0x7f19980970c0 2026-02-20T16:29:37.966 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:37.961+0000 7f199fe81640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f1998134340 con 0x7f1998129390 2026-02-20T16:29:37.966 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:37.961+0000 7f199fe81640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f1998134640 con 0x7f199812c890 2026-02-20T16:29:37.966 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:37.961+0000 7f199dbf6640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f19980970c0 0x7f19981289e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:37.966 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:37.961+0000 7f199dbf6640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f19980970c0 0x7f19981289e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:54580/0 (socket says 10.20.193.57:54580) 2026-02-20T16:29:37.966 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:37.961+0000 7f199d3f5640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f1998129390 0x7f199806dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:37.966 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:37.961+0000 7f199dbf6640 1 -- 10.20.193.57:0/641423990 learned_addr learned my addr 10.20.193.57:0/641423990 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:29:37.966 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:37.961+0000 7f199e3f7640 1 --2- 10.20.193.57:0/641423990 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f199812c890 0x7f199806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:37.966 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:37.961+0000 7f199d3f5640 1 -- 10.20.193.57:0/641423990 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f199812c890 msgr2=0x7f199806e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:37.966 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:37.961+0000 7f199d3f5640 1 --2- 10.20.193.57:0/641423990 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f199812c890 0x7f199806e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:37.966 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:37.961+0000 7f199d3f5640 1 -- 10.20.193.57:0/641423990 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f19980970c0 msgr2=0x7f19981289e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:37.967 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:37.961+0000 7f199d3f5640 1 --2- 10.20.193.57:0/641423990 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f19980970c0 0x7f19981289e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:37.967 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:37.961+0000 7f199d3f5640 1 -- 10.20.193.57:0/641423990 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f199806f8b0 con 0x7f1998129390 2026-02-20T16:29:37.967 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:37.961+0000 7f199dbf6640 1 --2- 10.20.193.57:0/641423990 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f19980970c0 0x7f19981289e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:29:37.967 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:37.961+0000 7f199d3f5640 1 --2- 10.20.193.57:0/641423990 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f1998129390 0x7f199806dde0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f198c00e9f0 tx=0x7f198c00eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:29:37.967 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:37.961+0000 7f19867fc640 1 -- 10.20.193.57:0/641423990 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f198c00cd80 con 0x7f1998129390 2026-02-20T16:29:37.967 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:37.961+0000 7f19867fc640 1 -- 10.20.193.57:0/641423990 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f198c0041c0 con 0x7f1998129390 2026-02-20T16:29:37.967 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:37.961+0000 7f199fe81640 1 -- 10.20.193.57:0/641423990 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19981320c0 con 0x7f1998129390 2026-02-20T16:29:37.967 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:37.961+0000 7f19867fc640 1 -- 10.20.193.57:0/641423990 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f198c0026e0 con 0x7f1998129390 2026-02-20T16:29:37.967 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:37.961+0000 7f199fe81640 1 -- 10.20.193.57:0/641423990 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1998129100 con 0x7f1998129390 2026-02-20T16:29:37.967 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:37.962+0000 7f19867fc640 1 -- 10.20.193.57:0/641423990 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 5) ==== 62057+0+0 (secure 0 0 0) 0x7f198c020030 con 0x7f1998129390 2026-02-20T16:29:37.967 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:37.962+0000 7f199fe81640 1 -- 10.20.193.57:0/641423990 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19981297c0 con 0x7f1998129390 2026-02-20T16:29:37.968 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:37.962+0000 7f19867fc640 1 -- 10.20.193.57:0/641423990 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(13..13 src has 1..13) ==== 2452+0+0 (secure 0 0 0) 0x7f198c066ff0 con 0x7f1998129390 2026-02-20T16:29:37.968 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:37.964+0000 7f19867fc640 1 -- 10.20.193.57:0/641423990 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f198c041020 con 0x7f1998129390 2026-02-20T16:29:38.038 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:38.036+0000 7f199fe81640 1 -- 10.20.193.57:0/641423990 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1998068c80 con 0x7f1998129390 2026-02-20T16:29:38.039 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:38.037+0000 7f19867fc640 1 -- 10.20.193.57:0/641423990 <== mon.1 v2:10.20.193.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+7005 (secure 0 0 0) 0x7f198c0662e0 con 0x7f1998129390 2026-02-20T16:29:38.039 INFO:teuthology.misc.health.trial057.stdout: 2026-02-20T16:29:38.039 INFO:teuthology.misc.health.trial057.stdout:{"epoch":13,"fsid":"3b3c5c1a-0a2b-40b9-ac1d-921ada466f9e","created":"2026-02-20T16:29:22.501479+0000","modified":"2026-02-20T16:29:36.735323+0000","last_up_change":"2026-02-20T16:29:33.726177+0000","last_in_change":"2026-02-20T16:29:24.294147+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T16:29:34.029059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a3139827-dc3c-46f9-b211-d376e3dc92f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6801","nonce":385793132}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6802","nonce":385793132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6804","nonce":385793132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6803","nonce":385793132}]},"public_addr":"10.20.193.57:6801/385793132","cluster_addr":"10.20.193.57:6802/385793132","heartbeat_back_addr":"10.20.193.57:6804/385793132","heartbeat_front_addr":"10.20.193.57:6803/385793132","state":["exists","up"]},{"osd":1,"uuid":"00e7cb17-534c-4ac2-8486-585b3b8db0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6805","nonce":3441840004}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6806","nonce":3441840004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6808","nonce":3441840004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6807","nonce":3441840004}]},"public_addr":"10.20.193.57:6805/3441840004","cluster_addr":"10.20.193.57:6806/3441840004","heartbeat_back_addr":"10.20.193.57:6808/3441840004","heartbeat_front_addr":"10.20.193.57:6807/3441840004","state":["exists","up"]},{"osd":2,"uuid":"d0b55b31-45df-4c58-bf11-a72d44f21a00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6809","nonce":1926844368}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6810","nonce":1926844368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6812","nonce":1926844368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6811","nonce":1926844368}]},"public_addr":"10.20.193.57:6809/1926844368","cluster_addr":"10.20.193.57:6810/1926844368","heartbeat_back_addr":"10.20.193.57:6812/1926844368","heartbeat_front_addr":"10.20.193.57:6811/1926844368","state":["exists","up"]},{"osd":3,"uuid":"b3bfbbd8-cfaf-4360-9a5b-c52e89ac3f75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6813","nonce":3124429028}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6814","nonce":3124429028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6816","nonce":3124429028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6815","nonce":3124429028}]},"public_addr":"10.20.193.57:6813/3124429028","cluster_addr":"10.20.193.57:6814/3124429028","heartbeat_back_addr":"10.20.193.57:6816/3124429028","heartbeat_front_addr":"10.20.193.57:6815/3124429028","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T16:29:31.711310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T16:29:31.724521+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T16:29:31.770683+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T16:29:31.821531+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T16:29:38.040 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:38.038+0000 7f199fe81640 1 -- 10.20.193.57:0/641423990 >> v1:10.20.193.57:6800/4138285113 conn(0x7f196804f7c0 legacy=0x7f1968051c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:38.040 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:38.038+0000 7f199fe81640 1 -- 10.20.193.57:0/641423990 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f1998129390 msgr2=0x7f199806dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:38.041 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:38.038+0000 7f199fe81640 1 --2- 10.20.193.57:0/641423990 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f1998129390 0x7f199806dde0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f198c00e9f0 tx=0x7f198c00eec0 comp rx=0 tx=0).stop 2026-02-20T16:29:38.041 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:38.038+0000 7f199fe81640 1 -- 10.20.193.57:0/641423990 shutdown_connections 2026-02-20T16:29:38.041 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:38.038+0000 7f199fe81640 1 --2- 10.20.193.57:0/641423990 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f199812c890 0x7f199806e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:38.041 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:38.038+0000 7f199fe81640 1 --2- 10.20.193.57:0/641423990 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f1998129390 0x7f199806dde0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:38.041 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:38.038+0000 7f199fe81640 1 --2- 10.20.193.57:0/641423990 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f19980970c0 0x7f19981289e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:38.041 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:38.038+0000 7f199fe81640 1 -- 10.20.193.57:0/641423990 >> 10.20.193.57:0/641423990 conn(0x7f199809d5a0 msgr2=0x7f199812ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:38.041 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:38.038+0000 7f199fe81640 1 -- 10.20.193.57:0/641423990 shutdown_connections 2026-02-20T16:29:38.041 INFO:teuthology.misc.health.trial057.stderr:2026-02-20T16:29:38.038+0000 7f199fe81640 1 -- 10.20.193.57:0/641423990 wait complete. 2026-02-20T16:29:38.046 DEBUG:teuthology.misc:4 of 4 OSDs are up 2026-02-20T16:29:38.046 INFO:tasks.ceph:Creating RBD pool 2026-02-20T16:29:38.046 DEBUG:teuthology.orchestra.run.trial057:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-20T16:29:38.116 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.112+0000 7fbdcd58d640 1 -- 10.20.193.57:0/810687950 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fbdc8129590 msgr2=0x7fbdc8129970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:38.116 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.112+0000 7fbdcd58d640 1 --2- 10.20.193.57:0/810687950 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fbdc8129590 0x7fbdc8129970 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc009a00 tx=0x7fbdbc02f1f0 comp rx=0 tx=0).stop 2026-02-20T16:29:38.116 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.112+0000 7fbdcd58d640 1 -- 10.20.193.57:0/810687950 shutdown_connections 2026-02-20T16:29:38.116 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.112+0000 7fbdcd58d640 1 --2- 10.20.193.57:0/810687950 >> v2:10.20.193.57:3300/0 conn(0x7fbdc812ced0 0x7fbdc812d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:38.116 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.112+0000 7fbdcd58d640 1 --2- 10.20.193.57:0/810687950 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fbdc8129590 0x7fbdc8129970 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:38.117 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.112+0000 7fbdcd58d640 1 -- 10.20.193.57:0/810687950 >> 10.20.193.57:0/810687950 conn(0x7fbdc809f4f0 msgr2=0x7fbdc809f900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:38.117 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.112+0000 7fbdcd58d640 1 -- 10.20.193.57:0/810687950 shutdown_connections 2026-02-20T16:29:38.117 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.112+0000 7fbdcd58d640 1 -- 10.20.193.57:0/810687950 wait complete. 2026-02-20T16:29:38.117 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.112+0000 7fbdcd58d640 1 Processor -- start 2026-02-20T16:29:38.117 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.112+0000 7fbdcd58d640 1 -- start start 2026-02-20T16:29:38.117 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.113+0000 7fbdcd58d640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fbdc8129590 0x7fbdc80728d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:38.117 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.113+0000 7fbdcd58d640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fbdc8129eb0 0x7fbdc8072e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:38.117 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.113+0000 7fbdcd58d640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fbdc812ced0 0x7fbdc8073350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:38.117 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.113+0000 7fbdcd58d640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc81356b0 con 0x7fbdc812ced0 2026-02-20T16:29:38.117 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.113+0000 7fbdcd58d640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7fbdc8135530 con 0x7fbdc8129590 2026-02-20T16:29:38.117 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.113+0000 7fbdcd58d640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7fbdc8135830 con 0x7fbdc8129eb0 2026-02-20T16:29:38.118 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.113+0000 7fbdc6ffd640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fbdc8129590 0x7fbdc80728d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:38.118 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.113+0000 7fbdc6ffd640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fbdc8129590 0x7fbdc80728d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3301/0 says I am v2:10.20.193.57:58396/0 (socket says 10.20.193.57:58396) 2026-02-20T16:29:38.118 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.113+0000 7fbdc6ffd640 1 -- 10.20.193.57:0/1844544762 learned_addr learned my addr 10.20.193.57:0/1844544762 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:29:38.118 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.113+0000 7fbdc67fc640 1 --2- 10.20.193.57:0/1844544762 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fbdc8129eb0 0x7fbdc8072e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:38.118 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.113+0000 7fbdc77fe640 1 --2- 10.20.193.57:0/1844544762 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fbdc812ced0 0x7fbdc8073350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:38.118 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.113+0000 7fbdc6ffd640 1 -- 10.20.193.57:0/1844544762 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fbdc8129eb0 msgr2=0x7fbdc8072e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:38.118 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.113+0000 7fbdc6ffd640 1 --2- 10.20.193.57:0/1844544762 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fbdc8129eb0 0x7fbdc8072e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:38.118 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.113+0000 7fbdc6ffd640 1 -- 10.20.193.57:0/1844544762 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fbdc812ced0 msgr2=0x7fbdc8073350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:38.118 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.113+0000 7fbdc6ffd640 1 --2- 10.20.193.57:0/1844544762 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fbdc812ced0 0x7fbdc8073350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:38.118 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.113+0000 7fbdc6ffd640 1 -- 10.20.193.57:0/1844544762 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdc808d960 con 0x7fbdc8129590 2026-02-20T16:29:38.118 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.113+0000 7fbdc6ffd640 1 --2- 10.20.193.57:0/1844544762 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fbdc8129590 0x7fbdc80728d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc009b30 tx=0x7fbdbc0026e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:29:38.119 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.113+0000 7fbda77fe640 1 -- 10.20.193.57:0/1844544762 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc046070 con 0x7fbdc8129590 2026-02-20T16:29:38.119 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.113+0000 7fbda77fe640 1 -- 10.20.193.57:0/1844544762 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbdbc002ae0 con 0x7fbdc8129590 2026-02-20T16:29:38.119 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.113+0000 7fbdcd58d640 1 -- 10.20.193.57:0/1844544762 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdc808cf60 con 0x7fbdc8129590 2026-02-20T16:29:38.119 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.113+0000 7fbda77fe640 1 -- 10.20.193.57:0/1844544762 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc038470 con 0x7fbdc8129590 2026-02-20T16:29:38.119 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.113+0000 7fbdcd58d640 1 -- 10.20.193.57:0/1844544762 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdc808d530 con 0x7fbdc8129590 2026-02-20T16:29:38.119 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.114+0000 7fbdcd58d640 1 -- 10.20.193.57:0/1844544762 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdc8129970 con 0x7fbdc8129590 2026-02-20T16:29:38.119 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.114+0000 7fbda77fe640 1 -- 10.20.193.57:0/1844544762 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 5) ==== 62057+0+0 (secure 0 0 0) 0x7fbdbc038610 con 0x7fbdc8129590 2026-02-20T16:29:38.119 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.114+0000 7fbda77fe640 1 -- 10.20.193.57:0/1844544762 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(13..13 src has 1..13) ==== 2452+0+0 (secure 0 0 0) 0x7fbdbc08b060 con 0x7fbdc8129590 2026-02-20T16:29:38.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.116+0000 7fbda77fe640 1 -- 10.20.193.57:0/1844544762 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7fbdc808d960 con 0x7fbdc8129590 2026-02-20T16:29:38.188 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.186+0000 7fbdcd58d640 1 -- 10.20.193.57:0/1844544762 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7fbdc8074840 con 0x7fbdc8129590 2026-02-20T16:29:38.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.742+0000 7fbda77fe640 1 -- 10.20.193.57:0/1844544762 <== mon.1 v2:10.20.193.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v14) ==== 109+0+0 (secure 0 0 0) 0x7fbdbc065090 con 0x7fbdc8129590 2026-02-20T16:29:38.744 INFO:teuthology.orchestra.run.trial057.stderr:pool 'rbd' created 2026-02-20T16:29:38.745 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.743+0000 7fbdcd58d640 1 -- 10.20.193.57:0/1844544762 >> v1:10.20.193.57:6800/4138285113 conn(0x7fbd9404f790 legacy=0x7fbd94051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:38.745 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.743+0000 7fbdcd58d640 1 -- 10.20.193.57:0/1844544762 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fbdc8129590 msgr2=0x7fbdc80728d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:38.745 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.743+0000 7fbdcd58d640 1 --2- 10.20.193.57:0/1844544762 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fbdc8129590 0x7fbdc80728d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc009b30 tx=0x7fbdbc0026e0 comp rx=0 tx=0).stop 2026-02-20T16:29:38.745 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.743+0000 7fbdcd58d640 1 -- 10.20.193.57:0/1844544762 shutdown_connections 2026-02-20T16:29:38.745 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.743+0000 7fbdcd58d640 1 --2- 10.20.193.57:0/1844544762 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fbdc812ced0 0x7fbdc8073350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:38.745 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.743+0000 7fbdcd58d640 1 --2- 10.20.193.57:0/1844544762 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fbdc8129eb0 0x7fbdc8072e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:38.745 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.743+0000 7fbdcd58d640 1 --2- 10.20.193.57:0/1844544762 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fbdc8129590 0x7fbdc80728d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:38.746 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.743+0000 7fbdcd58d640 1 -- 10.20.193.57:0/1844544762 >> 10.20.193.57:0/1844544762 conn(0x7fbdc809f4f0 msgr2=0x7fbdc812ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:38.746 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.743+0000 7fbdcd58d640 1 -- 10.20.193.57:0/1844544762 shutdown_connections 2026-02-20T16:29:38.746 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.743+0000 7fbdcd58d640 1 -- 10.20.193.57:0/1844544762 wait complete. 2026-02-20T16:29:38.754 DEBUG:teuthology.orchestra.run.trial057:> rbd --cluster ceph pool init rbd 2026-02-20T16:29:38.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.785+0000 7f7b256bb0c0 1 -- 10.20.193.57:0/2126010140 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x561b635fd160 msgr2=0x561b635fd540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:38.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.785+0000 7f7b256bb0c0 1 --2- 10.20.193.57:0/2126010140 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x561b635fd160 0x561b635fd540 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7b1000a3d0 tx=0x7f7b10058b60 comp rx=0 tx=0).stop 2026-02-20T16:29:38.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.785+0000 7f7b256bb0c0 1 -- 10.20.193.57:0/2126010140 shutdown_connections 2026-02-20T16:29:38.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.785+0000 7f7b256bb0c0 1 --2- 10.20.193.57:0/2126010140 >> v2:10.20.193.57:3300/0 conn(0x561b635fda80 0x561b63600660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:38.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.785+0000 7f7b256bb0c0 1 --2- 10.20.193.57:0/2126010140 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x561b635fd160 0x561b635fd540 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:38.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.785+0000 7f7b256bb0c0 1 -- 10.20.193.57:0/2126010140 >> 10.20.193.57:0/2126010140 conn(0x561b63570cb0 msgr2=0x561b635710c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:38.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.785+0000 7f7b256bb0c0 1 -- 10.20.193.57:0/2126010140 shutdown_connections 2026-02-20T16:29:38.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.785+0000 7f7b256bb0c0 1 -- 10.20.193.57:0/2126010140 wait complete. 2026-02-20T16:29:38.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.785+0000 7f7b256bb0c0 1 Processor -- start 2026-02-20T16:29:38.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.785+0000 7f7b256bb0c0 1 -- start start 2026-02-20T16:29:38.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.786+0000 7f7b256bb0c0 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x561b635fd160 0x561b636041c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:38.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.786+0000 7f7b256bb0c0 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x561b635fda80 0x561b63604700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:38.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.786+0000 7f7b256bb0c0 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x561b63600ba0 0x561b636078c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:38.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.786+0000 7f7b256bb0c0 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x561b633dbe50 con 0x561b635fd160 2026-02-20T16:29:38.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.786+0000 7f7b256bb0c0 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x561b6343cdb0 con 0x561b635fda80 2026-02-20T16:29:38.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.786+0000 7f7b256bb0c0 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x561b636013e0 con 0x561b63600ba0 2026-02-20T16:29:38.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.786+0000 7f7b24181640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x561b635fd160 0x561b636041c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:38.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.786+0000 7f7b23980640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x561b635fda80 0x561b63604700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:38.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.786+0000 7f7b24181640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x561b635fd160 0x561b636041c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:54622/0 (socket says 10.20.193.57:54622) 2026-02-20T16:29:38.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.786+0000 7f7b24181640 1 -- 10.20.193.57:0/624865700 learned_addr learned my addr 10.20.193.57:0/624865700 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:29:38.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.786+0000 7f7b2540a640 1 --2- 10.20.193.57:0/624865700 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x561b63600ba0 0x561b636078c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:38.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.786+0000 7f7b23980640 1 -- 10.20.193.57:0/624865700 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x561b63600ba0 msgr2=0x561b636078c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:38.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.786+0000 7f7b23980640 1 --2- 10.20.193.57:0/624865700 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x561b63600ba0 0x561b636078c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:38.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.786+0000 7f7b23980640 1 -- 10.20.193.57:0/624865700 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x561b635fd160 msgr2=0x561b636041c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:38.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.786+0000 7f7b23980640 1 --2- 10.20.193.57:0/624865700 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x561b635fd160 0x561b636041c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:38.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.786+0000 7f7b23980640 1 -- 10.20.193.57:0/624865700 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b63605970 con 0x561b635fda80 2026-02-20T16:29:38.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.786+0000 7f7b23980640 1 --2- 10.20.193.57:0/624865700 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x561b635fda80 0x561b63604700 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7b1400a6e0 tx=0x7f7b1400abb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:29:38.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.786+0000 7f7b2097a640 1 -- 10.20.193.57:0/624865700 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b140099a0 con 0x561b635fda80 2026-02-20T16:29:38.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.786+0000 7f7b2097a640 1 -- 10.20.193.57:0/624865700 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7b14009b40 con 0x561b635fda80 2026-02-20T16:29:38.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.786+0000 7f7b256bb0c0 1 -- 10.20.193.57:0/624865700 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x561b635faec0 con 0x561b635fda80 2026-02-20T16:29:38.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.786+0000 7f7b2097a640 1 -- 10.20.193.57:0/624865700 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b14015460 con 0x561b635fda80 2026-02-20T16:29:38.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.786+0000 7f7b256bb0c0 1 -- 10.20.193.57:0/624865700 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x561b63606a50 con 0x561b635fda80 2026-02-20T16:29:38.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.787+0000 7f7b2097a640 1 -- 10.20.193.57:0/624865700 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 5) ==== 62057+0+0 (secure 0 0 0) 0x7f7b1401d030 con 0x561b635fda80 2026-02-20T16:29:38.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.787+0000 7f7b2097a640 1 -- 10.20.193.57:0/624865700 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(14..14 src has 1..14) ==== 2794+0+0 (secure 0 0 0) 0x7f7b14065d50 con 0x561b635fda80 2026-02-20T16:29:38.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:38.787+0000 7f7b256bb0c0 1 -- 10.20.193.57:0/624865700 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x561b63608130 con 0x561b635fda80 2026-02-20T16:29:39.747 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:39.744+0000 7f7b2097a640 1 -- 10.20.193.57:0/624865700 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v15) ==== 141+0+0 (secure 0 0 0) 0x7f7b1403fc30 con 0x561b635fda80 2026-02-20T16:29:39.747 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:39.744+0000 7f7b256bb0c0 1 -- 10.20.193.57:0/624865700 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7b10064070 con 0x561b635fda80 2026-02-20T16:29:39.747 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:39.745+0000 7f7b2097a640 1 -- 10.20.193.57:0/624865700 <== mon.1 v2:10.20.193.57:3301/0 7 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f7b1403f500 con 0x561b635fda80 2026-02-20T16:29:39.747 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:39.745+0000 7f7b2297e640 1 -- 10.20.193.57:0/624865700 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=15}) -- 0x7f7afc002ae0 con 0x561b635fda80 2026-02-20T16:29:39.747 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:39.745+0000 7f7b2097a640 1 -- 10.20.193.57:0/624865700 <== mon.1 v2:10.20.193.57:3301/0 8 ==== osd_map(15..15 src has 1..15) ==== 650+0+0 (secure 0 0 0) 0x7f7b1403efb0 con 0x561b635fda80 2026-02-20T16:29:39.747 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:39.745+0000 7f7b256bb0c0 1 -- 10.20.193.57:0/624865700 --> v1:10.20.193.57:6813/3124429028 -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15) -- 0x561b6361b6e0 con 0x561b63617bd0 2026-02-20T16:29:39.749 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:39.748+0000 7f7b2540a640 1 -- 10.20.193.57:0/624865700 <== osd.3 v1:10.20.193.57:6813/3124429028 1 ==== osd_op_reply(1 rbd_trash [create] v15'1 uv1 ondisk = 0) ==== 153+0+0 (unknown 2722885549 0 0) 0x7f7b18006c50 con 0x561b63617bd0 2026-02-20T16:29:39.751 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:39.749+0000 7f7b256bb0c0 1 -- 10.20.193.57:0/624865700 --> v1:10.20.193.57:6813/3124429028 -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) -- 0x561b6366df60 con 0x561b63617bd0 2026-02-20T16:29:39.751 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:39.749+0000 7f7b2540a640 1 -- 10.20.193.57:0/624865700 <== osd.3 v1:10.20.193.57:6813/3124429028 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (unknown 2354864950 0 0) 0x7f7b18006c50 con 0x561b63617bd0 2026-02-20T16:29:39.751 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:39.750+0000 7f7b256bb0c0 1 -- 10.20.193.57:0/624865700 --> v1:10.20.193.57:6813/3124429028 -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) -- 0x561b6366d050 con 0x561b63617bd0 2026-02-20T16:29:39.751 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:39.750+0000 7f7b2540a640 1 -- 10.20.193.57:0/624865700 <== osd.3 v1:10.20.193.57:6813/3124429028 3 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (unknown 2366413114 0 0) 0x7f7b18006c50 con 0x561b63617bd0 2026-02-20T16:29:39.752 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:39.750+0000 7f7b2297e640 1 -- 10.20.193.57:0/624865700 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7f7afc003ef0 con 0x561b635fda80 2026-02-20T16:29:40.746 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:40.744+0000 7f7b2097a640 1 -- 10.20.193.57:0/624865700 <== mon.1 v2:10.20.193.57:3301/0 9 ==== pool_op_reply(tid 4 (0) Success v16) ==== 55+0+0 (secure 0 0 0) 0x7f7b1403f8d0 con 0x561b635fda80 2026-02-20T16:29:40.746 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:40.744+0000 7f7b2097a640 1 -- 10.20.193.57:0/624865700 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=16}) -- 0x7f7b04054ac0 con 0x561b635fda80 2026-02-20T16:29:40.746 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:40.744+0000 7f7b2097a640 1 -- 10.20.193.57:0/624865700 <== mon.1 v2:10.20.193.57:3301/0 10 ==== osd_map(16..16 src has 1..16) ==== 626+0+0 (secure 0 0 0) 0x7f7b14064ef0 con 0x561b635fda80 2026-02-20T16:29:40.747 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:40.744+0000 7f7b2297e640 1 -- 10.20.193.57:0/624865700 --> v1:10.20.193.57:6813/3124429028 -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16) -- 0x7f7afc0059c0 con 0x561b63617bd0 2026-02-20T16:29:40.747 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:40.745+0000 7f7b2540a640 1 -- 10.20.193.57:0/624865700 <== osd.3 v1:10.20.193.57:6813/3124429028 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v16'1 uv1 ondisk = 0) ==== 194+0+0 (unknown 1230306805 0 0) 0x7f7b18006c50 con 0x561b63617bd0 2026-02-20T16:29:40.747 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:40.745+0000 7f7b2297e640 1 -- 10.20.193.57:0/624865700 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v16) -- 0x7f7afc0053c0 con 0x561b635fda80 2026-02-20T16:29:41.746 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.744+0000 7f7b2097a640 1 -- 10.20.193.57:0/624865700 <== mon.1 v2:10.20.193.57:3301/0 11 ==== pool_op_reply(tid 6 (0) Success v17) ==== 43+0+0 (secure 0 0 0) 0x7f7b1405b020 con 0x561b635fda80 2026-02-20T16:29:41.746 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.744+0000 7f7b2097a640 1 -- 10.20.193.57:0/624865700 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=17}) -- 0x7f7b04054d40 con 0x561b635fda80 2026-02-20T16:29:41.747 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.744+0000 7f7b2097a640 1 -- 10.20.193.57:0/624865700 <== mon.1 v2:10.20.193.57:3301/0 12 ==== osd_map(17..17 src has 1..17) ==== 654+0+0 (secure 0 0 0) 0x7f7b14042310 con 0x561b635fda80 2026-02-20T16:29:41.747 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.744+0000 7f7b2297e640 1 -- 10.20.193.57:0/624865700 --> v1:10.20.193.57:6813/3124429028 -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17) -- 0x7f7afc006210 con 0x561b63617bd0 2026-02-20T16:29:41.748 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.746+0000 7f7b2540a640 1 -- 10.20.193.57:0/624865700 <== osd.3 v1:10.20.193.57:6813/3124429028 5 ==== osd_op_reply(7 rbd_info [write 0~19] v17'2 uv2 ondisk = 0) ==== 152+0+0 (unknown 3144429724 0 0) 0x7f7b18006c50 con 0x561b63617bd0 2026-02-20T16:29:41.748 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.746+0000 7f7b256bb0c0 1 -- 10.20.193.57:0/624865700 >> v1:10.20.193.57:6813/3124429028 conn(0x561b63617bd0 legacy=0x561b63619fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:41.748 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.746+0000 7f7b256bb0c0 1 -- 10.20.193.57:0/624865700 >> v1:10.20.193.57:6800/4138285113 conn(0x7f7b0404df80 legacy=0x7f7b04050440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:41.748 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.746+0000 7f7b256bb0c0 1 -- 10.20.193.57:0/624865700 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x561b635fda80 msgr2=0x561b63604700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:41.748 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.746+0000 7f7b256bb0c0 1 --2- 10.20.193.57:0/624865700 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x561b635fda80 0x561b63604700 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7b1400a6e0 tx=0x7f7b1400abb0 comp rx=0 tx=0).stop 2026-02-20T16:29:41.748 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.746+0000 7f7b2540a640 1 -- 10.20.193.57:0/624865700 reap_dead start 2026-02-20T16:29:41.749 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.746+0000 7f7b256bb0c0 1 -- 10.20.193.57:0/624865700 shutdown_connections 2026-02-20T16:29:41.749 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.746+0000 7f7b256bb0c0 1 -- 10.20.193.57:0/624865700 >> 10.20.193.57:0/624865700 conn(0x561b63570cb0 msgr2=0x561b6356e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:41.749 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.746+0000 7f7b256bb0c0 1 -- 10.20.193.57:0/624865700 shutdown_connections 2026-02-20T16:29:41.749 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.746+0000 7f7b256bb0c0 1 -- 10.20.193.57:0/624865700 wait complete. 2026-02-20T16:29:41.753 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-20T16:29:41.754 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2026-02-20T16:29:41.754 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-20T16:29:41.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.863+0000 7fc013106640 1 -- 10.20.193.57:0/2320514401 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fc00c0938c0 msgr2=0x7fc00c093ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:41.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.863+0000 7fc013106640 1 --2- 10.20.193.57:0/2320514401 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fc00c0938c0 0x7fc00c093ca0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbffc009a00 tx=0x7fbffc02f280 comp rx=0 tx=0).stop 2026-02-20T16:29:41.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.863+0000 7fc013106640 1 -- 10.20.193.57:0/2320514401 shutdown_connections 2026-02-20T16:29:41.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.863+0000 7fc013106640 1 --2- 10.20.193.57:0/2320514401 >> v2:10.20.193.57:3300/0 conn(0x7fc00c0950d0 0x7fc00c134af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:41.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.863+0000 7fc013106640 1 --2- 10.20.193.57:0/2320514401 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fc00c0938c0 0x7fc00c093ca0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:41.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.863+0000 7fc013106640 1 -- 10.20.193.57:0/2320514401 >> 10.20.193.57:0/2320514401 conn(0x7fc00c09a170 msgr2=0x7fc00c097a10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:41.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.863+0000 7fc013106640 1 -- 10.20.193.57:0/2320514401 shutdown_connections 2026-02-20T16:29:41.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.863+0000 7fc013106640 1 -- 10.20.193.57:0/2320514401 wait complete. 2026-02-20T16:29:41.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.863+0000 7fc013106640 1 Processor -- start 2026-02-20T16:29:41.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.863+0000 7fc013106640 1 -- start start 2026-02-20T16:29:41.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.863+0000 7fc013106640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fc00c0938c0 0x7fc00c1c6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:41.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.863+0000 7fc013106640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fc00c094580 0x7fc00c1c7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:41.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.863+0000 7fc013106640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fc00c0950d0 0x7fc00c08c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:41.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.863+0000 7fc013106640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7fc00c135610 con 0x7fc00c0938c0 2026-02-20T16:29:41.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.863+0000 7fc013106640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7fc00c135490 con 0x7fc00c0950d0 2026-02-20T16:29:41.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.863+0000 7fc013106640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7fc00c135790 con 0x7fc00c094580 2026-02-20T16:29:41.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.863+0000 7fc010e7b640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fc00c0938c0 0x7fc00c1c6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:41.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.863+0000 7fc010e7b640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fc00c0938c0 0x7fc00c1c6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:38694/0 (socket says 10.20.193.57:38694) 2026-02-20T16:29:41.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.863+0000 7fc010e7b640 1 -- 10.20.193.57:0/197971379 learned_addr learned my addr 10.20.193.57:0/197971379 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:29:41.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.863+0000 7fc01167c640 1 --2- 10.20.193.57:0/197971379 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fc00c0950d0 0x7fc00c08c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:41.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.863+0000 7fc003fff640 1 --2- 10.20.193.57:0/197971379 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fc00c094580 0x7fc00c1c7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:41.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.864+0000 7fc010e7b640 1 -- 10.20.193.57:0/197971379 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fc00c094580 msgr2=0x7fc00c1c7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:41.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.864+0000 7fc010e7b640 1 --2- 10.20.193.57:0/197971379 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fc00c094580 0x7fc00c1c7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:41.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.864+0000 7fc010e7b640 1 -- 10.20.193.57:0/197971379 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fc00c0950d0 msgr2=0x7fc00c08c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:41.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.864+0000 7fc010e7b640 1 --2- 10.20.193.57:0/197971379 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fc00c0950d0 0x7fc00c08c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:41.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.864+0000 7fc010e7b640 1 -- 10.20.193.57:0/197971379 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc00c08f850 con 0x7fc00c0938c0 2026-02-20T16:29:41.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.864+0000 7fc003fff640 1 --2- 10.20.193.57:0/197971379 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fc00c094580 0x7fc00c1c7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T16:29:41.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.864+0000 7fc01167c640 1 --2- 10.20.193.57:0/197971379 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fc00c0950d0 0x7fc00c08c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:29:41.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.864+0000 7fc010e7b640 1 --2- 10.20.193.57:0/197971379 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fc00c0938c0 0x7fc00c1c6bf0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbffc009b30 tx=0x7fbffc002910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:29:41.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.864+0000 7fc0017fa640 1 -- 10.20.193.57:0/197971379 <== mon.0 v2:10.20.193.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbffc004570 con 0x7fc00c0938c0 2026-02-20T16:29:41.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.864+0000 7fc0017fa640 1 -- 10.20.193.57:0/197971379 <== mon.0 v2:10.20.193.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbffc002d10 con 0x7fc00c0938c0 2026-02-20T16:29:41.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.864+0000 7fc013106640 1 -- 10.20.193.57:0/197971379 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc00c08e2a0 con 0x7fc00c0938c0 2026-02-20T16:29:41.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.864+0000 7fc0017fa640 1 -- 10.20.193.57:0/197971379 <== mon.0 v2:10.20.193.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbffc0386d0 con 0x7fc00c0938c0 2026-02-20T16:29:41.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.864+0000 7fc013106640 1 -- 10.20.193.57:0/197971379 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc00c1c7670 con 0x7fc00c0938c0 2026-02-20T16:29:41.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.864+0000 7fc013106640 1 -- 10.20.193.57:0/197971379 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc00c093ca0 con 0x7fc00c0938c0 2026-02-20T16:29:41.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.864+0000 7fc0017fa640 1 -- 10.20.193.57:0/197971379 <== mon.0 v2:10.20.193.57:3300/0 4 ==== mgrmap(e 5) ==== 62057+0+0 (secure 0 0 0) 0x7fbffc038870 con 0x7fc00c0938c0 2026-02-20T16:29:41.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.865+0000 7fc0017fa640 1 -- 10.20.193.57:0/197971379 <== mon.0 v2:10.20.193.57:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2861+0+0 (secure 0 0 0) 0x7fbffc08b7e0 con 0x7fc00c0938c0 2026-02-20T16:29:41.871 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.867+0000 7fc0017fa640 1 -- 10.20.193.57:0/197971379 <== mon.0 v2:10.20.193.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7fbffc0655e0 con 0x7fc00c0938c0 2026-02-20T16:29:41.939 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.937+0000 7fc013106640 1 -- 10.20.193.57:0/197971379 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7fc00c050a10 con 0x7fc00c0938c0 2026-02-20T16:29:41.939 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.938+0000 7fc0017fa640 1 -- 10.20.193.57:0/197971379 <== mon.0 v2:10.20.193.57:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v23) ==== 86+0+140 (secure 0 0 0) 0x7fbffc08a8a0 con 0x7fc00c0938c0 2026-02-20T16:29:41.940 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:29:41.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.938+0000 7fc013106640 1 -- 10.20.193.57:0/197971379 >> v1:10.20.193.57:6800/4138285113 conn(0x7fbfdc04f790 legacy=0x7fbfdc051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:41.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.938+0000 7fc013106640 1 -- 10.20.193.57:0/197971379 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fc00c0938c0 msgr2=0x7fc00c1c6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:41.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.938+0000 7fc013106640 1 --2- 10.20.193.57:0/197971379 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fc00c0938c0 0x7fc00c1c6bf0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbffc009b30 tx=0x7fbffc002910 comp rx=0 tx=0).stop 2026-02-20T16:29:41.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.938+0000 7fc013106640 1 -- 10.20.193.57:0/197971379 shutdown_connections 2026-02-20T16:29:41.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.938+0000 7fc013106640 1 --2- 10.20.193.57:0/197971379 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fc00c0950d0 0x7fc00c08c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:41.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.938+0000 7fc013106640 1 --2- 10.20.193.57:0/197971379 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fc00c094580 0x7fc00c1c7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:41.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.938+0000 7fc013106640 1 --2- 10.20.193.57:0/197971379 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fc00c0938c0 0x7fc00c1c6bf0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:41.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.938+0000 7fc013106640 1 -- 10.20.193.57:0/197971379 >> 10.20.193.57:0/197971379 conn(0x7fc00c09a170 msgr2=0x7fc00c09b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:41.942 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.939+0000 7fc013106640 1 -- 10.20.193.57:0/197971379 shutdown_connections 2026-02-20T16:29:41.942 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:41.939+0000 7fc013106640 1 -- 10.20.193.57:0/197971379 wait complete. 2026-02-20T16:29:41.947 INFO:teuthology.orchestra.run.trial057.stdout:[{"version":23,"timestamp":"2026-02-20T16:29:23.338009+0000","name":"","changes":[{"name":"mds/mds_debug_scatterstat","new_value":"true"}]}] 2026-02-20T16:29:41.947 INFO:tasks.ceph_manager:config epoch is 23 2026-02-20T16:29:41.948 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-20T16:29:41.948 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-20T16:29:41.948 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-20T16:29:42.021 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.016+0000 7fc5e0beb640 1 -- 10.20.193.57:0/2215310246 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fc5dc12c7e0 msgr2=0x7fc5dc12cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.021 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.016+0000 7fc5e0beb640 1 --2- 10.20.193.57:0/2215310246 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fc5dc12c7e0 0x7fc5dc12cbc0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc5d0009930 tx=0x7fc5d002f110 comp rx=0 tx=0).stop 2026-02-20T16:29:42.021 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.016+0000 7fc5e0beb640 1 -- 10.20.193.57:0/2215310246 shutdown_connections 2026-02-20T16:29:42.021 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.016+0000 7fc5e0beb640 1 --2- 10.20.193.57:0/2215310246 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fc5dc12d100 0x7fc5dc093470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.021 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.016+0000 7fc5e0beb640 1 --2- 10.20.193.57:0/2215310246 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fc5dc12c7e0 0x7fc5dc12cbc0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.021 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.016+0000 7fc5e0beb640 1 -- 10.20.193.57:0/2215310246 >> 10.20.193.57:0/2215310246 conn(0x7fc5dc09a280 msgr2=0x7fc5dc097a10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:42.021 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.016+0000 7fc5e0beb640 1 -- 10.20.193.57:0/2215310246 shutdown_connections 2026-02-20T16:29:42.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.017+0000 7fc5e0beb640 1 -- 10.20.193.57:0/2215310246 wait complete. 2026-02-20T16:29:42.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.017+0000 7fc5e0beb640 1 Processor -- start 2026-02-20T16:29:42.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.017+0000 7fc5e0beb640 1 -- start start 2026-02-20T16:29:42.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.017+0000 7fc5e0beb640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fc5dc0939b0 0x7fc5dc1265d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:42.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.017+0000 7fc5e0beb640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fc5dc12c7e0 0x7fc5dc126b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:42.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.017+0000 7fc5e0beb640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fc5dc12d100 0x7fc5dc06dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:42.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.017+0000 7fc5e0beb640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7fc5dc1358a0 con 0x7fc5dc12c7e0 2026-02-20T16:29:42.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.017+0000 7fc5e0beb640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7fc5dc135720 con 0x7fc5dc12d100 2026-02-20T16:29:42.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.017+0000 7fc5e0beb640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7fc5dc135a20 con 0x7fc5dc0939b0 2026-02-20T16:29:42.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.017+0000 7fc5da575640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fc5dc0939b0 0x7fc5dc1265d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:42.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.017+0000 7fc5d9d74640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fc5dc12c7e0 0x7fc5dc126b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:42.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.017+0000 7fc5dad76640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fc5dc12d100 0x7fc5dc06dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:42.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.017+0000 7fc5da575640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fc5dc0939b0 0x7fc5dc1265d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3302/0 says I am v2:10.20.193.57:47352/0 (socket says 10.20.193.57:47352) 2026-02-20T16:29:42.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.017+0000 7fc5d9d74640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fc5dc12c7e0 0x7fc5dc126b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:38710/0 (socket says 10.20.193.57:38710) 2026-02-20T16:29:42.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.017+0000 7fc5da575640 1 -- 10.20.193.57:0/3987251114 learned_addr learned my addr 10.20.193.57:0/3987251114 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:29:42.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.017+0000 7fc5dad76640 1 -- 10.20.193.57:0/3987251114 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fc5dc0939b0 msgr2=0x7fc5dc1265d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.017+0000 7fc5dad76640 1 --2- 10.20.193.57:0/3987251114 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fc5dc0939b0 0x7fc5dc1265d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.017+0000 7fc5dad76640 1 -- 10.20.193.57:0/3987251114 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fc5dc12c7e0 msgr2=0x7fc5dc126b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.017+0000 7fc5dad76640 1 --2- 10.20.193.57:0/3987251114 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fc5dc12c7e0 0x7fc5dc126b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.017+0000 7fc5dad76640 1 -- 10.20.193.57:0/3987251114 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5dc091c40 con 0x7fc5dc12d100 2026-02-20T16:29:42.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.017+0000 7fc5d9d74640 1 --2- 10.20.193.57:0/3987251114 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fc5dc12c7e0 0x7fc5dc126b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:29:42.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.018+0000 7fc5dad76640 1 --2- 10.20.193.57:0/3987251114 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fc5dc12d100 0x7fc5dc06dd70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc00cb10 tx=0x7fc5cc00a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:29:42.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.018+0000 7fc5c2ffd640 1 -- 10.20.193.57:0/3987251114 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5cc00a8a0 con 0x7fc5dc12d100 2026-02-20T16:29:42.024 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.018+0000 7fc5c2ffd640 1 -- 10.20.193.57:0/3987251114 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc5cc00aa40 con 0x7fc5dc12d100 2026-02-20T16:29:42.024 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.018+0000 7fc5c2ffd640 1 -- 10.20.193.57:0/3987251114 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5cc005070 con 0x7fc5dc12d100 2026-02-20T16:29:42.024 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.018+0000 7fc5e0beb640 1 -- 10.20.193.57:0/3987251114 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5dc091f00 con 0x7fc5dc12d100 2026-02-20T16:29:42.024 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.018+0000 7fc5e0beb640 1 -- 10.20.193.57:0/3987251114 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5dc135160 con 0x7fc5dc12d100 2026-02-20T16:29:42.024 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.018+0000 7fc5e0beb640 1 -- 10.20.193.57:0/3987251114 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5dc12cbc0 con 0x7fc5dc12d100 2026-02-20T16:29:42.024 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.018+0000 7fc5c2ffd640 1 -- 10.20.193.57:0/3987251114 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 5) ==== 62057+0+0 (secure 0 0 0) 0x7fc5cc005210 con 0x7fc5dc12d100 2026-02-20T16:29:42.024 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.019+0000 7fc5c2ffd640 1 -- 10.20.193.57:0/3987251114 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 2861+0+0 (secure 0 0 0) 0x7fc5cc066d70 con 0x7fc5dc12d100 2026-02-20T16:29:42.024 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.020+0000 7fc5c2ffd640 1 -- 10.20.193.57:0/3987251114 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7fc5cc040b70 con 0x7fc5dc12d100 2026-02-20T16:29:42.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.103+0000 7fc5e0beb640 1 -- 10.20.193.57:0/3987251114 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fc5dc050a10 con 0x7fc5dc12d100 2026-02-20T16:29:42.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.104+0000 7fc5c2ffd640 1 -- 10.20.193.57:0/3987251114 <== mon.1 v2:10.20.193.57:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+121453 (secure 0 0 0) 0x7fc5cc065e30 con 0x7fc5dc12d100 2026-02-20T16:29:42.107 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:29:42.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.105+0000 7fc5e0beb640 1 -- 10.20.193.57:0/3987251114 >> v1:10.20.193.57:6800/4138285113 conn(0x7fc5a804f790 legacy=0x7fc5a8051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.105+0000 7fc5e0beb640 1 -- 10.20.193.57:0/3987251114 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fc5dc12d100 msgr2=0x7fc5dc06dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.105+0000 7fc5e0beb640 1 --2- 10.20.193.57:0/3987251114 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fc5dc12d100 0x7fc5dc06dd70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc00cb10 tx=0x7fc5cc00a060 comp rx=0 tx=0).stop 2026-02-20T16:29:42.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.105+0000 7fc5e0beb640 1 -- 10.20.193.57:0/3987251114 shutdown_connections 2026-02-20T16:29:42.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.105+0000 7fc5e0beb640 1 --2- 10.20.193.57:0/3987251114 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fc5dc12d100 0x7fc5dc06dd70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.105+0000 7fc5e0beb640 1 --2- 10.20.193.57:0/3987251114 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fc5dc12c7e0 0x7fc5dc126b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.105+0000 7fc5e0beb640 1 --2- 10.20.193.57:0/3987251114 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fc5dc0939b0 0x7fc5dc1265d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.105+0000 7fc5e0beb640 1 -- 10.20.193.57:0/3987251114 >> 10.20.193.57:0/3987251114 conn(0x7fc5dc09a280 msgr2=0x7fc5dc129340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:42.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.105+0000 7fc5e0beb640 1 -- 10.20.193.57:0/3987251114 shutdown_connections 2026-02-20T16:29:42.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.105+0000 7fc5e0beb640 1 -- 10.20.193.57:0/3987251114 wait complete. 2026-02-20T16:29:42.114 INFO:teuthology.orchestra.run.trial057.stdout:{"epoch":5,"flags":0,"active_gid":4162,"active_name":"y","active_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6800","nonce":4138285113}]},"active_addr":"10.20.193.57:6800/4138285113","active_change":"2026-02-20T16:29:24.015078+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4157,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.57:0","nonce":3729051198}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.57:0","nonce":1295824105}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.57:0","nonce":2316661359}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.57:0","nonce":4240799477}]}]} 2026-02-20T16:29:42.170 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-20T16:29:42.170 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-20T16:29:42.170 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-20T16:29:42.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.237+0000 7f37cc19e640 1 -- 10.20.193.57:0/27018779 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f37c4094050 msgr2=0x7f37c4094580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.237+0000 7f37cc19e640 1 --2- 10.20.193.57:0/27018779 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f37c4094050 0x7f37c4094580 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f37b4009a30 tx=0x7f37b402f220 comp rx=0 tx=0).stop 2026-02-20T16:29:42.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.237+0000 7f37cc19e640 1 -- 10.20.193.57:0/27018779 shutdown_connections 2026-02-20T16:29:42.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.237+0000 7f37cc19e640 1 --2- 10.20.193.57:0/27018779 >> v2:10.20.193.57:3300/0 conn(0x7f37c40968a0 0x7f37c4095000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.237+0000 7f37cc19e640 1 --2- 10.20.193.57:0/27018779 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f37c40630c0 0x7f37c4094ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.242 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.237+0000 7f37cc19e640 1 --2- 10.20.193.57:0/27018779 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f37c4094050 0x7f37c4094580 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.242 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.237+0000 7f37cc19e640 1 -- 10.20.193.57:0/27018779 >> 10.20.193.57:0/27018779 conn(0x7f37c409a280 msgr2=0x7f37c4097a10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:42.242 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.237+0000 7f37cc19e640 1 -- 10.20.193.57:0/27018779 shutdown_connections 2026-02-20T16:29:42.242 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.237+0000 7f37cc19e640 1 -- 10.20.193.57:0/27018779 wait complete. 2026-02-20T16:29:42.242 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.238+0000 7f37cc19e640 1 Processor -- start 2026-02-20T16:29:42.242 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.238+0000 7f37cc19e640 1 -- start start 2026-02-20T16:29:42.242 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.238+0000 7f37cc19e640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f37c40630c0 0x7f37c41c6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:42.242 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.238+0000 7f37cc19e640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f37c4094050 0x7f37c41c6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:42.242 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.238+0000 7f37cc19e640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f37c40968a0 0x7f37c41c72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:42.242 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.238+0000 7f37cc19e640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f37c4133410 con 0x7f37c40630c0 2026-02-20T16:29:42.242 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.238+0000 7f37cc19e640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f37c4133290 con 0x7f37c4094050 2026-02-20T16:29:42.242 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.238+0000 7f37cc19e640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f37c4133590 con 0x7f37c40968a0 2026-02-20T16:29:42.242 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.238+0000 7f37c9f13640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f37c40630c0 0x7f37c41c6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:42.242 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.238+0000 7f37c9712640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f37c4094050 0x7f37c41c6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:42.242 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.238+0000 7f37ca714640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f37c40968a0 0x7f37c41c72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:42.242 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.238+0000 7f37c9f13640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f37c40630c0 0x7f37c41c6850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:38728/0 (socket says 10.20.193.57:38728) 2026-02-20T16:29:42.242 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.238+0000 7f37c9f13640 1 -- 10.20.193.57:0/882966898 learned_addr learned my addr 10.20.193.57:0/882966898 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:29:42.242 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.238+0000 7f37c9712640 1 -- 10.20.193.57:0/882966898 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f37c40968a0 msgr2=0x7f37c41c72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.242 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.238+0000 7f37c9712640 1 --2- 10.20.193.57:0/882966898 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f37c40968a0 0x7f37c41c72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.242 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.238+0000 7f37c9712640 1 -- 10.20.193.57:0/882966898 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f37c40630c0 msgr2=0x7f37c41c6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.242 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.238+0000 7f37c9712640 1 --2- 10.20.193.57:0/882966898 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f37c40630c0 0x7f37c41c6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.238+0000 7f37c9712640 1 -- 10.20.193.57:0/882966898 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37c4124030 con 0x7f37c4094050 2026-02-20T16:29:42.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.239+0000 7f37c9712640 1 --2- 10.20.193.57:0/882966898 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f37c4094050 0x7f37c41c6d90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f37b8002710 tx=0x7f37b8002be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:29:42.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.239+0000 7f37b27fc640 1 -- 10.20.193.57:0/882966898 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b800ed40 con 0x7f37c4094050 2026-02-20T16:29:42.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.239+0000 7f37b27fc640 1 -- 10.20.193.57:0/882966898 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f37b8010430 con 0x7f37c4094050 2026-02-20T16:29:42.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.239+0000 7f37cc19e640 1 -- 10.20.193.57:0/882966898 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37c4073230 con 0x7f37c4094050 2026-02-20T16:29:42.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.239+0000 7f37b27fc640 1 -- 10.20.193.57:0/882966898 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b8010860 con 0x7f37c4094050 2026-02-20T16:29:42.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.239+0000 7f37cc19e640 1 -- 10.20.193.57:0/882966898 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f37c4090e70 con 0x7f37c4094050 2026-02-20T16:29:42.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.239+0000 7f37cc19e640 1 -- 10.20.193.57:0/882966898 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37c4094580 con 0x7f37c4094050 2026-02-20T16:29:42.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.239+0000 7f37b27fc640 1 -- 10.20.193.57:0/882966898 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 5) ==== 62057+0+0 (secure 0 0 0) 0x7f37b8020030 con 0x7f37c4094050 2026-02-20T16:29:42.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.240+0000 7f37b27fc640 1 -- 10.20.193.57:0/882966898 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 2861+0+0 (secure 0 0 0) 0x7f37b8067320 con 0x7f37c4094050 2026-02-20T16:29:42.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.242+0000 7f37b27fc640 1 -- 10.20.193.57:0/882966898 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f37b8014030 con 0x7f37c4094050 2026-02-20T16:29:42.312 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.311+0000 7f37cc19e640 1 -- 10.20.193.57:0/882966898 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f37c4050a10 con 0x7f37c4094050 2026-02-20T16:29:42.312 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.311+0000 7f37b27fc640 1 -- 10.20.193.57:0/882966898 <== mon.1 v2:10.20.193.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+8904 (secure 0 0 0) 0x7f37b8041160 con 0x7f37c4094050 2026-02-20T16:29:42.312 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:29:42.313 INFO:teuthology.orchestra.run.trial057.stdout:{"epoch":17,"fsid":"3b3c5c1a-0a2b-40b9-ac1d-921ada466f9e","created":"2026-02-20T16:29:22.501479+0000","modified":"2026-02-20T16:29:41.743449+0000","last_up_change":"2026-02-20T16:29:33.726177+0000","last_in_change":"2026-02-20T16:29:24.294147+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T16:29:34.029059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-20T16:29:38.191724+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a3139827-dc3c-46f9-b211-d376e3dc92f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6801","nonce":385793132}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6802","nonce":385793132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6804","nonce":385793132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6803","nonce":385793132}]},"public_addr":"10.20.193.57:6801/385793132","cluster_addr":"10.20.193.57:6802/385793132","heartbeat_back_addr":"10.20.193.57:6804/385793132","heartbeat_front_addr":"10.20.193.57:6803/385793132","state":["exists","up"]},{"osd":1,"uuid":"00e7cb17-534c-4ac2-8486-585b3b8db0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6805","nonce":3441840004}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6806","nonce":3441840004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6808","nonce":3441840004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6807","nonce":3441840004}]},"public_addr":"10.20.193.57:6805/3441840004","cluster_addr":"10.20.193.57:6806/3441840004","heartbeat_back_addr":"10.20.193.57:6808/3441840004","heartbeat_front_addr":"10.20.193.57:6807/3441840004","state":["exists","up"]},{"osd":2,"uuid":"d0b55b31-45df-4c58-bf11-a72d44f21a00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6809","nonce":1926844368}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6810","nonce":1926844368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6812","nonce":1926844368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6811","nonce":1926844368}]},"public_addr":"10.20.193.57:6809/1926844368","cluster_addr":"10.20.193.57:6810/1926844368","heartbeat_back_addr":"10.20.193.57:6812/1926844368","heartbeat_front_addr":"10.20.193.57:6811/1926844368","state":["exists","up"]},{"osd":3,"uuid":"b3bfbbd8-cfaf-4360-9a5b-c52e89ac3f75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6813","nonce":3124429028}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6814","nonce":3124429028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6816","nonce":3124429028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6815","nonce":3124429028}]},"public_addr":"10.20.193.57:6813/3124429028","cluster_addr":"10.20.193.57:6814/3124429028","heartbeat_back_addr":"10.20.193.57:6816/3124429028","heartbeat_front_addr":"10.20.193.57:6815/3124429028","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T16:29:31.711310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T16:29:31.724521+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T16:29:31.770683+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T16:29:31.821531+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T16:29:42.313 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.312+0000 7f37cc19e640 1 -- 10.20.193.57:0/882966898 >> v1:10.20.193.57:6800/4138285113 conn(0x7f379404f790 legacy=0x7f3794051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.313 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.312+0000 7f37cc19e640 1 -- 10.20.193.57:0/882966898 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f37c4094050 msgr2=0x7f37c41c6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.313 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.312+0000 7f37cc19e640 1 --2- 10.20.193.57:0/882966898 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f37c4094050 0x7f37c41c6d90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f37b8002710 tx=0x7f37b8002be0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.314 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.312+0000 7f37cc19e640 1 -- 10.20.193.57:0/882966898 shutdown_connections 2026-02-20T16:29:42.314 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.312+0000 7f37cc19e640 1 --2- 10.20.193.57:0/882966898 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f37c40968a0 0x7f37c41c72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.314 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.312+0000 7f37cc19e640 1 --2- 10.20.193.57:0/882966898 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f37c4094050 0x7f37c41c6d90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.314 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.312+0000 7f37cc19e640 1 --2- 10.20.193.57:0/882966898 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f37c40630c0 0x7f37c41c6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.314 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.312+0000 7f37cc19e640 1 -- 10.20.193.57:0/882966898 >> 10.20.193.57:0/882966898 conn(0x7f37c409a280 msgr2=0x7f37c409af10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:42.314 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.312+0000 7f37cc19e640 1 -- 10.20.193.57:0/882966898 shutdown_connections 2026-02-20T16:29:42.314 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.312+0000 7f37cc19e640 1 -- 10.20.193.57:0/882966898 wait complete. 2026-02-20T16:29:42.321 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-20T16:29:42.321 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-20T16:29:42.392 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.388+0000 7fca4e62f640 1 -- 10.20.193.57:0/779263177 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fca48094ea0 msgr2=0x7fca481368f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.392 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.388+0000 7fca4e62f640 1 --2- 10.20.193.57:0/779263177 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fca48094ea0 0x7fca481368f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fca48095e10 tx=0x7fca3c02f310 comp rx=0 tx=0).stop 2026-02-20T16:29:42.392 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.388+0000 7fca4e62f640 1 -- 10.20.193.57:0/779263177 shutdown_connections 2026-02-20T16:29:42.393 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.388+0000 7fca4e62f640 1 --2- 10.20.193.57:0/779263177 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fca48094ea0 0x7fca481368f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.393 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.388+0000 7fca4e62f640 1 --2- 10.20.193.57:0/779263177 >> v2:10.20.193.57:3300/0 conn(0x7fca48094580 0x7fca48094960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.393 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.388+0000 7fca4e62f640 1 -- 10.20.193.57:0/779263177 >> 10.20.193.57:0/779263177 conn(0x7fca4809a280 msgr2=0x7fca48097a10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:42.393 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.388+0000 7fca4e62f640 1 -- 10.20.193.57:0/779263177 shutdown_connections 2026-02-20T16:29:42.393 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.388+0000 7fca4e62f640 1 -- 10.20.193.57:0/779263177 wait complete. 2026-02-20T16:29:42.393 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.389+0000 7fca4e62f640 1 Processor -- start 2026-02-20T16:29:42.393 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.389+0000 7fca4e62f640 1 -- start start 2026-02-20T16:29:42.393 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.389+0000 7fca4e62f640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fca48094580 0x7fca481242c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:42.393 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.389+0000 7fca4e62f640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fca48094ea0 0x7fca48124800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:42.393 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.389+0000 7fca4e62f640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fca480964a0 0x7fca48124d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:42.393 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.389+0000 7fca4e62f640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7fca481379a0 con 0x7fca48094580 2026-02-20T16:29:42.394 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.389+0000 7fca4e62f640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7fca48137820 con 0x7fca480964a0 2026-02-20T16:29:42.394 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.389+0000 7fca4e62f640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7fca48137b20 con 0x7fca48094ea0 2026-02-20T16:29:42.394 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.389+0000 7fca47fff640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fca48094580 0x7fca481242c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:42.394 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.389+0000 7fca4cba5640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fca480964a0 0x7fca48124d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:42.394 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.389+0000 7fca47fff640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fca48094580 0x7fca481242c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:38750/0 (socket says 10.20.193.57:38750) 2026-02-20T16:29:42.394 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.389+0000 7fca47fff640 1 -- 10.20.193.57:0/2928059732 learned_addr learned my addr 10.20.193.57:0/2928059732 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:29:42.394 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.389+0000 7fca477fe640 1 --2- 10.20.193.57:0/2928059732 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fca48094ea0 0x7fca48124800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:42.394 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.389+0000 7fca47fff640 1 -- 10.20.193.57:0/2928059732 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fca48094ea0 msgr2=0x7fca48124800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.394 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.389+0000 7fca47fff640 1 --2- 10.20.193.57:0/2928059732 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fca48094ea0 0x7fca48124800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.394 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.389+0000 7fca47fff640 1 -- 10.20.193.57:0/2928059732 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fca480964a0 msgr2=0x7fca48124d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.394 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.389+0000 7fca47fff640 1 --2- 10.20.193.57:0/2928059732 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fca480964a0 0x7fca48124d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.395 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.389+0000 7fca47fff640 1 -- 10.20.193.57:0/2928059732 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca48125e30 con 0x7fca48094580 2026-02-20T16:29:42.395 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.389+0000 7fca4cba5640 1 --2- 10.20.193.57:0/2928059732 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fca480964a0 0x7fca48124d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:29:42.395 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.389+0000 7fca47fff640 1 --2- 10.20.193.57:0/2928059732 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fca48094580 0x7fca481242c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fca3400ea10 tx=0x7fca3400eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:29:42.395 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.389+0000 7fca44ff9640 1 -- 10.20.193.57:0/2928059732 <== mon.0 v2:10.20.193.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca3400ce50 con 0x7fca48094580 2026-02-20T16:29:42.395 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.389+0000 7fca44ff9640 1 -- 10.20.193.57:0/2928059732 <== mon.0 v2:10.20.193.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca340040d0 con 0x7fca48094580 2026-02-20T16:29:42.395 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.389+0000 7fca4e62f640 1 -- 10.20.193.57:0/2928059732 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca48126520 con 0x7fca48094580 2026-02-20T16:29:42.395 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.389+0000 7fca44ff9640 1 -- 10.20.193.57:0/2928059732 <== mon.0 v2:10.20.193.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca340044e0 con 0x7fca48094580 2026-02-20T16:29:42.395 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.389+0000 7fca4e62f640 1 -- 10.20.193.57:0/2928059732 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca48127180 con 0x7fca48094580 2026-02-20T16:29:42.395 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.390+0000 7fca4e62f640 1 -- 10.20.193.57:0/2928059732 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca48094960 con 0x7fca48094580 2026-02-20T16:29:42.395 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.390+0000 7fca44ff9640 1 -- 10.20.193.57:0/2928059732 <== mon.0 v2:10.20.193.57:3300/0 4 ==== mgrmap(e 5) ==== 62057+0+0 (secure 0 0 0) 0x7fca34020030 con 0x7fca48094580 2026-02-20T16:29:42.395 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.390+0000 7fca44ff9640 1 -- 10.20.193.57:0/2928059732 <== mon.0 v2:10.20.193.57:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2861+0+0 (secure 0 0 0) 0x7fca34067360 con 0x7fca48094580 2026-02-20T16:29:42.396 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.392+0000 7fca44ff9640 1 -- 10.20.193.57:0/2928059732 <== mon.0 v2:10.20.193.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7fca34041160 con 0x7fca48094580 2026-02-20T16:29:42.464 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.462+0000 7fca4e62f640 1 -- 10.20.193.57:0/2928059732 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fca48136900 con 0x7fca48094580 2026-02-20T16:29:42.464 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.463+0000 7fca44ff9640 1 -- 10.20.193.57:0/2928059732 <== mon.0 v2:10.20.193.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+8904 (secure 0 0 0) 0x7fca34066420 con 0x7fca48094580 2026-02-20T16:29:42.465 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:29:42.465 INFO:teuthology.orchestra.run.trial057.stdout:{"epoch":17,"fsid":"3b3c5c1a-0a2b-40b9-ac1d-921ada466f9e","created":"2026-02-20T16:29:22.501479+0000","modified":"2026-02-20T16:29:41.743449+0000","last_up_change":"2026-02-20T16:29:33.726177+0000","last_in_change":"2026-02-20T16:29:24.294147+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T16:29:34.029059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-20T16:29:38.191724+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a3139827-dc3c-46f9-b211-d376e3dc92f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6801","nonce":385793132}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6802","nonce":385793132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6804","nonce":385793132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6803","nonce":385793132}]},"public_addr":"10.20.193.57:6801/385793132","cluster_addr":"10.20.193.57:6802/385793132","heartbeat_back_addr":"10.20.193.57:6804/385793132","heartbeat_front_addr":"10.20.193.57:6803/385793132","state":["exists","up"]},{"osd":1,"uuid":"00e7cb17-534c-4ac2-8486-585b3b8db0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6805","nonce":3441840004}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6806","nonce":3441840004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6808","nonce":3441840004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6807","nonce":3441840004}]},"public_addr":"10.20.193.57:6805/3441840004","cluster_addr":"10.20.193.57:6806/3441840004","heartbeat_back_addr":"10.20.193.57:6808/3441840004","heartbeat_front_addr":"10.20.193.57:6807/3441840004","state":["exists","up"]},{"osd":2,"uuid":"d0b55b31-45df-4c58-bf11-a72d44f21a00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6809","nonce":1926844368}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6810","nonce":1926844368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6812","nonce":1926844368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6811","nonce":1926844368}]},"public_addr":"10.20.193.57:6809/1926844368","cluster_addr":"10.20.193.57:6810/1926844368","heartbeat_back_addr":"10.20.193.57:6812/1926844368","heartbeat_front_addr":"10.20.193.57:6811/1926844368","state":["exists","up"]},{"osd":3,"uuid":"b3bfbbd8-cfaf-4360-9a5b-c52e89ac3f75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6813","nonce":3124429028}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6814","nonce":3124429028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6816","nonce":3124429028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6815","nonce":3124429028}]},"public_addr":"10.20.193.57:6813/3124429028","cluster_addr":"10.20.193.57:6814/3124429028","heartbeat_back_addr":"10.20.193.57:6816/3124429028","heartbeat_front_addr":"10.20.193.57:6815/3124429028","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T16:29:31.711310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T16:29:31.724521+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T16:29:31.770683+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T16:29:31.821531+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T16:29:42.466 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.463+0000 7fca4e62f640 1 -- 10.20.193.57:0/2928059732 >> v1:10.20.193.57:6800/4138285113 conn(0x7fca1804f930 legacy=0x7fca18051df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.466 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.463+0000 7fca4e62f640 1 -- 10.20.193.57:0/2928059732 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fca48094580 msgr2=0x7fca481242c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.466 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.463+0000 7fca4e62f640 1 --2- 10.20.193.57:0/2928059732 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fca48094580 0x7fca481242c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fca3400ea10 tx=0x7fca3400eee0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.466 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.464+0000 7fca4e62f640 1 -- 10.20.193.57:0/2928059732 shutdown_connections 2026-02-20T16:29:42.466 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.464+0000 7fca4e62f640 1 --2- 10.20.193.57:0/2928059732 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fca480964a0 0x7fca48124d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.466 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.464+0000 7fca4e62f640 1 --2- 10.20.193.57:0/2928059732 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fca48094ea0 0x7fca48124800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.467 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.464+0000 7fca4e62f640 1 --2- 10.20.193.57:0/2928059732 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fca48094580 0x7fca481242c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.467 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.464+0000 7fca4e62f640 1 -- 10.20.193.57:0/2928059732 >> 10.20.193.57:0/2928059732 conn(0x7fca4809a280 msgr2=0x7fca4809b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:42.467 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.464+0000 7fca4e62f640 1 -- 10.20.193.57:0/2928059732 shutdown_connections 2026-02-20T16:29:42.467 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.464+0000 7fca4e62f640 1 -- 10.20.193.57:0/2928059732 wait complete. 2026-02-20T16:29:42.474 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-20T16:29:42.474 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-20T16:29:42.475 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-20T16:29:42.475 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-20T16:29:42.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.544+0000 7f9876444640 1 -- 10.20.193.57:0/2035916273 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f9870096d60 msgr2=0x7f98700971d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.544+0000 7f9876444640 1 --2- 10.20.193.57:0/2035916273 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f9870096d60 0x7f98700971d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9864009f60 tx=0x7f986402f330 comp rx=0 tx=0).stop 2026-02-20T16:29:42.547 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.544+0000 7f74387ac640 1 -- 10.20.193.57:0/4078272032 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f7430095590 msgr2=0x7f74301304f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.547 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.544+0000 7f74387ac640 1 --2- 10.20.193.57:0/4078272032 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f7430095590 0x7f74301304f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7424009960 tx=0x7f742402f140 comp rx=0 tx=0).stop 2026-02-20T16:29:42.547 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.544+0000 7f9876444640 1 -- 10.20.193.57:0/2035916273 shutdown_connections 2026-02-20T16:29:42.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.544+0000 7f9876444640 1 --2- 10.20.193.57:0/2035916273 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f9870096d60 0x7f98700971d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.544+0000 7f9876444640 1 --2- 10.20.193.57:0/2035916273 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f987012d640 0x7f9870096820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.544+0000 7f9876444640 1 --2- 10.20.193.57:0/2035916273 >> v2:10.20.193.57:3300/0 conn(0x7f987012cd20 0x7f987012d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.544+0000 7f9876444640 1 -- 10.20.193.57:0/2035916273 >> 10.20.193.57:0/2035916273 conn(0x7f987006ce10 msgr2=0x7f987006d220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:42.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.544+0000 7f6fae4d3640 1 -- 10.20.193.57:0/3826644192 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f6fa8094ea0 msgr2=0x7f6fa81331c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.544+0000 7f6fae4d3640 1 --2- 10.20.193.57:0/3826644192 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f6fa8094ea0 0x7f6fa81331c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6f98009a30 tx=0x7f6f9802f2b0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.549 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.544+0000 7f74387ac640 1 -- 10.20.193.57:0/4078272032 shutdown_connections 2026-02-20T16:29:42.549 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.544+0000 7f74387ac640 1 --2- 10.20.193.57:0/4078272032 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f7430130a30 0x7f7430132e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.549 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.544+0000 7f74387ac640 1 --2- 10.20.193.57:0/4078272032 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f7430095590 0x7f74301304f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.549 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.544+0000 7f74387ac640 1 -- 10.20.193.57:0/4078272032 >> 10.20.193.57:0/4078272032 conn(0x7f743009a170 msgr2=0x7f7430097a10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:42.550 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.544+0000 7f9876444640 1 -- 10.20.193.57:0/2035916273 shutdown_connections 2026-02-20T16:29:42.550 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.544+0000 7f9876444640 1 -- 10.20.193.57:0/2035916273 wait complete. 2026-02-20T16:29:42.550 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.544+0000 7f6fae4d3640 1 -- 10.20.193.57:0/3826644192 shutdown_connections 2026-02-20T16:29:42.550 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.544+0000 7f6fae4d3640 1 --2- 10.20.193.57:0/3826644192 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f6fa8133700 0x7f6fa8135af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.550 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.544+0000 7f6fae4d3640 1 --2- 10.20.193.57:0/3826644192 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f6fa8094ea0 0x7f6fa81331c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.550 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.544+0000 7f6fae4d3640 1 --2- 10.20.193.57:0/3826644192 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f6fa8094580 0x7f6fa8094960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.551 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.544+0000 7f74387ac640 1 -- 10.20.193.57:0/4078272032 shutdown_connections 2026-02-20T16:29:42.551 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.544+0000 7f6fae4d3640 1 -- 10.20.193.57:0/3826644192 >> 10.20.193.57:0/3826644192 conn(0x7f6fa809a170 msgr2=0x7f6fa8097a10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:42.551 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.544+0000 7f74387ac640 1 -- 10.20.193.57:0/4078272032 wait complete. 2026-02-20T16:29:42.552 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.544+0000 7f6fae4d3640 1 -- 10.20.193.57:0/3826644192 shutdown_connections 2026-02-20T16:29:42.552 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.544+0000 7f6fae4d3640 1 -- 10.20.193.57:0/3826644192 wait complete. 2026-02-20T16:29:42.553 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.544+0000 7faa0fd56640 1 -- 10.20.193.57:0/803062868 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7faa0806edf0 msgr2=0x7faa08133ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.553 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.544+0000 7faa0fd56640 1 --2- 10.20.193.57:0/803062868 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7faa0806edf0 0x7faa08133ef0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc009930 tx=0x7fa9fc02f110 comp rx=0 tx=0).stop 2026-02-20T16:29:42.553 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.544+0000 7faa0fd56640 1 -- 10.20.193.57:0/803062868 shutdown_connections 2026-02-20T16:29:42.553 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.544+0000 7faa0fd56640 1 --2- 10.20.193.57:0/803062868 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7faa08134430 0x7faa08136820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.553 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.544+0000 7faa0fd56640 1 --2- 10.20.193.57:0/803062868 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7faa0806edf0 0x7faa08133ef0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.553 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.544+0000 7faa0fd56640 1 -- 10.20.193.57:0/803062868 >> 10.20.193.57:0/803062868 conn(0x7faa0809f500 msgr2=0x7faa0809f910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:42.553 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.544+0000 7faa0fd56640 1 -- 10.20.193.57:0/803062868 shutdown_connections 2026-02-20T16:29:42.554 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.544+0000 7faa0fd56640 1 -- 10.20.193.57:0/803062868 wait complete. 2026-02-20T16:29:42.554 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7f9876444640 1 Processor -- start 2026-02-20T16:29:42.554 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7f6fae4d3640 1 Processor -- start 2026-02-20T16:29:42.554 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7f9876444640 1 -- start start 2026-02-20T16:29:42.555 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7f6fae4d3640 1 -- start start 2026-02-20T16:29:42.555 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7faa0fd56640 1 Processor -- start 2026-02-20T16:29:42.555 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7f74387ac640 1 Processor -- start 2026-02-20T16:29:42.556 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7faa0fd56640 1 -- start start 2026-02-20T16:29:42.556 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7f74387ac640 1 -- start start 2026-02-20T16:29:42.557 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7f9876444640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f9870096d60 0x7f987006ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:42.557 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7f9876444640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f987012cd20 0x7f987006f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:42.557 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7f9876444640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f987012d640 0x7f987006f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:42.557 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7f9876444640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f98701344e0 con 0x7f987012cd20 2026-02-20T16:29:42.557 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7f6fae4d3640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f6fa8094580 0x7f6fa8132100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:42.558 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7f9876444640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f9870134360 con 0x7f987012d640 2026-02-20T16:29:42.558 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7f9876444640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f9870134660 con 0x7f9870096d60 2026-02-20T16:29:42.558 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7f6fae4d3640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f6fa8094ea0 0x7f6fa8132640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:42.559 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7f6fae4d3640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f6fa8133700 0x7f6fa8122180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:42.559 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7f6fae4d3640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa8136830 con 0x7f6fa8133700 2026-02-20T16:29:42.559 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7f6fae4d3640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f6fa81366b0 con 0x7f6fa8094ea0 2026-02-20T16:29:42.559 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7f6fae4d3640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f6fa81369b0 con 0x7f6fa8094580 2026-02-20T16:29:42.559 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7f986f7fe640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f987012cd20 0x7f987006f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:42.559 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7f98749ba640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f987012d640 0x7f987006f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:42.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7f6fa77fe640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f6fa8094ea0 0x7f6fa8132640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:42.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7f6faca49640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f6fa8133700 0x7f6fa8122180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:42.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7f98749ba640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f987012d640 0x7f987006f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3301/0 says I am v2:10.20.193.57:44786/0 (socket says 10.20.193.57:44786) 2026-02-20T16:29:42.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7f986f7fe640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f987012cd20 0x7f987006f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:38776/0 (socket says 10.20.193.57:38776) 2026-02-20T16:29:42.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7f6fa7fff640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f6fa8094580 0x7f6fa8132100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:42.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7f6fa77fe640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f6fa8094ea0 0x7f6fa8132640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3301/0 says I am v2:10.20.193.57:44792/0 (socket says 10.20.193.57:44792) 2026-02-20T16:29:42.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7f98749ba640 1 -- 10.20.193.57:0/3520410881 learned_addr learned my addr 10.20.193.57:0/3520410881 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:29:42.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7f986ffff640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f9870096d60 0x7f987006ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:42.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7f6fa77fe640 1 -- 10.20.193.57:0/3290433367 learned_addr learned my addr 10.20.193.57:0/3290433367 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:29:42.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7f6faca49640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f6fa8133700 0x7f6fa8122180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:38784/0 (socket says 10.20.193.57:38784) 2026-02-20T16:29:42.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7faa0fd56640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7faa0806e300 0x7faa0809ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:42.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7faa0fd56640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7faa0806edf0 0x7faa0809b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:42.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7faa0fd56640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7faa08134430 0x7faa0812cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:42.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7faa0fd56640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7faa08137a10 con 0x7faa08134430 2026-02-20T16:29:42.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7faa0fd56640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7faa08137890 con 0x7faa0806e300 2026-02-20T16:29:42.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7faa0fd56640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7faa08137b90 con 0x7faa0806edf0 2026-02-20T16:29:42.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7f98749ba640 1 -- 10.20.193.57:0/3520410881 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f9870096d60 msgr2=0x7f987006ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7f98749ba640 1 --2- 10.20.193.57:0/3520410881 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f9870096d60 0x7f987006ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7f98749ba640 1 -- 10.20.193.57:0/3520410881 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f987012cd20 msgr2=0x7f987006f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7faa0dacb640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7faa0806e300 0x7faa0809ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:42.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7f98749ba640 1 --2- 10.20.193.57:0/3520410881 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f987012cd20 0x7f987006f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7f98749ba640 1 -- 10.20.193.57:0/3520410881 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9870072450 con 0x7f987012d640 2026-02-20T16:29:42.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7faa0dacb640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7faa0806e300 0x7faa0809ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3301/0 says I am v2:10.20.193.57:44806/0 (socket says 10.20.193.57:44806) 2026-02-20T16:29:42.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7faa0dacb640 1 -- 10.20.193.57:0/778252628 learned_addr learned my addr 10.20.193.57:0/778252628 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:29:42.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7f74387ac640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f7430095590 0x7f7430134370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:42.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7faa0e2cc640 1 --2- 10.20.193.57:0/778252628 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7faa08134430 0x7faa0812cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:42.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7f74387ac640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f743012b4b0 0x7f74301348b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:42.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7f98749ba640 1 --2- 10.20.193.57:0/3520410881 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f987012d640 0x7f987006f980 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f986402f840 tx=0x7f9864009740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:29:42.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7f6fa77fe640 1 -- 10.20.193.57:0/3290433367 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f6fa8094580 msgr2=0x7f6fa8132100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7f6fa77fe640 1 --2- 10.20.193.57:0/3290433367 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f6fa8094580 0x7f6fa8132100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7f6fa77fe640 1 -- 10.20.193.57:0/3290433367 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f6fa8133700 msgr2=0x7f6fa8122180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7f6fa77fe640 1 --2- 10.20.193.57:0/3290433367 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f6fa8133700 0x7f6fa8122180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7f6fa77fe640 1 -- 10.20.193.57:0/3290433367 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fa8073ef0 con 0x7f6fa8094ea0 2026-02-20T16:29:42.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7f74387ac640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f7430130a30 0x7f7430134df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:42.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7f74387ac640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f74301336f0 con 0x7f7430095590 2026-02-20T16:29:42.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7f74387ac640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f7430133570 con 0x7f7430130a30 2026-02-20T16:29:42.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7f74387ac640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f7430133870 con 0x7f743012b4b0 2026-02-20T16:29:42.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7f7436521640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f7430095590 0x7f7430134370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:42.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7f7436d22640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f7430130a30 0x7f7430134df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:42.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7f7436521640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f7430095590 0x7f7430134370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:38810/0 (socket says 10.20.193.57:38810) 2026-02-20T16:29:42.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.545+0000 7f7436521640 1 -- 10.20.193.57:0/1489301993 learned_addr learned my addr 10.20.193.57:0/1489301993 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:29:42.569 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.546+0000 7f6fa77fe640 1 --2- 10.20.193.57:0/3290433367 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f6fa8094ea0 0x7f6fa8132640 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6f98009b60 tx=0x7f6f98005b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:29:42.569 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.546+0000 7faa0dacb640 1 -- 10.20.193.57:0/778252628 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7faa0806edf0 msgr2=0x7faa0809b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.569 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.546+0000 7faa0dacb640 1 --2- 10.20.193.57:0/778252628 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7faa0806edf0 0x7faa0809b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.569 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.546+0000 7faa0dacb640 1 -- 10.20.193.57:0/778252628 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7faa08134430 msgr2=0x7faa0812cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.546+0000 7f7435d20640 1 --2- 10.20.193.57:0/1489301993 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f743012b4b0 0x7f74301348b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:42.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.546+0000 7faa0dacb640 1 --2- 10.20.193.57:0/778252628 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7faa08134430 0x7faa0812cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.546+0000 7faa0dacb640 1 -- 10.20.193.57:0/778252628 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa081307e0 con 0x7faa0806e300 2026-02-20T16:29:42.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.546+0000 7f986cff9640 1 -- 10.20.193.57:0/3520410881 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9864004460 con 0x7f987012d640 2026-02-20T16:29:42.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.546+0000 7f6fa4ff9640 1 -- 10.20.193.57:0/3290433367 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f98002b30 con 0x7f6fa8094ea0 2026-02-20T16:29:42.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.546+0000 7f6fa4ff9640 1 -- 10.20.193.57:0/3290433367 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f98002cd0 con 0x7f6fa8094ea0 2026-02-20T16:29:42.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.546+0000 7f986cff9640 1 -- 10.20.193.57:0/3520410881 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9864004710 con 0x7f987012d640 2026-02-20T16:29:42.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.546+0000 7f6fa4ff9640 1 -- 10.20.193.57:0/3290433367 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f980386d0 con 0x7f6fa8094ea0 2026-02-20T16:29:42.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.546+0000 7f7436d22640 1 -- 10.20.193.57:0/1489301993 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f743012b4b0 msgr2=0x7f74301348b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.546+0000 7f7436d22640 1 --2- 10.20.193.57:0/1489301993 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f743012b4b0 0x7f74301348b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.546+0000 7f7436d22640 1 -- 10.20.193.57:0/1489301993 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f7430095590 msgr2=0x7f7430134370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.546+0000 7f7436d22640 1 --2- 10.20.193.57:0/1489301993 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f7430095590 0x7f7430134370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.546+0000 7f9876444640 1 -- 10.20.193.57:0/3520410881 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98700718a0 con 0x7f987012d640 2026-02-20T16:29:42.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.546+0000 7f6fae4d3640 1 -- 10.20.193.57:0/3290433367 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fa8132be0 con 0x7f6fa8094ea0 2026-02-20T16:29:42.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.546+0000 7faa0dacb640 1 --2- 10.20.193.57:0/778252628 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7faa0806e300 0x7faa0809ac20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa9f800c700 tx=0x7fa9f800cbd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:29:42.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.546+0000 7f7436d22640 1 -- 10.20.193.57:0/1489301993 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f743012fd50 con 0x7f7430130a30 2026-02-20T16:29:42.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.546+0000 7f986cff9640 1 -- 10.20.193.57:0/3520410881 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9864007760 con 0x7f987012d640 2026-02-20T16:29:42.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.546+0000 7f9876444640 1 -- 10.20.193.57:0/3520410881 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9870072710 con 0x7f987012d640 2026-02-20T16:29:42.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.546+0000 7f6fae4d3640 1 -- 10.20.193.57:0/3290433367 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fa8124dd0 con 0x7f6fa8094ea0 2026-02-20T16:29:42.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.546+0000 7fa9f67fc640 1 -- 10.20.193.57:0/778252628 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f8004230 con 0x7faa0806e300 2026-02-20T16:29:42.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.546+0000 7f7436d22640 1 --2- 10.20.193.57:0/1489301993 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f7430130a30 0x7f7430134df0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f742c00ef90 tx=0x7f742c00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:29:42.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.546+0000 7fa9f67fc640 1 -- 10.20.193.57:0/778252628 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa9f80044c0 con 0x7faa0806e300 2026-02-20T16:29:42.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.546+0000 7faa0fd56640 1 -- 10.20.193.57:0/778252628 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa0812f270 con 0x7faa0806e300 2026-02-20T16:29:42.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.546+0000 7fa9f67fc640 1 -- 10.20.193.57:0/778252628 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f80038f0 con 0x7faa0806e300 2026-02-20T16:29:42.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.546+0000 7faa0fd56640 1 -- 10.20.193.57:0/778252628 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7faa0812d470 con 0x7faa0806e300 2026-02-20T16:29:42.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.546+0000 7f6f827fc640 1 -- 10.20.193.57:0/3290433367 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6f6c001030 con 0x7f6fa8094ea0 2026-02-20T16:29:42.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.546+0000 7f7416ffd640 1 -- 10.20.193.57:0/1489301993 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742c019070 con 0x7f7430130a30 2026-02-20T16:29:42.577 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.546+0000 7f74387ac640 1 -- 10.20.193.57:0/1489301993 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7430073460 con 0x7f7430130a30 2026-02-20T16:29:42.577 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.546+0000 7f7416ffd640 1 -- 10.20.193.57:0/1489301993 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f742c0092f0 con 0x7f7430130a30 2026-02-20T16:29:42.577 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.546+0000 7f9876444640 1 -- 10.20.193.57:0/3520410881 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f987012d100 con 0x7f987012d640 2026-02-20T16:29:42.577 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.546+0000 7faa0fd56640 1 -- 10.20.193.57:0/778252628 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faa0806e6e0 con 0x7faa0806e300 2026-02-20T16:29:42.578 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.546+0000 7f7416ffd640 1 -- 10.20.193.57:0/1489301993 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742c00ce60 con 0x7f7430130a30 2026-02-20T16:29:42.578 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.546+0000 7f74387ac640 1 -- 10.20.193.57:0/1489301993 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f74301221f0 con 0x7f7430130a30 2026-02-20T16:29:42.578 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.546+0000 7f986cff9640 1 -- 10.20.193.57:0/3520410881 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 5) ==== 62057+0+0 (secure 0 0 0) 0x7f9864007900 con 0x7f987012d640 2026-02-20T16:29:42.579 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.547+0000 7f74387ac640 1 -- 10.20.193.57:0/1489301993 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7430133e00 con 0x7f7430130a30 2026-02-20T16:29:42.579 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.547+0000 7fa9f67fc640 1 -- 10.20.193.57:0/778252628 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 5) ==== 62057+0+0 (secure 0 0 0) 0x7fa9f8023060 con 0x7faa0806e300 2026-02-20T16:29:42.579 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.547+0000 7f7416ffd640 1 -- 10.20.193.57:0/1489301993 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 5) ==== 62057+0+0 (secure 0 0 0) 0x7f742c002cc0 con 0x7f7430130a30 2026-02-20T16:29:42.580 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.547+0000 7f986cff9640 1 -- 10.20.193.57:0/3520410881 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 2861+0+0 (secure 0 0 0) 0x7f986408ba30 con 0x7f987012d640 2026-02-20T16:29:42.580 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.547+0000 7f6fa4ff9640 1 -- 10.20.193.57:0/3290433367 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 5) ==== 62057+0+0 (secure 0 0 0) 0x7f6f98038870 con 0x7f6fa8094ea0 2026-02-20T16:29:42.580 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.547+0000 7f986cff9640 1 -- 10.20.193.57:0/3520410881 --> v1:10.20.193.57:6805/3441840004 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9864044e70 con 0x7f9840055e10 2026-02-20T16:29:42.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.547+0000 7f986cff9640 1 -- 10.20.193.57:0/3520410881 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f98640902c0 con 0x7f987012d640 2026-02-20T16:29:42.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.547+0000 7fa9f67fc640 1 -- 10.20.193.57:0/778252628 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 2861+0+0 (secure 0 0 0) 0x7fa9f8067520 con 0x7faa0806e300 2026-02-20T16:29:42.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.547+0000 7fa9f67fc640 1 -- 10.20.193.57:0/778252628 --> v1:10.20.193.57:6813/3124429028 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa9d8059b00 con 0x7fa9d8055e10 2026-02-20T16:29:42.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.547+0000 7fa9f67fc640 1 -- 10.20.193.57:0/778252628 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fa9f8067910 con 0x7faa0806e300 2026-02-20T16:29:42.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.547+0000 7f6fa4ff9640 1 -- 10.20.193.57:0/3290433367 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 2861+0+0 (secure 0 0 0) 0x7f6f9808bb10 con 0x7f6fa8094ea0 2026-02-20T16:29:42.582 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.547+0000 7f7416ffd640 1 -- 10.20.193.57:0/1489301993 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 2861+0+0 (secure 0 0 0) 0x7f742c067070 con 0x7f7430130a30 2026-02-20T16:29:42.582 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.547+0000 7f6fa4ff9640 1 -- 10.20.193.57:0/3290433367 --> v1:10.20.193.57:6809/1926844368 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6f78059ba0 con 0x7f6f78055eb0 2026-02-20T16:29:42.582 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.547+0000 7f6fa4ff9640 1 -- 10.20.193.57:0/3290433367 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f6f9808bfa0 con 0x7f6fa8094ea0 2026-02-20T16:29:42.583 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.547+0000 7f7416ffd640 1 -- 10.20.193.57:0/1489301993 --> v1:10.20.193.57:6801/385793132 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f742c013e50 con 0x7f7400055e80 2026-02-20T16:29:42.583 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.547+0000 7f7416ffd640 1 -- 10.20.193.57:0/1489301993 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f742c06e050 con 0x7f7430130a30 2026-02-20T16:29:42.583 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.548+0000 7f986cff9640 1 -- 10.20.193.57:0/3520410881 <== osd.1 v1:10.20.193.57:6805/3441840004 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7f9864044e70 con 0x7f9840055e10 2026-02-20T16:29:42.583 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.548+0000 7fa9f67fc640 1 -- 10.20.193.57:0/778252628 <== osd.3 v1:10.20.193.57:6813/3124429028 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7fa9d8059b00 con 0x7fa9d8055e10 2026-02-20T16:29:42.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.548+0000 7f6fa4ff9640 1 -- 10.20.193.57:0/3290433367 <== osd.2 v1:10.20.193.57:6809/1926844368 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7f6f78059ba0 con 0x7f6f78055eb0 2026-02-20T16:29:42.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.548+0000 7f7416ffd640 1 -- 10.20.193.57:0/1489301993 <== osd.0 v1:10.20.193.57:6801/385793132 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7f742c013e50 con 0x7f7400055e80 2026-02-20T16:29:42.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.554+0000 7faa0fd56640 1 -- 10.20.193.57:0/778252628 --> v1:10.20.193.57:6813/3124429028 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7faa08073090 con 0x7fa9d8055e10 2026-02-20T16:29:42.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.554+0000 7f6f827fc640 1 -- 10.20.193.57:0/3290433367 --> v1:10.20.193.57:6809/1926844368 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6f6c002ed0 con 0x7f6f78055eb0 2026-02-20T16:29:42.585 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.554+0000 7f6fa4ff9640 1 -- 10.20.193.57:0/3290433367 <== osd.2 v1:10.20.193.57:6809/1926844368 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 3679948908) 0x7f6f6c002ed0 con 0x7f6f78055eb0 2026-02-20T16:29:42.585 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.554+0000 7fa9f67fc640 1 -- 10.20.193.57:0/778252628 <== osd.3 v1:10.20.193.57:6813/3124429028 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 3679948908) 0x7faa08073090 con 0x7fa9d8055e10 2026-02-20T16:29:42.585 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.554+0000 7faa0fd56640 1 -- 10.20.193.57:0/778252628 >> v1:10.20.193.57:6813/3124429028 conn(0x7fa9d8055e10 legacy=0x7fa9d8058290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.554+0000 7f6f827fc640 1 -- 10.20.193.57:0/3290433367 >> v1:10.20.193.57:6809/1926844368 conn(0x7f6f78055eb0 legacy=0x7f6f78058330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.554+0000 7faa0fd56640 1 -- 10.20.193.57:0/778252628 >> v1:10.20.193.57:6800/4138285113 conn(0x7fa9d804f790 legacy=0x7fa9d8051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.554+0000 7faa0fd56640 1 -- 10.20.193.57:0/778252628 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7faa0806e300 msgr2=0x7faa0809ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.554+0000 7faa0fd56640 1 --2- 10.20.193.57:0/778252628 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7faa0806e300 0x7faa0809ac20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa9f800c700 tx=0x7fa9f800cbd0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.554+0000 7faa0e2cc640 1 -- 10.20.193.57:0/778252628 reap_dead start 2026-02-20T16:29:42.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.554+0000 7f6f827fc640 1 -- 10.20.193.57:0/3290433367 >> v1:10.20.193.57:6800/4138285113 conn(0x7f6f7804f7c0 legacy=0x7f6f78051c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.554+0000 7f6f827fc640 1 -- 10.20.193.57:0/3290433367 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f6fa8094ea0 msgr2=0x7f6fa8132640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.554+0000 7f6f827fc640 1 --2- 10.20.193.57:0/3290433367 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f6fa8094ea0 0x7f6fa8132640 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6f98009b60 tx=0x7f6f98005b40 comp rx=0 tx=0).stop 2026-02-20T16:29:42.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.554+0000 7f6faca49640 1 -- 10.20.193.57:0/3290433367 reap_dead start 2026-02-20T16:29:42.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.554+0000 7faa0fd56640 1 -- 10.20.193.57:0/778252628 shutdown_connections 2026-02-20T16:29:42.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.554+0000 7faa0fd56640 1 -- 10.20.193.57:0/778252628 >> 10.20.193.57:0/778252628 conn(0x7faa0809f500 msgr2=0x7faa08072980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:42.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.554+0000 7f6f827fc640 1 -- 10.20.193.57:0/3290433367 shutdown_connections 2026-02-20T16:29:42.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.554+0000 7f6f827fc640 1 -- 10.20.193.57:0/3290433367 >> 10.20.193.57:0/3290433367 conn(0x7f6fa809a170 msgr2=0x7f6fa8092920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:42.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.554+0000 7faa0fd56640 1 -- 10.20.193.57:0/778252628 shutdown_connections 2026-02-20T16:29:42.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.554+0000 7faa0fd56640 1 -- 10.20.193.57:0/778252628 wait complete. 2026-02-20T16:29:42.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.554+0000 7f6f827fc640 1 -- 10.20.193.57:0/3290433367 shutdown_connections 2026-02-20T16:29:42.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.554+0000 7f6f827fc640 1 -- 10.20.193.57:0/3290433367 wait complete. 2026-02-20T16:29:42.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.555+0000 7f74387ac640 1 -- 10.20.193.57:0/1489301993 --> v1:10.20.193.57:6801/385793132 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f74300740c0 con 0x7f7400055e80 2026-02-20T16:29:42.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.555+0000 7f7416ffd640 1 -- 10.20.193.57:0/1489301993 <== osd.0 v1:10.20.193.57:6801/385793132 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2217796425) 0x7f7424033020 con 0x7f7400055e80 2026-02-20T16:29:42.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.555+0000 7f74387ac640 1 -- 10.20.193.57:0/1489301993 >> v1:10.20.193.57:6801/385793132 conn(0x7f7400055e80 legacy=0x7f7400058300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.555+0000 7f74387ac640 1 -- 10.20.193.57:0/1489301993 >> v1:10.20.193.57:6800/4138285113 conn(0x7f740004f790 legacy=0x7f7400051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.555+0000 7f74387ac640 1 -- 10.20.193.57:0/1489301993 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f7430130a30 msgr2=0x7f7430134df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.555+0000 7f74387ac640 1 --2- 10.20.193.57:0/1489301993 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f7430130a30 0x7f7430134df0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f742c00ef90 tx=0x7f742c00c490 comp rx=0 tx=0).stop 2026-02-20T16:29:42.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.555+0000 7f7436d22640 1 -- 10.20.193.57:0/1489301993 reap_dead start 2026-02-20T16:29:42.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.555+0000 7f74387ac640 1 -- 10.20.193.57:0/1489301993 shutdown_connections 2026-02-20T16:29:42.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.555+0000 7f74387ac640 1 -- 10.20.193.57:0/1489301993 >> 10.20.193.57:0/1489301993 conn(0x7f743009a170 msgr2=0x7f7430127330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:42.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.555+0000 7f74387ac640 1 -- 10.20.193.57:0/1489301993 shutdown_connections 2026-02-20T16:29:42.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.555+0000 7f74387ac640 1 -- 10.20.193.57:0/1489301993 wait complete. 2026-02-20T16:29:42.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.555+0000 7f9876444640 1 -- 10.20.193.57:0/3520410881 --> v1:10.20.193.57:6805/3441840004 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f987009e230 con 0x7f9840055e10 2026-02-20T16:29:42.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.555+0000 7f986cff9640 1 -- 10.20.193.57:0/3520410881 <== osd.1 v1:10.20.193.57:6805/3441840004 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 3679948908) 0x7f987009e230 con 0x7f9840055e10 2026-02-20T16:29:42.592 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.556+0000 7f9876444640 1 -- 10.20.193.57:0/3520410881 >> v1:10.20.193.57:6805/3441840004 conn(0x7f9840055e10 legacy=0x7f9840058290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.592 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.556+0000 7f9876444640 1 -- 10.20.193.57:0/3520410881 >> v1:10.20.193.57:6800/4138285113 conn(0x7f984004f790 legacy=0x7f9840051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.592 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.556+0000 7f9876444640 1 -- 10.20.193.57:0/3520410881 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f987012d640 msgr2=0x7f987006f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.592 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.556+0000 7f9876444640 1 --2- 10.20.193.57:0/3520410881 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f987012d640 0x7f987006f980 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f986402f840 tx=0x7f9864009740 comp rx=0 tx=0).stop 2026-02-20T16:29:42.592 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.556+0000 7f98749ba640 1 -- 10.20.193.57:0/3520410881 reap_dead start 2026-02-20T16:29:42.592 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.556+0000 7f9876444640 1 -- 10.20.193.57:0/3520410881 shutdown_connections 2026-02-20T16:29:42.592 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.556+0000 7f9876444640 1 -- 10.20.193.57:0/3520410881 >> 10.20.193.57:0/3520410881 conn(0x7f987006ce10 msgr2=0x7f987009d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:42.592 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.556+0000 7f9876444640 1 -- 10.20.193.57:0/3520410881 shutdown_connections 2026-02-20T16:29:42.592 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.556+0000 7f9876444640 1 -- 10.20.193.57:0/3520410881 wait complete. 2026-02-20T16:29:42.592 INFO:teuthology.orchestra.run.trial057.stdout:42949672963 2026-02-20T16:29:42.593 INFO:teuthology.orchestra.run.trial057.stdout:42949672963 2026-02-20T16:29:42.593 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-20T16:29:42.594 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-20T16:29:42.594 INFO:teuthology.orchestra.run.trial057.stdout:38654705667 2026-02-20T16:29:42.595 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-20T16:29:42.595 INFO:teuthology.orchestra.run.trial057.stdout:42949672963 2026-02-20T16:29:42.596 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-20T16:29:42.702 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.701+0000 7f1afb698640 1 -- 10.20.193.57:0/1665342350 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f1af4094c90 msgr2=0x7f1af4095120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.703 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.701+0000 7f1afb698640 1 --2- 10.20.193.57:0/1665342350 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f1af4094c90 0x7f1af4095120 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1af0009f60 tx=0x7f1af002f320 comp rx=0 tx=0).stop 2026-02-20T16:29:42.703 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.701+0000 7f3d8066d640 1 -- 10.20.193.57:0/4282091319 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f3d78094ac0 msgr2=0x7f3d78094f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.703 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.701+0000 7f3d8066d640 1 --2- 10.20.193.57:0/4282091319 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f3d78094ac0 0x7f3d78094f00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c009a60 tx=0x7f3d6c031480 comp rx=0 tx=0).stop 2026-02-20T16:29:42.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.701+0000 7f1afb698640 1 -- 10.20.193.57:0/1665342350 shutdown_connections 2026-02-20T16:29:42.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.701+0000 7f1afb698640 1 --2- 10.20.193.57:0/1665342350 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f1af4094c90 0x7f1af4095120 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.701+0000 7f1afb698640 1 --2- 10.20.193.57:0/1665342350 >> v2:10.20.193.57:3300/0 conn(0x7f1af412b3d0 0x7f1af412b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.701+0000 7f1afb698640 1 -- 10.20.193.57:0/1665342350 >> 10.20.193.57:0/1665342350 conn(0x7f1af409a170 msgr2=0x7f1af4097a10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:42.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.701+0000 7f1afb698640 1 -- 10.20.193.57:0/1665342350 shutdown_connections 2026-02-20T16:29:42.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.701+0000 7f1afb698640 1 -- 10.20.193.57:0/1665342350 wait complete. 2026-02-20T16:29:42.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.701+0000 7f3d8066d640 1 -- 10.20.193.57:0/4282091319 shutdown_connections 2026-02-20T16:29:42.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.701+0000 7f3d8066d640 1 --2- 10.20.193.57:0/4282091319 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f3d78094ac0 0x7f3d78094f00 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.701+0000 7f3d8066d640 1 --2- 10.20.193.57:0/4282091319 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f3d7806c7e0 0x7f3d78094580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.701+0000 7f3d8066d640 1 -- 10.20.193.57:0/4282091319 >> 10.20.193.57:0/4282091319 conn(0x7f3d7809a170 msgr2=0x7f3d78097a10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:42.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.701+0000 7f3d8066d640 1 -- 10.20.193.57:0/4282091319 shutdown_connections 2026-02-20T16:29:42.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.701+0000 7f3d8066d640 1 -- 10.20.193.57:0/4282091319 wait complete. 2026-02-20T16:29:42.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f3d8066d640 1 Processor -- start 2026-02-20T16:29:42.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f1afb698640 1 Processor -- start 2026-02-20T16:29:42.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f1afb698640 1 -- start start 2026-02-20T16:29:42.708 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f3d8066d640 1 -- start start 2026-02-20T16:29:42.708 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f3d8066d640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f3d7806c7e0 0x7f3d7812bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:42.708 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f3d8066d640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f3d78094ac0 0x7f3d7812c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:42.708 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f3d8066d640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f3d7812fca0 0x7f3d7812c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:42.708 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f3d8066d640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7812b810 con 0x7f3d78094ac0 2026-02-20T16:29:42.708 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f3d8066d640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f3d7812b690 con 0x7f3d7806c7e0 2026-02-20T16:29:42.708 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f3d8066d640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f3d781337b0 con 0x7f3d7812fca0 2026-02-20T16:29:42.708 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f3d7dbe1640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f3d78094ac0 0x7f3d7812c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:42.709 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f3d7e3e2640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f3d7806c7e0 0x7f3d7812bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:42.709 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f3d7ebe3640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f3d7812fca0 0x7f3d7812c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:42.709 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f3d7dbe1640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f3d78094ac0 0x7f3d7812c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:38842/0 (socket says 10.20.193.57:38842) 2026-02-20T16:29:42.709 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f3d7e3e2640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f3d7806c7e0 0x7f3d7812bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3301/0 says I am v2:10.20.193.57:44838/0 (socket says 10.20.193.57:44838) 2026-02-20T16:29:42.709 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f3d7dbe1640 1 -- 10.20.193.57:0/2960850135 learned_addr learned my addr 10.20.193.57:0/2960850135 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:29:42.709 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f1afb698640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f1af4094c90 0x7f1af412a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:42.709 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f1afb698640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f1af412b3d0 0x7f1af412aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:42.710 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f1afb698640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f1af412bcf0 0x7f1af408c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:42.710 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f3d7dbe1640 1 -- 10.20.193.57:0/2960850135 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f3d7812fca0 msgr2=0x7f3d7812c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.710 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f3d7dbe1640 1 --2- 10.20.193.57:0/2960850135 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f3d7812fca0 0x7f3d7812c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.710 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f3d7dbe1640 1 -- 10.20.193.57:0/2960850135 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f3d7806c7e0 msgr2=0x7f3d7812bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.710 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f3d7dbe1640 1 --2- 10.20.193.57:0/2960850135 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f3d7806c7e0 0x7f3d7812bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.710 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f3d7dbe1640 1 -- 10.20.193.57:0/2960850135 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d7812dc20 con 0x7f3d78094ac0 2026-02-20T16:29:42.711 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f1afb698640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f1af41335b0 con 0x7f1af4094c90 2026-02-20T16:29:42.711 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f1afb698640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f1af4133430 con 0x7f1af412b3d0 2026-02-20T16:29:42.711 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f1afb698640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f1af4133730 con 0x7f1af412bcf0 2026-02-20T16:29:42.711 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f1af940d640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f1af4094c90 0x7f1af412a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:42.711 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f1af940d640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f1af4094c90 0x7f1af412a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:38858/0 (socket says 10.20.193.57:38858) 2026-02-20T16:29:42.711 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f1af940d640 1 -- 10.20.193.57:0/3441780560 learned_addr learned my addr 10.20.193.57:0/3441780560 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:29:42.712 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f3d7dbe1640 1 --2- 10.20.193.57:0/2960850135 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f3d78094ac0 0x7f3d7812c220 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c009b90 tx=0x7f3d6c002f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:29:42.712 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f1af9c0e640 1 --2- 10.20.193.57:0/3441780560 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f1af412bcf0 0x7f1af408c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:42.712 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f1af8c0c640 1 --2- 10.20.193.57:0/3441780560 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f1af412b3d0 0x7f1af412aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:42.713 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f1af940d640 1 -- 10.20.193.57:0/3441780560 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f1af412bcf0 msgr2=0x7f1af408c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.713 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f1af940d640 1 --2- 10.20.193.57:0/3441780560 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f1af412bcf0 0x7f1af408c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.713 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f1af940d640 1 -- 10.20.193.57:0/3441780560 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f1af412b3d0 msgr2=0x7f1af412aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.713 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f1af940d640 1 --2- 10.20.193.57:0/3441780560 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f1af412b3d0 0x7f1af412aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.713 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f1af940d640 1 -- 10.20.193.57:0/3441780560 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1af412af90 con 0x7f1af4094c90 2026-02-20T16:29:42.714 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f2634ebb640 1 -- 10.20.193.57:0/1936141121 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f2630134430 msgr2=0x7f2630136820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.714 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f2634ebb640 1 --2- 10.20.193.57:0/1936141121 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f2630134430 0x7f2630136820 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2620009f90 tx=0x7f262002f420 comp rx=0 tx=0).stop 2026-02-20T16:29:42.714 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f2634ebb640 1 -- 10.20.193.57:0/1936141121 shutdown_connections 2026-02-20T16:29:42.714 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f2634ebb640 1 --2- 10.20.193.57:0/1936141121 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f2630134430 0x7f2630136820 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.714 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f2634ebb640 1 --2- 10.20.193.57:0/1936141121 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f263006edf0 0x7f2630133ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.714 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f2634ebb640 1 -- 10.20.193.57:0/1936141121 >> 10.20.193.57:0/1936141121 conn(0x7f263009f500 msgr2=0x7f263009f910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:42.714 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f2634ebb640 1 -- 10.20.193.57:0/1936141121 shutdown_connections 2026-02-20T16:29:42.714 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f2634ebb640 1 -- 10.20.193.57:0/1936141121 wait complete. 2026-02-20T16:29:42.715 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f3d5effd640 1 -- 10.20.193.57:0/2960850135 <== mon.0 v2:10.20.193.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c0048a0 con 0x7f3d78094ac0 2026-02-20T16:29:42.715 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f3d5effd640 1 -- 10.20.193.57:0/2960850135 <== mon.0 v2:10.20.193.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3d6c004a40 con 0x7f3d78094ac0 2026-02-20T16:29:42.715 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f3d5effd640 1 -- 10.20.193.57:0/2960850135 <== mon.0 v2:10.20.193.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c005020 con 0x7f3d78094ac0 2026-02-20T16:29:42.715 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f3d8066d640 1 -- 10.20.193.57:0/2960850135 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d7812cca0 con 0x7f3d78094ac0 2026-02-20T16:29:42.716 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f1af940d640 1 --2- 10.20.193.57:0/3441780560 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f1af4094c90 0x7f1af412a510 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1ae400ea40 tx=0x7f1ae400ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:29:42.716 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f1ae1ffb640 1 -- 10.20.193.57:0/3441780560 <== mon.0 v2:10.20.193.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae400ce30 con 0x7f1af4094c90 2026-02-20T16:29:42.716 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f1ae1ffb640 1 -- 10.20.193.57:0/3441780560 <== mon.0 v2:10.20.193.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ae40040d0 con 0x7f1af4094c90 2026-02-20T16:29:42.716 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f1ae1ffb640 1 -- 10.20.193.57:0/3441780560 <== mon.0 v2:10.20.193.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae400ce30 con 0x7f1af4094c90 2026-02-20T16:29:42.716 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f4e30c6d640 1 -- 10.20.193.57:0/2136804472 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f4e2c12cd20 msgr2=0x7f4e2c12d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.717 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.702+0000 7f4e30c6d640 1 --2- 10.20.193.57:0/2136804472 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f4e2c12cd20 0x7f4e2c12d100 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4e20009930 tx=0x7f4e2002f110 comp rx=0 tx=0).stop 2026-02-20T16:29:42.717 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.703+0000 7f1afb698640 1 -- 10.20.193.57:0/3441780560 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1af4132840 con 0x7f1af4094c90 2026-02-20T16:29:42.717 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.703+0000 7f1afb698640 1 -- 10.20.193.57:0/3441780560 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1af408d920 con 0x7f1af4094c90 2026-02-20T16:29:42.718 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.703+0000 7f4e30c6d640 1 -- 10.20.193.57:0/2136804472 shutdown_connections 2026-02-20T16:29:42.718 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.703+0000 7f4e30c6d640 1 --2- 10.20.193.57:0/2136804472 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f4e2c096d60 0x7f4e2c0971d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.718 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.703+0000 7f4e30c6d640 1 --2- 10.20.193.57:0/2136804472 >> v2:10.20.193.57:3300/0 conn(0x7f4e2c12d640 0x7f4e2c096820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.718 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.703+0000 7f4e30c6d640 1 --2- 10.20.193.57:0/2136804472 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f4e2c12cd20 0x7f4e2c12d100 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.718 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.703+0000 7f4e30c6d640 1 -- 10.20.193.57:0/2136804472 >> 10.20.193.57:0/2136804472 conn(0x7f4e2c06ce10 msgr2=0x7f4e2c06d220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:42.719 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.703+0000 7f4e30c6d640 1 -- 10.20.193.57:0/2136804472 shutdown_connections 2026-02-20T16:29:42.719 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.703+0000 7f3d8066d640 1 -- 10.20.193.57:0/2960850135 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d7812e350 con 0x7f3d78094ac0 2026-02-20T16:29:42.719 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.703+0000 7f4e30c6d640 1 -- 10.20.193.57:0/2136804472 wait complete. 2026-02-20T16:29:42.720 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.703+0000 7f2634ebb640 1 Processor -- start 2026-02-20T16:29:42.720 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.703+0000 7f2634ebb640 1 -- start start 2026-02-20T16:29:42.720 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.703+0000 7f1afb698640 1 -- 10.20.193.57:0/3441780560 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1af4095120 con 0x7f1af4094c90 2026-02-20T16:29:42.720 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.703+0000 7f4e30c6d640 1 Processor -- start 2026-02-20T16:29:42.721 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.703+0000 7f3d8066d640 1 -- 10.20.193.57:0/2960850135 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d78094580 con 0x7f3d78094ac0 2026-02-20T16:29:42.721 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.703+0000 7f4e30c6d640 1 -- start start 2026-02-20T16:29:42.722 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.703+0000 7f2634ebb640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f263006e300 0x7f263012c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:42.722 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.703+0000 7f2634ebb640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f263006edf0 0x7f263012cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:42.722 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.703+0000 7f2634ebb640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f2630134430 0x7f263012d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:42.722 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.703+0000 7f2634ebb640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f26301379a0 con 0x7f263006edf0 2026-02-20T16:29:42.723 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.703+0000 7f2634ebb640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f2630137820 con 0x7f263006e300 2026-02-20T16:29:42.723 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.703+0000 7f2634ebb640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f2630137b20 con 0x7f2630134430 2026-02-20T16:29:42.723 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.703+0000 7f262e575640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f263006e300 0x7f263012c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:42.723 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.703+0000 7f262ed76640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f2630134430 0x7f263012d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:42.723 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.703+0000 7f262ed76640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f2630134430 0x7f263012d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3302/0 says I am v2:10.20.193.57:47500/0 (socket says 10.20.193.57:47500) 2026-02-20T16:29:42.723 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.703+0000 7f262e575640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f263006e300 0x7f263012c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3301/0 says I am v2:10.20.193.57:44856/0 (socket says 10.20.193.57:44856) 2026-02-20T16:29:42.723 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.703+0000 7f262e575640 1 -- 10.20.193.57:0/2751875412 learned_addr learned my addr 10.20.193.57:0/2751875412 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:29:42.723 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.703+0000 7f262dd74640 1 --2- 10.20.193.57:0/2751875412 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f263006edf0 0x7f263012cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:42.723 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.703+0000 7f1ae1ffb640 1 -- 10.20.193.57:0/3441780560 <== mon.0 v2:10.20.193.57:3300/0 4 ==== mgrmap(e 5) ==== 62057+0+0 (secure 0 0 0) 0x7f1ae4004280 con 0x7f1af4094c90 2026-02-20T16:29:42.724 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.703+0000 7f262ed76640 1 -- 10.20.193.57:0/2751875412 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f263006e300 msgr2=0x7f263012c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.724 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.703+0000 7f262ed76640 1 --2- 10.20.193.57:0/2751875412 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f263006e300 0x7f263012c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.724 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.703+0000 7f4e30c6d640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f4e2c096d60 0x7f4e2c12db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:42.725 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.703+0000 7f4e30c6d640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f4e2c12cd20 0x7f4e2c12e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:42.725 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.703+0000 7f4e30c6d640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f4e2c12d640 0x7f4e2c12e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:42.725 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.703+0000 7f4e30c6d640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f4e2c1344e0 con 0x7f4e2c12cd20 2026-02-20T16:29:42.725 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.703+0000 7f4e30c6d640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f4e2c134360 con 0x7f4e2c096d60 2026-02-20T16:29:42.725 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.703+0000 7f262ed76640 1 -- 10.20.193.57:0/2751875412 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f263006edf0 msgr2=0x7f263012cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.726 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.703+0000 7f4e30c6d640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f4e2c134660 con 0x7f4e2c12d640 2026-02-20T16:29:42.726 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.703+0000 7f4e29d74640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f4e2c12cd20 0x7f4e2c12e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:42.726 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.703+0000 7f4e29d74640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f4e2c12cd20 0x7f4e2c12e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:38880/0 (socket says 10.20.193.57:38880) 2026-02-20T16:29:42.726 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.703+0000 7f4e2a575640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f4e2c096d60 0x7f4e2c12db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:42.726 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.703+0000 7f262ed76640 1 --2- 10.20.193.57:0/2751875412 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f263006edf0 0x7f263012cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.726 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.703+0000 7f4e29d74640 1 -- 10.20.193.57:0/3949452622 learned_addr learned my addr 10.20.193.57:0/3949452622 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:29:42.727 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.703+0000 7f4e2ad76640 1 --2- 10.20.193.57:0/3949452622 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f4e2c12d640 0x7f4e2c12e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:42.727 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.704+0000 7f262ed76640 1 -- 10.20.193.57:0/2751875412 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f263012f0a0 con 0x7f2630134430 2026-02-20T16:29:42.727 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.704+0000 7f3d5effd640 1 -- 10.20.193.57:0/2960850135 <== mon.0 v2:10.20.193.57:3300/0 4 ==== mgrmap(e 5) ==== 62057+0+0 (secure 0 0 0) 0x7f3d6c00f2e0 con 0x7f3d78094ac0 2026-02-20T16:29:42.728 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.704+0000 7f262e575640 1 --2- 10.20.193.57:0/2751875412 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f263006e300 0x7f263012c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:29:42.728 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.704+0000 7f262dd74640 1 --2- 10.20.193.57:0/2751875412 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f263006edf0 0x7f263012cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:29:42.728 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.704+0000 7f4e2ad76640 1 -- 10.20.193.57:0/3949452622 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f4e2c096d60 msgr2=0x7f4e2c12db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.728 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.704+0000 7f262ed76640 1 --2- 10.20.193.57:0/2751875412 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f2630134430 0x7f263012d450 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2620033000 tx=0x7f2620002d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:29:42.729 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.704+0000 7f1ae1ffb640 1 -- 10.20.193.57:0/3441780560 <== mon.0 v2:10.20.193.57:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2861+0+0 (secure 0 0 0) 0x7f1ae400cc30 con 0x7f1af4094c90 2026-02-20T16:29:42.730 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.704+0000 7f4e2ad76640 1 --2- 10.20.193.57:0/3949452622 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f4e2c096d60 0x7f4e2c12db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.730 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.704+0000 7f4e2ad76640 1 -- 10.20.193.57:0/3949452622 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f4e2c12cd20 msgr2=0x7f4e2c12e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.730 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.704+0000 7f4e2ad76640 1 --2- 10.20.193.57:0/3949452622 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f4e2c12cd20 0x7f4e2c12e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.730 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.704+0000 7f4e2ad76640 1 -- 10.20.193.57:0/3949452622 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e2c073080 con 0x7f4e2c12d640 2026-02-20T16:29:42.730 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.704+0000 7f4e2ad76640 1 --2- 10.20.193.57:0/3949452622 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f4e2c12d640 0x7f4e2c12e5b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c00efc0 tx=0x7f4e1c00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:29:42.731 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.704+0000 7f2616ffd640 1 -- 10.20.193.57:0/2751875412 <== mon.2 v2:10.20.193.57:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2620046070 con 0x7f2630134430 2026-02-20T16:29:42.731 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.704+0000 7f2634ebb640 1 -- 10.20.193.57:0/2751875412 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f263012dfe0 con 0x7f2630134430 2026-02-20T16:29:42.731 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.704+0000 7f4e12ffd640 1 -- 10.20.193.57:0/3949452622 <== mon.2 v2:10.20.193.57:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c019070 con 0x7f4e2c12d640 2026-02-20T16:29:42.731 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.704+0000 7f4e12ffd640 1 -- 10.20.193.57:0/3949452622 <== mon.2 v2:10.20.193.57:3302/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4e1c0090d0 con 0x7f4e2c12d640 2026-02-20T16:29:42.732 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.704+0000 7f2634ebb640 1 -- 10.20.193.57:0/2751875412 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f26300735a0 con 0x7f2630134430 2026-02-20T16:29:42.732 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.704+0000 7f4e30c6d640 1 -- 10.20.193.57:0/3949452622 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e2c12eaf0 con 0x7f4e2c12d640 2026-02-20T16:29:42.732 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.704+0000 7f4e12ffd640 1 -- 10.20.193.57:0/3949452622 <== mon.2 v2:10.20.193.57:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c002a60 con 0x7f4e2c12d640 2026-02-20T16:29:42.732 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.704+0000 7f2616ffd640 1 -- 10.20.193.57:0/2751875412 <== mon.2 v2:10.20.193.57:3302/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f26200040c0 con 0x7f2630134430 2026-02-20T16:29:42.733 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.704+0000 7f4e30c6d640 1 -- 10.20.193.57:0/3949452622 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e2c06ef00 con 0x7f4e2c12d640 2026-02-20T16:29:42.733 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.704+0000 7f2616ffd640 1 -- 10.20.193.57:0/2751875412 <== mon.2 v2:10.20.193.57:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26200044d0 con 0x7f2630134430 2026-02-20T16:29:42.733 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.704+0000 7f3d5effd640 1 -- 10.20.193.57:0/2960850135 <== mon.0 v2:10.20.193.57:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2861+0+0 (secure 0 0 0) 0x7f3d6c08b9d0 con 0x7f3d78094ac0 2026-02-20T16:29:42.734 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.704+0000 7f2634ebb640 1 -- 10.20.193.57:0/2751875412 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f263006e6e0 con 0x7f2630134430 2026-02-20T16:29:42.734 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.704+0000 7f4e30c6d640 1 -- 10.20.193.57:0/3949452622 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e2c12d100 con 0x7f4e2c12d640 2026-02-20T16:29:42.734 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.705+0000 7f4e12ffd640 1 -- 10.20.193.57:0/3949452622 <== mon.2 v2:10.20.193.57:3302/0 4 ==== mgrmap(e 5) ==== 62057+0+0 (secure 0 0 0) 0x7f4e1c002c00 con 0x7f4e2c12d640 2026-02-20T16:29:42.735 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.705+0000 7f2616ffd640 1 -- 10.20.193.57:0/2751875412 <== mon.2 v2:10.20.193.57:3302/0 4 ==== mgrmap(e 5) ==== 62057+0+0 (secure 0 0 0) 0x7f2620004670 con 0x7f2630134430 2026-02-20T16:29:42.735 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.705+0000 7f2616ffd640 1 -- 10.20.193.57:0/2751875412 <== mon.2 v2:10.20.193.57:3302/0 5 ==== osd_map(17..17 src has 1..17) ==== 2861+0+0 (secure 0 0 0) 0x7f262008b240 con 0x7f2630134430 2026-02-20T16:29:42.735 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.705+0000 7f4e12ffd640 1 -- 10.20.193.57:0/3949452622 <== mon.2 v2:10.20.193.57:3302/0 5 ==== osd_map(17..17 src has 1..17) ==== 2861+0+0 (secure 0 0 0) 0x7f4e1c0670e0 con 0x7f4e2c12d640 2026-02-20T16:29:42.735 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.706+0000 7f3d5effd640 1 -- 10.20.193.57:0/2960850135 <== mon.0 v2:10.20.193.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f3d6c065850 con 0x7f3d78094ac0 2026-02-20T16:29:42.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.707+0000 7f4e12ffd640 1 -- 10.20.193.57:0/3949452622 <== mon.2 v2:10.20.193.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f4e1c010040 con 0x7f4e2c12d640 2026-02-20T16:29:42.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.708+0000 7f1ae1ffb640 1 -- 10.20.193.57:0/3441780560 <== mon.0 v2:10.20.193.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f1ae4040e00 con 0x7f1af4094c90 2026-02-20T16:29:42.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.709+0000 7f2616ffd640 1 -- 10.20.193.57:0/2751875412 <== mon.2 v2:10.20.193.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f263012f0a0 con 0x7f2630134430 2026-02-20T16:29:42.779 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.777+0000 7f3d8066d640 1 -- 10.20.193.57:0/2960850135 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f3d78050a10 con 0x7f3d78094ac0 2026-02-20T16:29:42.779 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.777+0000 7f3d5effd640 1 -- 10.20.193.57:0/2960850135 <== mon.0 v2:10.20.193.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3d6c00ecf0 con 0x7f3d78094ac0 2026-02-20T16:29:42.779 INFO:teuthology.orchestra.run.trial057.stdout:42949672962 2026-02-20T16:29:42.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.778+0000 7f1afb698640 1 -- 10.20.193.57:0/3441780560 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f1af40740c0 con 0x7f1af4094c90 2026-02-20T16:29:42.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.778+0000 7f4e30c6d640 1 -- 10.20.193.57:0/3949452622 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f4e2c050a10 con 0x7f4e2c12d640 2026-02-20T16:29:42.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.778+0000 7f1ae1ffb640 1 -- 10.20.193.57:0/3441780560 <== mon.0 v2:10.20.193.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1ae400ce30 con 0x7f1af4094c90 2026-02-20T16:29:42.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.778+0000 7f4e12ffd640 1 -- 10.20.193.57:0/3949452622 <== mon.2 v2:10.20.193.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4e1c040f80 con 0x7f4e2c12d640 2026-02-20T16:29:42.781 INFO:teuthology.orchestra.run.trial057.stdout:38654705666 2026-02-20T16:29:42.781 INFO:teuthology.orchestra.run.trial057.stdout:42949672962 2026-02-20T16:29:42.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.779+0000 7f3d8066d640 1 -- 10.20.193.57:0/2960850135 >> v1:10.20.193.57:6800/4138285113 conn(0x7f3d480581d0 legacy=0x7f3d4805a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.779+0000 7f3d8066d640 1 -- 10.20.193.57:0/2960850135 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f3d78094ac0 msgr2=0x7f3d7812c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.779+0000 7f3d8066d640 1 --2- 10.20.193.57:0/2960850135 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f3d78094ac0 0x7f3d7812c220 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c009b90 tx=0x7f3d6c002f60 comp rx=0 tx=0).stop 2026-02-20T16:29:42.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.779+0000 7f3d8066d640 1 -- 10.20.193.57:0/2960850135 shutdown_connections 2026-02-20T16:29:42.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.779+0000 7f3d8066d640 1 --2- 10.20.193.57:0/2960850135 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f3d7812fca0 0x7f3d7812c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.779+0000 7f3d8066d640 1 --2- 10.20.193.57:0/2960850135 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f3d78094ac0 0x7f3d7812c220 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.779+0000 7f3d8066d640 1 --2- 10.20.193.57:0/2960850135 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f3d7806c7e0 0x7f3d7812bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.779+0000 7f3d8066d640 1 -- 10.20.193.57:0/2960850135 >> 10.20.193.57:0/2960850135 conn(0x7f3d7809a170 msgr2=0x7f3d7809b910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:42.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.779+0000 7f3d8066d640 1 -- 10.20.193.57:0/2960850135 shutdown_connections 2026-02-20T16:29:42.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.779+0000 7f3d8066d640 1 -- 10.20.193.57:0/2960850135 wait complete. 2026-02-20T16:29:42.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.779+0000 7f2634ebb640 1 -- 10.20.193.57:0/2751875412 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f2630050a10 con 0x7f2630134430 2026-02-20T16:29:42.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.779+0000 7f2616ffd640 1 -- 10.20.193.57:0/2751875412 <== mon.2 v2:10.20.193.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f26200650e0 con 0x7f2630134430 2026-02-20T16:29:42.783 INFO:teuthology.orchestra.run.trial057.stdout:42949672962 2026-02-20T16:29:42.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.779+0000 7f4e30c6d640 1 -- 10.20.193.57:0/3949452622 >> v1:10.20.193.57:6800/4138285113 conn(0x7f4dfc04f790 legacy=0x7f4dfc051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.779+0000 7f4e30c6d640 1 -- 10.20.193.57:0/3949452622 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f4e2c12d640 msgr2=0x7f4e2c12e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.779+0000 7f4e30c6d640 1 --2- 10.20.193.57:0/3949452622 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f4e2c12d640 0x7f4e2c12e5b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c00efc0 tx=0x7f4e1c00c490 comp rx=0 tx=0).stop 2026-02-20T16:29:42.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.779+0000 7f4e30c6d640 1 -- 10.20.193.57:0/3949452622 shutdown_connections 2026-02-20T16:29:42.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.779+0000 7f4e30c6d640 1 --2- 10.20.193.57:0/3949452622 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f4e2c12d640 0x7f4e2c12e5b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.779+0000 7f4e30c6d640 1 --2- 10.20.193.57:0/3949452622 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f4e2c12cd20 0x7f4e2c12e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.779+0000 7f4e30c6d640 1 --2- 10.20.193.57:0/3949452622 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f4e2c096d60 0x7f4e2c12db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.779+0000 7f4e30c6d640 1 -- 10.20.193.57:0/3949452622 >> 10.20.193.57:0/3949452622 conn(0x7f4e2c06ce10 msgr2=0x7f4e2c1263f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:42.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.779+0000 7f4e30c6d640 1 -- 10.20.193.57:0/3949452622 shutdown_connections 2026-02-20T16:29:42.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.779+0000 7f4e30c6d640 1 -- 10.20.193.57:0/3949452622 wait complete. 2026-02-20T16:29:42.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.779+0000 7f1afb698640 1 -- 10.20.193.57:0/3441780560 >> v1:10.20.193.57:6800/4138285113 conn(0x7f1ac404fb90 legacy=0x7f1ac4052050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.779+0000 7f1afb698640 1 -- 10.20.193.57:0/3441780560 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f1af4094c90 msgr2=0x7f1af412a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.779+0000 7f1afb698640 1 --2- 10.20.193.57:0/3441780560 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f1af4094c90 0x7f1af412a510 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1ae400ea40 tx=0x7f1ae400ef10 comp rx=0 tx=0).stop 2026-02-20T16:29:42.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.779+0000 7f1afb698640 1 -- 10.20.193.57:0/3441780560 shutdown_connections 2026-02-20T16:29:42.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.779+0000 7f1afb698640 1 --2- 10.20.193.57:0/3441780560 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f1af412bcf0 0x7f1af408c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.779+0000 7f1afb698640 1 --2- 10.20.193.57:0/3441780560 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f1af412b3d0 0x7f1af412aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.779+0000 7f1afb698640 1 --2- 10.20.193.57:0/3441780560 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f1af4094c90 0x7f1af412a510 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.779+0000 7f1afb698640 1 -- 10.20.193.57:0/3441780560 >> 10.20.193.57:0/3441780560 conn(0x7f1af409a170 msgr2=0x7f1af4134440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:42.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.779+0000 7f1afb698640 1 -- 10.20.193.57:0/3441780560 shutdown_connections 2026-02-20T16:29:42.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.780+0000 7f1afb698640 1 -- 10.20.193.57:0/3441780560 wait complete. 2026-02-20T16:29:42.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.781+0000 7f2634ebb640 1 -- 10.20.193.57:0/2751875412 >> v1:10.20.193.57:6800/4138285113 conn(0x7f25fc04f790 legacy=0x7f25fc051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.781+0000 7f2634ebb640 1 -- 10.20.193.57:0/2751875412 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f2630134430 msgr2=0x7f263012d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:42.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.781+0000 7f2634ebb640 1 --2- 10.20.193.57:0/2751875412 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f2630134430 0x7f263012d450 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2620033000 tx=0x7f2620002d00 comp rx=0 tx=0).stop 2026-02-20T16:29:42.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.781+0000 7f2634ebb640 1 -- 10.20.193.57:0/2751875412 shutdown_connections 2026-02-20T16:29:42.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.781+0000 7f2634ebb640 1 --2- 10.20.193.57:0/2751875412 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f2630134430 0x7f263012d450 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.781+0000 7f2634ebb640 1 --2- 10.20.193.57:0/2751875412 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f263006edf0 0x7f263012cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.781+0000 7f2634ebb640 1 --2- 10.20.193.57:0/2751875412 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f263006e300 0x7f263012c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:42.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.781+0000 7f2634ebb640 1 -- 10.20.193.57:0/2751875412 >> 10.20.193.57:0/2751875412 conn(0x7f263009f500 msgr2=0x7f2630128a30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:42.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.781+0000 7f2634ebb640 1 -- 10.20.193.57:0/2751875412 shutdown_connections 2026-02-20T16:29:42.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:42.781+0000 7f2634ebb640 1 -- 10.20.193.57:0/2751875412 wait complete. 2026-02-20T16:29:42.789 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672963 got 42949672962 for osd.2 2026-02-20T16:29:42.790 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672963 got 42949672962 for osd.1 2026-02-20T16:29:42.790 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705666 for osd.0 2026-02-20T16:29:42.791 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672963 got 42949672962 for osd.3 2026-02-20T16:29:43.789 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-20T16:29:43.790 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-20T16:29:43.791 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-20T16:29:43.792 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-20T16:29:43.862 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.860+0000 7feb82d97640 1 -- 10.20.193.57:0/2649337713 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7feb7c06ec20 msgr2=0x7feb7c12ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:43.862 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.860+0000 7feb82d97640 1 --2- 10.20.193.57:0/2649337713 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7feb7c06ec20 0x7feb7c12ebd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7feb64009960 tx=0x7feb6402f140 comp rx=0 tx=0).stop 2026-02-20T16:29:43.862 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.860+0000 7feb82d97640 1 -- 10.20.193.57:0/2649337713 shutdown_connections 2026-02-20T16:29:43.862 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.860+0000 7feb82d97640 1 --2- 10.20.193.57:0/2649337713 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7feb7c06ec20 0x7feb7c12ebd0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:43.862 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.860+0000 7feb82d97640 1 --2- 10.20.193.57:0/2649337713 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7feb7c06e300 0x7feb7c06e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:43.863 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.860+0000 7feb82d97640 1 -- 10.20.193.57:0/2649337713 >> 10.20.193.57:0/2649337713 conn(0x7feb7c09f500 msgr2=0x7feb7c09f910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:43.863 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.860+0000 7feb82d97640 1 -- 10.20.193.57:0/2649337713 shutdown_connections 2026-02-20T16:29:43.863 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.860+0000 7feb82d97640 1 -- 10.20.193.57:0/2649337713 wait complete. 2026-02-20T16:29:43.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.860+0000 7f1c1d028640 1 -- 10.20.193.57:0/535847746 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f1c1806ec20 msgr2=0x7f1c1812ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:43.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.860+0000 7f1c1d028640 1 --2- 10.20.193.57:0/535847746 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f1c1806ec20 0x7f1c1812ebd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1c00009960 tx=0x7f1c0002f140 comp rx=0 tx=0).stop 2026-02-20T16:29:43.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.860+0000 7f1c1d028640 1 -- 10.20.193.57:0/535847746 shutdown_connections 2026-02-20T16:29:43.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.860+0000 7f1c1d028640 1 --2- 10.20.193.57:0/535847746 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f1c1806ec20 0x7f1c1812ebd0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:43.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.860+0000 7f1c1d028640 1 --2- 10.20.193.57:0/535847746 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f1c1806e300 0x7f1c1806e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:43.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.860+0000 7f1c1d028640 1 -- 10.20.193.57:0/535847746 >> 10.20.193.57:0/535847746 conn(0x7f1c1809f500 msgr2=0x7f1c1809f910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:43.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.860+0000 7f1c1d028640 1 -- 10.20.193.57:0/535847746 shutdown_connections 2026-02-20T16:29:43.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.860+0000 7f1c1d028640 1 -- 10.20.193.57:0/535847746 wait complete. 2026-02-20T16:29:43.865 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.860+0000 7f8bd29cb640 1 -- 10.20.193.57:0/1042919683 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8bcc06e300 msgr2=0x7f8bcc06e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:43.865 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.860+0000 7f8bd29cb640 1 --2- 10.20.193.57:0/1042919683 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8bcc06e300 0x7f8bcc06e6e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8009a00 tx=0x7f8bb802f1f0 comp rx=0 tx=0).stop 2026-02-20T16:29:43.865 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.860+0000 7f8bd29cb640 1 -- 10.20.193.57:0/1042919683 shutdown_connections 2026-02-20T16:29:43.865 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.860+0000 7f8bd29cb640 1 --2- 10.20.193.57:0/1042919683 >> v2:10.20.193.57:3300/0 conn(0x7f8bcc06ec20 0x7f8bcc12ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:43.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.860+0000 7f8bd29cb640 1 --2- 10.20.193.57:0/1042919683 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8bcc06e300 0x7f8bcc06e6e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:43.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.860+0000 7f8bd29cb640 1 -- 10.20.193.57:0/1042919683 >> 10.20.193.57:0/1042919683 conn(0x7f8bcc09f500 msgr2=0x7f8bcc09f910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:43.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.860+0000 7f8bd29cb640 1 -- 10.20.193.57:0/1042919683 shutdown_connections 2026-02-20T16:29:43.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.860+0000 7f8bd29cb640 1 -- 10.20.193.57:0/1042919683 wait complete. 2026-02-20T16:29:43.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.860+0000 7feb82d97640 1 Processor -- start 2026-02-20T16:29:43.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.860+0000 7feb82d97640 1 -- start start 2026-02-20T16:29:43.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7feb82d97640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7feb7c06e300 0x7feb7c12ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:43.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7feb82d97640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7feb7c06ec20 0x7feb7c130440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:43.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7feb82d97640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7feb7c12f110 0x7feb7c130980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:43.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7f1c1d028640 1 Processor -- start 2026-02-20T16:29:43.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7feb82d97640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7feb7c1379b0 con 0x7feb7c12f110 2026-02-20T16:29:43.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7feb82d97640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7feb7c137830 con 0x7feb7c06ec20 2026-02-20T16:29:43.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7feb82d97640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7feb7c137b30 con 0x7feb7c06e300 2026-02-20T16:29:43.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7f1c1d028640 1 -- start start 2026-02-20T16:29:43.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7feb73fff640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7feb7c06ec20 0x7feb7c130440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:43.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7feb80b0c640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7feb7c06e300 0x7feb7c12ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:43.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7feb8130d640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7feb7c12f110 0x7feb7c130980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:43.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7feb73fff640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7feb7c06ec20 0x7feb7c130440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3301/0 says I am v2:10.20.193.57:44888/0 (socket says 10.20.193.57:44888) 2026-02-20T16:29:43.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7feb73fff640 1 -- 10.20.193.57:0/3605118781 learned_addr learned my addr 10.20.193.57:0/3605118781 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:29:43.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7feb80b0c640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7feb7c06e300 0x7feb7c12ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3302/0 says I am v2:10.20.193.57:47522/0 (socket says 10.20.193.57:47522) 2026-02-20T16:29:43.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7feb8130d640 1 -- 10.20.193.57:0/3605118781 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7feb7c06e300 msgr2=0x7feb7c12ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:43.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7feb8130d640 1 --2- 10.20.193.57:0/3605118781 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7feb7c06e300 0x7feb7c12ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:43.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7feb8130d640 1 -- 10.20.193.57:0/3605118781 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7feb7c06ec20 msgr2=0x7feb7c130440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:43.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7feb8130d640 1 --2- 10.20.193.57:0/3605118781 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7feb7c06ec20 0x7feb7c130440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:43.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7feb8130d640 1 -- 10.20.193.57:0/3605118781 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb7c131860 con 0x7feb7c12f110 2026-02-20T16:29:43.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7feb73fff640 1 --2- 10.20.193.57:0/3605118781 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7feb7c06ec20 0x7feb7c130440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:29:43.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7feb8130d640 1 --2- 10.20.193.57:0/3605118781 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7feb7c12f110 0x7feb7c130980 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7feb7800caa0 tx=0x7feb7800cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:29:43.871 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7f1c1d028640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f1c1806e300 0x7f1c1812fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:43.871 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7f1c1d028640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f1c1806ec20 0x7f1c18130200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:43.871 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7f1c1d028640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f1c1812f110 0x7f1c18130740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:43.871 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7f1c1d028640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f1c18137a30 con 0x7f1c1806ec20 2026-02-20T16:29:43.871 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7f1c1d028640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f1c181378b0 con 0x7f1c1812f110 2026-02-20T16:29:43.871 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7f1c1d028640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f1c18137bb0 con 0x7f1c1806e300 2026-02-20T16:29:43.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7f8bd29cb640 1 Processor -- start 2026-02-20T16:29:43.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7f1c16d76640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f1c1806e300 0x7f1c1812fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:43.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7f8bd29cb640 1 -- start start 2026-02-20T16:29:43.873 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7feb717fa640 1 -- 10.20.193.57:0/3605118781 <== mon.0 v2:10.20.193.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb78016020 con 0x7feb7c12f110 2026-02-20T16:29:43.873 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7f1c16575640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f1c1806ec20 0x7f1c18130200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:43.873 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7f1c17577640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f1c1812f110 0x7f1c18130740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:43.874 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7f1c16d76640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f1c1806e300 0x7f1c1812fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3302/0 says I am v2:10.20.193.57:47536/0 (socket says 10.20.193.57:47536) 2026-02-20T16:29:43.874 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7f1c16d76640 1 -- 10.20.193.57:0/2545493584 learned_addr learned my addr 10.20.193.57:0/2545493584 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:29:43.874 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7feb717fa640 1 -- 10.20.193.57:0/3605118781 <== mon.0 v2:10.20.193.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb7800ad50 con 0x7feb7c12f110 2026-02-20T16:29:43.874 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7feb82d97640 1 -- 10.20.193.57:0/3605118781 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb7c130ec0 con 0x7feb7c12f110 2026-02-20T16:29:43.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7feb717fa640 1 -- 10.20.193.57:0/3605118781 <== mon.0 v2:10.20.193.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb78012680 con 0x7feb7c12f110 2026-02-20T16:29:43.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7feb82d97640 1 -- 10.20.193.57:0/3605118781 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb7c132b20 con 0x7feb7c12f110 2026-02-20T16:29:43.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7f1c16d76640 1 -- 10.20.193.57:0/2545493584 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f1c1812f110 msgr2=0x7f1c18130740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:43.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7f1c16d76640 1 --2- 10.20.193.57:0/2545493584 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f1c1812f110 0x7f1c18130740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:43.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7f1c16d76640 1 -- 10.20.193.57:0/2545493584 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f1c1806ec20 msgr2=0x7f1c18130200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:43.876 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7f1c16d76640 1 --2- 10.20.193.57:0/2545493584 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f1c1806ec20 0x7f1c18130200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:43.876 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7f1c16d76640 1 -- 10.20.193.57:0/2545493584 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c181312d0 con 0x7f1c1806e300 2026-02-20T16:29:43.876 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7f1c16d76640 1 --2- 10.20.193.57:0/2545493584 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f1c1806e300 0x7f1c1812fcc0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c0027e0 tx=0x7f1c0c002cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:29:43.876 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7f8bd29cb640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f8bcc06e300 0x7f8bcc12ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:43.877 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7f8bd29cb640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8bcc06ec20 0x7f8bcc130470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:43.877 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7f8bd29cb640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8bcc12f110 0x7f8bcc1309b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:43.877 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7f8bd29cb640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f8bcc137a30 con 0x7f8bcc06e300 2026-02-20T16:29:43.877 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7f8bd29cb640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f8bcc1378b0 con 0x7f8bcc06ec20 2026-02-20T16:29:43.877 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7f8bd29cb640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f8bcc137bb0 con 0x7f8bcc12f110 2026-02-20T16:29:43.877 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7f1bf77fe640 1 -- 10.20.193.57:0/2545493584 <== mon.2 v2:10.20.193.57:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c00ed40 con 0x7f1c1806e300 2026-02-20T16:29:43.878 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7f8bcb7fe640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8bcc06ec20 0x7f8bcc130470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:43.878 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7f8bcb7fe640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8bcc06ec20 0x7f8bcc130470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3301/0 says I am v2:10.20.193.57:44918/0 (socket says 10.20.193.57:44918) 2026-02-20T16:29:43.878 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7f8bcb7fe640 1 -- 10.20.193.57:0/1257451047 learned_addr learned my addr 10.20.193.57:0/1257451047 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:29:43.878 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7f8bd0f41640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8bcc12f110 0x7f8bcc1309b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:43.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7f1c1d028640 1 -- 10.20.193.57:0/2545493584 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c18132390 con 0x7f1c1806e300 2026-02-20T16:29:43.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7f1bf77fe640 1 -- 10.20.193.57:0/2545493584 <== mon.2 v2:10.20.193.57:3302/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1c0c010430 con 0x7f1c1806e300 2026-02-20T16:29:43.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7f1bf77fe640 1 -- 10.20.193.57:0/2545493584 <== mon.2 v2:10.20.193.57:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c010880 con 0x7f1c1806e300 2026-02-20T16:29:43.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.861+0000 7f1c1d028640 1 -- 10.20.193.57:0/2545493584 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c18073780 con 0x7f1c1806e300 2026-02-20T16:29:43.880 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.862+0000 7f8bcb7fe640 1 -- 10.20.193.57:0/1257451047 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8bcc12f110 msgr2=0x7f8bcc1309b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:43.880 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.862+0000 7f8bcb7fe640 1 --2- 10.20.193.57:0/1257451047 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8bcc12f110 0x7f8bcc1309b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:43.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.862+0000 7f8bcb7fe640 1 -- 10.20.193.57:0/1257451047 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f8bcc06e300 msgr2=0x7f8bcc12ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:43.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.862+0000 7f8bcbfff640 1 --2- 10.20.193.57:0/1257451047 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f8bcc06e300 0x7f8bcc12ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:43.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.862+0000 7f8bcb7fe640 1 --2- 10.20.193.57:0/1257451047 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f8bcc06e300 0x7f8bcc12ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:43.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.862+0000 7f8bcb7fe640 1 -- 10.20.193.57:0/1257451047 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bcc131e60 con 0x7f8bcc06ec20 2026-02-20T16:29:43.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.862+0000 7f8bcbfff640 1 --2- 10.20.193.57:0/1257451047 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f8bcc06e300 0x7f8bcc12ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T16:29:43.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.862+0000 7feb82d97640 1 -- 10.20.193.57:0/3605118781 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb7c06e6e0 con 0x7feb7c12f110 2026-02-20T16:29:43.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.862+0000 7f8bcb7fe640 1 --2- 10.20.193.57:0/1257451047 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8bcc06ec20 0x7f8bcc130470 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc00ea10 tx=0x7f8bbc00eee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:29:43.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.862+0000 7f8bc8ff9640 1 -- 10.20.193.57:0/1257451047 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc00ce50 con 0x7f8bcc06ec20 2026-02-20T16:29:43.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.862+0000 7f8bc8ff9640 1 -- 10.20.193.57:0/1257451047 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8bbc0040d0 con 0x7f8bcc06ec20 2026-02-20T16:29:43.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.862+0000 7f8bc8ff9640 1 -- 10.20.193.57:0/1257451047 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc0044e0 con 0x7f8bcc06ec20 2026-02-20T16:29:43.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.862+0000 7f8bd29cb640 1 -- 10.20.193.57:0/1257451047 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bcc130ef0 con 0x7f8bcc06ec20 2026-02-20T16:29:43.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.862+0000 7f8bd29cb640 1 -- 10.20.193.57:0/1257451047 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bcc132760 con 0x7f8bcc06ec20 2026-02-20T16:29:43.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.862+0000 7f1c1d028640 1 -- 10.20.193.57:0/2545493584 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c1806e6e0 con 0x7f1c1806e300 2026-02-20T16:29:43.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.862+0000 7feb717fa640 1 -- 10.20.193.57:0/3605118781 <== mon.0 v2:10.20.193.57:3300/0 4 ==== mgrmap(e 5) ==== 62057+0+0 (secure 0 0 0) 0x7feb78012820 con 0x7feb7c12f110 2026-02-20T16:29:43.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.862+0000 7feb717fa640 1 -- 10.20.193.57:0/3605118781 <== mon.0 v2:10.20.193.57:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2861+0+0 (secure 0 0 0) 0x7feb78067000 con 0x7feb7c12f110 2026-02-20T16:29:43.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.862+0000 7f1bf77fe640 1 -- 10.20.193.57:0/2545493584 <== mon.2 v2:10.20.193.57:3302/0 4 ==== mgrmap(e 5) ==== 62057+0+0 (secure 0 0 0) 0x7f1c0c010a20 con 0x7f1c1806e300 2026-02-20T16:29:43.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.862+0000 7f8bd29cb640 1 -- 10.20.193.57:0/1257451047 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bcc12ddc0 con 0x7f8bcc06ec20 2026-02-20T16:29:43.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.863+0000 7f1bf77fe640 1 -- 10.20.193.57:0/2545493584 <== mon.2 v2:10.20.193.57:3302/0 5 ==== osd_map(17..17 src has 1..17) ==== 2861+0+0 (secure 0 0 0) 0x7f1c0c0677e0 con 0x7f1c1806e300 2026-02-20T16:29:43.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.863+0000 7f8bc8ff9640 1 -- 10.20.193.57:0/1257451047 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 5) ==== 62057+0+0 (secure 0 0 0) 0x7f8bbc0026e0 con 0x7f8bcc06ec20 2026-02-20T16:29:43.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.863+0000 7f8bc8ff9640 1 -- 10.20.193.57:0/1257451047 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 2861+0+0 (secure 0 0 0) 0x7f8bbc0675c0 con 0x7f8bcc06ec20 2026-02-20T16:29:43.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.865+0000 7f8bc8ff9640 1 -- 10.20.193.57:0/1257451047 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f8bcc12ddc0 con 0x7f8bcc06ec20 2026-02-20T16:29:43.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.865+0000 7feb717fa640 1 -- 10.20.193.57:0/3605118781 <== mon.0 v2:10.20.193.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7feb78020030 con 0x7feb7c12f110 2026-02-20T16:29:43.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.866+0000 7f1bf77fe640 1 -- 10.20.193.57:0/2545493584 <== mon.2 v2:10.20.193.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f1c0c014070 con 0x7f1c1806e300 2026-02-20T16:29:43.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.901+0000 7fcc735a5640 1 -- 10.20.193.57:0/4049241991 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fcc6c095070 msgr2=0x7fcc6c1341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:43.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.901+0000 7fcc735a5640 1 --2- 10.20.193.57:0/4049241991 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fcc6c095070 0x7fcc6c1341d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcc60009930 tx=0x7fcc6002f1a0 comp rx=0 tx=0).stop 2026-02-20T16:29:43.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.901+0000 7fcc735a5640 1 -- 10.20.193.57:0/4049241991 shutdown_connections 2026-02-20T16:29:43.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.901+0000 7fcc735a5640 1 --2- 10.20.193.57:0/4049241991 >> v2:10.20.193.57:3300/0 conn(0x7fcc6c134710 0x7fcc6c136b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:43.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.901+0000 7fcc735a5640 1 --2- 10.20.193.57:0/4049241991 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fcc6c095070 0x7fcc6c1341d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:43.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.901+0000 7fcc735a5640 1 -- 10.20.193.57:0/4049241991 >> 10.20.193.57:0/4049241991 conn(0x7fcc6c09a170 msgr2=0x7fcc6c097a10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:43.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.901+0000 7fcc735a5640 1 -- 10.20.193.57:0/4049241991 shutdown_connections 2026-02-20T16:29:43.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.901+0000 7fcc735a5640 1 -- 10.20.193.57:0/4049241991 wait complete. 2026-02-20T16:29:43.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.901+0000 7fcc735a5640 1 Processor -- start 2026-02-20T16:29:43.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.902+0000 7fcc735a5640 1 -- start start 2026-02-20T16:29:43.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.902+0000 7fcc735a5640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fcc6c094580 0x7fcc6c1220d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:43.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.902+0000 7fcc735a5640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fcc6c095070 0x7fcc6c122610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:43.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.902+0000 7fcc735a5640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fcc6c134710 0x7fcc6c122b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:43.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.902+0000 7fcc735a5640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7fcc6c137980 con 0x7fcc6c094580 2026-02-20T16:29:43.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.902+0000 7fcc735a5640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7fcc6c137800 con 0x7fcc6c095070 2026-02-20T16:29:43.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.902+0000 7fcc735a5640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7fcc6c137b00 con 0x7fcc6c134710 2026-02-20T16:29:43.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.902+0000 7fcc7131a640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fcc6c094580 0x7fcc6c1220d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:43.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.902+0000 7fcc70b19640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fcc6c095070 0x7fcc6c122610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:43.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.902+0000 7fcc7131a640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fcc6c094580 0x7fcc6c1220d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:38940/0 (socket says 10.20.193.57:38940) 2026-02-20T16:29:43.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.902+0000 7fcc7131a640 1 -- 10.20.193.57:0/2599250342 learned_addr learned my addr 10.20.193.57:0/2599250342 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:29:43.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.902+0000 7fcc71b1b640 1 --2- 10.20.193.57:0/2599250342 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fcc6c134710 0x7fcc6c122b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:43.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.902+0000 7fcc70b19640 1 -- 10.20.193.57:0/2599250342 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fcc6c134710 msgr2=0x7fcc6c122b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:43.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.902+0000 7fcc70b19640 1 --2- 10.20.193.57:0/2599250342 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fcc6c134710 0x7fcc6c122b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:43.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.902+0000 7fcc70b19640 1 -- 10.20.193.57:0/2599250342 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fcc6c094580 msgr2=0x7fcc6c1220d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:43.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.902+0000 7fcc70b19640 1 --2- 10.20.193.57:0/2599250342 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fcc6c094580 0x7fcc6c1220d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:43.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.902+0000 7fcc70b19640 1 -- 10.20.193.57:0/2599250342 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc6c124a30 con 0x7fcc6c095070 2026-02-20T16:29:43.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.902+0000 7fcc71b1b640 1 --2- 10.20.193.57:0/2599250342 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fcc6c134710 0x7fcc6c122b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T16:29:43.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.902+0000 7fcc7131a640 1 --2- 10.20.193.57:0/2599250342 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fcc6c094580 0x7fcc6c1220d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:29:43.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.902+0000 7fcc70b19640 1 --2- 10.20.193.57:0/2599250342 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fcc6c095070 0x7fcc6c122610 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c099570 tx=0x7fcc60002910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:29:43.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.902+0000 7fcc59ffb640 1 -- 10.20.193.57:0/2599250342 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc60005d90 con 0x7fcc6c095070 2026-02-20T16:29:43.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.902+0000 7fcc59ffb640 1 -- 10.20.193.57:0/2599250342 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcc60002d10 con 0x7fcc6c095070 2026-02-20T16:29:43.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.902+0000 7fcc59ffb640 1 -- 10.20.193.57:0/2599250342 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc60004b00 con 0x7fcc6c095070 2026-02-20T16:29:43.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.902+0000 7fcc735a5640 1 -- 10.20.193.57:0/2599250342 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc6c1238e0 con 0x7fcc6c095070 2026-02-20T16:29:43.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.902+0000 7fcc735a5640 1 -- 10.20.193.57:0/2599250342 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc6c123090 con 0x7fcc6c095070 2026-02-20T16:29:43.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.903+0000 7fcc735a5640 1 -- 10.20.193.57:0/2599250342 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc6c094960 con 0x7fcc6c095070 2026-02-20T16:29:43.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.903+0000 7fcc59ffb640 1 -- 10.20.193.57:0/2599250342 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 5) ==== 62057+0+0 (secure 0 0 0) 0x7fcc60038470 con 0x7fcc6c095070 2026-02-20T16:29:43.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.903+0000 7fcc59ffb640 1 -- 10.20.193.57:0/2599250342 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 2861+0+0 (secure 0 0 0) 0x7fcc6008b490 con 0x7fcc6c095070 2026-02-20T16:29:43.909 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.905+0000 7fcc59ffb640 1 -- 10.20.193.57:0/2599250342 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7fcc60065230 con 0x7fcc6c095070 2026-02-20T16:29:43.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.934+0000 7feb82d97640 1 -- 10.20.193.57:0/3605118781 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7feb7c050a10 con 0x7feb7c12f110 2026-02-20T16:29:43.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.934+0000 7feb717fa640 1 -- 10.20.193.57:0/3605118781 <== mon.0 v2:10.20.193.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7feb78040ea0 con 0x7feb7c12f110 2026-02-20T16:29:43.936 INFO:teuthology.orchestra.run.trial057.stdout:42949672962 2026-02-20T16:29:43.937 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.935+0000 7feb82d97640 1 -- 10.20.193.57:0/3605118781 >> v1:10.20.193.57:6800/4138285113 conn(0x7feb4c04f790 legacy=0x7feb4c051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:43.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.936+0000 7feb82d97640 1 -- 10.20.193.57:0/3605118781 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7feb7c12f110 msgr2=0x7feb7c130980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:43.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.936+0000 7feb82d97640 1 --2- 10.20.193.57:0/3605118781 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7feb7c12f110 0x7feb7c130980 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7feb7800caa0 tx=0x7feb7800cf70 comp rx=0 tx=0).stop 2026-02-20T16:29:43.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.936+0000 7feb82d97640 1 -- 10.20.193.57:0/3605118781 shutdown_connections 2026-02-20T16:29:43.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.936+0000 7feb82d97640 1 --2- 10.20.193.57:0/3605118781 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7feb7c12f110 0x7feb7c130980 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:43.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.936+0000 7feb82d97640 1 --2- 10.20.193.57:0/3605118781 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7feb7c06ec20 0x7feb7c130440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:43.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.936+0000 7feb82d97640 1 --2- 10.20.193.57:0/3605118781 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7feb7c06e300 0x7feb7c12ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:43.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.936+0000 7feb82d97640 1 -- 10.20.193.57:0/3605118781 >> 10.20.193.57:0/3605118781 conn(0x7feb7c09f500 msgr2=0x7feb7c1284f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:43.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.936+0000 7feb82d97640 1 -- 10.20.193.57:0/3605118781 shutdown_connections 2026-02-20T16:29:43.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.936+0000 7feb82d97640 1 -- 10.20.193.57:0/3605118781 wait complete. 2026-02-20T16:29:43.939 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.936+0000 7f8bd29cb640 1 -- 10.20.193.57:0/1257451047 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f8bcc1314c0 con 0x7f8bcc06ec20 2026-02-20T16:29:43.939 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.936+0000 7f8bc8ff9640 1 -- 10.20.193.57:0/1257451047 <== mon.1 v2:10.20.193.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8bbc041460 con 0x7f8bcc06ec20 2026-02-20T16:29:43.939 INFO:teuthology.orchestra.run.trial057.stdout:42949672962 2026-02-20T16:29:43.940 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.937+0000 7f8bd29cb640 1 -- 10.20.193.57:0/1257451047 >> v1:10.20.193.57:6800/4138285113 conn(0x7f8b9c04f930 legacy=0x7f8b9c051df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:43.940 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.937+0000 7f8bd29cb640 1 -- 10.20.193.57:0/1257451047 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8bcc06ec20 msgr2=0x7f8bcc130470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:43.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.937+0000 7f8bd29cb640 1 --2- 10.20.193.57:0/1257451047 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8bcc06ec20 0x7f8bcc130470 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc00ea10 tx=0x7f8bbc00eee0 comp rx=0 tx=0).stop 2026-02-20T16:29:43.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.937+0000 7f8bd29cb640 1 -- 10.20.193.57:0/1257451047 shutdown_connections 2026-02-20T16:29:43.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.937+0000 7f8bd29cb640 1 --2- 10.20.193.57:0/1257451047 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8bcc12f110 0x7f8bcc1309b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:43.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.937+0000 7f8bd29cb640 1 --2- 10.20.193.57:0/1257451047 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8bcc06ec20 0x7f8bcc130470 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:43.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.937+0000 7f8bd29cb640 1 --2- 10.20.193.57:0/1257451047 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f8bcc06e300 0x7f8bcc12ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:43.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.937+0000 7f8bd29cb640 1 -- 10.20.193.57:0/1257451047 >> 10.20.193.57:0/1257451047 conn(0x7f8bcc09f500 msgr2=0x7f8bcc09c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:43.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.937+0000 7f8bd29cb640 1 -- 10.20.193.57:0/1257451047 shutdown_connections 2026-02-20T16:29:43.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.938+0000 7f8bd29cb640 1 -- 10.20.193.57:0/1257451047 wait complete. 2026-02-20T16:29:43.942 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.941+0000 7f1c1d028640 1 -- 10.20.193.57:0/2545493584 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f1c18050a10 con 0x7f1c1806e300 2026-02-20T16:29:43.942 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.941+0000 7f1bf77fe640 1 -- 10.20.193.57:0/2545493584 <== mon.2 v2:10.20.193.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1c0c041600 con 0x7f1c1806e300 2026-02-20T16:29:43.943 INFO:teuthology.orchestra.run.trial057.stdout:38654705666 2026-02-20T16:29:43.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.942+0000 7f1c1d028640 1 -- 10.20.193.57:0/2545493584 >> v1:10.20.193.57:6800/4138285113 conn(0x7f1be404f790 legacy=0x7f1be4051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:43.945 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.942+0000 7f1c1d028640 1 -- 10.20.193.57:0/2545493584 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f1c1806e300 msgr2=0x7f1c1812fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:43.945 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.942+0000 7f1c1d028640 1 --2- 10.20.193.57:0/2545493584 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f1c1806e300 0x7f1c1812fcc0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c0027e0 tx=0x7f1c0c002cb0 comp rx=0 tx=0).stop 2026-02-20T16:29:43.945 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.943+0000 7f1c1d028640 1 -- 10.20.193.57:0/2545493584 shutdown_connections 2026-02-20T16:29:43.945 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.943+0000 7f1c1d028640 1 --2- 10.20.193.57:0/2545493584 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f1c1812f110 0x7f1c18130740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:43.945 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.943+0000 7f1c1d028640 1 --2- 10.20.193.57:0/2545493584 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f1c1806ec20 0x7f1c18130200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:43.945 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.943+0000 7f1c1d028640 1 --2- 10.20.193.57:0/2545493584 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f1c1806e300 0x7f1c1812fcc0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:43.945 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.943+0000 7f1c1d028640 1 -- 10.20.193.57:0/2545493584 >> 10.20.193.57:0/2545493584 conn(0x7f1c1809f500 msgr2=0x7f1c18128c50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:43.945 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.943+0000 7f1c1d028640 1 -- 10.20.193.57:0/2545493584 shutdown_connections 2026-02-20T16:29:43.945 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.943+0000 7f1c1d028640 1 -- 10.20.193.57:0/2545493584 wait complete. 2026-02-20T16:29:43.947 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672963 got 42949672962 for osd.2 2026-02-20T16:29:43.948 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672963 got 42949672962 for osd.1 2026-02-20T16:29:43.953 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705666 for osd.0 2026-02-20T16:29:43.979 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.977+0000 7fcc735a5640 1 -- 10.20.193.57:0/2599250342 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fcc6c0008d0 con 0x7fcc6c095070 2026-02-20T16:29:43.979 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.977+0000 7fcc59ffb640 1 -- 10.20.193.57:0/2599250342 <== mon.1 v2:10.20.193.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcc6008a550 con 0x7fcc6c095070 2026-02-20T16:29:43.979 INFO:teuthology.orchestra.run.trial057.stdout:42949672962 2026-02-20T16:29:43.980 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.978+0000 7fcc735a5640 1 -- 10.20.193.57:0/2599250342 >> v1:10.20.193.57:6800/4138285113 conn(0x7fcc3c04f790 legacy=0x7fcc3c051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:43.980 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.978+0000 7fcc735a5640 1 -- 10.20.193.57:0/2599250342 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fcc6c095070 msgr2=0x7fcc6c122610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:43.981 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.978+0000 7fcc735a5640 1 --2- 10.20.193.57:0/2599250342 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fcc6c095070 0x7fcc6c122610 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c099570 tx=0x7fcc60002910 comp rx=0 tx=0).stop 2026-02-20T16:29:43.981 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.978+0000 7fcc735a5640 1 -- 10.20.193.57:0/2599250342 shutdown_connections 2026-02-20T16:29:43.981 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.978+0000 7fcc735a5640 1 --2- 10.20.193.57:0/2599250342 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fcc6c134710 0x7fcc6c122b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:43.981 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.978+0000 7fcc735a5640 1 --2- 10.20.193.57:0/2599250342 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fcc6c095070 0x7fcc6c122610 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:43.981 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.978+0000 7fcc735a5640 1 --2- 10.20.193.57:0/2599250342 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fcc6c094580 0x7fcc6c1220d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:43.981 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.978+0000 7fcc735a5640 1 -- 10.20.193.57:0/2599250342 >> 10.20.193.57:0/2599250342 conn(0x7fcc6c09a170 msgr2=0x7fcc6c136790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:43.981 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.978+0000 7fcc735a5640 1 -- 10.20.193.57:0/2599250342 shutdown_connections 2026-02-20T16:29:43.981 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:43.978+0000 7fcc735a5640 1 -- 10.20.193.57:0/2599250342 wait complete. 2026-02-20T16:29:43.988 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672963 got 42949672962 for osd.3 2026-02-20T16:29:44.947 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-20T16:29:44.949 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-20T16:29:44.954 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-20T16:29:44.989 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-20T16:29:45.018 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.015+0000 7f44df9f3640 1 -- 10.20.193.57:0/4170090227 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f44d812b640 msgr2=0x7f44d812ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:45.018 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.015+0000 7f44df9f3640 1 --2- 10.20.193.57:0/4170090227 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f44d812b640 0x7f44d812ba80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f44cc009a60 tx=0x7f44cc02f260 comp rx=0 tx=0).stop 2026-02-20T16:29:45.018 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.016+0000 7f44df9f3640 1 -- 10.20.193.57:0/4170090227 shutdown_connections 2026-02-20T16:29:45.018 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.016+0000 7f44df9f3640 1 --2- 10.20.193.57:0/4170090227 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f44d812b640 0x7f44d812ba80 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.018 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.016+0000 7f44df9f3640 1 --2- 10.20.193.57:0/4170090227 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f44d8128510 0x7f44d81288f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.018 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.016+0000 7f44df9f3640 1 -- 10.20.193.57:0/4170090227 >> 10.20.193.57:0/4170090227 conn(0x7f44d809dd20 msgr2=0x7f44d809e130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:45.018 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.016+0000 7f44df9f3640 1 -- 10.20.193.57:0/4170090227 shutdown_connections 2026-02-20T16:29:45.018 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.016+0000 7f44df9f3640 1 -- 10.20.193.57:0/4170090227 wait complete. 2026-02-20T16:29:45.018 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.016+0000 7f44df9f3640 1 Processor -- start 2026-02-20T16:29:45.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.016+0000 7f44df9f3640 1 -- start start 2026-02-20T16:29:45.021 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.016+0000 7f44df9f3640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f44d8128510 0x7f44d81c4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:45.021 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.016+0000 7f44df9f3640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f44d812b640 0x7f44d81c51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:45.021 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.016+0000 7f44df9f3640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f44d812bfc0 0x7f44d8130300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:45.021 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.016+0000 7f44df9f3640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f44d81345e0 con 0x7f44d812b640 2026-02-20T16:29:45.021 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.016+0000 7f44df9f3640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f44d8134460 con 0x7f44d8128510 2026-02-20T16:29:45.021 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.016+0000 7f44df9f3640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f44d8134760 con 0x7f44d812bfc0 2026-02-20T16:29:45.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.017+0000 7f44dd768640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f44d8128510 0x7f44d81c4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:45.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.017+0000 7f44dcf67640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f44d812b640 0x7f44d81c51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:45.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.017+0000 7f44ddf69640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f44d812bfc0 0x7f44d8130300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:45.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.017+0000 7f44dcf67640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f44d812b640 0x7f44d81c51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:38952/0 (socket says 10.20.193.57:38952) 2026-02-20T16:29:45.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.017+0000 7f44dd768640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f44d8128510 0x7f44d81c4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3301/0 says I am v2:10.20.193.57:44976/0 (socket says 10.20.193.57:44976) 2026-02-20T16:29:45.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.017+0000 7f44dcf67640 1 -- 10.20.193.57:0/93380343 learned_addr learned my addr 10.20.193.57:0/93380343 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:29:45.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.017+0000 7f44dcf67640 1 -- 10.20.193.57:0/93380343 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f44d812bfc0 msgr2=0x7f44d8130300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:45.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.017+0000 7f44dcf67640 1 --2- 10.20.193.57:0/93380343 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f44d812bfc0 0x7f44d8130300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.017+0000 7f44dcf67640 1 -- 10.20.193.57:0/93380343 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f44d8128510 msgr2=0x7f44d81c4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:45.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.017+0000 7f44dcf67640 1 --2- 10.20.193.57:0/93380343 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f44d8128510 0x7f44d81c4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.017+0000 7f44dcf67640 1 -- 10.20.193.57:0/93380343 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44d8131e70 con 0x7f44d812b640 2026-02-20T16:29:45.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.017+0000 7f44dcf67640 1 --2- 10.20.193.57:0/93380343 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f44d812b640 0x7f44d81c51d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f44cc02f770 tx=0x7f44cc002910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:29:45.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.017+0000 7f44c5ffb640 1 -- 10.20.193.57:0/93380343 <== mon.0 v2:10.20.193.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44cc004570 con 0x7f44d812b640 2026-02-20T16:29:45.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.017+0000 7f44c5ffb640 1 -- 10.20.193.57:0/93380343 <== mon.0 v2:10.20.193.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f44cc002d10 con 0x7f44d812b640 2026-02-20T16:29:45.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.017+0000 7f44df9f3640 1 -- 10.20.193.57:0/93380343 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44d8133140 con 0x7f44d812b640 2026-02-20T16:29:45.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.017+0000 7f44c5ffb640 1 -- 10.20.193.57:0/93380343 <== mon.0 v2:10.20.193.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44cc004b00 con 0x7f44d812b640 2026-02-20T16:29:45.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.017+0000 7f44df9f3640 1 -- 10.20.193.57:0/93380343 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44d8132630 con 0x7f44d812b640 2026-02-20T16:29:45.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.018+0000 7f44df9f3640 1 -- 10.20.193.57:0/93380343 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44d81288f0 con 0x7f44d812b640 2026-02-20T16:29:45.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.018+0000 7f44c5ffb640 1 -- 10.20.193.57:0/93380343 <== mon.0 v2:10.20.193.57:3300/0 4 ==== mgrmap(e 5) ==== 62057+0+0 (secure 0 0 0) 0x7f44cc04a030 con 0x7f44d812b640 2026-02-20T16:29:45.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.018+0000 7f44c5ffb640 1 -- 10.20.193.57:0/93380343 <== mon.0 v2:10.20.193.57:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2861+0+0 (secure 0 0 0) 0x7f44cc08b4c0 con 0x7f44d812b640 2026-02-20T16:29:45.026 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.019+0000 7f9a8854c640 1 -- 10.20.193.57:0/393243720 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f9a80132470 msgr2=0x7f9a80134860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:45.026 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.019+0000 7f9a8854c640 1 --2- 10.20.193.57:0/393243720 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f9a80132470 0x7f9a80134860 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c009f60 tx=0x7f9a7c02f330 comp rx=0 tx=0).stop 2026-02-20T16:29:45.026 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.019+0000 7f9a8854c640 1 -- 10.20.193.57:0/393243720 shutdown_connections 2026-02-20T16:29:45.026 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.019+0000 7f9a8854c640 1 --2- 10.20.193.57:0/393243720 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f9a80132470 0x7f9a80134860 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.026 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.019+0000 7f9a8854c640 1 --2- 10.20.193.57:0/393243720 >> v2:10.20.193.57:3300/0 conn(0x7f9a8012fb40 0x7f9a80131f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.026 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.019+0000 7f9a8854c640 1 -- 10.20.193.57:0/393243720 >> 10.20.193.57:0/393243720 conn(0x7f9a8009bd20 msgr2=0x7f9a8009c130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:45.026 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.019+0000 7f9a8854c640 1 -- 10.20.193.57:0/393243720 shutdown_connections 2026-02-20T16:29:45.026 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.019+0000 7f9a8854c640 1 -- 10.20.193.57:0/393243720 wait complete. 2026-02-20T16:29:45.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.019+0000 7f9a8854c640 1 Processor -- start 2026-02-20T16:29:45.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.020+0000 7f9a8854c640 1 -- start start 2026-02-20T16:29:45.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.020+0000 7f9a8854c640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f9a800715c0 0x7f9a801c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:45.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.020+0000 7f9a8854c640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f9a8012fb40 0x7f9a801c71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:45.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.020+0000 7f9a8854c640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f9a80132470 0x7f9a8012a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:45.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.020+0000 7f9a8854c640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f9a80135640 con 0x7f9a8012fb40 2026-02-20T16:29:45.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.020+0000 7f9a8854c640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f9a801354c0 con 0x7f9a800715c0 2026-02-20T16:29:45.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.020+0000 7f9a8854c640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f9a801357c0 con 0x7f9a80132470 2026-02-20T16:29:45.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.020+0000 7f9a86ac2640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f9a80132470 0x7f9a8012a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:45.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.020+0000 7f9a862c1640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f9a800715c0 0x7f9a801c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:45.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.020+0000 7f9a86ac2640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f9a80132470 0x7f9a8012a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3302/0 says I am v2:10.20.193.57:47584/0 (socket says 10.20.193.57:47584) 2026-02-20T16:29:45.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.020+0000 7f9a85ac0640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f9a8012fb40 0x7f9a801c71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:45.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.020+0000 7f9a86ac2640 1 -- 10.20.193.57:0/2664088306 learned_addr learned my addr 10.20.193.57:0/2664088306 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:29:45.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.020+0000 7f9a86ac2640 1 -- 10.20.193.57:0/2664088306 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f9a800715c0 msgr2=0x7f9a801c6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:45.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.020+0000 7f9a86ac2640 1 --2- 10.20.193.57:0/2664088306 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f9a800715c0 0x7f9a801c6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.020+0000 7f9a86ac2640 1 -- 10.20.193.57:0/2664088306 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f9a8012fb40 msgr2=0x7f9a801c71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:45.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.020+0000 7f9a86ac2640 1 --2- 10.20.193.57:0/2664088306 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f9a8012fb40 0x7f9a801c71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.020+0000 7f9a86ac2640 1 -- 10.20.193.57:0/2664088306 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a80073e70 con 0x7f9a80132470 2026-02-20T16:29:45.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.020+0000 7f9a86ac2640 1 --2- 10.20.193.57:0/2664088306 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f9a80132470 0x7f9a8012a630 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c00b150 tx=0x7f9a7c004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:29:45.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.020+0000 7f9a66ffd640 1 -- 10.20.193.57:0/2664088306 <== mon.2 v2:10.20.193.57:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a7c047070 con 0x7f9a80132470 2026-02-20T16:29:45.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.020+0000 7f9a66ffd640 1 -- 10.20.193.57:0/2664088306 <== mon.2 v2:10.20.193.57:3302/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a7c009360 con 0x7f9a80132470 2026-02-20T16:29:45.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.020+0000 7f9a8854c640 1 -- 10.20.193.57:0/2664088306 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a8012c700 con 0x7f9a80132470 2026-02-20T16:29:45.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.020+0000 7f9a66ffd640 1 -- 10.20.193.57:0/2664088306 <== mon.2 v2:10.20.193.57:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a7c0046c0 con 0x7f9a80132470 2026-02-20T16:29:45.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.020+0000 7f9a8854c640 1 -- 10.20.193.57:0/2664088306 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a8012cf90 con 0x7f9a80132470 2026-02-20T16:29:45.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.021+0000 7f44c5ffb640 1 -- 10.20.193.57:0/93380343 <== mon.0 v2:10.20.193.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f44cc065480 con 0x7f44d812b640 2026-02-20T16:29:45.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.021+0000 7f9a8854c640 1 -- 10.20.193.57:0/2664088306 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a8012d1f0 con 0x7f9a80132470 2026-02-20T16:29:45.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.021+0000 7f9a66ffd640 1 -- 10.20.193.57:0/2664088306 <== mon.2 v2:10.20.193.57:3302/0 4 ==== mgrmap(e 5) ==== 62057+0+0 (secure 0 0 0) 0x7f9a7c007420 con 0x7f9a80132470 2026-02-20T16:29:45.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.021+0000 7f9a66ffd640 1 -- 10.20.193.57:0/2664088306 <== mon.2 v2:10.20.193.57:3302/0 5 ==== osd_map(17..17 src has 1..17) ==== 2861+0+0 (secure 0 0 0) 0x7f9a7c08b910 con 0x7f9a80132470 2026-02-20T16:29:45.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.024+0000 7f9a66ffd640 1 -- 10.20.193.57:0/2664088306 <== mon.2 v2:10.20.193.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f9a80073e70 con 0x7f9a80132470 2026-02-20T16:29:45.062 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.060+0000 7f12c0f53640 1 -- 10.20.193.57:0/903552454 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f12bc0938c0 msgr2=0x7f12bc093ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:45.062 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.060+0000 7f12c0f53640 1 --2- 10.20.193.57:0/903552454 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f12bc0938c0 0x7f12bc093ca0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f12b0009a00 tx=0x7f12b002f280 comp rx=0 tx=0).stop 2026-02-20T16:29:45.062 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.060+0000 7f12c0f53640 1 -- 10.20.193.57:0/903552454 shutdown_connections 2026-02-20T16:29:45.062 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.060+0000 7f12c0f53640 1 --2- 10.20.193.57:0/903552454 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f12bc095100 0x7f12bc134af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.062 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.060+0000 7f12c0f53640 1 --2- 10.20.193.57:0/903552454 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f12bc0938c0 0x7f12bc093ca0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.063 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.060+0000 7f12c0f53640 1 -- 10.20.193.57:0/903552454 >> 10.20.193.57:0/903552454 conn(0x7f12bc09a170 msgr2=0x7f12bc097a10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:45.063 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.060+0000 7f12c0f53640 1 -- 10.20.193.57:0/903552454 shutdown_connections 2026-02-20T16:29:45.063 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.060+0000 7f12c0f53640 1 -- 10.20.193.57:0/903552454 wait complete. 2026-02-20T16:29:45.063 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.060+0000 7fdc2c38d640 1 -- 10.20.193.57:0/4149662010 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fdc2406ec20 msgr2=0x7fdc2412ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:45.064 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.060+0000 7fdc2c38d640 1 --2- 10.20.193.57:0/4149662010 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fdc2406ec20 0x7fdc2412ebd0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdc18009930 tx=0x7fdc1802f110 comp rx=0 tx=0).stop 2026-02-20T16:29:45.064 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.060+0000 7fdc2c38d640 1 -- 10.20.193.57:0/4149662010 shutdown_connections 2026-02-20T16:29:45.064 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.060+0000 7fdc2c38d640 1 --2- 10.20.193.57:0/4149662010 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fdc2406ec20 0x7fdc2412ebd0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.064 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.060+0000 7fdc2c38d640 1 --2- 10.20.193.57:0/4149662010 >> v2:10.20.193.57:3300/0 conn(0x7fdc2406e300 0x7fdc2406e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.064 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.060+0000 7fdc2c38d640 1 -- 10.20.193.57:0/4149662010 >> 10.20.193.57:0/4149662010 conn(0x7fdc2409f500 msgr2=0x7fdc2409f910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:45.064 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.060+0000 7fdc2c38d640 1 -- 10.20.193.57:0/4149662010 shutdown_connections 2026-02-20T16:29:45.064 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.060+0000 7fdc2c38d640 1 -- 10.20.193.57:0/4149662010 wait complete. 2026-02-20T16:29:45.065 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.061+0000 7f12c0f53640 1 Processor -- start 2026-02-20T16:29:45.066 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.061+0000 7f12c0f53640 1 -- start start 2026-02-20T16:29:45.066 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.061+0000 7f12c0f53640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f12bc0938c0 0x7f12bc08c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:45.066 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.061+0000 7f12c0f53640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f12bc094580 0x7f12bc08c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:45.066 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.061+0000 7f12c0f53640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f12bc095100 0x7f12bc08ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:45.066 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.061+0000 7f12c0f53640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f12bc1355b0 con 0x7f12bc0938c0 2026-02-20T16:29:45.066 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.061+0000 7f12c0f53640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f12bc135430 con 0x7f12bc094580 2026-02-20T16:29:45.066 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.061+0000 7f12c0f53640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f12bc135730 con 0x7f12bc095100 2026-02-20T16:29:45.066 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.061+0000 7f12ba575640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f12bc0938c0 0x7f12bc08c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:45.066 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.061+0000 7f12ba575640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f12bc0938c0 0x7f12bc08c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:39006/0 (socket says 10.20.193.57:39006) 2026-02-20T16:29:45.066 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.061+0000 7f12ba575640 1 -- 10.20.193.57:0/313144847 learned_addr learned my addr 10.20.193.57:0/313144847 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:29:45.067 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.061+0000 7f12b9d74640 1 --2- 10.20.193.57:0/313144847 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f12bc094580 0x7f12bc08c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:45.067 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.061+0000 7f12bad76640 1 --2- 10.20.193.57:0/313144847 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f12bc095100 0x7f12bc08ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:45.067 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.061+0000 7fdc2c38d640 1 Processor -- start 2026-02-20T16:29:45.067 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.061+0000 7fdc2c38d640 1 -- start start 2026-02-20T16:29:45.068 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.061+0000 7f12ba575640 1 -- 10.20.193.57:0/313144847 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f12bc095100 msgr2=0x7f12bc08ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:45.068 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.061+0000 7f12ba575640 1 --2- 10.20.193.57:0/313144847 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f12bc095100 0x7f12bc08ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.068 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.061+0000 7f12ba575640 1 -- 10.20.193.57:0/313144847 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f12bc094580 msgr2=0x7f12bc08c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:45.068 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.061+0000 7f12ba575640 1 --2- 10.20.193.57:0/313144847 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f12bc094580 0x7f12bc08c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.068 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.061+0000 7f12ba575640 1 -- 10.20.193.57:0/313144847 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12bc08df40 con 0x7f12bc0938c0 2026-02-20T16:29:45.069 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.061+0000 7f12b9d74640 1 --2- 10.20.193.57:0/313144847 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f12bc094580 0x7f12bc08c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:29:45.069 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.061+0000 7fdc2c38d640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fdc2406e300 0x7fdc241c7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:45.069 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.061+0000 7fdc2c38d640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fdc2406ec20 0x7fdc241c7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:45.069 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.061+0000 7fdc2c38d640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fdc2412f110 0x7fdc2412fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:45.070 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.061+0000 7f12ba575640 1 --2- 10.20.193.57:0/313144847 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f12bc0938c0 0x7f12bc08c400 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f12b002f7e0 tx=0x7f12b0002910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:29:45.070 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.061+0000 7fdc2c38d640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7fdc24137a30 con 0x7fdc2412f110 2026-02-20T16:29:45.070 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.061+0000 7fdc2c38d640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7fdc241378b0 con 0x7fdc2406e300 2026-02-20T16:29:45.070 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.061+0000 7fdc2c38d640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7fdc24137bb0 con 0x7fdc2406ec20 2026-02-20T16:29:45.070 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.061+0000 7fdc2a102640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fdc2406e300 0x7fdc241c7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:45.071 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.061+0000 7fdc29901640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fdc2406ec20 0x7fdc241c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:45.071 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.061+0000 7fdc2a102640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fdc2406e300 0x7fdc241c7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3301/0 says I am v2:10.20.193.57:44996/0 (socket says 10.20.193.57:44996) 2026-02-20T16:29:45.071 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.061+0000 7fdc29901640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fdc2406ec20 0x7fdc241c7570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3302/0 says I am v2:10.20.193.57:47622/0 (socket says 10.20.193.57:47622) 2026-02-20T16:29:45.071 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.061+0000 7f12a2ffd640 1 -- 10.20.193.57:0/313144847 <== mon.0 v2:10.20.193.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b0002c90 con 0x7f12bc0938c0 2026-02-20T16:29:45.071 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.061+0000 7fdc2a903640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fdc2412f110 0x7fdc2412fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:45.072 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.061+0000 7fdc29901640 1 -- 10.20.193.57:0/2242226129 learned_addr learned my addr 10.20.193.57:0/2242226129 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:29:45.072 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.061+0000 7f12a2ffd640 1 -- 10.20.193.57:0/313144847 <== mon.0 v2:10.20.193.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f12b0002e30 con 0x7f12bc0938c0 2026-02-20T16:29:45.072 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.061+0000 7f12c0f53640 1 -- 10.20.193.57:0/313144847 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12bc08efd0 con 0x7f12bc0938c0 2026-02-20T16:29:45.072 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.061+0000 7f12a2ffd640 1 -- 10.20.193.57:0/313144847 <== mon.0 v2:10.20.193.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b0004ac0 con 0x7f12bc0938c0 2026-02-20T16:29:45.072 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.061+0000 7f12c0f53640 1 -- 10.20.193.57:0/313144847 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12bc1265b0 con 0x7f12bc0938c0 2026-02-20T16:29:45.073 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.061+0000 7fdc29901640 1 -- 10.20.193.57:0/2242226129 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fdc2406e300 msgr2=0x7fdc241c7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:45.074 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.061+0000 7fdc29901640 1 --2- 10.20.193.57:0/2242226129 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fdc2406e300 0x7fdc241c7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.074 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.061+0000 7fdc29901640 1 -- 10.20.193.57:0/2242226129 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fdc2412f110 msgr2=0x7fdc2412fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:45.074 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.061+0000 7fdc29901640 1 --2- 10.20.193.57:0/2242226129 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fdc2412f110 0x7fdc2412fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.074 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.061+0000 7fdc29901640 1 -- 10.20.193.57:0/2242226129 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc24129510 con 0x7fdc2406ec20 2026-02-20T16:29:45.074 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.061+0000 7fdc2a903640 1 --2- 10.20.193.57:0/2242226129 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fdc2412f110 0x7fdc2412fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T16:29:45.074 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.061+0000 7fdc29901640 1 --2- 10.20.193.57:0/2242226129 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fdc2406ec20 0x7fdc241c7570 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdc18009a60 tx=0x7fdc18002910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:29:45.074 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.062+0000 7fdc0affd640 1 -- 10.20.193.57:0/2242226129 <== mon.2 v2:10.20.193.57:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc18002d10 con 0x7fdc2406ec20 2026-02-20T16:29:45.074 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.062+0000 7fdc0affd640 1 -- 10.20.193.57:0/2242226129 <== mon.2 v2:10.20.193.57:3302/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdc1802fe50 con 0x7fdc2406ec20 2026-02-20T16:29:45.074 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.062+0000 7fdc2c38d640 1 -- 10.20.193.57:0/2242226129 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc241c7ab0 con 0x7fdc2406ec20 2026-02-20T16:29:45.074 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.062+0000 7fdc0affd640 1 -- 10.20.193.57:0/2242226129 <== mon.2 v2:10.20.193.57:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc18004b00 con 0x7fdc2406ec20 2026-02-20T16:29:45.074 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.062+0000 7fdc2c38d640 1 -- 10.20.193.57:0/2242226129 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc24132770 con 0x7fdc2406ec20 2026-02-20T16:29:45.075 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.062+0000 7f12c0f53640 1 -- 10.20.193.57:0/313144847 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12bc093ca0 con 0x7f12bc0938c0 2026-02-20T16:29:45.075 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.062+0000 7f12a2ffd640 1 -- 10.20.193.57:0/313144847 <== mon.0 v2:10.20.193.57:3300/0 4 ==== mgrmap(e 5) ==== 62057+0+0 (secure 0 0 0) 0x7f12b0038470 con 0x7f12bc0938c0 2026-02-20T16:29:45.076 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.062+0000 7fdc2c38d640 1 -- 10.20.193.57:0/2242226129 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc2406e6e0 con 0x7fdc2406ec20 2026-02-20T16:29:45.076 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.062+0000 7fdc0affd640 1 -- 10.20.193.57:0/2242226129 <== mon.2 v2:10.20.193.57:3302/0 4 ==== mgrmap(e 5) ==== 62057+0+0 (secure 0 0 0) 0x7fdc18038470 con 0x7fdc2406ec20 2026-02-20T16:29:45.076 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.062+0000 7f12a2ffd640 1 -- 10.20.193.57:0/313144847 <== mon.0 v2:10.20.193.57:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2861+0+0 (secure 0 0 0) 0x7f12b008b690 con 0x7f12bc0938c0 2026-02-20T16:29:45.077 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.063+0000 7fdc0affd640 1 -- 10.20.193.57:0/2242226129 <== mon.2 v2:10.20.193.57:3302/0 5 ==== osd_map(17..17 src has 1..17) ==== 2861+0+0 (secure 0 0 0) 0x7fdc1808b2c0 con 0x7fdc2406ec20 2026-02-20T16:29:45.077 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.064+0000 7f12a2ffd640 1 -- 10.20.193.57:0/313144847 <== mon.0 v2:10.20.193.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f12b00654d0 con 0x7f12bc0938c0 2026-02-20T16:29:45.077 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.064+0000 7fdc0affd640 1 -- 10.20.193.57:0/2242226129 <== mon.2 v2:10.20.193.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7fdc18065100 con 0x7fdc2406ec20 2026-02-20T16:29:45.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.091+0000 7f44df9f3640 1 -- 10.20.193.57:0/93380343 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f44d8074840 con 0x7f44d812b640 2026-02-20T16:29:45.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.092+0000 7f44c5ffb640 1 -- 10.20.193.57:0/93380343 <== mon.0 v2:10.20.193.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f44cc08a620 con 0x7f44d812b640 2026-02-20T16:29:45.094 INFO:teuthology.orchestra.run.trial057.stdout:42949672963 2026-02-20T16:29:45.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.093+0000 7f44df9f3640 1 -- 10.20.193.57:0/93380343 >> v1:10.20.193.57:6800/4138285113 conn(0x7f44a804f790 legacy=0x7f44a8051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:45.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.093+0000 7f44df9f3640 1 -- 10.20.193.57:0/93380343 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f44d812b640 msgr2=0x7f44d81c51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:45.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.093+0000 7f44df9f3640 1 --2- 10.20.193.57:0/93380343 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f44d812b640 0x7f44d81c51d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f44cc02f770 tx=0x7f44cc002910 comp rx=0 tx=0).stop 2026-02-20T16:29:45.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.093+0000 7f44df9f3640 1 -- 10.20.193.57:0/93380343 shutdown_connections 2026-02-20T16:29:45.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.093+0000 7f44df9f3640 1 --2- 10.20.193.57:0/93380343 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f44d812bfc0 0x7f44d8130300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.093+0000 7f44df9f3640 1 --2- 10.20.193.57:0/93380343 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f44d812b640 0x7f44d81c51d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.093+0000 7f44df9f3640 1 --2- 10.20.193.57:0/93380343 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f44d8128510 0x7f44d81c4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.093+0000 7f44df9f3640 1 -- 10.20.193.57:0/93380343 >> 10.20.193.57:0/93380343 conn(0x7f44d809dd20 msgr2=0x7f44d806fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:45.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.093+0000 7f44df9f3640 1 -- 10.20.193.57:0/93380343 shutdown_connections 2026-02-20T16:29:45.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.093+0000 7f44df9f3640 1 -- 10.20.193.57:0/93380343 wait complete. 2026-02-20T16:29:45.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.097+0000 7f9a8854c640 1 -- 10.20.193.57:0/2664088306 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f9a800719a0 con 0x7f9a80132470 2026-02-20T16:29:45.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.097+0000 7f9a66ffd640 1 -- 10.20.193.57:0/2664088306 <== mon.2 v2:10.20.193.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9a7c03d070 con 0x7f9a80132470 2026-02-20T16:29:45.099 INFO:teuthology.orchestra.run.trial057.stdout:42949672963 2026-02-20T16:29:45.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.099+0000 7f9a8854c640 1 -- 10.20.193.57:0/2664088306 >> v1:10.20.193.57:6800/4138285113 conn(0x7f9a5004f790 legacy=0x7f9a50051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:45.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.099+0000 7f9a8854c640 1 -- 10.20.193.57:0/2664088306 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f9a80132470 msgr2=0x7f9a8012a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:45.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.099+0000 7f9a8854c640 1 --2- 10.20.193.57:0/2664088306 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f9a80132470 0x7f9a8012a630 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c00b150 tx=0x7f9a7c004270 comp rx=0 tx=0).stop 2026-02-20T16:29:45.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.099+0000 7f9a8854c640 1 -- 10.20.193.57:0/2664088306 shutdown_connections 2026-02-20T16:29:45.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.099+0000 7f9a8854c640 1 --2- 10.20.193.57:0/2664088306 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f9a80132470 0x7f9a8012a630 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.099+0000 7f9a8854c640 1 --2- 10.20.193.57:0/2664088306 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f9a8012fb40 0x7f9a801c71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.099+0000 7f9a8854c640 1 --2- 10.20.193.57:0/2664088306 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f9a800715c0 0x7f9a801c6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.099+0000 7f9a8854c640 1 -- 10.20.193.57:0/2664088306 >> 10.20.193.57:0/2664088306 conn(0x7f9a8009bd20 msgr2=0x7f9a801287f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:45.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.099+0000 7f9a8854c640 1 -- 10.20.193.57:0/2664088306 shutdown_connections 2026-02-20T16:29:45.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.099+0000 7f9a8854c640 1 -- 10.20.193.57:0/2664088306 wait complete. 2026-02-20T16:29:45.104 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672963 got 42949672963 for osd.2 2026-02-20T16:29:45.104 DEBUG:teuthology.parallel:result is None 2026-02-20T16:29:45.109 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672963 got 42949672963 for osd.1 2026-02-20T16:29:45.109 DEBUG:teuthology.parallel:result is None 2026-02-20T16:29:45.136 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.134+0000 7f12c0f53640 1 -- 10.20.193.57:0/313144847 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f12bc050a10 con 0x7f12bc0938c0 2026-02-20T16:29:45.136 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.134+0000 7f12a2ffd640 1 -- 10.20.193.57:0/313144847 <== mon.0 v2:10.20.193.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f12b008a7f0 con 0x7f12bc0938c0 2026-02-20T16:29:45.136 INFO:teuthology.orchestra.run.trial057.stdout:38654705668 2026-02-20T16:29:45.137 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.135+0000 7f12c0f53640 1 -- 10.20.193.57:0/313144847 >> v1:10.20.193.57:6800/4138285113 conn(0x7f128804f790 legacy=0x7f1288051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:45.138 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.135+0000 7f12c0f53640 1 -- 10.20.193.57:0/313144847 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f12bc0938c0 msgr2=0x7f12bc08c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:45.138 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.135+0000 7f12c0f53640 1 --2- 10.20.193.57:0/313144847 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f12bc0938c0 0x7f12bc08c400 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f12b002f7e0 tx=0x7f12b0002910 comp rx=0 tx=0).stop 2026-02-20T16:29:45.138 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.135+0000 7f12c0f53640 1 -- 10.20.193.57:0/313144847 shutdown_connections 2026-02-20T16:29:45.138 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.135+0000 7f12c0f53640 1 --2- 10.20.193.57:0/313144847 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f12bc095100 0x7f12bc08ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.138 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.135+0000 7f12c0f53640 1 --2- 10.20.193.57:0/313144847 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f12bc094580 0x7f12bc08c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.138 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.135+0000 7f12c0f53640 1 --2- 10.20.193.57:0/313144847 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f12bc0938c0 0x7f12bc08c400 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.138 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.135+0000 7f12c0f53640 1 -- 10.20.193.57:0/313144847 >> 10.20.193.57:0/313144847 conn(0x7f12bc09a170 msgr2=0x7f12bc09b200 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:45.138 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.135+0000 7f12c0f53640 1 -- 10.20.193.57:0/313144847 shutdown_connections 2026-02-20T16:29:45.138 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.135+0000 7f12c0f53640 1 -- 10.20.193.57:0/313144847 wait complete. 2026-02-20T16:29:45.139 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.138+0000 7fdc2c38d640 1 -- 10.20.193.57:0/2242226129 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fdc24050a10 con 0x7fdc2406ec20 2026-02-20T16:29:45.140 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.138+0000 7fdc0affd640 1 -- 10.20.193.57:0/2242226129 <== mon.2 v2:10.20.193.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdc1808a420 con 0x7fdc2406ec20 2026-02-20T16:29:45.140 INFO:teuthology.orchestra.run.trial057.stdout:42949672963 2026-02-20T16:29:45.142 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.140+0000 7fdc2c38d640 1 -- 10.20.193.57:0/2242226129 >> v1:10.20.193.57:6800/4138285113 conn(0x7fdbf404f790 legacy=0x7fdbf4051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:45.142 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.140+0000 7fdc2c38d640 1 -- 10.20.193.57:0/2242226129 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fdc2406ec20 msgr2=0x7fdc241c7570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:45.142 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.140+0000 7fdc2c38d640 1 --2- 10.20.193.57:0/2242226129 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fdc2406ec20 0x7fdc241c7570 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdc18009a60 tx=0x7fdc18002910 comp rx=0 tx=0).stop 2026-02-20T16:29:45.142 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.140+0000 7fdc2c38d640 1 -- 10.20.193.57:0/2242226129 shutdown_connections 2026-02-20T16:29:45.142 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.140+0000 7fdc2c38d640 1 --2- 10.20.193.57:0/2242226129 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fdc2412f110 0x7fdc2412fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.142 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.140+0000 7fdc2c38d640 1 --2- 10.20.193.57:0/2242226129 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fdc2406ec20 0x7fdc241c7570 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.142 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.140+0000 7fdc2c38d640 1 --2- 10.20.193.57:0/2242226129 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fdc2406e300 0x7fdc241c7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.142 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.140+0000 7fdc2c38d640 1 -- 10.20.193.57:0/2242226129 >> 10.20.193.57:0/2242226129 conn(0x7fdc2409f500 msgr2=0x7fdc24072980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:45.142 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.140+0000 7fdc2c38d640 1 -- 10.20.193.57:0/2242226129 shutdown_connections 2026-02-20T16:29:45.143 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.140+0000 7fdc2c38d640 1 -- 10.20.193.57:0/2242226129 wait complete. 2026-02-20T16:29:45.145 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705668 for osd.0 2026-02-20T16:29:45.145 DEBUG:teuthology.parallel:result is None 2026-02-20T16:29:45.150 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672963 got 42949672963 for osd.3 2026-02-20T16:29:45.150 DEBUG:teuthology.parallel:result is None 2026-02-20T16:29:45.151 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-20T16:29:45.151 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T16:29:45.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.256+0000 7f8fc3cd3640 1 -- 10.20.193.57:0/2103526597 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8fbc12c7e0 msgr2=0x7f8fbc12cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:45.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.256+0000 7f8fc3cd3640 1 --2- 10.20.193.57:0/2103526597 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8fbc12c7e0 0x7f8fbc12cbc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8fac009a30 tx=0x7f8fac02f220 comp rx=0 tx=0).stop 2026-02-20T16:29:45.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.256+0000 7f8fc3cd3640 1 -- 10.20.193.57:0/2103526597 shutdown_connections 2026-02-20T16:29:45.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.256+0000 7f8fc3cd3640 1 --2- 10.20.193.57:0/2103526597 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8fbc12d100 0x7f8fbc093470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.256+0000 7f8fc3cd3640 1 --2- 10.20.193.57:0/2103526597 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8fbc12c7e0 0x7f8fbc12cbc0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.256+0000 7f8fc3cd3640 1 -- 10.20.193.57:0/2103526597 >> 10.20.193.57:0/2103526597 conn(0x7f8fbc09a280 msgr2=0x7f8fbc097a10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:45.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.256+0000 7f8fc3cd3640 1 -- 10.20.193.57:0/2103526597 shutdown_connections 2026-02-20T16:29:45.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.256+0000 7f8fc3cd3640 1 -- 10.20.193.57:0/2103526597 wait complete. 2026-02-20T16:29:45.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.257+0000 7f8fc3cd3640 1 Processor -- start 2026-02-20T16:29:45.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.257+0000 7f8fc3cd3640 1 -- start start 2026-02-20T16:29:45.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.257+0000 7f8fc3cd3640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8fbc0939b0 0x7f8fbc06dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:45.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.257+0000 7f8fc3cd3640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8fbc12c7e0 0x7f8fbc06e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:45.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.257+0000 7f8fc3cd3640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f8fbc12d100 0x7f8fbc092060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:45.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.257+0000 7f8fc3cd3640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f8fbc1358a0 con 0x7f8fbc12d100 2026-02-20T16:29:45.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.257+0000 7f8fc3cd3640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f8fbc135720 con 0x7f8fbc12c7e0 2026-02-20T16:29:45.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.257+0000 7f8fc3cd3640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f8fbc135a20 con 0x7f8fbc0939b0 2026-02-20T16:29:45.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.257+0000 7f8fc1a48640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8fbc0939b0 0x7f8fbc06dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:45.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.257+0000 7f8fc1247640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8fbc12c7e0 0x7f8fbc06e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:45.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.257+0000 7f8fc2249640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f8fbc12d100 0x7f8fbc092060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:45.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.257+0000 7f8fc1a48640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8fbc0939b0 0x7f8fbc06dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3302/0 says I am v2:10.20.193.57:47650/0 (socket says 10.20.193.57:47650) 2026-02-20T16:29:45.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.257+0000 7f8fc1a48640 1 -- 10.20.193.57:0/1680984829 learned_addr learned my addr 10.20.193.57:0/1680984829 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:29:45.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.257+0000 7f8fc1a48640 1 -- 10.20.193.57:0/1680984829 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8fbc12c7e0 msgr2=0x7f8fbc06e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:45.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.257+0000 7f8fc1a48640 1 --2- 10.20.193.57:0/1680984829 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8fbc12c7e0 0x7f8fbc06e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.257+0000 7f8fc1a48640 1 -- 10.20.193.57:0/1680984829 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f8fbc12d100 msgr2=0x7f8fbc092060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:45.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.257+0000 7f8fc1a48640 1 --2- 10.20.193.57:0/1680984829 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f8fbc12d100 0x7f8fbc092060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.257+0000 7f8fc1a48640 1 -- 10.20.193.57:0/1680984829 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fbc091da0 con 0x7f8fbc0939b0 2026-02-20T16:29:45.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.257+0000 7f8fc1a48640 1 --2- 10.20.193.57:0/1680984829 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8fbc0939b0 0x7f8fbc06dfe0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8fac002410 tx=0x7f8fac02fd20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:29:45.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.257+0000 7f8faa7fc640 1 -- 10.20.193.57:0/1680984829 <== mon.2 v2:10.20.193.57:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fac002970 con 0x7f8fbc0939b0 2026-02-20T16:29:45.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.257+0000 7f8faa7fc640 1 -- 10.20.193.57:0/1680984829 <== mon.2 v2:10.20.193.57:3302/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8fac002b10 con 0x7f8fbc0939b0 2026-02-20T16:29:45.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.257+0000 7f8fc3cd3640 1 -- 10.20.193.57:0/1680984829 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fbc090db0 con 0x7f8fbc0939b0 2026-02-20T16:29:45.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.257+0000 7f8faa7fc640 1 -- 10.20.193.57:0/1680984829 <== mon.2 v2:10.20.193.57:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fac0048a0 con 0x7f8fbc0939b0 2026-02-20T16:29:45.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.257+0000 7f8fc3cd3640 1 -- 10.20.193.57:0/1680984829 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fbc0919d0 con 0x7f8fbc0939b0 2026-02-20T16:29:45.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.258+0000 7f8fc3cd3640 1 -- 10.20.193.57:0/1680984829 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fbc12cbc0 con 0x7f8fbc0939b0 2026-02-20T16:29:45.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.258+0000 7f8faa7fc640 1 -- 10.20.193.57:0/1680984829 <== mon.2 v2:10.20.193.57:3302/0 4 ==== mgrmap(e 5) ==== 62057+0+0 (secure 0 0 0) 0x7f8fac038470 con 0x7f8fbc0939b0 2026-02-20T16:29:45.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.259+0000 7f8faa7fc640 1 -- 10.20.193.57:0/1680984829 <== mon.2 v2:10.20.193.57:3302/0 5 ==== osd_map(17..17 src has 1..17) ==== 2861+0+0 (secure 0 0 0) 0x7f8fac08b300 con 0x7f8fbc0939b0 2026-02-20T16:29:45.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.260+0000 7f8faa7fc640 1 -- 10.20.193.57:0/1680984829 <== mon.2 v2:10.20.193.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f8fac0650c0 con 0x7f8fbc0939b0 2026-02-20T16:29:45.328 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.327+0000 7f8fc3cd3640 1 -- 10.20.193.57:0/1680984829 --> v1:10.20.193.57:6800/4138285113 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8fbc050a10 con 0x7f8f8c04f7c0 2026-02-20T16:29:45.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.327+0000 7f8faa7fc640 1 -- 10.20.193.57:0/1680984829 <== mgr.4162 v1:10.20.193.57:6800/4138285113 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32169 (unknown 2965378022 0 1809831739) 0x7f8fbc050a10 con 0x7f8f8c04f7c0 2026-02-20T16:29:45.329 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:29:45.331 INFO:teuthology.orchestra.run.trial057.stderr:dumped all 2026-02-20T16:29:45.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.328+0000 7f8fc3cd3640 1 -- 10.20.193.57:0/1680984829 >> v1:10.20.193.57:6800/4138285113 conn(0x7f8f8c04f7c0 legacy=0x7f8f8c051c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:45.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.328+0000 7f8fc3cd3640 1 -- 10.20.193.57:0/1680984829 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8fbc0939b0 msgr2=0x7f8fbc06dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:45.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.328+0000 7f8fc3cd3640 1 --2- 10.20.193.57:0/1680984829 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8fbc0939b0 0x7f8fbc06dfe0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8fac002410 tx=0x7f8fac02fd20 comp rx=0 tx=0).stop 2026-02-20T16:29:45.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.328+0000 7f8fc3cd3640 1 -- 10.20.193.57:0/1680984829 shutdown_connections 2026-02-20T16:29:45.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.328+0000 7f8fc3cd3640 1 --2- 10.20.193.57:0/1680984829 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f8fbc12d100 0x7f8fbc092060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.328+0000 7f8fc3cd3640 1 --2- 10.20.193.57:0/1680984829 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8fbc12c7e0 0x7f8fbc06e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.328+0000 7f8fc3cd3640 1 --2- 10.20.193.57:0/1680984829 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8fbc0939b0 0x7f8fbc06dfe0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.328+0000 7f8fc3cd3640 1 -- 10.20.193.57:0/1680984829 >> 10.20.193.57:0/1680984829 conn(0x7f8fbc09a280 msgr2=0x7f8fbc129340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:45.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.328+0000 7f8fc3cd3640 1 -- 10.20.193.57:0/1680984829 shutdown_connections 2026-02-20T16:29:45.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.328+0000 7f8fc3cd3640 1 -- 10.20.193.57:0/1680984829 wait complete. 2026-02-20T16:29:45.337 INFO:teuthology.orchestra.run.trial057.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2026-02-20T16:29:44.019086+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109612,"kb_used_data":1736,"kb_used_omap":6,"kb_used_meta":107769,"kb_avail":377377748,"statfs":{"total":386547056640,"available":386434813952,"internally_reserved":0,"allocated":1777664,"data_stored":1342175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6373,"internal_metadata":110356251},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.275245"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T16:29:41.746548+0000","last_change":"2026-02-20T16:29:41.746889+0000","last_active":"2026-02-20T16:29:41.746548+0000","last_peered":"2026-02-20T16:29:41.746548+0000","last_clean":"2026-02-20T16:29:41.746548+0000","last_became_active":"2026-02-20T16:29:39.745934+0000","last_became_peered":"2026-02-20T16:29:39.745934+0000","last_unstale":"2026-02-20T16:29:41.746548+0000","last_undegraded":"2026-02-20T16:29:41.746548+0000","last_fullsized":"2026-02-20T16:29:41.746548+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:02:11.864227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001161203,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T16:29:41.745643+0000","last_change":"2026-02-20T16:29:41.745860+0000","last_active":"2026-02-20T16:29:41.745643+0000","last_peered":"2026-02-20T16:29:41.745643+0000","last_clean":"2026-02-20T16:29:41.745643+0000","last_became_active":"2026-02-20T16:29:39.747939+0000","last_became_peered":"2026-02-20T16:29:39.747939+0000","last_unstale":"2026-02-20T16:29:41.745643+0000","last_undegraded":"2026-02-20T16:29:41.745643+0000","last_fullsized":"2026-02-20T16:29:41.745643+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T01:15:51.058340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033720799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T16:29:41.746700+0000","last_change":"2026-02-20T16:29:41.746928+0000","last_active":"2026-02-20T16:29:41.746700+0000","last_peered":"2026-02-20T16:29:41.746700+0000","last_clean":"2026-02-20T16:29:41.746700+0000","last_became_active":"2026-02-20T16:29:39.746070+0000","last_became_peered":"2026-02-20T16:29:39.746070+0000","last_unstale":"2026-02-20T16:29:41.746700+0000","last_undegraded":"2026-02-20T16:29:41.746700+0000","last_fullsized":"2026-02-20T16:29:41.746700+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:10:54.031743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001207149,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T16:29:41.745676+0000","last_change":"2026-02-20T16:29:41.745829+0000","last_active":"2026-02-20T16:29:41.745676+0000","last_peered":"2026-02-20T16:29:41.745676+0000","last_clean":"2026-02-20T16:29:41.745676+0000","last_became_active":"2026-02-20T16:29:39.747943+0000","last_became_peered":"2026-02-20T16:29:39.747943+0000","last_unstale":"2026-02-20T16:29:41.745676+0000","last_undegraded":"2026-02-20T16:29:41.745676+0000","last_fullsized":"2026-02-20T16:29:41.745676+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T01:50:47.446286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000271997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"17'2","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T16:29:41.746443+0000","last_change":"2026-02-20T16:29:41.746443+0000","last_active":"2026-02-20T16:29:41.746443+0000","last_peered":"2026-02-20T16:29:41.746443+0000","last_clean":"2026-02-20T16:29:41.746443+0000","last_became_active":"2026-02-20T16:29:39.748192+0000","last_became_peered":"2026-02-20T16:29:39.748192+0000","last_unstale":"2026-02-20T16:29:41.746443+0000","last_undegraded":"2026-02-20T16:29:41.746443+0000","last_fullsized":"2026-02-20T16:29:41.746443+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:35:42.345489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092195700000000005,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T16:29:42.394363+0000","last_change":"2026-02-20T16:29:42.394517+0000","last_active":"2026-02-20T16:29:42.394363+0000","last_peered":"2026-02-20T16:29:42.394363+0000","last_clean":"2026-02-20T16:29:42.394363+0000","last_became_active":"2026-02-20T16:29:39.747810+0000","last_became_peered":"2026-02-20T16:29:39.747810+0000","last_unstale":"2026-02-20T16:29:42.394363+0000","last_undegraded":"2026-02-20T16:29:42.394363+0000","last_fullsized":"2026-02-20T16:29:42.394363+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:21:15.349172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025212999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T16:29:41.746499+0000","last_change":"2026-02-20T16:29:41.746669+0000","last_active":"2026-02-20T16:29:41.746499+0000","last_peered":"2026-02-20T16:29:41.746499+0000","last_clean":"2026-02-20T16:29:41.746499+0000","last_became_active":"2026-02-20T16:29:39.748363+0000","last_became_peered":"2026-02-20T16:29:39.748363+0000","last_unstale":"2026-02-20T16:29:41.746499+0000","last_undegraded":"2026-02-20T16:29:41.746499+0000","last_fullsized":"2026-02-20T16:29:41.746499+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:12:49.948165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010429829999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"15'1","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T16:29:41.746286+0000","last_change":"2026-02-20T16:29:41.746516+0000","last_active":"2026-02-20T16:29:41.746286+0000","last_peered":"2026-02-20T16:29:41.746286+0000","last_clean":"2026-02-20T16:29:41.746286+0000","last_became_active":"2026-02-20T16:29:39.747501+0000","last_became_peered":"2026-02-20T16:29:39.747501+0000","last_unstale":"2026-02-20T16:29:41.746286+0000","last_undegraded":"2026-02-20T16:29:41.746286+0000","last_fullsized":"2026-02-20T16:29:41.746286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:28:35.250145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093713599999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"12'72","reported_seq":110,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T16:29:41.745418+0000","last_change":"2026-02-20T16:29:35.927618+0000","last_active":"2026-02-20T16:29:41.745418+0000","last_peered":"2026-02-20T16:29:41.745418+0000","last_clean":"2026-02-20T16:29:41.745418+0000","last_became_active":"2026-02-20T16:29:35.927174+0000","last_became_peered":"2026-02-20T16:29:35.927174+0000","last_unstale":"2026-02-20T16:29:41.745418+0000","last_undegraded":"2026-02-20T16:29:41.745418+0000","last_fullsized":"2026-02-20T16:29:41.745418+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:34.730052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:34.730052+0000","last_clean_scrub_stamp":"2026-02-20T16:29:34.730052+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T04:24:55.154240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672963,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":151552,"data_stored":41226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27100,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344740,"statfs":{"total":96636764160,"available":96609013760,"internally_reserved":0,"allocated":139264,"data_stored":37780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672963,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27700,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":745472,"data_stored":631594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":741376,"data_stored":631575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T16:29:45.338 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T16:29:45.408 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.404+0000 7fcda03f5640 1 -- 10.20.193.57:0/2742416164 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fcd980939b0 msgr2=0x7fcd98093e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:45.408 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.404+0000 7fcda03f5640 1 --2- 10.20.193.57:0/2742416164 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fcd980939b0 0x7fcd98093e20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcd94009fd0 tx=0x7fcd9402f3e0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.408 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.404+0000 7fcda03f5640 1 -- 10.20.193.57:0/2742416164 shutdown_connections 2026-02-20T16:29:45.408 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.404+0000 7fcda03f5640 1 --2- 10.20.193.57:0/2742416164 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fcd980939b0 0x7fcd98093e20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.409 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.404+0000 7fcda03f5640 1 --2- 10.20.193.57:0/2742416164 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fcd9812d100 0x7fcd98093470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.409 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.404+0000 7fcda03f5640 1 --2- 10.20.193.57:0/2742416164 >> v2:10.20.193.57:3300/0 conn(0x7fcd9812c7e0 0x7fcd9812cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.409 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.404+0000 7fcda03f5640 1 -- 10.20.193.57:0/2742416164 >> 10.20.193.57:0/2742416164 conn(0x7fcd9809a280 msgr2=0x7fcd98097a10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:45.409 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.404+0000 7fcda03f5640 1 -- 10.20.193.57:0/2742416164 shutdown_connections 2026-02-20T16:29:45.409 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.404+0000 7fcda03f5640 1 -- 10.20.193.57:0/2742416164 wait complete. 2026-02-20T16:29:45.409 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.404+0000 7fcda03f5640 1 Processor -- start 2026-02-20T16:29:45.409 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.404+0000 7fcda03f5640 1 -- start start 2026-02-20T16:29:45.409 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.405+0000 7fcda03f5640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fcd980939b0 0x7fcd981c6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:45.409 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.405+0000 7fcda03f5640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fcd9812c7e0 0x7fcd981c70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:45.409 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.405+0000 7fcda03f5640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fcd9812d100 0x7fcd98132300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:45.409 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.405+0000 7fcda03f5640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7fcd98134580 con 0x7fcd9812c7e0 2026-02-20T16:29:45.410 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.405+0000 7fcda03f5640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7fcd98134400 con 0x7fcd980939b0 2026-02-20T16:29:45.410 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.405+0000 7fcda03f5640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7fcd98134700 con 0x7fcd9812d100 2026-02-20T16:29:45.410 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.405+0000 7fcd9e16a640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fcd980939b0 0x7fcd981c6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:45.410 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.405+0000 7fcd9e96b640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fcd9812d100 0x7fcd98132300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:45.410 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.405+0000 7fcd9e16a640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fcd980939b0 0x7fcd981c6bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3301/0 says I am v2:10.20.193.57:45020/0 (socket says 10.20.193.57:45020) 2026-02-20T16:29:45.410 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.405+0000 7fcd9d969640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fcd9812c7e0 0x7fcd981c70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:45.410 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.405+0000 7fcd9e16a640 1 -- 10.20.193.57:0/1890705891 learned_addr learned my addr 10.20.193.57:0/1890705891 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:29:45.410 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.405+0000 7fcd9e16a640 1 -- 10.20.193.57:0/1890705891 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fcd9812d100 msgr2=0x7fcd98132300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:45.410 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.405+0000 7fcd9e16a640 1 --2- 10.20.193.57:0/1890705891 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fcd9812d100 0x7fcd98132300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.410 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.405+0000 7fcd9e16a640 1 -- 10.20.193.57:0/1890705891 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fcd9812c7e0 msgr2=0x7fcd981c70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:45.410 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.405+0000 7fcd9e16a640 1 --2- 10.20.193.57:0/1890705891 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fcd9812c7e0 0x7fcd981c70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.410 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.405+0000 7fcd9e16a640 1 -- 10.20.193.57:0/1890705891 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd9806e5a0 con 0x7fcd980939b0 2026-02-20T16:29:45.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.405+0000 7fcd9e96b640 1 --2- 10.20.193.57:0/1890705891 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fcd9812d100 0x7fcd98132300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:29:45.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.405+0000 7fcd9d969640 1 --2- 10.20.193.57:0/1890705891 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fcd9812c7e0 0x7fcd981c70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:29:45.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.405+0000 7fcd9e16a640 1 --2- 10.20.193.57:0/1890705891 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fcd980939b0 0x7fcd981c6bb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcd8800ea10 tx=0x7fcd8800eee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:29:45.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.405+0000 7fcd7effd640 1 -- 10.20.193.57:0/1890705891 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd8800ce50 con 0x7fcd980939b0 2026-02-20T16:29:45.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.405+0000 7fcd7effd640 1 -- 10.20.193.57:0/1890705891 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd880040d0 con 0x7fcd980939b0 2026-02-20T16:29:45.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.405+0000 7fcda03f5640 1 -- 10.20.193.57:0/1890705891 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd981c7630 con 0x7fcd980939b0 2026-02-20T16:29:45.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.405+0000 7fcd7effd640 1 -- 10.20.193.57:0/1890705891 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd880044e0 con 0x7fcd980939b0 2026-02-20T16:29:45.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.405+0000 7fcda03f5640 1 -- 10.20.193.57:0/1890705891 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd9806eff0 con 0x7fcd980939b0 2026-02-20T16:29:45.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.405+0000 7fcda03f5640 1 -- 10.20.193.57:0/1890705891 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd9812cbc0 con 0x7fcd980939b0 2026-02-20T16:29:45.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.406+0000 7fcd7effd640 1 -- 10.20.193.57:0/1890705891 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 5) ==== 62057+0+0 (secure 0 0 0) 0x7fcd88020030 con 0x7fcd980939b0 2026-02-20T16:29:45.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.406+0000 7fcd7effd640 1 -- 10.20.193.57:0/1890705891 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 2861+0+0 (secure 0 0 0) 0x7fcd88067320 con 0x7fcd980939b0 2026-02-20T16:29:45.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.408+0000 7fcd7effd640 1 -- 10.20.193.57:0/1890705891 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7fcd88041120 con 0x7fcd980939b0 2026-02-20T16:29:45.477 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.475+0000 7fcda03f5640 1 -- 10.20.193.57:0/1890705891 --> v1:10.20.193.57:6800/4138285113 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcd9806f720 con 0x7fcd6804f930 2026-02-20T16:29:45.477 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.476+0000 7fcd7effd640 1 -- 10.20.193.57:0/1890705891 <== mgr.4162 v1:10.20.193.57:6800/4138285113 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32169 (unknown 2965378022 0 1809831739) 0x7fcd9806f720 con 0x7fcd6804f930 2026-02-20T16:29:45.478 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:29:45.479 INFO:teuthology.orchestra.run.trial057.stderr:dumped all 2026-02-20T16:29:45.479 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.476+0000 7fcda03f5640 1 -- 10.20.193.57:0/1890705891 >> v1:10.20.193.57:6800/4138285113 conn(0x7fcd6804f930 legacy=0x7fcd68051df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:45.479 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.476+0000 7fcda03f5640 1 -- 10.20.193.57:0/1890705891 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fcd980939b0 msgr2=0x7fcd981c6bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:45.479 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.476+0000 7fcda03f5640 1 --2- 10.20.193.57:0/1890705891 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fcd980939b0 0x7fcd981c6bb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcd8800ea10 tx=0x7fcd8800eee0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.477+0000 7fcda03f5640 1 -- 10.20.193.57:0/1890705891 shutdown_connections 2026-02-20T16:29:45.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.477+0000 7fcda03f5640 1 --2- 10.20.193.57:0/1890705891 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fcd9812d100 0x7fcd98132300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.477+0000 7fcda03f5640 1 --2- 10.20.193.57:0/1890705891 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fcd9812c7e0 0x7fcd981c70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.477+0000 7fcda03f5640 1 --2- 10.20.193.57:0/1890705891 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fcd980939b0 0x7fcd981c6bb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.477+0000 7fcda03f5640 1 -- 10.20.193.57:0/1890705891 >> 10.20.193.57:0/1890705891 conn(0x7fcd9809a280 msgr2=0x7fcd98129340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:45.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.477+0000 7fcda03f5640 1 -- 10.20.193.57:0/1890705891 shutdown_connections 2026-02-20T16:29:45.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.477+0000 7fcda03f5640 1 -- 10.20.193.57:0/1890705891 wait complete. 2026-02-20T16:29:45.485 INFO:teuthology.orchestra.run.trial057.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2026-02-20T16:29:44.019086+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109612,"kb_used_data":1736,"kb_used_omap":6,"kb_used_meta":107769,"kb_avail":377377748,"statfs":{"total":386547056640,"available":386434813952,"internally_reserved":0,"allocated":1777664,"data_stored":1342175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6373,"internal_metadata":110356251},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.275245"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T16:29:41.746548+0000","last_change":"2026-02-20T16:29:41.746889+0000","last_active":"2026-02-20T16:29:41.746548+0000","last_peered":"2026-02-20T16:29:41.746548+0000","last_clean":"2026-02-20T16:29:41.746548+0000","last_became_active":"2026-02-20T16:29:39.745934+0000","last_became_peered":"2026-02-20T16:29:39.745934+0000","last_unstale":"2026-02-20T16:29:41.746548+0000","last_undegraded":"2026-02-20T16:29:41.746548+0000","last_fullsized":"2026-02-20T16:29:41.746548+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:02:11.864227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001161203,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T16:29:41.745643+0000","last_change":"2026-02-20T16:29:41.745860+0000","last_active":"2026-02-20T16:29:41.745643+0000","last_peered":"2026-02-20T16:29:41.745643+0000","last_clean":"2026-02-20T16:29:41.745643+0000","last_became_active":"2026-02-20T16:29:39.747939+0000","last_became_peered":"2026-02-20T16:29:39.747939+0000","last_unstale":"2026-02-20T16:29:41.745643+0000","last_undegraded":"2026-02-20T16:29:41.745643+0000","last_fullsized":"2026-02-20T16:29:41.745643+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T01:15:51.058340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033720799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T16:29:41.746700+0000","last_change":"2026-02-20T16:29:41.746928+0000","last_active":"2026-02-20T16:29:41.746700+0000","last_peered":"2026-02-20T16:29:41.746700+0000","last_clean":"2026-02-20T16:29:41.746700+0000","last_became_active":"2026-02-20T16:29:39.746070+0000","last_became_peered":"2026-02-20T16:29:39.746070+0000","last_unstale":"2026-02-20T16:29:41.746700+0000","last_undegraded":"2026-02-20T16:29:41.746700+0000","last_fullsized":"2026-02-20T16:29:41.746700+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:10:54.031743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001207149,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T16:29:41.745676+0000","last_change":"2026-02-20T16:29:41.745829+0000","last_active":"2026-02-20T16:29:41.745676+0000","last_peered":"2026-02-20T16:29:41.745676+0000","last_clean":"2026-02-20T16:29:41.745676+0000","last_became_active":"2026-02-20T16:29:39.747943+0000","last_became_peered":"2026-02-20T16:29:39.747943+0000","last_unstale":"2026-02-20T16:29:41.745676+0000","last_undegraded":"2026-02-20T16:29:41.745676+0000","last_fullsized":"2026-02-20T16:29:41.745676+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T01:50:47.446286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000271997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"17'2","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T16:29:41.746443+0000","last_change":"2026-02-20T16:29:41.746443+0000","last_active":"2026-02-20T16:29:41.746443+0000","last_peered":"2026-02-20T16:29:41.746443+0000","last_clean":"2026-02-20T16:29:41.746443+0000","last_became_active":"2026-02-20T16:29:39.748192+0000","last_became_peered":"2026-02-20T16:29:39.748192+0000","last_unstale":"2026-02-20T16:29:41.746443+0000","last_undegraded":"2026-02-20T16:29:41.746443+0000","last_fullsized":"2026-02-20T16:29:41.746443+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:35:42.345489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092195700000000005,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T16:29:42.394363+0000","last_change":"2026-02-20T16:29:42.394517+0000","last_active":"2026-02-20T16:29:42.394363+0000","last_peered":"2026-02-20T16:29:42.394363+0000","last_clean":"2026-02-20T16:29:42.394363+0000","last_became_active":"2026-02-20T16:29:39.747810+0000","last_became_peered":"2026-02-20T16:29:39.747810+0000","last_unstale":"2026-02-20T16:29:42.394363+0000","last_undegraded":"2026-02-20T16:29:42.394363+0000","last_fullsized":"2026-02-20T16:29:42.394363+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:21:15.349172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025212999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T16:29:41.746499+0000","last_change":"2026-02-20T16:29:41.746669+0000","last_active":"2026-02-20T16:29:41.746499+0000","last_peered":"2026-02-20T16:29:41.746499+0000","last_clean":"2026-02-20T16:29:41.746499+0000","last_became_active":"2026-02-20T16:29:39.748363+0000","last_became_peered":"2026-02-20T16:29:39.748363+0000","last_unstale":"2026-02-20T16:29:41.746499+0000","last_undegraded":"2026-02-20T16:29:41.746499+0000","last_fullsized":"2026-02-20T16:29:41.746499+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:12:49.948165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010429829999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"15'1","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T16:29:41.746286+0000","last_change":"2026-02-20T16:29:41.746516+0000","last_active":"2026-02-20T16:29:41.746286+0000","last_peered":"2026-02-20T16:29:41.746286+0000","last_clean":"2026-02-20T16:29:41.746286+0000","last_became_active":"2026-02-20T16:29:39.747501+0000","last_became_peered":"2026-02-20T16:29:39.747501+0000","last_unstale":"2026-02-20T16:29:41.746286+0000","last_undegraded":"2026-02-20T16:29:41.746286+0000","last_fullsized":"2026-02-20T16:29:41.746286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:28:35.250145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093713599999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"12'72","reported_seq":110,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T16:29:41.745418+0000","last_change":"2026-02-20T16:29:35.927618+0000","last_active":"2026-02-20T16:29:41.745418+0000","last_peered":"2026-02-20T16:29:41.745418+0000","last_clean":"2026-02-20T16:29:41.745418+0000","last_became_active":"2026-02-20T16:29:35.927174+0000","last_became_peered":"2026-02-20T16:29:35.927174+0000","last_unstale":"2026-02-20T16:29:41.745418+0000","last_undegraded":"2026-02-20T16:29:41.745418+0000","last_fullsized":"2026-02-20T16:29:41.745418+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:34.730052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:34.730052+0000","last_clean_scrub_stamp":"2026-02-20T16:29:34.730052+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T04:24:55.154240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672963,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":151552,"data_stored":41226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27100,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344740,"statfs":{"total":96636764160,"available":96609013760,"internally_reserved":0,"allocated":139264,"data_stored":37780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672963,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27700,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":745472,"data_stored":631594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":741376,"data_stored":631575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T16:29:45.487 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-20T16:29:45.487 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-20T16:29:45.488 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-20T16:29:45.488 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-20T16:29:45.559 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.555+0000 7f9336b5d640 1 -- 10.20.193.57:0/2288676960 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f93300968a0 msgr2=0x7f9330132ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:45.559 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.555+0000 7f9336b5d640 1 --2- 10.20.193.57:0/2288676960 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f93300968a0 0x7f9330132ca0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f932c009f90 tx=0x7f932c02f390 comp rx=0 tx=0).stop 2026-02-20T16:29:45.559 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.555+0000 7f9336b5d640 1 -- 10.20.193.57:0/2288676960 shutdown_connections 2026-02-20T16:29:45.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.555+0000 7f9336b5d640 1 --2- 10.20.193.57:0/2288676960 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f93300968a0 0x7f9330132ca0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.555+0000 7f9336b5d640 1 --2- 10.20.193.57:0/2288676960 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f9330094050 0x7f9330094580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.555+0000 7f9336b5d640 1 -- 10.20.193.57:0/2288676960 >> 10.20.193.57:0/2288676960 conn(0x7f933009a280 msgr2=0x7f9330097a10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:45.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.555+0000 7f9336b5d640 1 -- 10.20.193.57:0/2288676960 shutdown_connections 2026-02-20T16:29:45.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.555+0000 7f9336b5d640 1 -- 10.20.193.57:0/2288676960 wait complete. 2026-02-20T16:29:45.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.555+0000 7f9336b5d640 1 Processor -- start 2026-02-20T16:29:45.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.555+0000 7f9336b5d640 1 -- start start 2026-02-20T16:29:45.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.555+0000 7f9336b5d640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f93300630c0 0x7f933008c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:45.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.556+0000 7f9336b5d640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f9330094050 0x7f933008c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:45.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.556+0000 7f9336b5d640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f93300968a0 0x7f933008ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:45.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.556+0000 7f9336b5d640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f93301333f0 con 0x7f9330094050 2026-02-20T16:29:45.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.556+0000 7f9336b5d640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f9330093eb0 con 0x7f93300968a0 2026-02-20T16:29:45.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.556+0000 7f9336b5d640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f9330133570 con 0x7f93300630c0 2026-02-20T16:29:45.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.556+0000 7f9327fff640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f9330094050 0x7f933008c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:45.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.556+0000 7f93348d2640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f93300630c0 0x7f933008c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:45.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.556+0000 7f9327fff640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f9330094050 0x7f933008c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:39030/0 (socket says 10.20.193.57:39030) 2026-02-20T16:29:45.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.556+0000 7f9327fff640 1 -- 10.20.193.57:0/536738915 learned_addr learned my addr 10.20.193.57:0/536738915 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:29:45.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.556+0000 7f93350d3640 1 --2- 10.20.193.57:0/536738915 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f93300968a0 0x7f933008ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:45.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.556+0000 7f9327fff640 1 -- 10.20.193.57:0/536738915 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f93300630c0 msgr2=0x7f933008c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:45.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.556+0000 7f9327fff640 1 --2- 10.20.193.57:0/536738915 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f93300630c0 0x7f933008c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.556+0000 7f9327fff640 1 -- 10.20.193.57:0/536738915 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f93300968a0 msgr2=0x7f933008ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:45.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.556+0000 7f9327fff640 1 --2- 10.20.193.57:0/536738915 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f93300968a0 0x7f933008ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.556+0000 7f9327fff640 1 -- 10.20.193.57:0/536738915 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9330073530 con 0x7f9330094050 2026-02-20T16:29:45.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.556+0000 7f93350d3640 1 --2- 10.20.193.57:0/536738915 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f93300968a0 0x7f933008ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:29:45.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.556+0000 7f9327fff640 1 --2- 10.20.193.57:0/536738915 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f9330094050 0x7f933008c940 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f931800c550 tx=0x7f931800ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:29:45.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.556+0000 7f93257fa640 1 -- 10.20.193.57:0/536738915 <== mon.0 v2:10.20.193.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9318005480 con 0x7f9330094050 2026-02-20T16:29:45.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.556+0000 7f93257fa640 1 -- 10.20.193.57:0/536738915 <== mon.0 v2:10.20.193.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f93180036f0 con 0x7f9330094050 2026-02-20T16:29:45.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.556+0000 7f9336b5d640 1 -- 10.20.193.57:0/536738915 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9330073c70 con 0x7f9330094050 2026-02-20T16:29:45.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.556+0000 7f93257fa640 1 -- 10.20.193.57:0/536738915 <== mon.0 v2:10.20.193.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9318003b40 con 0x7f9330094050 2026-02-20T16:29:45.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.556+0000 7f9336b5d640 1 -- 10.20.193.57:0/536738915 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9330132fa0 con 0x7f9330094050 2026-02-20T16:29:45.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.556+0000 7f9336b5d640 1 -- 10.20.193.57:0/536738915 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9330094580 con 0x7f9330094050 2026-02-20T16:29:45.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.557+0000 7f93257fa640 1 -- 10.20.193.57:0/536738915 <== mon.0 v2:10.20.193.57:3300/0 4 ==== mgrmap(e 5) ==== 62057+0+0 (secure 0 0 0) 0x7f9318003ce0 con 0x7f9330094050 2026-02-20T16:29:45.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.557+0000 7f93257fa640 1 -- 10.20.193.57:0/536738915 <== mon.0 v2:10.20.193.57:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2861+0+0 (secure 0 0 0) 0x7f9318066670 con 0x7f9330094050 2026-02-20T16:29:45.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.559+0000 7f93257fa640 1 -- 10.20.193.57:0/536738915 <== mon.0 v2:10.20.193.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f93180404f0 con 0x7f9330094050 2026-02-20T16:29:45.641 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.640+0000 7f9336b5d640 1 -- 10.20.193.57:0/536738915 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f93301ca7d0 con 0x7f9330094050 2026-02-20T16:29:45.641 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.640+0000 7f93257fa640 1 -- 10.20.193.57:0/536738915 <== mon.0 v2:10.20.193.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f93180657b0 con 0x7f9330094050 2026-02-20T16:29:45.642 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:29:45.642 INFO:teuthology.orchestra.run.trial057.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-20T16:29:45.643 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.640+0000 7f9336b5d640 1 -- 10.20.193.57:0/536738915 >> v1:10.20.193.57:6800/4138285113 conn(0x7f930004f790 legacy=0x7f9300051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:45.643 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.640+0000 7f9336b5d640 1 -- 10.20.193.57:0/536738915 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f9330094050 msgr2=0x7f933008c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:45.643 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.640+0000 7f9336b5d640 1 --2- 10.20.193.57:0/536738915 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f9330094050 0x7f933008c940 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f931800c550 tx=0x7f931800ca20 comp rx=0 tx=0).stop 2026-02-20T16:29:45.643 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.640+0000 7f9336b5d640 1 -- 10.20.193.57:0/536738915 shutdown_connections 2026-02-20T16:29:45.643 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.640+0000 7f9336b5d640 1 --2- 10.20.193.57:0/536738915 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f93300968a0 0x7f933008ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.644 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.640+0000 7f9336b5d640 1 --2- 10.20.193.57:0/536738915 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f9330094050 0x7f933008c940 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.644 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.640+0000 7f9336b5d640 1 --2- 10.20.193.57:0/536738915 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f93300630c0 0x7f933008c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.644 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.640+0000 7f9336b5d640 1 -- 10.20.193.57:0/536738915 >> 10.20.193.57:0/536738915 conn(0x7f933009a280 msgr2=0x7f9330127320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:45.644 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.640+0000 7f9336b5d640 1 -- 10.20.193.57:0/536738915 shutdown_connections 2026-02-20T16:29:45.644 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.640+0000 7f9336b5d640 1 -- 10.20.193.57:0/536738915 wait complete. 2026-02-20T16:29:45.649 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-20T16:29:45.650 INFO:teuthology.run_tasks:Running task exec... 2026-02-20T16:29:45.665 INFO:teuthology.task.exec:Executing custom commands... 2026-02-20T16:29:45.665 INFO:teuthology.task.exec:Running commands on role osd.0 host ubuntu@trial057.front.sepia.ceph.com 2026-02-20T16:29:45.665 DEBUG:teuthology.orchestra.run.trial057:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd set-require-min-compat-client squid' 2026-02-20T16:29:45.734 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.730+0000 7f160da6d640 1 -- 10.20.193.57:0/906982550 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f160812bfd0 msgr2=0x7f160812c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:45.734 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.730+0000 7f160da6d640 1 --2- 10.20.193.57:0/906982550 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f160812bfd0 0x7f160812c3b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f15fc009a30 tx=0x7f15fc02f260 comp rx=0 tx=0).stop 2026-02-20T16:29:45.734 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.730+0000 7f160da6d640 1 -- 10.20.193.57:0/906982550 shutdown_connections 2026-02-20T16:29:45.734 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.730+0000 7f160da6d640 1 --2- 10.20.193.57:0/906982550 >> v2:10.20.193.57:3300/0 conn(0x7f1608096da0 0x7f1608132c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.734 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.730+0000 7f160da6d640 1 --2- 10.20.193.57:0/906982550 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f1608096480 0x7f1608096860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.735 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.730+0000 7f160da6d640 1 --2- 10.20.193.57:0/906982550 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f160812bfd0 0x7f160812c3b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.735 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.730+0000 7f160da6d640 1 -- 10.20.193.57:0/906982550 >> 10.20.193.57:0/906982550 conn(0x7f160809b3a0 msgr2=0x7f160809b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:45.735 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.730+0000 7f160da6d640 1 -- 10.20.193.57:0/906982550 shutdown_connections 2026-02-20T16:29:45.735 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.730+0000 7f160da6d640 1 -- 10.20.193.57:0/906982550 wait complete. 2026-02-20T16:29:45.735 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.730+0000 7f160da6d640 1 Processor -- start 2026-02-20T16:29:45.735 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.730+0000 7f160da6d640 1 -- start start 2026-02-20T16:29:45.735 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.731+0000 7f160da6d640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f1608096480 0x7f16081c2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:45.735 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.731+0000 7f160da6d640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f1608096da0 0x7f16081c2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:45.735 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.731+0000 7f160da6d640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f160812bfd0 0x7f16081261e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:45.735 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.731+0000 7f160da6d640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f1608095960 con 0x7f160812bfd0 2026-02-20T16:29:45.735 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.731+0000 7f160da6d640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f16080957e0 con 0x7f1608096480 2026-02-20T16:29:45.735 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.731+0000 7f160da6d640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f1608095ae0 con 0x7f1608096da0 2026-02-20T16:29:45.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.731+0000 7f16067fc640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f1608096da0 0x7f16081c2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:45.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.731+0000 7f16077fe640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f160812bfd0 0x7f16081261e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:45.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.731+0000 7f1606ffd640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f1608096480 0x7f16081c2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:45.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.731+0000 7f16067fc640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f1608096da0 0x7f16081c2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3302/0 says I am v2:10.20.193.57:47716/0 (socket says 10.20.193.57:47716) 2026-02-20T16:29:45.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.731+0000 7f16067fc640 1 -- 10.20.193.57:0/2972956822 learned_addr learned my addr 10.20.193.57:0/2972956822 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:29:45.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.731+0000 7f16067fc640 1 -- 10.20.193.57:0/2972956822 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f1608096480 msgr2=0x7f16081c2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:45.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.731+0000 7f16067fc640 1 --2- 10.20.193.57:0/2972956822 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f1608096480 0x7f16081c2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.731+0000 7f16067fc640 1 -- 10.20.193.57:0/2972956822 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f160812bfd0 msgr2=0x7f16081261e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:45.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.731+0000 7f16067fc640 1 --2- 10.20.193.57:0/2972956822 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f160812bfd0 0x7f16081261e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:45.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.731+0000 7f16067fc640 1 -- 10.20.193.57:0/2972956822 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16081c33e0 con 0x7f1608096da0 2026-02-20T16:29:45.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.731+0000 7f16077fe640 1 --2- 10.20.193.57:0/2972956822 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f160812bfd0 0x7f16081261e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:29:45.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.731+0000 7f16067fc640 1 --2- 10.20.193.57:0/2972956822 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f1608096da0 0x7f16081c2ea0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f15f0009880 tx=0x7f15f0009d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:29:45.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.731+0000 7f15dffff640 1 -- 10.20.193.57:0/2972956822 <== mon.2 v2:10.20.193.57:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f0004240 con 0x7f1608096da0 2026-02-20T16:29:45.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.731+0000 7f15dffff640 1 -- 10.20.193.57:0/2972956822 <== mon.2 v2:10.20.193.57:3302/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f15f00043e0 con 0x7f1608096da0 2026-02-20T16:29:45.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.731+0000 7f160da6d640 1 -- 10.20.193.57:0/2972956822 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1608128d70 con 0x7f1608096da0 2026-02-20T16:29:45.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.731+0000 7f15dffff640 1 -- 10.20.193.57:0/2972956822 <== mon.2 v2:10.20.193.57:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f000cab0 con 0x7f1608096da0 2026-02-20T16:29:45.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.731+0000 7f160da6d640 1 -- 10.20.193.57:0/2972956822 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f1608126900 con 0x7f1608096da0 2026-02-20T16:29:45.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.732+0000 7f15dffff640 1 -- 10.20.193.57:0/2972956822 <== mon.2 v2:10.20.193.57:3302/0 4 ==== mgrmap(e 5) ==== 62057+0+0 (secure 0 0 0) 0x7f15f000cc50 con 0x7f1608096da0 2026-02-20T16:29:45.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.732+0000 7f160da6d640 1 -- 10.20.193.57:0/2972956822 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1608096000 con 0x7f1608096da0 2026-02-20T16:29:45.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.732+0000 7f15dffff640 1 -- 10.20.193.57:0/2972956822 <== mon.2 v2:10.20.193.57:3302/0 5 ==== osd_map(17..17 src has 1..17) ==== 2861+0+0 (secure 0 0 0) 0x7f15f0066e40 con 0x7f1608096da0 2026-02-20T16:29:45.738 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.734+0000 7f15dffff640 1 -- 10.20.193.57:0/2972956822 <== mon.2 v2:10.20.193.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f15f0040ce0 con 0x7f1608096da0 2026-02-20T16:29:45.811 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:45.809+0000 7f160da6d640 1 -- 10.20.193.57:0/2972956822 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_command({"prefix": "osd set-require-min-compat-client", "version": "squid"} v 0) -- 0x7f16080697a0 con 0x7f1608096da0 2026-02-20T16:29:46.762 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.760+0000 7f15dffff640 1 -- 10.20.193.57:0/2972956822 <== mon.2 v2:10.20.193.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd set-require-min-compat-client", "version": "squid"}]=0 set require_min_compat_client to squid v18) ==== 139+0+0 (secure 0 0 0) 0x7f15f0065fa0 con 0x7f1608096da0 2026-02-20T16:29:46.763 INFO:teuthology.orchestra.run.trial057.stderr:set require_min_compat_client to squid 2026-02-20T16:29:46.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.763+0000 7f160da6d640 1 -- 10.20.193.57:0/2972956822 >> v1:10.20.193.57:6800/4138285113 conn(0x7f15d804f790 legacy=0x7f15d8051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:46.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.763+0000 7f160da6d640 1 -- 10.20.193.57:0/2972956822 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f1608096da0 msgr2=0x7f16081c2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:46.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.763+0000 7f160da6d640 1 --2- 10.20.193.57:0/2972956822 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f1608096da0 0x7f16081c2ea0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f15f0009880 tx=0x7f15f0009d50 comp rx=0 tx=0).stop 2026-02-20T16:29:46.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.763+0000 7f160da6d640 1 -- 10.20.193.57:0/2972956822 shutdown_connections 2026-02-20T16:29:46.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.763+0000 7f160da6d640 1 --2- 10.20.193.57:0/2972956822 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f160812bfd0 0x7f16081261e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:46.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.763+0000 7f160da6d640 1 --2- 10.20.193.57:0/2972956822 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f1608096da0 0x7f16081c2ea0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:46.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.763+0000 7f160da6d640 1 --2- 10.20.193.57:0/2972956822 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f1608096480 0x7f16081c2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:46.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.763+0000 7f160da6d640 1 -- 10.20.193.57:0/2972956822 >> 10.20.193.57:0/2972956822 conn(0x7f160809b3a0 msgr2=0x7f1608071920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:46.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.763+0000 7f160da6d640 1 -- 10.20.193.57:0/2972956822 shutdown_connections 2026-02-20T16:29:46.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.763+0000 7f160da6d640 1 -- 10.20.193.57:0/2972956822 wait complete. 2026-02-20T16:29:46.773 INFO:teuthology.run_tasks:Running task print... 2026-02-20T16:29:46.787 INFO:teuthology.task.print:**** done ceph 2026-02-20T16:29:46.788 INFO:teuthology.run_tasks:Running task print... 2026-02-20T16:29:46.802 INFO:teuthology.task.print:*** upgrading, no cephfs present 2026-02-20T16:29:46.802 INFO:teuthology.run_tasks:Running task exec... 2026-02-20T16:29:46.822 INFO:teuthology.task.exec:Executing custom commands... 2026-02-20T16:29:46.822 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@trial057.front.sepia.ceph.com 2026-02-20T16:29:46.823 DEBUG:teuthology.orchestra.run.trial057:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs dump' 2026-02-20T16:29:46.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.887+0000 7fa877506640 1 -- 10.20.193.57:0/3709107849 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fa87012b680 msgr2=0x7fa87012ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:46.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.887+0000 7fa877506640 1 --2- 10.20.193.57:0/3709107849 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fa87012b680 0x7fa87012ba60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa860009a00 tx=0x7fa86002f1e0 comp rx=0 tx=0).stop 2026-02-20T16:29:46.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.887+0000 7fa877506640 1 -- 10.20.193.57:0/3709107849 shutdown_connections 2026-02-20T16:29:46.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.887+0000 7fa877506640 1 --2- 10.20.193.57:0/3709107849 >> v2:10.20.193.57:3300/0 conn(0x7fa870096ff0 0x7fa870095330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:46.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.887+0000 7fa877506640 1 --2- 10.20.193.57:0/3709107849 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fa87012b680 0x7fa87012ba60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:46.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.887+0000 7fa877506640 1 -- 10.20.193.57:0/3709107849 >> 10.20.193.57:0/3709107849 conn(0x7fa87009b3a0 msgr2=0x7fa87009b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:46.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.887+0000 7fa877506640 1 -- 10.20.193.57:0/3709107849 shutdown_connections 2026-02-20T16:29:46.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.887+0000 7fa877506640 1 -- 10.20.193.57:0/3709107849 wait complete. 2026-02-20T16:29:46.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.888+0000 7fa877506640 1 Processor -- start 2026-02-20T16:29:46.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.888+0000 7fa877506640 1 -- start start 2026-02-20T16:29:46.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.888+0000 7fa877506640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fa870096ff0 0x7fa87012a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:46.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.888+0000 7fa877506640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fa87012b680 0x7fa87012a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:46.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.888+0000 7fa877506640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fa87012bfa0 0x7fa87012ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:29:46.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.888+0000 7fa877506640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7fa870133670 con 0x7fa870096ff0 2026-02-20T16:29:46.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.888+0000 7fa877506640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7fa870095160 con 0x7fa87012b680 2026-02-20T16:29:46.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.888+0000 7fa877506640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7fa8701337f0 con 0x7fa87012bfa0 2026-02-20T16:29:46.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.888+0000 7fa87527b640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fa870096ff0 0x7fa87012a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:46.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.888+0000 7fa874a7a640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fa87012b680 0x7fa87012a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:46.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.888+0000 7fa87527b640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fa870096ff0 0x7fa87012a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:39058/0 (socket says 10.20.193.57:39058) 2026-02-20T16:29:46.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.888+0000 7fa87527b640 1 -- 10.20.193.57:0/70771804 learned_addr learned my addr 10.20.193.57:0/70771804 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:29:46.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.888+0000 7fa874a7a640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fa87012b680 0x7fa87012a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3301/0 says I am v2:10.20.193.57:45062/0 (socket says 10.20.193.57:45062) 2026-02-20T16:29:46.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.888+0000 7fa875a7c640 1 --2- 10.20.193.57:0/70771804 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fa87012bfa0 0x7fa87012ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:29:46.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.888+0000 7fa87527b640 1 -- 10.20.193.57:0/70771804 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fa87012bfa0 msgr2=0x7fa87012ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:46.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.888+0000 7fa87527b640 1 --2- 10.20.193.57:0/70771804 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fa87012bfa0 0x7fa87012ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:46.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.888+0000 7fa87527b640 1 -- 10.20.193.57:0/70771804 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fa87012b680 msgr2=0x7fa87012a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:46.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.888+0000 7fa87527b640 1 --2- 10.20.193.57:0/70771804 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fa87012b680 0x7fa87012a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:46.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.888+0000 7fa87527b640 1 -- 10.20.193.57:0/70771804 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa870132b40 con 0x7fa870096ff0 2026-02-20T16:29:46.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.888+0000 7fa875a7c640 1 --2- 10.20.193.57:0/70771804 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fa87012bfa0 0x7fa87012ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T16:29:46.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.888+0000 7fa874a7a640 1 --2- 10.20.193.57:0/70771804 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fa87012b680 0x7fa87012a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:29:46.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.889+0000 7fa87527b640 1 --2- 10.20.193.57:0/70771804 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fa870096ff0 0x7fa87012a400 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa860009b30 tx=0x7fa860002910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:29:46.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.889+0000 7fa85dffb640 1 -- 10.20.193.57:0/70771804 <== mon.0 v2:10.20.193.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa860046070 con 0x7fa870096ff0 2026-02-20T16:29:46.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.889+0000 7fa85dffb640 1 -- 10.20.193.57:0/70771804 <== mon.0 v2:10.20.193.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa860004570 con 0x7fa870096ff0 2026-02-20T16:29:46.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.889+0000 7fa877506640 1 -- 10.20.193.57:0/70771804 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa870070860 con 0x7fa870096ff0 2026-02-20T16:29:46.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.889+0000 7fa85dffb640 1 -- 10.20.193.57:0/70771804 <== mon.0 v2:10.20.193.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa860038470 con 0x7fa870096ff0 2026-02-20T16:29:46.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.889+0000 7fa877506640 1 -- 10.20.193.57:0/70771804 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa87006f130 con 0x7fa870096ff0 2026-02-20T16:29:46.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.889+0000 7fa877506640 1 -- 10.20.193.57:0/70771804 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa87012ba60 con 0x7fa870096ff0 2026-02-20T16:29:46.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.889+0000 7fa85dffb640 1 -- 10.20.193.57:0/70771804 <== mon.0 v2:10.20.193.57:3300/0 4 ==== mgrmap(e 5) ==== 62057+0+0 (secure 0 0 0) 0x7fa860038610 con 0x7fa870096ff0 2026-02-20T16:29:46.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.890+0000 7fa85dffb640 1 -- 10.20.193.57:0/70771804 <== mon.0 v2:10.20.193.57:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2833+0+0 (secure 0 0 0) 0x7fa86008b290 con 0x7fa870096ff0 2026-02-20T16:29:46.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.892+0000 7fa85dffb640 1 -- 10.20.193.57:0/70771804 <== mon.0 v2:10.20.193.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7fa8600650a0 con 0x7fa870096ff0 2026-02-20T16:29:46.974 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.972+0000 7fa877506640 1 -- 10.20.193.57:0/70771804 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fa8700697a0 con 0x7fa870096ff0 2026-02-20T16:29:46.974 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.972+0000 7fa85dffb640 1 -- 10.20.193.57:0/70771804 <== mon.0 v2:10.20.193.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 1 v1) ==== 75+0+440 (secure 0 0 0) 0x7fa86008a360 con 0x7fa870096ff0 2026-02-20T16:29:46.974 INFO:teuthology.orchestra.run.trial057.stdout:e1 2026-02-20T16:29:46.974 INFO:teuthology.orchestra.run.trial057.stdout:btime 2026-02-20T16:29:22:501307+0000 2026-02-20T16:29:46.975 INFO:teuthology.orchestra.run.trial057.stdout:enable_multiple, ever_enabled_multiple: 1,1 2026-02-20T16:29:46.975 INFO:teuthology.orchestra.run.trial057.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-20T16:29:46.975 INFO:teuthology.orchestra.run.trial057.stdout:legacy client fscid: -1 2026-02-20T16:29:46.975 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:29:46.975 INFO:teuthology.orchestra.run.trial057.stdout:No filesystems configured 2026-02-20T16:29:46.976 INFO:teuthology.orchestra.run.trial057.stderr:dumped fsmap epoch 1 2026-02-20T16:29:46.976 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.973+0000 7fa877506640 1 -- 10.20.193.57:0/70771804 >> v1:10.20.193.57:6800/4138285113 conn(0x7fa84004f790 legacy=0x7fa840051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:46.976 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.973+0000 7fa877506640 1 -- 10.20.193.57:0/70771804 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fa870096ff0 msgr2=0x7fa87012a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:29:46.976 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.973+0000 7fa877506640 1 --2- 10.20.193.57:0/70771804 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fa870096ff0 0x7fa87012a400 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa860009b30 tx=0x7fa860002910 comp rx=0 tx=0).stop 2026-02-20T16:29:46.977 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.973+0000 7fa877506640 1 -- 10.20.193.57:0/70771804 shutdown_connections 2026-02-20T16:29:46.977 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.973+0000 7fa877506640 1 --2- 10.20.193.57:0/70771804 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fa87012bfa0 0x7fa87012ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:46.977 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.973+0000 7fa877506640 1 --2- 10.20.193.57:0/70771804 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fa87012b680 0x7fa87012a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:46.977 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.973+0000 7fa877506640 1 --2- 10.20.193.57:0/70771804 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fa870096ff0 0x7fa87012a400 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:29:46.977 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.973+0000 7fa877506640 1 -- 10.20.193.57:0/70771804 >> 10.20.193.57:0/70771804 conn(0x7fa87009b3a0 msgr2=0x7fa870134680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:29:46.977 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.973+0000 7fa877506640 1 -- 10.20.193.57:0/70771804 shutdown_connections 2026-02-20T16:29:46.977 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:29:46.973+0000 7fa877506640 1 -- 10.20.193.57:0/70771804 wait complete. 2026-02-20T16:29:46.982 INFO:teuthology.run_tasks:Running task install.upgrade... 2026-02-20T16:29:46.996 INFO:teuthology.task.install:project ceph config {'mon.a': None} overrides {'flavor': 'default', 'sha1': 'f7870454149f22574086dd2ff55d050585136531'} 2026-02-20T16:29:46.996 INFO:teuthology.task.install:remote ubuntu@trial057.front.sepia.ceph.com config {'flavor': 'default', 'sha1': 'f7870454149f22574086dd2ff55d050585136531'} 2026-02-20T16:29:46.996 INFO:teuthology.task.install:extra packages: [] 2026-02-20T16:29:47.004 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-20T16:29:47.004 INFO:teuthology.task.install:Upgrading ceph rpm packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd 2026-02-20T16:29:47.005 DEBUG:teuthology.orchestra.run.trial057:> rpm -q ceph-common --qf '%{VERSION}-%{RELEASE}' 2026-02-20T16:29:47.024 INFO:teuthology.orchestra.run.trial057.stdout:19.2.3-672.g283431c0.el9 2026-02-20T16:29:47.024 INFO:teuthology.packaging:The installed version of ceph-common is 19.2.3-672.g283431c0.el9 2026-02-20T16:29:47.025 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f7870454149f22574086dd2ff55d050585136531 2026-02-20T16:29:47.183 INFO:teuthology.task.install:Ceph rpm upgrade from 19.2.3-672.g283431c0.el9 to 20.2.0-677.gf7870454 2026-02-20T16:29:47.183 INFO:teuthology.task.install.rpm:Host trial057 is: centos 9.stream x86_64 2026-02-20T16:29:47.184 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f7870454149f22574086dd2ff55d050585136531 2026-02-20T16:29:47.325 INFO:teuthology.task.install.rpm:Repo base URL: https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260219.182737-tentacle/f7870454149f22574086dd2ff55d050585136531/centos/9/flavors/default/ 2026-02-20T16:29:47.325 DEBUG:teuthology.orchestra.run.trial057:> sudo rm -f /etc/yum.repos.d/ceph.repo 2026-02-20T16:29:47.487 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260219.182737-tentacle/f7870454149f22574086dd2ff55d050585136531/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260219.182737-tentacle/f7870454149f22574086dd2ff55d050585136531/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260219.182737-tentacle/f7870454149f22574086dd2ff55d050585136531/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-20T16:29:47.487 DEBUG:teuthology.orchestra.run.trial057:> set -ex 2026-02-20T16:29:47.487 DEBUG:teuthology.orchestra.run.trial057:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-20T16:29:47.512 DEBUG:teuthology.orchestra.run.trial057:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/f7870454149f22574086dd2ff55d050585136531/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-20T16:29:47.577 DEBUG:teuthology.orchestra.run.trial057:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-20T16:29:47.641 DEBUG:teuthology.orchestra.run.trial057:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-20T16:29:47.697 INFO:teuthology.orchestra.run.trial057.stdout:check_obsoletes = 1 2026-02-20T16:29:47.706 DEBUG:teuthology.orchestra.run.trial057:> sudo yum clean all 2026-02-20T16:29:47.865 INFO:teuthology.orchestra.run.trial057.stdout:56 files removed 2026-02-20T16:29:47.880 DEBUG:teuthology.orchestra.run.trial057:> sudo yum -y upgrade ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd 2026-02-20T16:29:48.171 INFO:teuthology.orchestra.run.trial057.stdout:ceph packages for x86_64 613 kB/s | 87 kB 00:00 2026-02-20T16:29:48.314 INFO:teuthology.orchestra.run.trial057.stdout:ceph noarch packages 153 kB/s | 18 kB 00:00 2026-02-20T16:29:48.446 INFO:teuthology.orchestra.run.trial057.stdout:ceph source packages 18 kB/s | 1.9 kB 00:00 2026-02-20T16:29:49.323 INFO:teuthology.orchestra.run.trial057.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.9 MB 00:00 2026-02-20T16:30:06.254 INFO:teuthology.orchestra.run.trial057.stdout:CentOS Stream 9 - AppStream 1.6 MB/s | 27 MB 00:16 2026-02-20T16:30:09.535 INFO:teuthology.orchestra.run.trial057.stdout:CentOS Stream 9 - CRB 8.5 MB/s | 7.8 MB 00:00 2026-02-20T16:30:11.384 INFO:teuthology.orchestra.run.trial057.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 20 kB 00:01 2026-02-20T16:30:11.663 INFO:teuthology.orchestra.run.trial057.stdout:Extra Packages for Enterprise Linux 94 MB/s | 20 MB 00:00 2026-02-20T16:30:14.846 INFO:teuthology.orchestra.run.trial057.stdout:lab-extras 1.7 MB/s | 50 kB 00:00 2026-02-20T16:30:16.029 INFO:teuthology.orchestra.run.trial057.stderr:Package cephadm available, but not installed. 2026-02-20T16:30:16.029 INFO:teuthology.orchestra.run.trial057.stdout:No match for argument: cephadm 2026-02-20T16:30:16.031 INFO:teuthology.orchestra.run.trial057.stderr:Package ceph-mgr-dashboard available, but not installed. 2026-02-20T16:30:16.032 INFO:teuthology.orchestra.run.trial057.stdout:No match for argument: ceph-mgr-dashboard 2026-02-20T16:30:16.032 INFO:teuthology.orchestra.run.trial057.stderr:Package ceph-mgr-diskprediction-local available, but not installed. 2026-02-20T16:30:16.032 INFO:teuthology.orchestra.run.trial057.stdout:No match for argument: ceph-mgr-diskprediction-local 2026-02-20T16:30:16.033 INFO:teuthology.orchestra.run.trial057.stderr:Package ceph-mgr-rook available, but not installed. 2026-02-20T16:30:16.033 INFO:teuthology.orchestra.run.trial057.stdout:No match for argument: ceph-mgr-rook 2026-02-20T16:30:16.033 INFO:teuthology.orchestra.run.trial057.stderr:Package ceph-mgr-cephadm available, but not installed. 2026-02-20T16:30:16.034 INFO:teuthology.orchestra.run.trial057.stdout:No match for argument: ceph-mgr-cephadm 2026-02-20T16:30:16.034 INFO:teuthology.orchestra.run.trial057.stderr:Package ceph-volume available, but not installed. 2026-02-20T16:30:16.034 INFO:teuthology.orchestra.run.trial057.stdout:No match for argument: ceph-volume 2026-02-20T16:30:16.071 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-20T16:30:16.072 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-20T16:30:16.072 INFO:teuthology.orchestra.run.trial057.stdout: Package Arch Version Repository Size 2026-02-20T16:30:16.072 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-20T16:30:16.073 INFO:teuthology.orchestra.run.trial057.stdout:Upgrading: 2026-02-20T16:30:16.073 INFO:teuthology.orchestra.run.trial057.stdout: ceph x86_64 2:20.2.0-677.gf7870454.el9 ceph 6.5 k 2026-02-20T16:30:16.073 INFO:teuthology.orchestra.run.trial057.stdout: ceph-base x86_64 2:20.2.0-677.gf7870454.el9 ceph 5.9 M 2026-02-20T16:30:16.073 INFO:teuthology.orchestra.run.trial057.stdout: ceph-common x86_64 2:20.2.0-677.gf7870454.el9 ceph 24 M 2026-02-20T16:30:16.073 INFO:teuthology.orchestra.run.trial057.stdout: ceph-fuse x86_64 2:20.2.0-677.gf7870454.el9 ceph 943 k 2026-02-20T16:30:16.073 INFO:teuthology.orchestra.run.trial057.stdout: ceph-immutable-object-cache 2026-02-20T16:30:16.073 INFO:teuthology.orchestra.run.trial057.stdout: x86_64 2:20.2.0-677.gf7870454.el9 ceph 154 k 2026-02-20T16:30:16.073 INFO:teuthology.orchestra.run.trial057.stdout: ceph-mds x86_64 2:20.2.0-677.gf7870454.el9 ceph 2.3 M 2026-02-20T16:30:16.073 INFO:teuthology.orchestra.run.trial057.stdout: ceph-mgr x86_64 2:20.2.0-677.gf7870454.el9 ceph 961 k 2026-02-20T16:30:16.073 INFO:teuthology.orchestra.run.trial057.stdout: ceph-mgr-modules-core noarch 2:20.2.0-677.gf7870454.el9 ceph-noarch 290 k 2026-02-20T16:30:16.073 INFO:teuthology.orchestra.run.trial057.stdout: ceph-mon x86_64 2:20.2.0-677.gf7870454.el9 ceph 5.0 M 2026-02-20T16:30:16.074 INFO:teuthology.orchestra.run.trial057.stdout: ceph-osd x86_64 2:20.2.0-677.gf7870454.el9 ceph 17 M 2026-02-20T16:30:16.074 INFO:teuthology.orchestra.run.trial057.stdout: ceph-radosgw x86_64 2:20.2.0-677.gf7870454.el9 ceph 24 M 2026-02-20T16:30:16.074 INFO:teuthology.orchestra.run.trial057.stdout: ceph-selinux x86_64 2:20.2.0-677.gf7870454.el9 ceph 25 k 2026-02-20T16:30:16.074 INFO:teuthology.orchestra.run.trial057.stdout: ceph-test x86_64 2:20.2.0-677.gf7870454.el9 ceph 84 M 2026-02-20T16:30:16.074 INFO:teuthology.orchestra.run.trial057.stdout: libcephfs-devel x86_64 2:20.2.0-677.gf7870454.el9 ceph 34 k 2026-02-20T16:30:16.074 INFO:teuthology.orchestra.run.trial057.stdout: libcephfs2 x86_64 2:20.2.0-677.gf7870454.el9 ceph 869 k 2026-02-20T16:30:16.074 INFO:teuthology.orchestra.run.trial057.stdout: libcephsqlite x86_64 2:20.2.0-677.gf7870454.el9 ceph 164 k 2026-02-20T16:30:16.074 INFO:teuthology.orchestra.run.trial057.stdout: librados-devel x86_64 2:20.2.0-677.gf7870454.el9 ceph 126 k 2026-02-20T16:30:16.074 INFO:teuthology.orchestra.run.trial057.stdout: librados2 x86_64 2:20.2.0-677.gf7870454.el9 ceph 3.5 M 2026-02-20T16:30:16.074 INFO:teuthology.orchestra.run.trial057.stdout: libradosstriper1 x86_64 2:20.2.0-677.gf7870454.el9 ceph 250 k 2026-02-20T16:30:16.074 INFO:teuthology.orchestra.run.trial057.stdout: librbd1 x86_64 2:20.2.0-677.gf7870454.el9 ceph 2.8 M 2026-02-20T16:30:16.074 INFO:teuthology.orchestra.run.trial057.stdout: librgw2 x86_64 2:20.2.0-677.gf7870454.el9 ceph 6.4 M 2026-02-20T16:30:16.075 INFO:teuthology.orchestra.run.trial057.stdout: python3-ceph-argparse x86_64 2:20.2.0-677.gf7870454.el9 ceph 45 k 2026-02-20T16:30:16.075 INFO:teuthology.orchestra.run.trial057.stdout: python3-ceph-common x86_64 2:20.2.0-677.gf7870454.el9 ceph 175 k 2026-02-20T16:30:16.075 INFO:teuthology.orchestra.run.trial057.stdout: python3-cephfs x86_64 2:20.2.0-677.gf7870454.el9 ceph 163 k 2026-02-20T16:30:16.075 INFO:teuthology.orchestra.run.trial057.stdout: python3-rados x86_64 2:20.2.0-677.gf7870454.el9 ceph 323 k 2026-02-20T16:30:16.075 INFO:teuthology.orchestra.run.trial057.stdout: python3-rbd x86_64 2:20.2.0-677.gf7870454.el9 ceph 305 k 2026-02-20T16:30:16.075 INFO:teuthology.orchestra.run.trial057.stdout: python3-rgw x86_64 2:20.2.0-677.gf7870454.el9 ceph 99 k 2026-02-20T16:30:16.075 INFO:teuthology.orchestra.run.trial057.stdout: rbd-fuse x86_64 2:20.2.0-677.gf7870454.el9 ceph 91 k 2026-02-20T16:30:16.075 INFO:teuthology.orchestra.run.trial057.stdout: rbd-mirror x86_64 2:20.2.0-677.gf7870454.el9 ceph 2.9 M 2026-02-20T16:30:16.075 INFO:teuthology.orchestra.run.trial057.stdout: rbd-nbd x86_64 2:20.2.0-677.gf7870454.el9 ceph 180 k 2026-02-20T16:30:16.076 INFO:teuthology.orchestra.run.trial057.stdout:Installing dependencies: 2026-02-20T16:30:16.076 INFO:teuthology.orchestra.run.trial057.stdout: libcephfs-proxy2 x86_64 2:20.2.0-677.gf7870454.el9 ceph 24 k 2026-02-20T16:30:16.076 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:30:16.076 INFO:teuthology.orchestra.run.trial057.stdout:Transaction Summary 2026-02-20T16:30:16.076 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-20T16:30:16.076 INFO:teuthology.orchestra.run.trial057.stdout:Install 1 Package 2026-02-20T16:30:16.076 INFO:teuthology.orchestra.run.trial057.stdout:Upgrade 30 Packages 2026-02-20T16:30:16.076 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:30:16.077 INFO:teuthology.orchestra.run.trial057.stdout:Total download size: 182 M 2026-02-20T16:30:16.077 INFO:teuthology.orchestra.run.trial057.stdout:Downloading Packages: 2026-02-20T16:30:16.129 INFO:teuthology.orchestra.run.trial057.stdout:(1/31): ceph-20.2.0-677.gf7870454.el9.x86_64.rp 118 kB/s | 6.5 kB 00:00 2026-02-20T16:30:16.140 INFO:teuthology.orchestra.run.trial057.stdout:(2/31): libcephfs-proxy2-20.2.0-677.gf7870454.e 369 kB/s | 24 kB 00:00 2026-02-20T16:30:16.233 INFO:teuthology.orchestra.run.trial057.stdout:(3/31): ceph-fuse-20.2.0-677.gf7870454.el9.x86_ 9.9 MB/s | 943 kB 00:00 2026-02-20T16:30:16.274 INFO:teuthology.orchestra.run.trial057.stdout:(4/31): ceph-immutable-object-cache-20.2.0-677. 3.6 MB/s | 154 kB 00:00 2026-02-20T16:30:16.376 INFO:teuthology.orchestra.run.trial057.stdout:(5/31): ceph-base-20.2.0-677.gf7870454.el9.x86_ 20 MB/s | 5.9 MB 00:00 2026-02-20T16:30:16.420 INFO:teuthology.orchestra.run.trial057.stdout:(6/31): ceph-mgr-20.2.0-677.gf7870454.el9.x86_6 21 MB/s | 961 kB 00:00 2026-02-20T16:30:16.432 INFO:teuthology.orchestra.run.trial057.stdout:(7/31): ceph-mds-20.2.0-677.gf7870454.el9.x86_6 15 MB/s | 2.3 MB 00:00 2026-02-20T16:30:16.656 INFO:teuthology.orchestra.run.trial057.stdout:(8/31): ceph-mon-20.2.0-677.gf7870454.el9.x86_6 21 MB/s | 5.0 MB 00:00 2026-02-20T16:30:17.638 INFO:teuthology.orchestra.run.trial057.stdout:(9/31): ceph-common-20.2.0-677.gf7870454.el9.x8 16 MB/s | 24 MB 00:01 2026-02-20T16:30:17.695 INFO:teuthology.orchestra.run.trial057.stdout:(10/31): ceph-radosgw-20.2.0-677.gf7870454.el9. 23 MB/s | 24 MB 00:01 2026-02-20T16:30:17.696 INFO:teuthology.orchestra.run.trial057.stdout:(11/31): ceph-selinux-20.2.0-677.gf7870454.el9. 434 kB/s | 25 kB 00:00 2026-02-20T16:30:17.756 INFO:teuthology.orchestra.run.trial057.stdout:(12/31): libcephfs-devel-20.2.0-677.gf7870454.e 569 kB/s | 34 kB 00:00 2026-02-20T16:30:17.881 INFO:teuthology.orchestra.run.trial057.stdout:(13/31): libcephfs2-20.2.0-677.gf7870454.el9.x8 6.8 MB/s | 869 kB 00:00 2026-02-20T16:30:17.908 INFO:teuthology.orchestra.run.trial057.stdout:(14/31): ceph-osd-20.2.0-677.gf7870454.el9.x86_ 11 MB/s | 17 MB 00:01 2026-02-20T16:30:17.933 INFO:teuthology.orchestra.run.trial057.stdout:(15/31): libcephsqlite-20.2.0-677.gf7870454.el9 3.1 MB/s | 164 kB 00:00 2026-02-20T16:30:17.961 INFO:teuthology.orchestra.run.trial057.stdout:(16/31): librados-devel-20.2.0-677.gf7870454.el 2.3 MB/s | 126 kB 00:00 2026-02-20T16:30:18.023 INFO:teuthology.orchestra.run.trial057.stdout:(17/31): libradosstriper1-20.2.0-677.gf7870454. 4.0 MB/s | 250 kB 00:00 2026-02-20T16:30:18.389 INFO:teuthology.orchestra.run.trial057.stdout:(18/31): librados2-20.2.0-677.gf7870454.el9.x86 7.7 MB/s | 3.5 MB 00:00 2026-02-20T16:30:18.487 INFO:teuthology.orchestra.run.trial057.stdout:(19/31): librbd1-20.2.0-677.gf7870454.el9.x86_6 6.1 MB/s | 2.8 MB 00:00 2026-02-20T16:30:18.548 INFO:teuthology.orchestra.run.trial057.stdout:(20/31): python3-ceph-argparse-20.2.0-677.gf787 730 kB/s | 45 kB 00:00 2026-02-20T16:30:18.612 INFO:teuthology.orchestra.run.trial057.stdout:(21/31): python3-ceph-common-20.2.0-677.gf78704 2.7 MB/s | 175 kB 00:00 2026-02-20T16:30:18.675 INFO:teuthology.orchestra.run.trial057.stdout:(22/31): python3-cephfs-20.2.0-677.gf7870454.el 2.5 MB/s | 163 kB 00:00 2026-02-20T16:30:18.742 INFO:teuthology.orchestra.run.trial057.stdout:(23/31): python3-rados-20.2.0-677.gf7870454.el9 4.7 MB/s | 323 kB 00:00 2026-02-20T16:30:18.810 INFO:teuthology.orchestra.run.trial057.stdout:(24/31): python3-rbd-20.2.0-677.gf7870454.el9.x 4.4 MB/s | 305 kB 00:00 2026-02-20T16:30:18.874 INFO:teuthology.orchestra.run.trial057.stdout:(25/31): python3-rgw-20.2.0-677.gf7870454.el9.x 1.5 MB/s | 99 kB 00:00 2026-02-20T16:30:18.940 INFO:teuthology.orchestra.run.trial057.stdout:(26/31): rbd-fuse-20.2.0-677.gf7870454.el9.x86_ 1.4 MB/s | 91 kB 00:00 2026-02-20T16:30:19.169 INFO:teuthology.orchestra.run.trial057.stdout:(27/31): librgw2-20.2.0-677.gf7870454.el9.x86_6 8.2 MB/s | 6.4 MB 00:00 2026-02-20T16:30:19.226 INFO:teuthology.orchestra.run.trial057.stdout:(28/31): rbd-nbd-20.2.0-677.gf7870454.el9.x86_6 3.1 MB/s | 180 kB 00:00 2026-02-20T16:30:19.285 INFO:teuthology.orchestra.run.trial057.stdout:(29/31): ceph-mgr-modules-core-20.2.0-677.gf787 4.8 MB/s | 290 kB 00:00 2026-02-20T16:30:19.536 INFO:teuthology.orchestra.run.trial057.stdout:(30/31): rbd-mirror-20.2.0-677.gf7870454.el9.x8 4.9 MB/s | 2.9 MB 00:00 2026-02-20T16:30:20.586 INFO:teuthology.orchestra.run.trial057.stdout:(31/31): ceph-test-20.2.0-677.gf7870454.el9.x86 29 MB/s | 84 MB 00:02 2026-02-20T16:30:20.589 INFO:teuthology.orchestra.run.trial057.stdout:-------------------------------------------------------------------------------- 2026-02-20T16:30:20.589 INFO:teuthology.orchestra.run.trial057.stdout:Total 40 MB/s | 182 MB 00:04 2026-02-20T16:30:20.589 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction check 2026-02-20T16:30:20.610 INFO:teuthology.orchestra.run.trial057.stdout:Transaction check succeeded. 2026-02-20T16:30:20.610 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction test 2026-02-20T16:30:21.195 INFO:teuthology.orchestra.run.trial057.stdout:Transaction test succeeded. 2026-02-20T16:30:21.195 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction 2026-02-20T16:30:21.955 INFO:teuthology.orchestra.run.trial057.stdout: Preparing : 1/1 2026-02-20T16:30:21.962 INFO:teuthology.orchestra.run.trial057.stdout: Upgrading : librados2-2:20.2.0-677.gf7870454.el9.x86_64 1/61 2026-02-20T16:30:22.098 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: librados2-2:20.2.0-677.gf7870454.el9.x86_64 1/61 2026-02-20T16:30:22.099 INFO:teuthology.orchestra.run.trial057.stdout: Upgrading : librbd1-2:20.2.0-677.gf7870454.el9.x86_64 2/61 2026-02-20T16:30:22.392 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: librbd1-2:20.2.0-677.gf7870454.el9.x86_64 2/61 2026-02-20T16:30:22.406 INFO:teuthology.orchestra.run.trial057.stdout: Upgrading : librgw2-2:20.2.0-677.gf7870454.el9.x86_64 3/61 2026-02-20T16:30:22.432 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: librgw2-2:20.2.0-677.gf7870454.el9.x86_64 3/61 2026-02-20T16:30:22.441 INFO:teuthology.orchestra.run.trial057.stdout: Upgrading : python3-rados-2:20.2.0-677.gf7870454.el9.x86_64 4/61 2026-02-20T16:30:22.442 INFO:teuthology.orchestra.run.trial057.stdout: Upgrading : libcephsqlite-2:20.2.0-677.gf7870454.el9.x86_64 5/61 2026-02-20T16:30:22.464 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: libcephsqlite-2:20.2.0-677.gf7870454.el9.x86_64 5/61 2026-02-20T16:30:22.465 INFO:teuthology.orchestra.run.trial057.stdout: Upgrading : libradosstriper1-2:20.2.0-677.gf7870454.el9.x86_64 6/61 2026-02-20T16:30:22.479 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: libradosstriper1-2:20.2.0-677.gf7870454.el9.x86_64 6/61 2026-02-20T16:30:22.481 INFO:teuthology.orchestra.run.trial057.stdout: Upgrading : python3-ceph-argparse-2:20.2.0-677.gf7870454.el9.x 7/61 2026-02-20T16:30:22.481 INFO:teuthology.orchestra.run.trial057.stdout: Installing : libcephfs-proxy2-2:20.2.0-677.gf7870454.el9.x86_64 8/61 2026-02-20T16:30:22.528 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: libcephfs-proxy2-2:20.2.0-677.gf7870454.el9.x86_64 8/61 2026-02-20T16:30:22.529 INFO:teuthology.orchestra.run.trial057.stdout: Upgrading : libcephfs2-2:20.2.0-677.gf7870454.el9.x86_64 9/61 2026-02-20T16:30:22.548 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: libcephfs2-2:20.2.0-677.gf7870454.el9.x86_64 9/61 2026-02-20T16:30:22.565 INFO:teuthology.orchestra.run.trial057.stdout: Upgrading : python3-cephfs-2:20.2.0-677.gf7870454.el9.x86_64 10/61 2026-02-20T16:30:22.572 INFO:teuthology.orchestra.run.trial057.stdout: Upgrading : python3-rbd-2:20.2.0-677.gf7870454.el9.x86_64 11/61 2026-02-20T16:30:22.579 INFO:teuthology.orchestra.run.trial057.stdout: Upgrading : python3-rgw-2:20.2.0-677.gf7870454.el9.x86_64 12/61 2026-02-20T16:30:22.626 INFO:teuthology.orchestra.run.trial057.stdout: Upgrading : librados-devel-2:20.2.0-677.gf7870454.el9.x86_64 13/61 2026-02-20T16:30:22.661 INFO:teuthology.orchestra.run.trial057.stdout: Upgrading : ceph-mgr-modules-core-2:20.2.0-677.gf7870454.el9.n 14/61 2026-02-20T16:30:22.662 INFO:teuthology.orchestra.run.trial057.stdout: Upgrading : python3-ceph-common-2:20.2.0-677.gf7870454.el9.x86 15/61 2026-02-20T16:30:23.776 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-common-2:20.2.0-677.gf7870454.el9.x86_64 16/61 2026-02-20T16:30:23.784 INFO:teuthology.orchestra.run.trial057.stdout: Upgrading : ceph-common-2:20.2.0-677.gf7870454.el9.x86_64 16/61 2026-02-20T16:30:24.080 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-common-2:20.2.0-677.gf7870454.el9.x86_64 16/61 2026-02-20T16:30:24.091 INFO:teuthology.orchestra.run.trial057.stdout: Upgrading : ceph-base-2:20.2.0-677.gf7870454.el9.x86_64 17/61 2026-02-20T16:30:24.106 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-base-2:20.2.0-677.gf7870454.el9.x86_64 17/61 2026-02-20T16:30:24.107 INFO:teuthology.orchestra.run.trial057.stdout: Upgrading : ceph-selinux-2:20.2.0-677.gf7870454.el9.x86_64 18/61 2026-02-20T16:30:28.304 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-selinux-2:20.2.0-677.gf7870454.el9.x86_64 18/61 2026-02-20T16:30:28.306 INFO:teuthology.orchestra.run.trial057.stdout: Upgrading : ceph-mds-2:20.2.0-677.gf7870454.el9.x86_64 19/61 2026-02-20T16:30:28.354 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-mds-2:20.2.0-677.gf7870454.el9.x86_64 19/61 2026-02-20T16:30:28.356 INFO:teuthology.orchestra.run.trial057.stdout: Upgrading : ceph-mgr-2:20.2.0-677.gf7870454.el9.x86_64 20/61 2026-02-20T16:30:28.578 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-mgr-2:20.2.0-677.gf7870454.el9.x86_64 20/61 2026-02-20T16:30:28.588 INFO:teuthology.orchestra.run.trial057.stdout: Upgrading : ceph-mon-2:20.2.0-677.gf7870454.el9.x86_64 21/61 2026-02-20T16:30:29.293 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-mon-2:20.2.0-677.gf7870454.el9.x86_64 21/61 2026-02-20T16:30:29.309 INFO:teuthology.orchestra.run.trial057.stdout: Upgrading : ceph-osd-2:20.2.0-677.gf7870454.el9.x86_64 22/61 2026-02-20T16:30:29.318 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-osd-2:20.2.0-677.gf7870454.el9.x86_64 22/61 2026-02-20T16:30:30.415 INFO:teuthology.orchestra.run.trial057.stdout: Upgrading : ceph-2:20.2.0-677.gf7870454.el9.x86_64 23/61 2026-02-20T16:30:30.425 INFO:teuthology.orchestra.run.trial057.stdout: Upgrading : ceph-radosgw-2:20.2.0-677.gf7870454.el9.x86_64 24/61 2026-02-20T16:30:30.440 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-radosgw-2:20.2.0-677.gf7870454.el9.x86_64 24/61 2026-02-20T16:30:30.441 INFO:teuthology.orchestra.run.trial057.stdout: Upgrading : ceph-immutable-object-cache-2:20.2.0-677.gf7870454 25/61 2026-02-20T16:30:30.575 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.2.0-677.gf7870454 25/61 2026-02-20T16:30:30.578 INFO:teuthology.orchestra.run.trial057.stdout: Upgrading : rbd-mirror-2:20.2.0-677.gf7870454.el9.x86_64 26/61 2026-02-20T16:30:34.482 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: rbd-mirror-2:20.2.0-677.gf7870454.el9.x86_64 26/61 2026-02-20T16:30:34.489 INFO:teuthology.orchestra.run.trial057.stdout: Upgrading : ceph-test-2:20.2.0-677.gf7870454.el9.x86_64 27/61 2026-02-20T16:30:34.494 INFO:teuthology.orchestra.run.trial057.stdout: Upgrading : libcephfs-devel-2:20.2.0-677.gf7870454.el9.x86_64 28/61 2026-02-20T16:30:34.504 INFO:teuthology.orchestra.run.trial057.stdout: Upgrading : rbd-fuse-2:20.2.0-677.gf7870454.el9.x86_64 29/61 2026-02-20T16:30:34.545 INFO:teuthology.orchestra.run.trial057.stdout: Upgrading : rbd-nbd-2:20.2.0-677.gf7870454.el9.x86_64 30/61 2026-02-20T16:30:34.546 INFO:teuthology.orchestra.run.trial057.stdout: Upgrading : ceph-fuse-2:20.2.0-677.gf7870454.el9.x86_64 31/61 2026-02-20T16:30:34.550 INFO:teuthology.orchestra.run.trial057.stdout: Cleanup : ceph-2:19.2.3-672.g283431c0.el9.x86_64 32/61 2026-02-20T16:30:34.554 INFO:teuthology.orchestra.run.trial057.stdout: Cleanup : ceph-test-2:19.2.3-672.g283431c0.el9.x86_64 33/61 2026-02-20T16:30:34.559 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-672.g283431c0.el9.x86_64 34/61 2026-02-20T16:30:34.559 INFO:teuthology.orchestra.run.trial057.stdout: Cleanup : ceph-radosgw-2:19.2.3-672.g283431c0.el9.x86_64 34/61 2026-02-20T16:30:34.567 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-672.g283431c0.el9.x86_64 34/61 2026-02-20T16:30:34.569 INFO:teuthology.orchestra.run.trial057.stdout: Cleanup : rbd-nbd-2:19.2.3-672.g283431c0.el9.x86_64 35/61 2026-02-20T16:30:34.574 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: rbd-mirror-2:19.2.3-672.g283431c0.el9.x86_64 36/61 2026-02-20T16:30:34.574 INFO:teuthology.orchestra.run.trial057.stdout: Cleanup : rbd-mirror-2:19.2.3-672.g283431c0.el9.x86_64 36/61 2026-02-20T16:30:34.581 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: rbd-mirror-2:19.2.3-672.g283431c0.el9.x86_64 36/61 2026-02-20T16:30:34.586 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-mgr-2:19.2.3-672.g283431c0.el9.x86_64 37/61 2026-02-20T16:30:34.587 INFO:teuthology.orchestra.run.trial057.stdout: Cleanup : ceph-mgr-2:19.2.3-672.g283431c0.el9.x86_64 37/61 2026-02-20T16:30:34.593 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-mgr-2:19.2.3-672.g283431c0.el9.x86_64 37/61 2026-02-20T16:30:34.595 INFO:teuthology.orchestra.run.trial057.stdout: Cleanup : rbd-fuse-2:19.2.3-672.g283431c0.el9.x86_64 38/61 2026-02-20T16:30:34.600 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-672.g283431c0 39/61 2026-02-20T16:30:34.600 INFO:teuthology.orchestra.run.trial057.stdout: Cleanup : ceph-immutable-object-cache-2:19.2.3-672.g283431c0 39/61 2026-02-20T16:30:34.607 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-672.g283431c0 39/61 2026-02-20T16:30:34.608 INFO:teuthology.orchestra.run.trial057.stdout: Cleanup : libcephfs-devel-2:19.2.3-672.g283431c0.el9.x86_64 40/61 2026-02-20T16:30:34.608 INFO:teuthology.orchestra.run.trial057.stdout: Cleanup : libcephsqlite-2:19.2.3-672.g283431c0.el9.x86_64 41/61 2026-02-20T16:30:34.620 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: libcephsqlite-2:19.2.3-672.g283431c0.el9.x86_64 41/61 2026-02-20T16:30:34.622 INFO:teuthology.orchestra.run.trial057.stdout: Cleanup : librados-devel-2:19.2.3-672.g283431c0.el9.x86_64 42/61 2026-02-20T16:30:34.627 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-mds-2:19.2.3-672.g283431c0.el9.x86_64 43/61 2026-02-20T16:30:34.627 INFO:teuthology.orchestra.run.trial057.stdout: Cleanup : ceph-mds-2:19.2.3-672.g283431c0.el9.x86_64 43/61 2026-02-20T16:30:34.634 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-mds-2:19.2.3-672.g283431c0.el9.x86_64 43/61 2026-02-20T16:30:34.639 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-mon-2:19.2.3-672.g283431c0.el9.x86_64 44/61 2026-02-20T16:30:34.639 INFO:teuthology.orchestra.run.trial057.stdout: Cleanup : ceph-mon-2:19.2.3-672.g283431c0.el9.x86_64 44/61 2026-02-20T16:30:34.646 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-mon-2:19.2.3-672.g283431c0.el9.x86_64 44/61 2026-02-20T16:30:34.652 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-osd-2:19.2.3-672.g283431c0.el9.x86_64 45/61 2026-02-20T16:30:34.653 INFO:teuthology.orchestra.run.trial057.stdout: Cleanup : ceph-osd-2:19.2.3-672.g283431c0.el9.x86_64 45/61 2026-02-20T16:30:34.660 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-osd-2:19.2.3-672.g283431c0.el9.x86_64 45/61 2026-02-20T16:30:34.661 INFO:teuthology.orchestra.run.trial057.stdout: Cleanup : ceph-selinux-2:19.2.3-672.g283431c0.el9.x86_64 46/61 2026-02-20T16:30:34.666 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-selinux-2:19.2.3-672.g283431c0.el9.x86_64 46/61 2026-02-20T16:30:34.673 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-base-2:19.2.3-672.g283431c0.el9.x86_64 47/61 2026-02-20T16:30:34.673 INFO:teuthology.orchestra.run.trial057.stdout: Cleanup : ceph-base-2:19.2.3-672.g283431c0.el9.x86_64 47/61 2026-02-20T16:30:34.689 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-base-2:19.2.3-672.g283431c0.el9.x86_64 47/61 2026-02-20T16:30:34.690 INFO:teuthology.orchestra.run.trial057.stdout: Cleanup : ceph-common-2:19.2.3-672.g283431c0.el9.x86_64 48/61 2026-02-20T16:30:34.698 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-common-2:19.2.3-672.g283431c0.el9.x86_64 48/61 2026-02-20T16:30:34.698 INFO:teuthology.orchestra.run.trial057.stdout: Cleanup : libradosstriper1-2:19.2.3-672.g283431c0.el9.x86_64 49/61 2026-02-20T16:30:34.708 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: libradosstriper1-2:19.2.3-672.g283431c0.el9.x86_64 49/61 2026-02-20T16:30:34.709 INFO:teuthology.orchestra.run.trial057.stdout: Cleanup : python3-cephfs-2:19.2.3-672.g283431c0.el9.x86_64 50/61 2026-02-20T16:30:34.711 INFO:teuthology.orchestra.run.trial057.stdout: Cleanup : python3-rbd-2:19.2.3-672.g283431c0.el9.x86_64 51/61 2026-02-20T16:30:34.711 INFO:teuthology.orchestra.run.trial057.stdout: Cleanup : librbd1-2:19.2.3-672.g283431c0.el9.x86_64 52/61 2026-02-20T16:30:34.722 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: librbd1-2:19.2.3-672.g283431c0.el9.x86_64 52/61 2026-02-20T16:30:34.723 INFO:teuthology.orchestra.run.trial057.stdout: Cleanup : python3-rgw-2:19.2.3-672.g283431c0.el9.x86_64 53/61 2026-02-20T16:30:34.723 INFO:teuthology.orchestra.run.trial057.stdout: Cleanup : librgw2-2:19.2.3-672.g283431c0.el9.x86_64 54/61 2026-02-20T16:30:34.734 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: librgw2-2:19.2.3-672.g283431c0.el9.x86_64 54/61 2026-02-20T16:30:34.736 INFO:teuthology.orchestra.run.trial057.stdout: Cleanup : python3-rados-2:19.2.3-672.g283431c0.el9.x86_64 55/61 2026-02-20T16:30:34.736 INFO:teuthology.orchestra.run.trial057.stdout: Cleanup : libcephfs2-2:19.2.3-672.g283431c0.el9.x86_64 56/61 2026-02-20T16:30:34.747 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: libcephfs2-2:19.2.3-672.g283431c0.el9.x86_64 56/61 2026-02-20T16:30:34.749 INFO:teuthology.orchestra.run.trial057.stdout: Cleanup : ceph-fuse-2:19.2.3-672.g283431c0.el9.x86_64 57/61 2026-02-20T16:30:34.750 INFO:teuthology.orchestra.run.trial057.stdout: Cleanup : python3-ceph-argparse-2:19.2.3-672.g283431c0.el9.x 58/61 2026-02-20T16:30:34.752 INFO:teuthology.orchestra.run.trial057.stdout: Cleanup : python3-ceph-common-2:19.2.3-672.g283431c0.el9.x86 59/61 2026-02-20T16:30:34.754 INFO:teuthology.orchestra.run.trial057.stdout: Cleanup : ceph-mgr-modules-core-2:19.2.3-672.g283431c0.el9.n 60/61 2026-02-20T16:30:34.754 INFO:teuthology.orchestra.run.trial057.stdout: Cleanup : librados2-2:19.2.3-672.g283431c0.el9.x86_64 61/61 2026-02-20T16:30:35.162 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: librados2-2:19.2.3-672.g283431c0.el9.x86_64 61/61 2026-02-20T16:30:35.162 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : libcephfs-proxy2-2:20.2.0-677.gf7870454.el9.x86_64 1/61 2026-02-20T16:30:35.162 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-2:20.2.0-677.gf7870454.el9.x86_64 2/61 2026-02-20T16:30:35.162 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-2:19.2.3-672.g283431c0.el9.x86_64 3/61 2026-02-20T16:30:35.162 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-base-2:20.2.0-677.gf7870454.el9.x86_64 4/61 2026-02-20T16:30:35.162 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-base-2:19.2.3-672.g283431c0.el9.x86_64 5/61 2026-02-20T16:30:35.162 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-common-2:20.2.0-677.gf7870454.el9.x86_64 6/61 2026-02-20T16:30:35.162 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-common-2:19.2.3-672.g283431c0.el9.x86_64 7/61 2026-02-20T16:30:35.163 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-fuse-2:20.2.0-677.gf7870454.el9.x86_64 8/61 2026-02-20T16:30:35.163 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-fuse-2:19.2.3-672.g283431c0.el9.x86_64 9/61 2026-02-20T16:30:35.163 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-immutable-object-cache-2:20.2.0-677.gf7870454 10/61 2026-02-20T16:30:35.163 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-672.g283431c0 11/61 2026-02-20T16:30:35.163 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-mds-2:20.2.0-677.gf7870454.el9.x86_64 12/61 2026-02-20T16:30:35.163 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-mds-2:19.2.3-672.g283431c0.el9.x86_64 13/61 2026-02-20T16:30:35.163 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-mgr-2:20.2.0-677.gf7870454.el9.x86_64 14/61 2026-02-20T16:30:35.163 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-mgr-2:19.2.3-672.g283431c0.el9.x86_64 15/61 2026-02-20T16:30:35.163 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-mon-2:20.2.0-677.gf7870454.el9.x86_64 16/61 2026-02-20T16:30:35.163 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-mon-2:19.2.3-672.g283431c0.el9.x86_64 17/61 2026-02-20T16:30:35.163 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-osd-2:20.2.0-677.gf7870454.el9.x86_64 18/61 2026-02-20T16:30:35.163 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-osd-2:19.2.3-672.g283431c0.el9.x86_64 19/61 2026-02-20T16:30:35.163 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-radosgw-2:20.2.0-677.gf7870454.el9.x86_64 20/61 2026-02-20T16:30:35.164 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-radosgw-2:19.2.3-672.g283431c0.el9.x86_64 21/61 2026-02-20T16:30:35.164 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-selinux-2:20.2.0-677.gf7870454.el9.x86_64 22/61 2026-02-20T16:30:35.164 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-selinux-2:19.2.3-672.g283431c0.el9.x86_64 23/61 2026-02-20T16:30:35.164 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-test-2:20.2.0-677.gf7870454.el9.x86_64 24/61 2026-02-20T16:30:35.164 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-test-2:19.2.3-672.g283431c0.el9.x86_64 25/61 2026-02-20T16:30:35.164 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : libcephfs-devel-2:20.2.0-677.gf7870454.el9.x86_64 26/61 2026-02-20T16:30:35.164 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : libcephfs-devel-2:19.2.3-672.g283431c0.el9.x86_64 27/61 2026-02-20T16:30:35.164 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : libcephfs2-2:20.2.0-677.gf7870454.el9.x86_64 28/61 2026-02-20T16:30:35.164 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : libcephfs2-2:19.2.3-672.g283431c0.el9.x86_64 29/61 2026-02-20T16:30:35.164 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : libcephsqlite-2:20.2.0-677.gf7870454.el9.x86_64 30/61 2026-02-20T16:30:35.164 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : libcephsqlite-2:19.2.3-672.g283431c0.el9.x86_64 31/61 2026-02-20T16:30:35.165 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : librados-devel-2:20.2.0-677.gf7870454.el9.x86_64 32/61 2026-02-20T16:30:35.165 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : librados-devel-2:19.2.3-672.g283431c0.el9.x86_64 33/61 2026-02-20T16:30:35.165 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : librados2-2:20.2.0-677.gf7870454.el9.x86_64 34/61 2026-02-20T16:30:35.165 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : librados2-2:19.2.3-672.g283431c0.el9.x86_64 35/61 2026-02-20T16:30:35.165 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : libradosstriper1-2:20.2.0-677.gf7870454.el9.x86_64 36/61 2026-02-20T16:30:35.165 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : libradosstriper1-2:19.2.3-672.g283431c0.el9.x86_64 37/61 2026-02-20T16:30:35.165 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : librbd1-2:20.2.0-677.gf7870454.el9.x86_64 38/61 2026-02-20T16:30:35.165 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : librbd1-2:19.2.3-672.g283431c0.el9.x86_64 39/61 2026-02-20T16:30:35.165 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : librgw2-2:20.2.0-677.gf7870454.el9.x86_64 40/61 2026-02-20T16:30:35.165 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : librgw2-2:19.2.3-672.g283431c0.el9.x86_64 41/61 2026-02-20T16:30:35.165 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-ceph-argparse-2:20.2.0-677.gf7870454.el9.x 42/61 2026-02-20T16:30:35.165 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-ceph-argparse-2:19.2.3-672.g283431c0.el9.x 43/61 2026-02-20T16:30:35.166 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-ceph-common-2:20.2.0-677.gf7870454.el9.x86 44/61 2026-02-20T16:30:35.166 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-ceph-common-2:19.2.3-672.g283431c0.el9.x86 45/61 2026-02-20T16:30:35.166 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-cephfs-2:20.2.0-677.gf7870454.el9.x86_64 46/61 2026-02-20T16:30:35.166 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-cephfs-2:19.2.3-672.g283431c0.el9.x86_64 47/61 2026-02-20T16:30:35.166 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-rados-2:20.2.0-677.gf7870454.el9.x86_64 48/61 2026-02-20T16:30:35.166 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-rados-2:19.2.3-672.g283431c0.el9.x86_64 49/61 2026-02-20T16:30:35.166 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-rbd-2:20.2.0-677.gf7870454.el9.x86_64 50/61 2026-02-20T16:30:35.166 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-rbd-2:19.2.3-672.g283431c0.el9.x86_64 51/61 2026-02-20T16:30:35.166 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-rgw-2:20.2.0-677.gf7870454.el9.x86_64 52/61 2026-02-20T16:30:35.166 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-rgw-2:19.2.3-672.g283431c0.el9.x86_64 53/61 2026-02-20T16:30:35.166 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : rbd-fuse-2:20.2.0-677.gf7870454.el9.x86_64 54/61 2026-02-20T16:30:35.166 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : rbd-fuse-2:19.2.3-672.g283431c0.el9.x86_64 55/61 2026-02-20T16:30:35.166 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : rbd-mirror-2:20.2.0-677.gf7870454.el9.x86_64 56/61 2026-02-20T16:30:35.167 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : rbd-mirror-2:19.2.3-672.g283431c0.el9.x86_64 57/61 2026-02-20T16:30:35.167 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : rbd-nbd-2:20.2.0-677.gf7870454.el9.x86_64 58/61 2026-02-20T16:30:35.167 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : rbd-nbd-2:19.2.3-672.g283431c0.el9.x86_64 59/61 2026-02-20T16:30:35.167 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-mgr-modules-core-2:20.2.0-677.gf7870454.el9.n 60/61 2026-02-20T16:30:35.223 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-672.g283431c0.el9.n 61/61 2026-02-20T16:30:35.223 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:30:35.223 INFO:teuthology.orchestra.run.trial057.stdout:Upgraded: 2026-02-20T16:30:35.223 INFO:teuthology.orchestra.run.trial057.stdout: ceph-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T16:30:35.223 INFO:teuthology.orchestra.run.trial057.stdout: ceph-base-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T16:30:35.223 INFO:teuthology.orchestra.run.trial057.stdout: ceph-common-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T16:30:35.223 INFO:teuthology.orchestra.run.trial057.stdout: ceph-fuse-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T16:30:35.223 INFO:teuthology.orchestra.run.trial057.stdout: ceph-immutable-object-cache-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T16:30:35.224 INFO:teuthology.orchestra.run.trial057.stdout: ceph-mds-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T16:30:35.224 INFO:teuthology.orchestra.run.trial057.stdout: ceph-mgr-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T16:30:35.224 INFO:teuthology.orchestra.run.trial057.stdout: ceph-mgr-modules-core-2:20.2.0-677.gf7870454.el9.noarch 2026-02-20T16:30:35.224 INFO:teuthology.orchestra.run.trial057.stdout: ceph-mon-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T16:30:35.224 INFO:teuthology.orchestra.run.trial057.stdout: ceph-osd-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T16:30:35.224 INFO:teuthology.orchestra.run.trial057.stdout: ceph-radosgw-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T16:30:35.224 INFO:teuthology.orchestra.run.trial057.stdout: ceph-selinux-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T16:30:35.224 INFO:teuthology.orchestra.run.trial057.stdout: ceph-test-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T16:30:35.224 INFO:teuthology.orchestra.run.trial057.stdout: libcephfs-devel-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T16:30:35.224 INFO:teuthology.orchestra.run.trial057.stdout: libcephfs2-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T16:30:35.224 INFO:teuthology.orchestra.run.trial057.stdout: libcephsqlite-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T16:30:35.224 INFO:teuthology.orchestra.run.trial057.stdout: librados-devel-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T16:30:35.225 INFO:teuthology.orchestra.run.trial057.stdout: librados2-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T16:30:35.225 INFO:teuthology.orchestra.run.trial057.stdout: libradosstriper1-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T16:30:35.225 INFO:teuthology.orchestra.run.trial057.stdout: librbd1-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T16:30:35.225 INFO:teuthology.orchestra.run.trial057.stdout: librgw2-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T16:30:35.225 INFO:teuthology.orchestra.run.trial057.stdout: python3-ceph-argparse-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T16:30:35.225 INFO:teuthology.orchestra.run.trial057.stdout: python3-ceph-common-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T16:30:35.225 INFO:teuthology.orchestra.run.trial057.stdout: python3-cephfs-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T16:30:35.225 INFO:teuthology.orchestra.run.trial057.stdout: python3-rados-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T16:30:35.225 INFO:teuthology.orchestra.run.trial057.stdout: python3-rbd-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T16:30:35.225 INFO:teuthology.orchestra.run.trial057.stdout: python3-rgw-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T16:30:35.225 INFO:teuthology.orchestra.run.trial057.stdout: rbd-fuse-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T16:30:35.225 INFO:teuthology.orchestra.run.trial057.stdout: rbd-mirror-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T16:30:35.226 INFO:teuthology.orchestra.run.trial057.stdout: rbd-nbd-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T16:30:35.226 INFO:teuthology.orchestra.run.trial057.stdout:Installed: 2026-02-20T16:30:35.226 INFO:teuthology.orchestra.run.trial057.stdout: libcephfs-proxy2-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T16:30:35.226 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:30:35.226 INFO:teuthology.orchestra.run.trial057.stdout:Complete! 2026-02-20T16:30:35.280 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f7870454149f22574086dd2ff55d050585136531 2026-02-20T16:30:35.481 DEBUG:teuthology.orchestra.run.trial057:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-20T16:30:35.503 INFO:teuthology.orchestra.run.trial057.stdout:20.2.0-677.gf7870454.el9 2026-02-20T16:30:35.504 INFO:teuthology.packaging:The installed version of ceph is 20.2.0-677.gf7870454.el9 2026-02-20T16:30:35.504 INFO:teuthology.task.install:The correct ceph version 20.2.0-677.gf7870454 is installed. 2026-02-20T16:30:35.506 INFO:teuthology.run_tasks:Running task print... 2026-02-20T16:30:35.519 INFO:teuthology.task.print:**** done install.upgrade 2026-02-20T16:30:35.519 INFO:teuthology.run_tasks:Running task ceph.restart... 2026-02-20T16:30:35.547 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-20T16:30:35.547 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T16:30:35.557 INFO:tasks.ceph.mon.a:Stopped 2026-02-20T16:30:35.557 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-20T16:30:35.557 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-20T16:30:35.598 INFO:tasks.ceph.mon.a:Started 2026-02-20T16:30:35.598 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-20T16:30:35.598 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T16:30:35.606 INFO:tasks.ceph.mon.b:Stopped 2026-02-20T16:30:35.606 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-20T16:30:35.607 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-20T16:30:35.649 INFO:tasks.ceph.mon.b:Started 2026-02-20T16:30:35.649 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-20T16:30:35.649 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T16:30:35.659 INFO:tasks.ceph.mon.c:Stopped 2026-02-20T16:30:35.659 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-20T16:30:35.659 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-20T16:30:35.702 INFO:tasks.ceph.mon.c:Started 2026-02-20T16:30:35.702 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-20T16:30:35.702 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T16:30:35.723 INFO:tasks.ceph.mgr.x:Stopped 2026-02-20T16:30:35.723 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-20T16:30:35.723 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-20T16:30:35.764 INFO:tasks.ceph.mgr.x:Started 2026-02-20T16:30:35.764 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2026-02-20T16:30:35.764 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T16:30:35.790 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2026-02-20T16:30:35.790 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2026-02-20T16:30:35.790 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2026-02-20T16:30:35.790 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2026-02-20T16:30:35.790 INFO:tasks.ceph.mgr.y:Stopped 2026-02-20T16:30:35.790 INFO:tasks.ceph.mgr.y:Restarting daemon 2026-02-20T16:30:35.790 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2026-02-20T16:30:35.832 INFO:tasks.ceph.mgr.y:Started 2026-02-20T16:30:35.833 INFO:teuthology.run_tasks:Running task ceph.healthy... 2026-02-20T16:30:35.855 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-20T16:30:35.856 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-20T16:30:35.856 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-20T16:30:41.695 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2026-02-20T16:30:41.696 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2026-02-20T16:30:41.696 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2026-02-20T16:30:41.696 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y has been restored 2026-02-20T16:30:47.927 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:47.923+0000 7fcc8ff3f640 1 -- 10.20.193.57:0/2328818862 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fcc88177a70 msgr2=0x7fcc6c0861e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:47.927 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:47.923+0000 7fcc8ff3f640 1 --2- 10.20.193.57:0/2328818862 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fcc88177a70 0x7fcc6c0861e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcc78005fd0 tx=0x7fcc78032150 comp rx=0 tx=0).stop 2026-02-20T16:30:47.928 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:47.923+0000 7fcc8ff3f640 1 -- 10.20.193.57:0/2328818862 shutdown_connections 2026-02-20T16:30:47.928 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:47.923+0000 7fcc8ff3f640 1 --2- 10.20.193.57:0/2328818862 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fcc8805c060 0x7fcc6c065b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:47.928 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:47.923+0000 7fcc8ff3f640 1 --2- 10.20.193.57:0/2328818862 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fcc88177a70 0x7fcc6c0861e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:47.928 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:47.923+0000 7fcc8ff3f640 1 --2- 10.20.193.57:0/2328818862 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fcc6c003760 0x7fcc6c023ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:47.928 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:47.923+0000 7fcc8ff3f640 1 -- 10.20.193.57:0/2328818862 >> 10.20.193.57:0/2328818862 conn(0x7fcc880833e0 msgr2=0x7fcc880840b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:47.928 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:47.923+0000 7fcc8ff3f640 1 -- 10.20.193.57:0/2328818862 shutdown_connections 2026-02-20T16:30:47.928 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:47.923+0000 7fcc8ff3f640 1 -- 10.20.193.57:0/2328818862 wait complete. 2026-02-20T16:30:47.928 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:47.924+0000 7fcc8ff3f640 1 Processor -- start 2026-02-20T16:30:47.928 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:47.924+0000 7fcc8ff3f640 1 -- start start 2026-02-20T16:30:47.928 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:47.924+0000 7fcc8ff3f640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fcc6c003760 0x7fcc881771a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:47.928 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:47.924+0000 7fcc8ff3f640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fcc8805c060 0x7fcc8807abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:47.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:47.924+0000 7fcc8ff3f640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fcc8805c970 0x7fcc8807b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:47.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:47.924+0000 7fcc8ff3f640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7fcc88136860 con 0x7fcc8805c060 2026-02-20T16:30:47.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:47.924+0000 7fcc8ff3f640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7fcc881366e0 con 0x7fcc8805c970 2026-02-20T16:30:47.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:47.924+0000 7fcc8ff3f640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7fcc881369e0 con 0x7fcc6c003760 2026-02-20T16:30:47.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:47.924+0000 7fcc8dcb4640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fcc6c003760 0x7fcc881771a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:47.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:47.924+0000 7fcc8d4b3640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fcc8805c060 0x7fcc8807abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:47.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:47.924+0000 7fcc8dcb4640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fcc6c003760 0x7fcc881771a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3302/0 says I am v2:10.20.193.57:48734/0 (socket says 10.20.193.57:48734) 2026-02-20T16:30:47.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:47.924+0000 7fcc8e4b5640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fcc8805c970 0x7fcc8807b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:47.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:47.924+0000 7fcc8dcb4640 1 -- 10.20.193.57:0/2024626198 learned_addr learned my addr 10.20.193.57:0/2024626198 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:30:47.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:47.924+0000 7fcc8d4b3640 1 -- 10.20.193.57:0/2024626198 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fcc6c003760 msgr2=0x7fcc881771a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:47.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:47.924+0000 7fcc8d4b3640 1 --2- 10.20.193.57:0/2024626198 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fcc6c003760 0x7fcc881771a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:47.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:47.924+0000 7fcc8d4b3640 1 -- 10.20.193.57:0/2024626198 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fcc8805c970 msgr2=0x7fcc8807b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:47.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:47.924+0000 7fcc8d4b3640 1 --2- 10.20.193.57:0/2024626198 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fcc8805c970 0x7fcc8807b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:47.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:47.924+0000 7fcc8d4b3640 1 -- 10.20.193.57:0/2024626198 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc8810c000 con 0x7fcc8805c060 2026-02-20T16:30:47.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:47.924+0000 7fcc8d4b3640 1 --2- 10.20.193.57:0/2024626198 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fcc8805c060 0x7fcc8807abe0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c0067d0 tx=0x7fcc7c012e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:30:47.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:47.924+0000 7fcc767fc640 1 -- 10.20.193.57:0/2024626198 <== mon.0 v2:10.20.193.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c011b40 con 0x7fcc8805c060 2026-02-20T16:30:47.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:47.924+0000 7fcc767fc640 1 -- 10.20.193.57:0/2024626198 <== mon.0 v2:10.20.193.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcc7c003e50 con 0x7fcc8805c060 2026-02-20T16:30:47.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:47.924+0000 7fcc767fc640 1 -- 10.20.193.57:0/2024626198 <== mon.0 v2:10.20.193.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c01c420 con 0x7fcc8805c060 2026-02-20T16:30:47.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:47.924+0000 7fcc8ff3f640 1 -- 10.20.193.57:0/2024626198 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc881776e0 con 0x7fcc8805c060 2026-02-20T16:30:47.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:47.925+0000 7fcc8ff3f640 1 -- 10.20.193.57:0/2024626198 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc88118010 con 0x7fcc8805c060 2026-02-20T16:30:47.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:47.926+0000 7fcc8ff3f640 1 -- 10.20.193.57:0/2024626198 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc88136f70 con 0x7fcc8805c060 2026-02-20T16:30:47.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:47.926+0000 7fcc767fc640 1 -- 10.20.193.57:0/2024626198 <== mon.0 v2:10.20.193.57:3300/0 4 ==== mgrmap(e 7) ==== 60871+0+0 (secure 0 0 0) 0x7fcc7c01c5c0 con 0x7fcc8805c060 2026-02-20T16:30:47.931 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:47.926+0000 7fcc767fc640 1 -- 10.20.193.57:0/2024626198 <== mon.0 v2:10.20.193.57:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3020+0+0 (secure 0 0 0) 0x7fcc7c066050 con 0x7fcc8805c060 2026-02-20T16:30:47.931 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:47.929+0000 7fcc767fc640 1 -- 10.20.193.57:0/2024626198 <== mon.0 v2:10.20.193.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+158585 (secure 0 0 0) 0x7fcc7c064870 con 0x7fcc8805c060 2026-02-20T16:30:47.931 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:47.930+0000 7fcc767fc640 1 -- 10.20.193.57:0/2024626198 <== mon.0 v2:10.20.193.57:3300/0 7 ==== mgrmap(e 8) ==== 59878+0+0 (secure 0 0 0) 0x7fcc7c064bf0 con 0x7fcc8805c060 2026-02-20T16:30:47.933 INFO:tasks.ceph.mgr.y.trial057.stderr:2026-02-20T16:30:47.931+0000 7feaa958c640 -1 mgr.server handle_report got status from non-daemon mon.a 2026-02-20T16:30:47.934 INFO:tasks.ceph.mgr.y.trial057.stderr:2026-02-20T16:30:47.932+0000 7feaa958c640 -1 mgr.server handle_report got status from non-daemon mon.c 2026-02-20T16:30:47.934 INFO:tasks.ceph.mgr.y.trial057.stderr:2026-02-20T16:30:47.933+0000 7feaa958c640 -1 mgr.server handle_report got status from non-daemon mon.b 2026-02-20T16:30:48.015 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.013+0000 7fcc8ff3f640 1 -- 10.20.193.57:0/2024626198 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fcc88053200 con 0x7fcc8805c060 2026-02-20T16:30:48.016 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.014+0000 7fcc767fc640 1 -- 10.20.193.57:0/2024626198 <== mon.0 v2:10.20.193.57:3300/0 8 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v8) ==== 74+0+116493 (secure 0 0 0) 0x7fcc7c068260 con 0x7fcc8805c060 2026-02-20T16:30:48.017 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:30:48.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.015+0000 7fcc8ff3f640 1 -- 10.20.193.57:0/2024626198 >> v1:10.20.193.57:6800/2007744879 conn(0x7fcc58027120 legacy=0x7fcc58027510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.015+0000 7fcc8ff3f640 1 -- 10.20.193.57:0/2024626198 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fcc8805c060 msgr2=0x7fcc8807abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.015+0000 7fcc8ff3f640 1 --2- 10.20.193.57:0/2024626198 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fcc8805c060 0x7fcc8807abe0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c0067d0 tx=0x7fcc7c012e80 comp rx=0 tx=0).stop 2026-02-20T16:30:48.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.015+0000 7fcc8ff3f640 1 -- 10.20.193.57:0/2024626198 shutdown_connections 2026-02-20T16:30:48.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.015+0000 7fcc8ff3f640 1 --2- 10.20.193.57:0/2024626198 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fcc8805c970 0x7fcc8807b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.015+0000 7fcc8ff3f640 1 --2- 10.20.193.57:0/2024626198 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fcc8805c060 0x7fcc8807abe0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.015+0000 7fcc8ff3f640 1 --2- 10.20.193.57:0/2024626198 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fcc6c003760 0x7fcc881771a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.015+0000 7fcc8ff3f640 1 -- 10.20.193.57:0/2024626198 >> 10.20.193.57:0/2024626198 conn(0x7fcc880833e0 msgr2=0x7fcc8811a940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:48.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.015+0000 7fcc8ff3f640 1 -- 10.20.193.57:0/2024626198 shutdown_connections 2026-02-20T16:30:48.020 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.015+0000 7fcc8ff3f640 1 -- 10.20.193.57:0/2024626198 wait complete. 2026-02-20T16:30:48.025 INFO:teuthology.orchestra.run.trial057.stdout:{"epoch":8,"flags":0,"active_gid":14109,"active_name":"y","active_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6800","nonce":2007744879}]},"active_addr":"10.20.193.57:6800/2007744879","active_change":"2026-02-20T16:30:46.925000+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[{"gid":14103,"name":"x","mgr_features":4544132024016699391,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":20,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.57:0","nonce":3280315434}]}]} 2026-02-20T16:30:48.029 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-20T16:30:48.029 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-20T16:30:48.030 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-20T16:30:48.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.097+0000 7f788c164640 1 -- 10.20.193.57:0/1841239865 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f788405c970 msgr2=0x7f7884176350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.097+0000 7f788c164640 1 --2- 10.20.193.57:0/1841239865 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f788405c970 0x7f7884176350 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7878005ea0 tx=0x7f787802f190 comp rx=0 tx=0).stop 2026-02-20T16:30:48.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.097+0000 7f788c164640 1 -- 10.20.193.57:0/1841239865 shutdown_connections 2026-02-20T16:30:48.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.097+0000 7f788c164640 1 --2- 10.20.193.57:0/1841239865 >> v2:10.20.193.57:3300/0 conn(0x7f7884176890 0x7f7884196c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.097+0000 7f788c164640 1 --2- 10.20.193.57:0/1841239865 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f788405c970 0x7f7884176350 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.097+0000 7f788c164640 1 --2- 10.20.193.57:0/1841239865 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f788405c060 0x7f788405c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.097+0000 7f788c164640 1 -- 10.20.193.57:0/1841239865 >> 10.20.193.57:0/1841239865 conn(0x7f78840833e0 msgr2=0x7f78840840b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:48.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.098+0000 7f788c164640 1 -- 10.20.193.57:0/1841239865 shutdown_connections 2026-02-20T16:30:48.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.098+0000 7f788c164640 1 -- 10.20.193.57:0/1841239865 wait complete. 2026-02-20T16:30:48.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.098+0000 7f788c164640 1 Processor -- start 2026-02-20T16:30:48.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.098+0000 7f788c164640 1 -- start start 2026-02-20T16:30:48.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.098+0000 7f788c164640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f788405c060 0x7f788407a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:48.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.098+0000 7f788c164640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f788405c970 0x7f788407a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:48.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.098+0000 7f788c164640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f7884176890 0x7f788407aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:48.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.098+0000 7f788c164640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f7884197c30 con 0x7f788405c060 2026-02-20T16:30:48.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.098+0000 7f788c164640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f7884197ab0 con 0x7f788405c970 2026-02-20T16:30:48.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.098+0000 7f788c164640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f7884197db0 con 0x7f7884176890 2026-02-20T16:30:48.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.098+0000 7f7889ed9640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f788405c060 0x7f788407a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:48.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.098+0000 7f7889ed9640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f788405c060 0x7f788407a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:56308/0 (socket says 10.20.193.57:56308) 2026-02-20T16:30:48.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.098+0000 7f7889ed9640 1 -- 10.20.193.57:0/1928510222 learned_addr learned my addr 10.20.193.57:0/1928510222 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:30:48.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.098+0000 7f78896d8640 1 --2- 10.20.193.57:0/1928510222 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f788405c970 0x7f788407a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:48.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.098+0000 7f788a6da640 1 --2- 10.20.193.57:0/1928510222 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f7884176890 0x7f788407aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:48.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.099+0000 7f7889ed9640 1 -- 10.20.193.57:0/1928510222 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f7884176890 msgr2=0x7f788407aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.099+0000 7f7889ed9640 1 --2- 10.20.193.57:0/1928510222 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f7884176890 0x7f788407aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.099+0000 7f7889ed9640 1 -- 10.20.193.57:0/1928510222 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f788405c970 msgr2=0x7f788407a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.099+0000 7f7889ed9640 1 --2- 10.20.193.57:0/1928510222 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f788405c970 0x7f788407a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.099+0000 7f7889ed9640 1 -- 10.20.193.57:0/1928510222 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f788407c180 con 0x7f788405c060 2026-02-20T16:30:48.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.099+0000 7f7889ed9640 1 --2- 10.20.193.57:0/1928510222 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f788405c060 0x7f788407a000 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f787400e9c0 tx=0x7f787400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:30:48.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.099+0000 7f78727fc640 1 -- 10.20.193.57:0/1928510222 <== mon.0 v2:10.20.193.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f787400cc90 con 0x7f788405c060 2026-02-20T16:30:48.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.099+0000 7f78727fc640 1 -- 10.20.193.57:0/1928510222 <== mon.0 v2:10.20.193.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f787400ce50 con 0x7f788405c060 2026-02-20T16:30:48.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.099+0000 7f78727fc640 1 -- 10.20.193.57:0/1928510222 <== mon.0 v2:10.20.193.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7874004ae0 con 0x7f788405c060 2026-02-20T16:30:48.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.099+0000 7f788c164640 1 -- 10.20.193.57:0/1928510222 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f788407b8a0 con 0x7f788405c060 2026-02-20T16:30:48.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.099+0000 7f788c164640 1 -- 10.20.193.57:0/1928510222 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7884196db0 con 0x7f788405c060 2026-02-20T16:30:48.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.099+0000 7f788c164640 1 -- 10.20.193.57:0/1928510222 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f788405c430 con 0x7f788405c060 2026-02-20T16:30:48.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.099+0000 7f78727fc640 1 -- 10.20.193.57:0/1928510222 <== mon.0 v2:10.20.193.57:3300/0 4 ==== mgrmap(e 8) ==== 59878+0+0 (secure 0 0 0) 0x7f7874021440 con 0x7f788405c060 2026-02-20T16:30:48.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.100+0000 7f78727fc640 1 -- 10.20.193.57:0/1928510222 <== mon.0 v2:10.20.193.57:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3020+0+0 (secure 0 0 0) 0x7f7874063ec0 con 0x7f788405c060 2026-02-20T16:30:48.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.101+0000 7f78727fc640 1 -- 10.20.193.57:0/1928510222 <== mon.0 v2:10.20.193.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7f7874062620 con 0x7f788405c060 2026-02-20T16:30:48.179 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.177+0000 7f788c164640 1 -- 10.20.193.57:0/1928510222 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7884053200 con 0x7f788405c060 2026-02-20T16:30:48.179 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.177+0000 7f78727fc640 1 -- 10.20.193.57:0/1928510222 <== mon.0 v2:10.20.193.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+9177 (secure 0 0 0) 0x7f78740629a0 con 0x7f788405c060 2026-02-20T16:30:48.180 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:30:48.180 INFO:teuthology.orchestra.run.trial057.stdout:{"epoch":20,"fsid":"3b3c5c1a-0a2b-40b9-ac1d-921ada466f9e","created":"2026-02-20T16:29:22.501479+0000","modified":"2026-02-20T16:30:46.924877+0000","last_up_change":"2026-02-20T16:29:33.726177+0000","last_in_change":"2026-02-20T16:29:24.294147+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"squid","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T16:29:34.029059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-20T16:29:38.191724+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a3139827-dc3c-46f9-b211-d376e3dc92f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6801","nonce":385793132}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6802","nonce":385793132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6804","nonce":385793132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6803","nonce":385793132}]},"public_addr":"10.20.193.57:6801/385793132","cluster_addr":"10.20.193.57:6802/385793132","heartbeat_back_addr":"10.20.193.57:6804/385793132","heartbeat_front_addr":"10.20.193.57:6803/385793132","state":["exists","up"]},{"osd":1,"uuid":"00e7cb17-534c-4ac2-8486-585b3b8db0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6805","nonce":3441840004}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6806","nonce":3441840004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6808","nonce":3441840004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6807","nonce":3441840004}]},"public_addr":"10.20.193.57:6805/3441840004","cluster_addr":"10.20.193.57:6806/3441840004","heartbeat_back_addr":"10.20.193.57:6808/3441840004","heartbeat_front_addr":"10.20.193.57:6807/3441840004","state":["exists","up"]},{"osd":2,"uuid":"d0b55b31-45df-4c58-bf11-a72d44f21a00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6809","nonce":1926844368}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6810","nonce":1926844368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6812","nonce":1926844368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6811","nonce":1926844368}]},"public_addr":"10.20.193.57:6809/1926844368","cluster_addr":"10.20.193.57:6810/1926844368","heartbeat_back_addr":"10.20.193.57:6812/1926844368","heartbeat_front_addr":"10.20.193.57:6811/1926844368","state":["exists","up"]},{"osd":3,"uuid":"b3bfbbd8-cfaf-4360-9a5b-c52e89ac3f75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6813","nonce":3124429028}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6814","nonce":3124429028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6816","nonce":3124429028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6815","nonce":3124429028}]},"public_addr":"10.20.193.57:6813/3124429028","cluster_addr":"10.20.193.57:6814/3124429028","heartbeat_back_addr":"10.20.193.57:6816/3124429028","heartbeat_front_addr":"10.20.193.57:6815/3124429028","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T16:29:31.711310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T16:29:31.724521+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T16:29:31.770683+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T16:29:31.821531+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.57:0/4240799477":"2026-02-21T16:30:46.924862+0000","10.20.193.57:0/1295824105":"2026-02-21T16:30:46.924862+0000","10.20.193.57:0/2316661359":"2026-02-21T16:30:46.924862+0000","10.20.193.57:0/3729051198":"2026-02-21T16:30:46.924862+0000","10.20.193.57:6800/4138285113":"2026-02-21T16:30:46.924862+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T16:30:48.181 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.178+0000 7f788c164640 1 -- 10.20.193.57:0/1928510222 >> v1:10.20.193.57:6800/2007744879 conn(0x7f785404c930 legacy=0x7f785406cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.181 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.178+0000 7f788c164640 1 -- 10.20.193.57:0/1928510222 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f788405c060 msgr2=0x7f788407a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.181 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.178+0000 7f788c164640 1 --2- 10.20.193.57:0/1928510222 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f788405c060 0x7f788407a000 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f787400e9c0 tx=0x7f787400ee90 comp rx=0 tx=0).stop 2026-02-20T16:30:48.182 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.178+0000 7f788c164640 1 -- 10.20.193.57:0/1928510222 shutdown_connections 2026-02-20T16:30:48.182 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.178+0000 7f788c164640 1 --2- 10.20.193.57:0/1928510222 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f7884176890 0x7f788407aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.182 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.178+0000 7f788c164640 1 --2- 10.20.193.57:0/1928510222 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f788405c970 0x7f788407a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.182 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.178+0000 7f788c164640 1 --2- 10.20.193.57:0/1928510222 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f788405c060 0x7f788407a000 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.182 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.178+0000 7f788c164640 1 -- 10.20.193.57:0/1928510222 >> 10.20.193.57:0/1928510222 conn(0x7f78840833e0 msgr2=0x7f7884185da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:48.182 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.178+0000 7f788c164640 1 -- 10.20.193.57:0/1928510222 shutdown_connections 2026-02-20T16:30:48.182 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.178+0000 7f788c164640 1 -- 10.20.193.57:0/1928510222 wait complete. 2026-02-20T16:30:48.188 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-20T16:30:48.188 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-20T16:30:48.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.256+0000 7fe012e52640 1 -- 10.20.193.57:0/3196721300 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fe00c1778a0 msgr2=0x7fe00c197c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.256+0000 7fe012e52640 1 --2- 10.20.193.57:0/3196721300 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fe00c1778a0 0x7fe00c197c80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe008004af0 tx=0x7fe00802f310 comp rx=0 tx=0).stop 2026-02-20T16:30:48.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.256+0000 7fe012e52640 1 -- 10.20.193.57:0/3196721300 shutdown_connections 2026-02-20T16:30:48.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.256+0000 7fe012e52640 1 --2- 10.20.193.57:0/3196721300 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fe00c1778a0 0x7fe00c197c80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.256+0000 7fe012e52640 1 --2- 10.20.193.57:0/3196721300 >> v2:10.20.193.57:3300/0 conn(0x7fe00c05cb40 0x7fe00c177360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.256+0000 7fe012e52640 1 -- 10.20.193.57:0/3196721300 >> 10.20.193.57:0/3196721300 conn(0x7fe00c0833e0 msgr2=0x7fe00c0840b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:48.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.256+0000 7fe012e52640 1 -- 10.20.193.57:0/3196721300 shutdown_connections 2026-02-20T16:30:48.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.256+0000 7fe012e52640 1 -- 10.20.193.57:0/3196721300 wait complete. 2026-02-20T16:30:48.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.257+0000 7fe012e52640 1 Processor -- start 2026-02-20T16:30:48.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.257+0000 7fe012e52640 1 -- start start 2026-02-20T16:30:48.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.257+0000 7fe012e52640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fe00c05c060 0x7fe00c121fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:48.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.257+0000 7fe012e52640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fe00c05cb40 0x7fe00c1224f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:48.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.257+0000 7fe012e52640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fe00c1778a0 0x7fe00c125370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:48.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.257+0000 7fe012e52640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7fe00c198bf0 con 0x7fe00c05c060 2026-02-20T16:30:48.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.257+0000 7fe012e52640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7fe00c198a70 con 0x7fe00c1778a0 2026-02-20T16:30:48.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.257+0000 7fe012e52640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7fe00c198d70 con 0x7fe00c05cb40 2026-02-20T16:30:48.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.257+0000 7fe010bc7640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fe00c05c060 0x7fe00c121fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:48.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.257+0000 7fe0113c8640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fe00c1778a0 0x7fe00c125370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:48.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.257+0000 7fe010bc7640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fe00c05c060 0x7fe00c121fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:56316/0 (socket says 10.20.193.57:56316) 2026-02-20T16:30:48.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.257+0000 7fe010bc7640 1 -- 10.20.193.57:0/825560106 learned_addr learned my addr 10.20.193.57:0/825560106 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:30:48.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.257+0000 7fe003fff640 1 --2- 10.20.193.57:0/825560106 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fe00c05cb40 0x7fe00c1224f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:48.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.257+0000 7fe0113c8640 1 -- 10.20.193.57:0/825560106 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fe00c05cb40 msgr2=0x7fe00c1224f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.257+0000 7fe0113c8640 1 --2- 10.20.193.57:0/825560106 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fe00c05cb40 0x7fe00c1224f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.257+0000 7fe0113c8640 1 -- 10.20.193.57:0/825560106 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fe00c05c060 msgr2=0x7fe00c121fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.257+0000 7fe0113c8640 1 --2- 10.20.193.57:0/825560106 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fe00c05c060 0x7fe00c121fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.257+0000 7fe0113c8640 1 -- 10.20.193.57:0/825560106 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe00c10d370 con 0x7fe00c1778a0 2026-02-20T16:30:48.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.257+0000 7fe010bc7640 1 --2- 10.20.193.57:0/825560106 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fe00c05c060 0x7fe00c121fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:30:48.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.258+0000 7fe0113c8640 1 --2- 10.20.193.57:0/825560106 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fe00c1778a0 0x7fe00c125370 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe008004af0 tx=0x7fe0080093d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:30:48.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.258+0000 7fe0017fa640 1 -- 10.20.193.57:0/825560106 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe008046070 con 0x7fe00c1778a0 2026-02-20T16:30:48.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.258+0000 7fe0017fa640 1 -- 10.20.193.57:0/825560106 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe0080042d0 con 0x7fe00c1778a0 2026-02-20T16:30:48.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.258+0000 7fe0017fa640 1 -- 10.20.193.57:0/825560106 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe008004720 con 0x7fe00c1778a0 2026-02-20T16:30:48.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.258+0000 7fe012e52640 1 -- 10.20.193.57:0/825560106 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe00c10e310 con 0x7fe00c1778a0 2026-02-20T16:30:48.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.258+0000 7fe012e52640 1 -- 10.20.193.57:0/825560106 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe00c122a30 con 0x7fe00c1778a0 2026-02-20T16:30:48.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.258+0000 7fe012e52640 1 -- 10.20.193.57:0/825560106 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe00c085e00 con 0x7fe00c1778a0 2026-02-20T16:30:48.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.258+0000 7fe0017fa640 1 -- 10.20.193.57:0/825560106 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 8) ==== 59878+0+0 (secure 0 0 0) 0x7fe008007420 con 0x7fe00c1778a0 2026-02-20T16:30:48.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.259+0000 7fe0017fa640 1 -- 10.20.193.57:0/825560106 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 3020+0+0 (secure 0 0 0) 0x7fe008087d40 con 0x7fe00c1778a0 2026-02-20T16:30:48.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.260+0000 7fe0017fa640 1 -- 10.20.193.57:0/825560106 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7fe0080048c0 con 0x7fe00c1778a0 2026-02-20T16:30:48.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.338+0000 7fe012e52640 1 -- 10.20.193.57:0/825560106 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe00c053200 con 0x7fe00c1778a0 2026-02-20T16:30:48.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.338+0000 7fe0017fa640 1 -- 10.20.193.57:0/825560106 <== mon.1 v2:10.20.193.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+9177 (secure 0 0 0) 0x7fe0080513f0 con 0x7fe00c1778a0 2026-02-20T16:30:48.340 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:30:48.340 INFO:teuthology.orchestra.run.trial057.stdout:{"epoch":20,"fsid":"3b3c5c1a-0a2b-40b9-ac1d-921ada466f9e","created":"2026-02-20T16:29:22.501479+0000","modified":"2026-02-20T16:30:46.924877+0000","last_up_change":"2026-02-20T16:29:33.726177+0000","last_in_change":"2026-02-20T16:29:24.294147+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"squid","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T16:29:34.029059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-20T16:29:38.191724+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a3139827-dc3c-46f9-b211-d376e3dc92f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6801","nonce":385793132}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6802","nonce":385793132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6804","nonce":385793132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6803","nonce":385793132}]},"public_addr":"10.20.193.57:6801/385793132","cluster_addr":"10.20.193.57:6802/385793132","heartbeat_back_addr":"10.20.193.57:6804/385793132","heartbeat_front_addr":"10.20.193.57:6803/385793132","state":["exists","up"]},{"osd":1,"uuid":"00e7cb17-534c-4ac2-8486-585b3b8db0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6805","nonce":3441840004}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6806","nonce":3441840004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6808","nonce":3441840004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6807","nonce":3441840004}]},"public_addr":"10.20.193.57:6805/3441840004","cluster_addr":"10.20.193.57:6806/3441840004","heartbeat_back_addr":"10.20.193.57:6808/3441840004","heartbeat_front_addr":"10.20.193.57:6807/3441840004","state":["exists","up"]},{"osd":2,"uuid":"d0b55b31-45df-4c58-bf11-a72d44f21a00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6809","nonce":1926844368}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6810","nonce":1926844368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6812","nonce":1926844368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6811","nonce":1926844368}]},"public_addr":"10.20.193.57:6809/1926844368","cluster_addr":"10.20.193.57:6810/1926844368","heartbeat_back_addr":"10.20.193.57:6812/1926844368","heartbeat_front_addr":"10.20.193.57:6811/1926844368","state":["exists","up"]},{"osd":3,"uuid":"b3bfbbd8-cfaf-4360-9a5b-c52e89ac3f75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6813","nonce":3124429028}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6814","nonce":3124429028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6816","nonce":3124429028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6815","nonce":3124429028}]},"public_addr":"10.20.193.57:6813/3124429028","cluster_addr":"10.20.193.57:6814/3124429028","heartbeat_back_addr":"10.20.193.57:6816/3124429028","heartbeat_front_addr":"10.20.193.57:6815/3124429028","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T16:29:31.711310+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T16:29:31.724521+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T16:29:31.770683+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T16:29:31.821531+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.57:0/4240799477":"2026-02-21T16:30:46.924862+0000","10.20.193.57:0/1295824105":"2026-02-21T16:30:46.924862+0000","10.20.193.57:0/2316661359":"2026-02-21T16:30:46.924862+0000","10.20.193.57:0/3729051198":"2026-02-21T16:30:46.924862+0000","10.20.193.57:6800/4138285113":"2026-02-21T16:30:46.924862+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T16:30:48.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.339+0000 7fe012e52640 1 -- 10.20.193.57:0/825560106 >> v1:10.20.193.57:6800/2007744879 conn(0x7fdfdc04c930 legacy=0x7fdfdc06cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.339+0000 7fe012e52640 1 -- 10.20.193.57:0/825560106 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fe00c1778a0 msgr2=0x7fe00c125370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.339+0000 7fe012e52640 1 --2- 10.20.193.57:0/825560106 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fe00c1778a0 0x7fe00c125370 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe008004af0 tx=0x7fe0080093d0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.339+0000 7fe012e52640 1 -- 10.20.193.57:0/825560106 shutdown_connections 2026-02-20T16:30:48.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.339+0000 7fe012e52640 1 --2- 10.20.193.57:0/825560106 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fe00c1778a0 0x7fe00c125370 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.339+0000 7fe012e52640 1 --2- 10.20.193.57:0/825560106 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fe00c05cb40 0x7fe00c1224f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.339+0000 7fe012e52640 1 --2- 10.20.193.57:0/825560106 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fe00c05c060 0x7fe00c121fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.339+0000 7fe012e52640 1 -- 10.20.193.57:0/825560106 >> 10.20.193.57:0/825560106 conn(0x7fe00c0833e0 msgr2=0x7fe00c075b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:48.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.339+0000 7fe012e52640 1 -- 10.20.193.57:0/825560106 shutdown_connections 2026-02-20T16:30:48.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.339+0000 7fe012e52640 1 -- 10.20.193.57:0/825560106 wait complete. 2026-02-20T16:30:48.349 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-20T16:30:48.350 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-20T16:30:48.351 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-20T16:30:48.351 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-20T16:30:48.420 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.418+0000 7fe6bb690640 1 -- 10.20.193.57:0/2926045193 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fe6b41368f0 msgr2=0x7fe6b4197270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.418+0000 7fe6bb690640 1 --2- 10.20.193.57:0/2926045193 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fe6b41368f0 0x7fe6b4197270 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0009fd0 tx=0x7fe6b002f350 comp rx=0 tx=0).stop 2026-02-20T16:30:48.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.418+0000 7fe6bb690640 1 -- 10.20.193.57:0/2926045193 shutdown_connections 2026-02-20T16:30:48.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.418+0000 7fe6bb690640 1 --2- 10.20.193.57:0/2926045193 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fe6b41368f0 0x7fe6b4197270 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.418+0000 7fe6bb690640 1 --2- 10.20.193.57:0/2926045193 >> v2:10.20.193.57:3300/0 conn(0x7fe6b4135f40 0x7fe6b41363b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.418+0000 7fe6bb690640 1 --2- 10.20.193.57:0/2926045193 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fe6b4130220 0x7fe6b4086570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.418+0000 7fe6bb690640 1 -- 10.20.193.57:0/2926045193 >> 10.20.193.57:0/2926045193 conn(0x7fe6b408aae0 msgr2=0x7fe6b408aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:48.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.418+0000 7fe6bb690640 1 -- 10.20.193.57:0/2926045193 shutdown_connections 2026-02-20T16:30:48.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.418+0000 7fe6bb690640 1 -- 10.20.193.57:0/2926045193 wait complete. 2026-02-20T16:30:48.422 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.419+0000 7f0894f58640 1 -- 10.20.193.57:0/3173959872 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f0890157250 msgr2=0x7f0890177630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.419+0000 7f0894f58640 1 --2- 10.20.193.57:0/3173959872 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f0890157250 0x7f0890177630 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0878005fd0 tx=0x7f087802f1d0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.419+0000 7f0894f58640 1 -- 10.20.193.57:0/3173959872 shutdown_connections 2026-02-20T16:30:48.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.419+0000 7f0894f58640 1 --2- 10.20.193.57:0/3173959872 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f0890177b70 0x7f0890197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.419+0000 7f0894f58640 1 --2- 10.20.193.57:0/3173959872 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f0890157250 0x7f0890177630 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.419+0000 7f0894f58640 1 -- 10.20.193.57:0/3173959872 >> 10.20.193.57:0/3173959872 conn(0x7f089008aae0 msgr2=0x7f089008aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:48.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.419+0000 7f0894f58640 1 -- 10.20.193.57:0/3173959872 shutdown_connections 2026-02-20T16:30:48.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.419+0000 7f0894f58640 1 -- 10.20.193.57:0/3173959872 wait complete. 2026-02-20T16:30:48.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.419+0000 7ff0a13e4640 1 -- 10.20.193.57:0/2791221492 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7ff09c130220 msgr2=0x7ff09c086570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.419+0000 7ff0a13e4640 1 --2- 10.20.193.57:0/2791221492 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7ff09c130220 0x7ff09c086570 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff0900098c0 tx=0x7ff09002f060 comp rx=0 tx=0).stop 2026-02-20T16:30:48.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.419+0000 7ff0a13e4640 1 -- 10.20.193.57:0/2791221492 shutdown_connections 2026-02-20T16:30:48.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.419+0000 7ff0a13e4640 1 --2- 10.20.193.57:0/2791221492 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7ff09c136af0 0x7ff09c198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.419+0000 7ff0a13e4640 1 --2- 10.20.193.57:0/2791221492 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7ff09c130220 0x7ff09c086570 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.419+0000 7ff0a13e4640 1 -- 10.20.193.57:0/2791221492 >> 10.20.193.57:0/2791221492 conn(0x7ff09c08aae0 msgr2=0x7ff09c08aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:48.425 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.419+0000 7ff0a13e4640 1 -- 10.20.193.57:0/2791221492 shutdown_connections 2026-02-20T16:30:48.425 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.419+0000 7fe6bb690640 1 Processor -- start 2026-02-20T16:30:48.425 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.419+0000 7ff0a13e4640 1 -- 10.20.193.57:0/2791221492 wait complete. 2026-02-20T16:30:48.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.419+0000 7fe6bb690640 1 -- start start 2026-02-20T16:30:48.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.419+0000 7fe6bb690640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fe6b4130220 0x7fe6b405b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:48.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.419+0000 7fe6bb690640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fe6b4135f40 0x7fe6b405b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:48.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.419+0000 7fe6bb690640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fe6b41368f0 0x7fe6b405bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:48.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.419+0000 7fe6bb690640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b4086930 con 0x7fe6b41368f0 2026-02-20T16:30:48.427 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.419+0000 7fe6bb690640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7fe6b4197b40 con 0x7fe6b4130220 2026-02-20T16:30:48.427 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.419+0000 7fe6bb690640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7fe6b41979c0 con 0x7fe6b4135f40 2026-02-20T16:30:48.427 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.419+0000 7f0894f58640 1 Processor -- start 2026-02-20T16:30:48.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.419+0000 7fe6b8c04640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fe6b4135f40 0x7fe6b405b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:48.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.419+0000 7fe6b8c04640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fe6b4135f40 0x7fe6b405b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3302/0 says I am v2:10.20.193.57:48786/0 (socket says 10.20.193.57:48786) 2026-02-20T16:30:48.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.419+0000 7fe6b8c04640 1 -- 10.20.193.57:0/505772503 learned_addr learned my addr 10.20.193.57:0/505772503 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:30:48.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.419+0000 7fe6b9c06640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fe6b41368f0 0x7fe6b405bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:48.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.419+0000 7f0894f58640 1 -- start start 2026-02-20T16:30:48.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.419+0000 7fe6b9405640 1 --2- 10.20.193.57:0/505772503 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fe6b4130220 0x7fe6b405b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:48.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.419+0000 7fe6b8c04640 1 -- 10.20.193.57:0/505772503 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fe6b4130220 msgr2=0x7fe6b405b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.419+0000 7fe6b8c04640 1 --2- 10.20.193.57:0/505772503 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fe6b4130220 0x7fe6b405b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.419+0000 7fe6b8c04640 1 -- 10.20.193.57:0/505772503 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fe6b41368f0 msgr2=0x7fe6b405bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.419+0000 7fe6b8c04640 1 --2- 10.20.193.57:0/505772503 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fe6b41368f0 0x7fe6b405bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.419+0000 7fe6b8c04640 1 -- 10.20.193.57:0/505772503 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6b40799d0 con 0x7fe6b4135f40 2026-02-20T16:30:48.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.419+0000 7fe6b8c04640 1 --2- 10.20.193.57:0/505772503 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fe6b4135f40 0x7fe6b405b9b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe6a80094b0 tx=0x7fe6a800ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:30:48.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.419+0000 7f0894f58640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f0890130220 0x7f0890177630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:48.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.419+0000 7f0894f58640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f0890157250 0x7f0890197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:48.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.419+0000 7f0894f58640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f0890177b70 0x7f08901565f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:48.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.419+0000 7f0894f58640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f0890198d40 con 0x7f0890177b70 2026-02-20T16:30:48.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.419+0000 7f0894f58640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f0890198bc0 con 0x7f0890130220 2026-02-20T16:30:48.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.419+0000 7f0894f58640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f0890198ec0 con 0x7f0890157250 2026-02-20T16:30:48.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.420+0000 7f088dd74640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f0890157250 0x7f0890197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:48.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.420+0000 7f088e575640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f0890130220 0x7f0890177630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:48.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.420+0000 7f088dd74640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f0890157250 0x7f0890197f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3302/0 says I am v2:10.20.193.57:48794/0 (socket says 10.20.193.57:48794) 2026-02-20T16:30:48.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.420+0000 7f088dd74640 1 -- 10.20.193.57:0/2969082096 learned_addr learned my addr 10.20.193.57:0/2969082096 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:30:48.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.420+0000 7fe6a1ffb640 1 -- 10.20.193.57:0/505772503 <== mon.2 v2:10.20.193.57:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a800cd20 con 0x7fe6b4135f40 2026-02-20T16:30:48.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.420+0000 7f088ed76640 1 --2- 10.20.193.57:0/2969082096 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f0890177b70 0x7f08901565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:48.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.420+0000 7ff0a13e4640 1 Processor -- start 2026-02-20T16:30:48.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.420+0000 7fe6a1ffb640 1 -- 10.20.193.57:0/505772503 <== mon.2 v2:10.20.193.57:3302/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe6a8004880 con 0x7fe6b4135f40 2026-02-20T16:30:48.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.420+0000 7fe6bb690640 1 -- 10.20.193.57:0/505772503 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6b41307a0 con 0x7fe6b4135f40 2026-02-20T16:30:48.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.420+0000 7fe6a1ffb640 1 -- 10.20.193.57:0/505772503 <== mon.2 v2:10.20.193.57:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a8004cd0 con 0x7fe6b4135f40 2026-02-20T16:30:48.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.420+0000 7fe6bb690640 1 -- 10.20.193.57:0/505772503 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6b4081390 con 0x7fe6b4135f40 2026-02-20T16:30:48.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.420+0000 7ff0a13e4640 1 -- start start 2026-02-20T16:30:48.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.420+0000 7f088e575640 1 -- 10.20.193.57:0/2969082096 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f0890157250 msgr2=0x7f0890197f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.420+0000 7f088e575640 1 --2- 10.20.193.57:0/2969082096 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f0890157250 0x7f0890197f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.420+0000 7f088e575640 1 -- 10.20.193.57:0/2969082096 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f0890177b70 msgr2=0x7f08901565f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.420+0000 7f088e575640 1 --2- 10.20.193.57:0/2969082096 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f0890177b70 0x7f08901565f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.420+0000 7f088e575640 1 -- 10.20.193.57:0/2969082096 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f089005cb20 con 0x7f0890130220 2026-02-20T16:30:48.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.420+0000 7f088e575640 1 --2- 10.20.193.57:0/2969082096 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f0890130220 0x7f0890177630 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0884002760 tx=0x7f088400c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:30:48.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.420+0000 7f0876ffd640 1 -- 10.20.193.57:0/2969082096 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0884016070 con 0x7f0890130220 2026-02-20T16:30:48.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.420+0000 7f0876ffd640 1 -- 10.20.193.57:0/2969082096 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0884004310 con 0x7f0890130220 2026-02-20T16:30:48.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.420+0000 7f0894f58640 1 -- 10.20.193.57:0/2969082096 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f089005c440 con 0x7f0890130220 2026-02-20T16:30:48.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.420+0000 7f0876ffd640 1 -- 10.20.193.57:0/2969082096 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08840068c0 con 0x7f0890130220 2026-02-20T16:30:48.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.420+0000 7f0894f58640 1 -- 10.20.193.57:0/2969082096 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0890156b30 con 0x7f0890130220 2026-02-20T16:30:48.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.420+0000 7ff0a13e4640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7ff09c130220 0x7ff09c05b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:48.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.420+0000 7ff0a13e4640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7ff09c135f40 0x7ff09c05b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:48.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.420+0000 7ff0a13e4640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7ff09c136af0 0x7ff09c1463c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:48.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.420+0000 7ff0a13e4640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7ff09c198d30 con 0x7ff09c135f40 2026-02-20T16:30:48.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.420+0000 7ff0a13e4640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7ff09c198bb0 con 0x7ff09c136af0 2026-02-20T16:30:48.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.420+0000 7ff0a13e4640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7ff09c198eb0 con 0x7ff09c130220 2026-02-20T16:30:48.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.420+0000 7ff09a7fc640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7ff09c135f40 0x7ff09c05b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:48.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.420+0000 7ff09b7fe640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7ff09c136af0 0x7ff09c1463c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:48.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.420+0000 7ff09affd640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7ff09c130220 0x7ff09c05b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:48.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.420+0000 7ff09a7fc640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7ff09c135f40 0x7ff09c05b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:56362/0 (socket says 10.20.193.57:56362) 2026-02-20T16:30:48.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.420+0000 7ff09b7fe640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7ff09c136af0 0x7ff09c1463c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3301/0 says I am v2:10.20.193.57:45230/0 (socket says 10.20.193.57:45230) 2026-02-20T16:30:48.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.420+0000 7ff09a7fc640 1 -- 10.20.193.57:0/3087810012 learned_addr learned my addr 10.20.193.57:0/3087810012 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:30:48.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.420+0000 7fe6bb690640 1 -- 10.20.193.57:0/505772503 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe678001030 con 0x7fe6b4135f40 2026-02-20T16:30:48.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.420+0000 7ff09a7fc640 1 -- 10.20.193.57:0/3087810012 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7ff09c130220 msgr2=0x7ff09c05b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.420+0000 7ff09a7fc640 1 --2- 10.20.193.57:0/3087810012 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7ff09c130220 0x7ff09c05b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.420+0000 7ff09a7fc640 1 -- 10.20.193.57:0/3087810012 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7ff09c136af0 msgr2=0x7ff09c1463c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.420+0000 7ff09a7fc640 1 --2- 10.20.193.57:0/3087810012 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7ff09c136af0 0x7ff09c1463c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.420+0000 7ff09a7fc640 1 -- 10.20.193.57:0/3087810012 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff09c079d30 con 0x7ff09c135f40 2026-02-20T16:30:48.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.420+0000 7f0894f58640 1 -- 10.20.193.57:0/2969082096 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0890086570 con 0x7f0890130220 2026-02-20T16:30:48.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.420+0000 7ff09a7fc640 1 --2- 10.20.193.57:0/3087810012 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7ff09c135f40 0x7ff09c05b800 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff08400c4f0 tx=0x7ff08400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:30:48.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.420+0000 7ff07b7fe640 1 -- 10.20.193.57:0/3087810012 <== mon.0 v2:10.20.193.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff084016020 con 0x7ff09c135f40 2026-02-20T16:30:48.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.420+0000 7ff07b7fe640 1 -- 10.20.193.57:0/3087810012 <== mon.0 v2:10.20.193.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff084012920 con 0x7ff09c135f40 2026-02-20T16:30:48.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.420+0000 7ff0a13e4640 1 -- 10.20.193.57:0/3087810012 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff09c081670 con 0x7ff09c135f40 2026-02-20T16:30:48.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.420+0000 7ff07b7fe640 1 -- 10.20.193.57:0/3087810012 <== mon.0 v2:10.20.193.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff084012d30 con 0x7ff09c135f40 2026-02-20T16:30:48.441 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.420+0000 7fe6a1ffb640 1 -- 10.20.193.57:0/505772503 <== mon.2 v2:10.20.193.57:3302/0 4 ==== mgrmap(e 8) ==== 59878+0+0 (secure 0 0 0) 0x7fe6a80040d0 con 0x7fe6b4135f40 2026-02-20T16:30:48.441 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.420+0000 7ff0a13e4640 1 -- 10.20.193.57:0/3087810012 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff09c05bd40 con 0x7ff09c135f40 2026-02-20T16:30:48.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.421+0000 7f0876ffd640 1 -- 10.20.193.57:0/2969082096 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 8) ==== 59878+0+0 (secure 0 0 0) 0x7f0884006a60 con 0x7f0890130220 2026-02-20T16:30:48.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.421+0000 7f0876ffd640 1 -- 10.20.193.57:0/2969082096 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 3020+0+0 (secure 0 0 0) 0x7f0884063230 con 0x7f0890130220 2026-02-20T16:30:48.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.421+0000 7ff0a13e4640 1 -- 10.20.193.57:0/3087810012 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff09c086570 con 0x7ff09c135f40 2026-02-20T16:30:48.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.421+0000 7fe6a1ffb640 1 -- 10.20.193.57:0/505772503 <== mon.2 v2:10.20.193.57:3302/0 5 ==== osd_map(20..20 src has 1..20) ==== 3020+0+0 (secure 0 0 0) 0x7fe6a8063e00 con 0x7fe6b4135f40 2026-02-20T16:30:48.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.421+0000 7f0876ffd640 1 -- 10.20.193.57:0/2969082096 --> v1:10.20.193.57:6801/385793132 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0884010e50 con 0x7f085c071250 2026-02-20T16:30:48.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.421+0000 7f0876ffd640 1 -- 10.20.193.57:0/2969082096 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f088406a050 con 0x7f0890130220 2026-02-20T16:30:48.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.421+0000 7fe6a1ffb640 1 -- 10.20.193.57:0/505772503 --> v1:10.20.193.57:6809/1926844368 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe684092ef0 con 0x7fe684071250 2026-02-20T16:30:48.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.421+0000 7fe6a1ffb640 1 -- 10.20.193.57:0/505772503 <== mon.2 v2:10.20.193.57:3302/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fe6a80664d0 con 0x7fe6b4135f40 2026-02-20T16:30:48.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.421+0000 7ff07b7fe640 1 -- 10.20.193.57:0/3087810012 <== mon.0 v2:10.20.193.57:3300/0 4 ==== mgrmap(e 8) ==== 59878+0+0 (secure 0 0 0) 0x7ff08401b400 con 0x7ff09c135f40 2026-02-20T16:30:48.446 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.421+0000 7ff07b7fe640 1 -- 10.20.193.57:0/3087810012 <== mon.0 v2:10.20.193.57:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3020+0+0 (secure 0 0 0) 0x7ff084063520 con 0x7ff09c135f40 2026-02-20T16:30:48.446 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.421+0000 7ff07b7fe640 1 -- 10.20.193.57:0/3087810012 --> v1:10.20.193.57:6805/3441840004 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff068092ef0 con 0x7ff068071250 2026-02-20T16:30:48.446 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.421+0000 7ff07b7fe640 1 -- 10.20.193.57:0/3087810012 <== mon.0 v2:10.20.193.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff08406a050 con 0x7ff09c135f40 2026-02-20T16:30:48.446 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.422+0000 7f0876ffd640 1 -- 10.20.193.57:0/2969082096 <== osd.0 v1:10.20.193.57:6801/385793132 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7f0884010e50 con 0x7f085c071250 2026-02-20T16:30:48.447 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.422+0000 7fe6a1ffb640 1 -- 10.20.193.57:0/505772503 <== osd.2 v1:10.20.193.57:6809/1926844368 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7fe684092ef0 con 0x7fe684071250 2026-02-20T16:30:48.447 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.422+0000 7f5339164640 1 -- 10.20.193.57:0/2490765811 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f5334174330 msgr2=0x7f5334194710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.447 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.422+0000 7f5339164640 1 --2- 10.20.193.57:0/2490765811 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f5334174330 0x7f5334194710 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5324004af0 tx=0x7f532402f3d0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.448 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.422+0000 7ff07b7fe640 1 -- 10.20.193.57:0/3087810012 <== osd.1 v1:10.20.193.57:6805/3441840004 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7ff068092ef0 con 0x7ff068071250 2026-02-20T16:30:48.450 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.422+0000 7f5339164640 1 -- 10.20.193.57:0/2490765811 shutdown_connections 2026-02-20T16:30:48.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.422+0000 7f5339164640 1 --2- 10.20.193.57:0/2490765811 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f5334174330 0x7f5334194710 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.422+0000 7f5339164640 1 --2- 10.20.193.57:0/2490765811 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f5334085b90 0x7f533407d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.422+0000 7f5339164640 1 -- 10.20.193.57:0/2490765811 >> 10.20.193.57:0/2490765811 conn(0x7f53340833e0 msgr2=0x7f53340840b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:48.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.422+0000 7f5339164640 1 -- 10.20.193.57:0/2490765811 shutdown_connections 2026-02-20T16:30:48.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.422+0000 7f5339164640 1 -- 10.20.193.57:0/2490765811 wait complete. 2026-02-20T16:30:48.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.423+0000 7f5339164640 1 Processor -- start 2026-02-20T16:30:48.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.423+0000 7f5339164640 1 -- start start 2026-02-20T16:30:48.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.423+0000 7f5339164640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f533407dc60 0x7f533418f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:48.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.423+0000 7f5339164640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f5334085b90 0x7f533418f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:48.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.423+0000 7f5339164640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f5334174330 0x7f5334174730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:48.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.423+0000 7f5339164640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f5334195810 con 0x7f533407dc60 2026-02-20T16:30:48.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.423+0000 7f5339164640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f5334195690 con 0x7f5334174330 2026-02-20T16:30:48.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.423+0000 7f5339164640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f5334195990 con 0x7f5334085b90 2026-02-20T16:30:48.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.423+0000 7f5332d76640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f533407dc60 0x7f533418f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:48.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.423+0000 7f5332d76640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f533407dc60 0x7f533418f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:56382/0 (socket says 10.20.193.57:56382) 2026-02-20T16:30:48.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.423+0000 7f5333577640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f5334174330 0x7f5334174730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:48.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.423+0000 7f5332d76640 1 -- 10.20.193.57:0/3369078645 learned_addr learned my addr 10.20.193.57:0/3369078645 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:30:48.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.423+0000 7f5332575640 1 --2- 10.20.193.57:0/3369078645 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f5334085b90 0x7f533418f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:48.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.423+0000 7f5333577640 1 -- 10.20.193.57:0/3369078645 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f5334085b90 msgr2=0x7f533418f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.423+0000 7f5333577640 1 --2- 10.20.193.57:0/3369078645 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f5334085b90 0x7f533418f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.423+0000 7f5333577640 1 -- 10.20.193.57:0/3369078645 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f533407dc60 msgr2=0x7f533418f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.423+0000 7f5333577640 1 --2- 10.20.193.57:0/3369078645 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f533407dc60 0x7f533418f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.423+0000 7f5333577640 1 -- 10.20.193.57:0/3369078645 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f533407f8f0 con 0x7f5334174330 2026-02-20T16:30:48.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.423+0000 7f5332d76640 1 --2- 10.20.193.57:0/3369078645 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f533407dc60 0x7f533418f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:30:48.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.423+0000 7f5333577640 1 --2- 10.20.193.57:0/3369078645 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f5334174330 0x7f5334174730 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5324004af0 tx=0x7f5324002c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:30:48.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.423+0000 7f53137fe640 1 -- 10.20.193.57:0/3369078645 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53240040c0 con 0x7f5334174330 2026-02-20T16:30:48.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.423+0000 7f53137fe640 1 -- 10.20.193.57:0/3369078645 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5324004280 con 0x7f5334174330 2026-02-20T16:30:48.453 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.423+0000 7f5339164640 1 -- 10.20.193.57:0/3369078645 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f533418fcd0 con 0x7f5334174330 2026-02-20T16:30:48.453 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.423+0000 7f53137fe640 1 -- 10.20.193.57:0/3369078645 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53240046d0 con 0x7f5334174330 2026-02-20T16:30:48.453 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.423+0000 7f5339164640 1 -- 10.20.193.57:0/3369078645 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5334079c30 con 0x7f5334174330 2026-02-20T16:30:48.453 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.424+0000 7f53137fe640 1 -- 10.20.193.57:0/3369078645 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 8) ==== 59878+0+0 (secure 0 0 0) 0x7f532404a450 con 0x7f5334174330 2026-02-20T16:30:48.453 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.424+0000 7f5339164640 1 -- 10.20.193.57:0/3369078645 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f533407a600 con 0x7f5334174330 2026-02-20T16:30:48.453 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.424+0000 7f53137fe640 1 -- 10.20.193.57:0/3369078645 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 3020+0+0 (secure 0 0 0) 0x7f53240879c0 con 0x7f5334174330 2026-02-20T16:30:48.453 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.424+0000 7f53137fe640 1 -- 10.20.193.57:0/3369078645 --> v1:10.20.193.57:6813/3124429028 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f532403de50 con 0x7f5300071250 2026-02-20T16:30:48.453 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.424+0000 7f53137fe640 1 -- 10.20.193.57:0/3369078645 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f532408c2a0 con 0x7f5334174330 2026-02-20T16:30:48.453 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.425+0000 7f53137fe640 1 -- 10.20.193.57:0/3369078645 <== osd.3 v1:10.20.193.57:6813/3124429028 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7f532403de50 con 0x7f5300071250 2026-02-20T16:30:48.453 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.428+0000 7fe6bb690640 1 -- 10.20.193.57:0/505772503 --> v1:10.20.193.57:6809/1926844368 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe678002e60 con 0x7fe684071250 2026-02-20T16:30:48.454 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.428+0000 7fe6a1ffb640 1 -- 10.20.193.57:0/505772503 <== osd.2 v1:10.20.193.57:6809/1926844368 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 4244904967) 0x7fe678002e60 con 0x7fe684071250 2026-02-20T16:30:48.454 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.428+0000 7fe6bb690640 1 -- 10.20.193.57:0/505772503 >> v1:10.20.193.57:6809/1926844368 conn(0x7fe684071250 legacy=0x7fe684091680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.454 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.428+0000 7fe6bb690640 1 -- 10.20.193.57:0/505772503 >> v1:10.20.193.57:6800/2007744879 conn(0x7fe68404c930 legacy=0x7fe68406cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.428+0000 7fe6bb690640 1 -- 10.20.193.57:0/505772503 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fe6b4135f40 msgr2=0x7fe6b405b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.428+0000 7fe6bb690640 1 --2- 10.20.193.57:0/505772503 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fe6b4135f40 0x7fe6b405b9b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe6a80094b0 tx=0x7fe6a800ee60 comp rx=0 tx=0).stop 2026-02-20T16:30:48.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.428+0000 7fe6b9c06640 1 -- 10.20.193.57:0/505772503 reap_dead start 2026-02-20T16:30:48.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.428+0000 7fe6bb690640 1 -- 10.20.193.57:0/505772503 shutdown_connections 2026-02-20T16:30:48.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.428+0000 7fe6bb690640 1 -- 10.20.193.57:0/505772503 >> 10.20.193.57:0/505772503 conn(0x7fe6b408aae0 msgr2=0x7fe6b4134830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:48.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.428+0000 7fe6bb690640 1 -- 10.20.193.57:0/505772503 shutdown_connections 2026-02-20T16:30:48.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.428+0000 7fe6bb690640 1 -- 10.20.193.57:0/505772503 wait complete. 2026-02-20T16:30:48.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.428+0000 7ff0a13e4640 1 -- 10.20.193.57:0/3087810012 --> v1:10.20.193.57:6805/3441840004 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff09c134f10 con 0x7ff068071250 2026-02-20T16:30:48.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.429+0000 7ff07b7fe640 1 -- 10.20.193.57:0/3087810012 <== osd.1 v1:10.20.193.57:6805/3441840004 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 4244904967) 0x7ff09c134f10 con 0x7ff068071250 2026-02-20T16:30:48.456 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.429+0000 7ff0a13e4640 1 -- 10.20.193.57:0/3087810012 >> v1:10.20.193.57:6805/3441840004 conn(0x7ff068071250 legacy=0x7ff068091680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.456 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.429+0000 7ff0a13e4640 1 -- 10.20.193.57:0/3087810012 >> v1:10.20.193.57:6800/2007744879 conn(0x7ff06804c930 legacy=0x7ff06806cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.456 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.429+0000 7ff0a13e4640 1 -- 10.20.193.57:0/3087810012 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7ff09c135f40 msgr2=0x7ff09c05b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.456 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.429+0000 7ff0a13e4640 1 --2- 10.20.193.57:0/3087810012 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7ff09c135f40 0x7ff09c05b800 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff08400c4f0 tx=0x7ff08400c9c0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.457 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.429+0000 7ff09b7fe640 1 -- 10.20.193.57:0/3087810012 reap_dead start 2026-02-20T16:30:48.457 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.429+0000 7ff0a13e4640 1 -- 10.20.193.57:0/3087810012 shutdown_connections 2026-02-20T16:30:48.457 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.429+0000 7ff0a13e4640 1 -- 10.20.193.57:0/3087810012 >> 10.20.193.57:0/3087810012 conn(0x7ff09c08aae0 msgr2=0x7ff09c1345b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:48.457 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.429+0000 7ff0a13e4640 1 -- 10.20.193.57:0/3087810012 shutdown_connections 2026-02-20T16:30:48.457 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.429+0000 7ff0a13e4640 1 -- 10.20.193.57:0/3087810012 wait complete. 2026-02-20T16:30:48.457 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.429+0000 7f0894f58640 1 -- 10.20.193.57:0/2969082096 --> v1:10.20.193.57:6801/385793132 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0890157040 con 0x7f085c071250 2026-02-20T16:30:48.457 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.430+0000 7f0876ffd640 1 -- 10.20.193.57:0/2969082096 <== osd.0 v1:10.20.193.57:6801/385793132 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2753631528) 0x7f0890157040 con 0x7f085c071250 2026-02-20T16:30:48.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.431+0000 7f0894f58640 1 -- 10.20.193.57:0/2969082096 >> v1:10.20.193.57:6801/385793132 conn(0x7f085c071250 legacy=0x7f085c091680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.431+0000 7f0894f58640 1 -- 10.20.193.57:0/2969082096 >> v1:10.20.193.57:6800/2007744879 conn(0x7f085c04c930 legacy=0x7f085c06cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.431+0000 7f0894f58640 1 -- 10.20.193.57:0/2969082096 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f0890130220 msgr2=0x7f0890177630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.431+0000 7f0894f58640 1 --2- 10.20.193.57:0/2969082096 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f0890130220 0x7f0890177630 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0884002760 tx=0x7f088400c970 comp rx=0 tx=0).stop 2026-02-20T16:30:48.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.431+0000 7f088ed76640 1 -- 10.20.193.57:0/2969082096 reap_dead start 2026-02-20T16:30:48.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.431+0000 7f0894f58640 1 -- 10.20.193.57:0/2969082096 shutdown_connections 2026-02-20T16:30:48.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.431+0000 7f0894f58640 1 -- 10.20.193.57:0/2969082096 >> 10.20.193.57:0/2969082096 conn(0x7f089008aae0 msgr2=0x7f0890132430 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:48.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.431+0000 7f0894f58640 1 -- 10.20.193.57:0/2969082096 shutdown_connections 2026-02-20T16:30:48.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.431+0000 7f0894f58640 1 -- 10.20.193.57:0/2969082096 wait complete. 2026-02-20T16:30:48.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.431+0000 7f5339164640 1 -- 10.20.193.57:0/3369078645 --> v1:10.20.193.57:6813/3124429028 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5334174ef0 con 0x7f5300071250 2026-02-20T16:30:48.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.431+0000 7f53137fe640 1 -- 10.20.193.57:0/3369078645 <== osd.3 v1:10.20.193.57:6813/3124429028 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 4244904967) 0x7f5334174ef0 con 0x7f5300071250 2026-02-20T16:30:48.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.432+0000 7f5339164640 1 -- 10.20.193.57:0/3369078645 >> v1:10.20.193.57:6813/3124429028 conn(0x7f5300071250 legacy=0x7f5300091680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.432+0000 7f5339164640 1 -- 10.20.193.57:0/3369078645 >> v1:10.20.193.57:6800/2007744879 conn(0x7f530004c930 legacy=0x7f530006cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.432+0000 7f5339164640 1 -- 10.20.193.57:0/3369078645 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f5334174330 msgr2=0x7f5334174730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.432+0000 7f5339164640 1 --2- 10.20.193.57:0/3369078645 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f5334174330 0x7f5334174730 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5324004af0 tx=0x7f5324002c80 comp rx=0 tx=0).stop 2026-02-20T16:30:48.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.432+0000 7f5333577640 1 -- 10.20.193.57:0/3369078645 reap_dead start 2026-02-20T16:30:48.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.432+0000 7f5339164640 1 -- 10.20.193.57:0/3369078645 shutdown_connections 2026-02-20T16:30:48.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.432+0000 7f5339164640 1 -- 10.20.193.57:0/3369078645 >> 10.20.193.57:0/3369078645 conn(0x7f53340833e0 msgr2=0x7f5334059d80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:48.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.432+0000 7f5339164640 1 -- 10.20.193.57:0/3369078645 shutdown_connections 2026-02-20T16:30:48.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.432+0000 7f5339164640 1 -- 10.20.193.57:0/3369078645 wait complete. 2026-02-20T16:30:48.461 INFO:teuthology.orchestra.run.trial057.stdout:42949672976 2026-02-20T16:30:48.461 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-20T16:30:48.462 INFO:teuthology.orchestra.run.trial057.stdout:42949672976 2026-02-20T16:30:48.462 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-20T16:30:48.463 INFO:teuthology.orchestra.run.trial057.stdout:38654705680 2026-02-20T16:30:48.463 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-20T16:30:48.464 INFO:teuthology.orchestra.run.trial057.stdout:42949672976 2026-02-20T16:30:48.464 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-20T16:30:48.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.570+0000 7fcb567a7640 1 -- 10.20.193.57:0/1123026190 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fcb50085b90 msgr2=0x7fcb5007d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.570+0000 7fcb567a7640 1 --2- 10.20.193.57:0/1123026190 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fcb50085b90 0x7fcb5007d720 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c005ea0 tx=0x7fcb3c02f220 comp rx=0 tx=0).stop 2026-02-20T16:30:48.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.570+0000 7fcb567a7640 1 -- 10.20.193.57:0/1123026190 shutdown_connections 2026-02-20T16:30:48.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.570+0000 7fcb567a7640 1 --2- 10.20.193.57:0/1123026190 >> v2:10.20.193.57:3300/0 conn(0x7fcb50173320 0x7fcb50193700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.570+0000 7fcb567a7640 1 --2- 10.20.193.57:0/1123026190 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fcb5007dc60 0x7fcb5007e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.570+0000 7fcb567a7640 1 --2- 10.20.193.57:0/1123026190 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fcb50085b90 0x7fcb5007d720 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.570+0000 7fcb567a7640 1 -- 10.20.193.57:0/1123026190 >> 10.20.193.57:0/1123026190 conn(0x7fcb500833e0 msgr2=0x7fcb500840b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:48.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.570+0000 7fcb567a7640 1 -- 10.20.193.57:0/1123026190 shutdown_connections 2026-02-20T16:30:48.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.570+0000 7fcb567a7640 1 -- 10.20.193.57:0/1123026190 wait complete. 2026-02-20T16:30:48.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.570+0000 7f9978088640 1 -- 10.20.193.57:0/1692147564 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f9970087260 msgr2=0x7f9970134220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.570+0000 7f9978088640 1 --2- 10.20.193.57:0/1692147564 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f9970087260 0x7f9970134220 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f996c009750 tx=0x7f996c02f3c0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.570+0000 7f980b1b1640 1 -- 10.20.193.57:0/4086440649 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f9804085b90 msgr2=0x7f980407d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.570+0000 7fcb567a7640 1 Processor -- start 2026-02-20T16:30:48.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.570+0000 7f9978088640 1 -- 10.20.193.57:0/1692147564 shutdown_connections 2026-02-20T16:30:48.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.570+0000 7f9978088640 1 --2- 10.20.193.57:0/1692147564 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f9970087260 0x7f9970134220 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.570+0000 7f9978088640 1 --2- 10.20.193.57:0/1692147564 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f9970086e70 0x7f9970133ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.570+0000 7f9978088640 1 --2- 10.20.193.57:0/1692147564 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f9970086560 0x7f9970086930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.570+0000 7f980b1b1640 1 --2- 10.20.193.57:0/4086440649 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f9804085b90 0x7f980407d720 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f97f4005ea0 tx=0x7f97f402f220 comp rx=0 tx=0).stop 2026-02-20T16:30:48.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.570+0000 7f9978088640 1 -- 10.20.193.57:0/1692147564 >> 10.20.193.57:0/1692147564 conn(0x7f9970089230 msgr2=0x7f997005a910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:48.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.570+0000 7f980b1b1640 1 -- 10.20.193.57:0/4086440649 shutdown_connections 2026-02-20T16:30:48.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.570+0000 7f980b1b1640 1 --2- 10.20.193.57:0/4086440649 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f9804173320 0x7f9804193700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.570+0000 7f980b1b1640 1 --2- 10.20.193.57:0/4086440649 >> v2:10.20.193.57:3300/0 conn(0x7f980407dc60 0x7f980407e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.570+0000 7f980b1b1640 1 --2- 10.20.193.57:0/4086440649 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f9804085b90 0x7f980407d720 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.570+0000 7f980b1b1640 1 -- 10.20.193.57:0/4086440649 >> 10.20.193.57:0/4086440649 conn(0x7f98040833e0 msgr2=0x7f98040840b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:48.577 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.570+0000 7f9978088640 1 -- 10.20.193.57:0/1692147564 shutdown_connections 2026-02-20T16:30:48.577 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.570+0000 7f9978088640 1 -- 10.20.193.57:0/1692147564 wait complete. 2026-02-20T16:30:48.577 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.570+0000 7f980b1b1640 1 -- 10.20.193.57:0/4086440649 shutdown_connections 2026-02-20T16:30:48.578 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.570+0000 7fcb567a7640 1 -- start start 2026-02-20T16:30:48.578 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.570+0000 7f980b1b1640 1 -- 10.20.193.57:0/4086440649 wait complete. 2026-02-20T16:30:48.579 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.570+0000 7fcb567a7640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fcb5007dc60 0x7fcb5005a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:48.580 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.570+0000 7fcb567a7640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fcb50085b90 0x7fcb5005aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:48.580 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.570+0000 7fcb567a7640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fcb50173320 0x7fcb5005b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:48.580 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.570+0000 7fcb567a7640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7fcb501946b0 con 0x7fcb5007dc60 2026-02-20T16:30:48.580 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.570+0000 7fcb567a7640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7fcb50194530 con 0x7fcb50085b90 2026-02-20T16:30:48.580 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.570+0000 7fcb567a7640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7fcb50194830 con 0x7fcb50173320 2026-02-20T16:30:48.580 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7fcb4ffff640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fcb5007dc60 0x7fcb5005a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:48.580 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7fcb54d1d640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fcb50173320 0x7fcb5005b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:48.580 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7fcb4f7fe640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fcb50085b90 0x7fcb5005aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:48.580 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7fcb4ffff640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fcb5007dc60 0x7fcb5005a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:56432/0 (socket says 10.20.193.57:56432) 2026-02-20T16:30:48.580 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7fcb4ffff640 1 -- 10.20.193.57:0/656145194 learned_addr learned my addr 10.20.193.57:0/656145194 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:30:48.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7fcb4ffff640 1 -- 10.20.193.57:0/656145194 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fcb50173320 msgr2=0x7fcb5005b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7fcb4ffff640 1 --2- 10.20.193.57:0/656145194 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fcb50173320 0x7fcb5005b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7fcb4ffff640 1 -- 10.20.193.57:0/656145194 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fcb50085b90 msgr2=0x7fcb5005aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7fcb4ffff640 1 --2- 10.20.193.57:0/656145194 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fcb50085b90 0x7fcb5005aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7fcb4ffff640 1 -- 10.20.193.57:0/656145194 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb5005be40 con 0x7fcb5007dc60 2026-02-20T16:30:48.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7fcb54d1d640 1 --2- 10.20.193.57:0/656145194 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fcb50173320 0x7fcb5005b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:30:48.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7fcb4f7fe640 1 --2- 10.20.193.57:0/656145194 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fcb50085b90 0x7fcb5005aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:30:48.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7fcb4ffff640 1 --2- 10.20.193.57:0/656145194 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fcb5007dc60 0x7fcb5005a660 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c005fa0 tx=0x7fcb3c02fd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:30:48.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7f3bb0690640 1 -- 10.20.193.57:0/1034710044 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f3ba8086560 msgr2=0x7f3ba8086930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.582 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7f980b1b1640 1 Processor -- start 2026-02-20T16:30:48.582 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7fcb4cff9640 1 -- 10.20.193.57:0/656145194 <== mon.0 v2:10.20.193.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c046070 con 0x7fcb5007dc60 2026-02-20T16:30:48.582 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7f3bb0690640 1 --2- 10.20.193.57:0/1034710044 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f3ba8086560 0x7f3ba8086930 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3b98005ea0 tx=0x7f3b9802f1d0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.583 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7fcb4cff9640 1 -- 10.20.193.57:0/656145194 <== mon.0 v2:10.20.193.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcb3c0029a0 con 0x7fcb5007dc60 2026-02-20T16:30:48.583 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7fcb567a7640 1 -- 10.20.193.57:0/656145194 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb50173ee0 con 0x7fcb5007dc60 2026-02-20T16:30:48.583 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7f3bb0690640 1 -- 10.20.193.57:0/1034710044 shutdown_connections 2026-02-20T16:30:48.583 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7f3bb0690640 1 --2- 10.20.193.57:0/1034710044 >> v2:10.20.193.57:3300/0 conn(0x7f3ba8086e70 0x7f3ba8133ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.583 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7f3bb0690640 1 --2- 10.20.193.57:0/1034710044 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f3ba8086560 0x7f3ba8086930 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7f3bb0690640 1 -- 10.20.193.57:0/1034710044 >> 10.20.193.57:0/1034710044 conn(0x7f3ba8089230 msgr2=0x7f3ba805a910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:48.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7f9978088640 1 Processor -- start 2026-02-20T16:30:48.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7f3bb0690640 1 -- 10.20.193.57:0/1034710044 shutdown_connections 2026-02-20T16:30:48.585 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7fcb4cff9640 1 -- 10.20.193.57:0/656145194 <== mon.0 v2:10.20.193.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c002d90 con 0x7fcb5007dc60 2026-02-20T16:30:48.585 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7f3bb0690640 1 -- 10.20.193.57:0/1034710044 wait complete. 2026-02-20T16:30:48.585 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7f980b1b1640 1 -- start start 2026-02-20T16:30:48.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7f9978088640 1 -- start start 2026-02-20T16:30:48.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7fcb567a7640 1 -- 10.20.193.57:0/656145194 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb50193870 con 0x7fcb5007dc60 2026-02-20T16:30:48.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7f9978088640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f9970086560 0x7f9970106010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:48.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7f9978088640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f9970086e70 0x7f9970106550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:48.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7f9978088640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f9970087260 0x7f9970125a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:48.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7f9978088640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f9970195960 con 0x7f9970086560 2026-02-20T16:30:48.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7f9978088640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f99701957e0 con 0x7f9970086e70 2026-02-20T16:30:48.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7f9978088640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f9970195ae0 con 0x7f9970087260 2026-02-20T16:30:48.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7f980b1b1640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f980407dc60 0x7f980411fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:48.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7f980b1b1640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f9804085b90 0x7f98041203e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:48.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7f980b1b1640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f9804173320 0x7f9804120920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:48.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7f980b1b1640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f9804194770 con 0x7f980407dc60 2026-02-20T16:30:48.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7f980b1b1640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f98041945f0 con 0x7f9804085b90 2026-02-20T16:30:48.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7f980b1b1640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f98041948f0 con 0x7f9804173320 2026-02-20T16:30:48.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7f9809727640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f9804173320 0x7f9804120920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:48.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7f9808f26640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f980407dc60 0x7f980411fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:48.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7f9809727640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f9804173320 0x7f9804120920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3302/0 says I am v2:10.20.193.57:48886/0 (socket says 10.20.193.57:48886) 2026-02-20T16:30:48.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7f9809727640 1 -- 10.20.193.57:0/1995631717 learned_addr learned my addr 10.20.193.57:0/1995631717 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:30:48.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7f97fbfff640 1 --2- 10.20.193.57:0/1995631717 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f9804085b90 0x7f98041203e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:48.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7f99755fc640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f9970086e70 0x7f9970106550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:48.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7f9975dfd640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f9970086560 0x7f9970106010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:48.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7f99755fc640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f9970086e70 0x7f9970106550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3301/0 says I am v2:10.20.193.57:45322/0 (socket says 10.20.193.57:45322) 2026-02-20T16:30:48.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7f99755fc640 1 -- 10.20.193.57:0/3215454559 learned_addr learned my addr 10.20.193.57:0/3215454559 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:30:48.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7f99765fe640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f9970087260 0x7f9970125a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:48.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7f9809727640 1 -- 10.20.193.57:0/1995631717 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f9804085b90 msgr2=0x7f98041203e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7f9809727640 1 --2- 10.20.193.57:0/1995631717 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f9804085b90 0x7f98041203e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7f9809727640 1 -- 10.20.193.57:0/1995631717 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f980407dc60 msgr2=0x7f980411fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7f9809727640 1 --2- 10.20.193.57:0/1995631717 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f980407dc60 0x7f980411fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7f9809727640 1 -- 10.20.193.57:0/1995631717 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f980407bf90 con 0x7f9804173320 2026-02-20T16:30:48.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7f9808f26640 1 --2- 10.20.193.57:0/1995631717 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f980407dc60 0x7f980411fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:30:48.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.571+0000 7fcb567a7640 1 -- 10.20.193.57:0/656145194 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb5005d820 con 0x7fcb5007dc60 2026-02-20T16:30:48.592 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.572+0000 7f9975dfd640 1 -- 10.20.193.57:0/3215454559 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f9970087260 msgr2=0x7f9970125a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.592 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.572+0000 7f9975dfd640 1 --2- 10.20.193.57:0/3215454559 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f9970087260 0x7f9970125a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.592 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.572+0000 7f9975dfd640 1 -- 10.20.193.57:0/3215454559 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f9970086e70 msgr2=0x7f9970106550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.592 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.572+0000 7f9975dfd640 1 --2- 10.20.193.57:0/3215454559 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f9970086e70 0x7f9970106550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.592 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.572+0000 7f3bb0690640 1 Processor -- start 2026-02-20T16:30:48.593 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.572+0000 7f9809727640 1 --2- 10.20.193.57:0/1995631717 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f9804173320 0x7f9804120920 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9800009e80 tx=0x7f980000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:30:48.593 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.572+0000 7f9975dfd640 1 -- 10.20.193.57:0/3215454559 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9970108480 con 0x7f9970086560 2026-02-20T16:30:48.593 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.572+0000 7f99765fe640 1 --2- 10.20.193.57:0/3215454559 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f9970087260 0x7f9970125a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:30:48.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.572+0000 7f3bb0690640 1 -- start start 2026-02-20T16:30:48.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.572+0000 7f97f97fa640 1 -- 10.20.193.57:0/1995631717 <== mon.2 v2:10.20.193.57:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f980000cde0 con 0x7f9804173320 2026-02-20T16:30:48.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.572+0000 7fcb4cff9640 1 -- 10.20.193.57:0/656145194 <== mon.0 v2:10.20.193.57:3300/0 4 ==== mgrmap(e 8) ==== 59878+0+0 (secure 0 0 0) 0x7fcb3c038470 con 0x7fcb5007dc60 2026-02-20T16:30:48.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.572+0000 7f97f97fa640 1 -- 10.20.193.57:0/1995631717 <== mon.2 v2:10.20.193.57:3302/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f98000090d0 con 0x7f9804173320 2026-02-20T16:30:48.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.572+0000 7f980b1b1640 1 -- 10.20.193.57:0/1995631717 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f980410b440 con 0x7f9804173320 2026-02-20T16:30:48.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.572+0000 7f9975dfd640 1 --2- 10.20.193.57:0/3215454559 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f9970086560 0x7f9970106010 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f996000d720 tx=0x7f996000dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:30:48.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.572+0000 7f97f97fa640 1 -- 10.20.193.57:0/1995631717 <== mon.2 v2:10.20.193.57:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9800003a80 con 0x7f9804173320 2026-02-20T16:30:48.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.572+0000 7f3bb0690640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f3ba8086560 0x7f3ba8058830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:48.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.572+0000 7f3bb0690640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f3ba8086e70 0x7f3ba8058d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:48.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.572+0000 7f3bb0690640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f3ba8087260 0x7f3ba81951b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:48.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.572+0000 7f3bb0690640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba8196b00 con 0x7f3ba8087260 2026-02-20T16:30:48.597 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.572+0000 7f3bb0690640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f3ba8196980 con 0x7f3ba8086560 2026-02-20T16:30:48.597 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.572+0000 7f3bb0690640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f3ba8196c80 con 0x7f3ba8086e70 2026-02-20T16:30:48.597 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.572+0000 7fcb4cff9640 1 -- 10.20.193.57:0/656145194 <== mon.0 v2:10.20.193.57:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3020+0+0 (secure 0 0 0) 0x7fcb3c087b00 con 0x7fcb5007dc60 2026-02-20T16:30:48.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.572+0000 7f3bae405640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f3ba8086560 0x7f3ba8058830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:48.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.572+0000 7f3baec06640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f3ba8087260 0x7f3ba81951b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:48.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.572+0000 7f3badc04640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f3ba8086e70 0x7f3ba8058d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:48.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.572+0000 7f3bae405640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f3ba8086560 0x7f3ba8058830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3301/0 says I am v2:10.20.193.57:45338/0 (socket says 10.20.193.57:45338) 2026-02-20T16:30:48.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.572+0000 7f3bae405640 1 -- 10.20.193.57:0/3000099937 learned_addr learned my addr 10.20.193.57:0/3000099937 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:30:48.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.572+0000 7f3bae405640 1 -- 10.20.193.57:0/3000099937 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f3ba8086e70 msgr2=0x7f3ba8058d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.572+0000 7f3bae405640 1 --2- 10.20.193.57:0/3000099937 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f3ba8086e70 0x7f3ba8058d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.572+0000 7f3bae405640 1 -- 10.20.193.57:0/3000099937 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f3ba8087260 msgr2=0x7f3ba81951b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.572+0000 7f3bae405640 1 --2- 10.20.193.57:0/3000099937 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f3ba8087260 0x7f3ba81951b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.572+0000 7f3bae405640 1 -- 10.20.193.57:0/3000099937 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ba8059d60 con 0x7f3ba8086560 2026-02-20T16:30:48.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.572+0000 7f3baec06640 1 --2- 10.20.193.57:0/3000099937 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f3ba8087260 0x7f3ba81951b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:30:48.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.572+0000 7f980b1b1640 1 -- 10.20.193.57:0/1995631717 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f9804123440 con 0x7f9804173320 2026-02-20T16:30:48.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.572+0000 7f3bae405640 1 --2- 10.20.193.57:0/3000099937 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f3ba8086560 0x7f3ba8058830 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3b9802fe70 tx=0x7f3b98002900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:30:48.600 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.572+0000 7f980b1b1640 1 -- 10.20.193.57:0/1995631717 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f980407e080 con 0x7f9804173320 2026-02-20T16:30:48.600 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.572+0000 7f3b8effd640 1 -- 10.20.193.57:0/3000099937 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b98046070 con 0x7f3ba8086560 2026-02-20T16:30:48.600 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.572+0000 7f3b8effd640 1 -- 10.20.193.57:0/3000099937 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b980045f0 con 0x7f3ba8086560 2026-02-20T16:30:48.600 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.572+0000 7f3b8effd640 1 -- 10.20.193.57:0/3000099937 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b98038470 con 0x7f3ba8086560 2026-02-20T16:30:48.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.572+0000 7f97f97fa640 1 -- 10.20.193.57:0/1995631717 <== mon.2 v2:10.20.193.57:3302/0 4 ==== mgrmap(e 8) ==== 59878+0+0 (secure 0 0 0) 0x7f9800003c20 con 0x7f9804173320 2026-02-20T16:30:48.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.572+0000 7f3bb0690640 1 -- 10.20.193.57:0/3000099937 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ba8106e30 con 0x7f3ba8086560 2026-02-20T16:30:48.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.572+0000 7f3bb0690640 1 -- 10.20.193.57:0/3000099937 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ba80592b0 con 0x7f3ba8086560 2026-02-20T16:30:48.602 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.573+0000 7f97f97fa640 1 -- 10.20.193.57:0/1995631717 <== mon.2 v2:10.20.193.57:3302/0 5 ==== osd_map(20..20 src has 1..20) ==== 3020+0+0 (secure 0 0 0) 0x7f9800063d70 con 0x7f9804173320 2026-02-20T16:30:48.602 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.573+0000 7f3bb0690640 1 -- 10.20.193.57:0/3000099937 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ba8084d30 con 0x7f3ba8086560 2026-02-20T16:30:48.602 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.573+0000 7f3b8effd640 1 -- 10.20.193.57:0/3000099937 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 8) ==== 59878+0+0 (secure 0 0 0) 0x7f3b98038610 con 0x7f3ba8086560 2026-02-20T16:30:48.602 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.573+0000 7f3b8effd640 1 -- 10.20.193.57:0/3000099937 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 3020+0+0 (secure 0 0 0) 0x7f3b98087d30 con 0x7f3ba8086560 2026-02-20T16:30:48.603 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.573+0000 7f995e7fc640 1 -- 10.20.193.57:0/3215454559 <== mon.0 v2:10.20.193.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9960014070 con 0x7f9970086560 2026-02-20T16:30:48.603 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.573+0000 7fcb4cff9640 1 -- 10.20.193.57:0/656145194 <== mon.0 v2:10.20.193.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7fcb5005d820 con 0x7fcb5007dc60 2026-02-20T16:30:48.604 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.573+0000 7f995e7fc640 1 -- 10.20.193.57:0/3215454559 <== mon.0 v2:10.20.193.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f99600044e0 con 0x7f9970086560 2026-02-20T16:30:48.604 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.573+0000 7f9978088640 1 -- 10.20.193.57:0/3215454559 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9970108f00 con 0x7f9970086560 2026-02-20T16:30:48.604 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.573+0000 7f995e7fc640 1 -- 10.20.193.57:0/3215454559 <== mon.0 v2:10.20.193.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9960004ae0 con 0x7f9970086560 2026-02-20T16:30:48.604 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.574+0000 7f9978088640 1 -- 10.20.193.57:0/3215454559 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9970108720 con 0x7f9970086560 2026-02-20T16:30:48.604 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.574+0000 7f9978088640 1 -- 10.20.193.57:0/3215454559 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f997005a070 con 0x7f9970086560 2026-02-20T16:30:48.604 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.574+0000 7f995e7fc640 1 -- 10.20.193.57:0/3215454559 <== mon.0 v2:10.20.193.57:3300/0 4 ==== mgrmap(e 8) ==== 59878+0+0 (secure 0 0 0) 0x7f9960004c80 con 0x7f9970086560 2026-02-20T16:30:48.604 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.574+0000 7f995e7fc640 1 -- 10.20.193.57:0/3215454559 <== mon.0 v2:10.20.193.57:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3020+0+0 (secure 0 0 0) 0x7f9960063820 con 0x7f9970086560 2026-02-20T16:30:48.605 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.574+0000 7f97f97fa640 1 -- 10.20.193.57:0/1995631717 <== mon.2 v2:10.20.193.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7f9800022020 con 0x7f9804173320 2026-02-20T16:30:48.605 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.575+0000 7f3b8effd640 1 -- 10.20.193.57:0/3000099937 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7f3ba8084d30 con 0x7f3ba8086560 2026-02-20T16:30:48.605 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.576+0000 7f995e7fc640 1 -- 10.20.193.57:0/3215454559 <== mon.0 v2:10.20.193.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7f997005a070 con 0x7f9970086560 2026-02-20T16:30:48.651 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.649+0000 7fcb567a7640 1 -- 10.20.193.57:0/656145194 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fcb5007e030 con 0x7fcb5007dc60 2026-02-20T16:30:48.651 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.650+0000 7fcb4cff9640 1 -- 10.20.193.57:0/656145194 <== mon.0 v2:10.20.193.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcb3c086260 con 0x7fcb5007dc60 2026-02-20T16:30:48.652 INFO:teuthology.orchestra.run.trial057.stdout:42949672973 2026-02-20T16:30:48.652 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.650+0000 7f9978088640 1 -- 10.20.193.57:0/3215454559 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f9970086930 con 0x7f9970086560 2026-02-20T16:30:48.652 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.651+0000 7f995e7fc640 1 -- 10.20.193.57:0/3215454559 <== mon.0 v2:10.20.193.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9960062080 con 0x7f9970086560 2026-02-20T16:30:48.652 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.651+0000 7f3bb0690640 1 -- 10.20.193.57:0/3000099937 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f3ba8086930 con 0x7f3ba8086560 2026-02-20T16:30:48.653 INFO:teuthology.orchestra.run.trial057.stdout:38654705678 2026-02-20T16:30:48.653 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.651+0000 7f3b8effd640 1 -- 10.20.193.57:0/3000099937 <== mon.1 v2:10.20.193.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3b98038d90 con 0x7f3ba8086560 2026-02-20T16:30:48.653 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.651+0000 7fcb567a7640 1 -- 10.20.193.57:0/656145194 >> v1:10.20.193.57:6800/2007744879 conn(0x7fcb2004c930 legacy=0x7fcb2006cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.654 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.651+0000 7fcb567a7640 1 -- 10.20.193.57:0/656145194 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fcb5007dc60 msgr2=0x7fcb5005a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.654 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.651+0000 7fcb567a7640 1 --2- 10.20.193.57:0/656145194 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fcb5007dc60 0x7fcb5005a660 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c005fa0 tx=0x7fcb3c02fd50 comp rx=0 tx=0).stop 2026-02-20T16:30:48.654 INFO:teuthology.orchestra.run.trial057.stdout:42949672973 2026-02-20T16:30:48.655 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.651+0000 7fcb567a7640 1 -- 10.20.193.57:0/656145194 shutdown_connections 2026-02-20T16:30:48.655 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.651+0000 7fcb567a7640 1 --2- 10.20.193.57:0/656145194 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fcb50173320 0x7fcb5005b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.655 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.651+0000 7fcb567a7640 1 --2- 10.20.193.57:0/656145194 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fcb50085b90 0x7fcb5005aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.655 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.651+0000 7fcb567a7640 1 --2- 10.20.193.57:0/656145194 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fcb5007dc60 0x7fcb5005a660 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.655 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.651+0000 7fcb567a7640 1 -- 10.20.193.57:0/656145194 >> 10.20.193.57:0/656145194 conn(0x7fcb500833e0 msgr2=0x7fcb500798a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:48.655 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.651+0000 7fcb567a7640 1 -- 10.20.193.57:0/656145194 shutdown_connections 2026-02-20T16:30:48.655 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.651+0000 7fcb567a7640 1 -- 10.20.193.57:0/656145194 wait complete. 2026-02-20T16:30:48.656 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.652+0000 7f9978088640 1 -- 10.20.193.57:0/3215454559 >> v1:10.20.193.57:6800/2007744879 conn(0x7f994004c980 legacy=0x7f994006ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.656 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.652+0000 7f9978088640 1 -- 10.20.193.57:0/3215454559 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f9970086560 msgr2=0x7f9970106010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.656 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.652+0000 7f9978088640 1 --2- 10.20.193.57:0/3215454559 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f9970086560 0x7f9970106010 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f996000d720 tx=0x7f996000dbf0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.656 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.652+0000 7f9978088640 1 -- 10.20.193.57:0/3215454559 shutdown_connections 2026-02-20T16:30:48.656 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.652+0000 7f9978088640 1 --2- 10.20.193.57:0/3215454559 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f9970087260 0x7f9970125a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.656 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.652+0000 7f9978088640 1 --2- 10.20.193.57:0/3215454559 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f9970086e70 0x7f9970106550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.656 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.652+0000 7f9978088640 1 --2- 10.20.193.57:0/3215454559 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f9970086560 0x7f9970106010 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.656 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.652+0000 7f9978088640 1 -- 10.20.193.57:0/3215454559 >> 10.20.193.57:0/3215454559 conn(0x7f9970089230 msgr2=0x7f9970116c90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:48.656 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.652+0000 7f9978088640 1 -- 10.20.193.57:0/3215454559 shutdown_connections 2026-02-20T16:30:48.656 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.652+0000 7f9978088640 1 -- 10.20.193.57:0/3215454559 wait complete. 2026-02-20T16:30:48.657 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.652+0000 7f3bb0690640 1 -- 10.20.193.57:0/3000099937 >> v1:10.20.193.57:6800/2007744879 conn(0x7f3b7804c930 legacy=0x7f3b7806cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.657 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.652+0000 7f3bb0690640 1 -- 10.20.193.57:0/3000099937 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f3ba8086560 msgr2=0x7f3ba8058830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.657 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.652+0000 7f3bb0690640 1 --2- 10.20.193.57:0/3000099937 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f3ba8086560 0x7f3ba8058830 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3b9802fe70 tx=0x7f3b98002900 comp rx=0 tx=0).stop 2026-02-20T16:30:48.657 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.652+0000 7f3bb0690640 1 -- 10.20.193.57:0/3000099937 shutdown_connections 2026-02-20T16:30:48.658 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.653+0000 7f3bb0690640 1 --2- 10.20.193.57:0/3000099937 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f3ba8087260 0x7f3ba81951b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.658 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.653+0000 7f3bb0690640 1 --2- 10.20.193.57:0/3000099937 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f3ba8086e70 0x7f3ba8058d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.658 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.653+0000 7f3bb0690640 1 --2- 10.20.193.57:0/3000099937 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f3ba8086560 0x7f3ba8058830 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.658 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.653+0000 7f3bb0690640 1 -- 10.20.193.57:0/3000099937 >> 10.20.193.57:0/3000099937 conn(0x7f3ba8089230 msgr2=0x7f3ba8114b70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:48.658 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.653+0000 7f3bb0690640 1 -- 10.20.193.57:0/3000099937 shutdown_connections 2026-02-20T16:30:48.658 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.653+0000 7f3bb0690640 1 -- 10.20.193.57:0/3000099937 wait complete. 2026-02-20T16:30:48.658 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.653+0000 7f980b1b1640 1 -- 10.20.193.57:0/1995631717 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f9804123e30 con 0x7f9804173320 2026-02-20T16:30:48.658 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.653+0000 7f97f97fa640 1 -- 10.20.193.57:0/1995631717 <== mon.2 v2:10.20.193.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9800010040 con 0x7f9804173320 2026-02-20T16:30:48.659 INFO:teuthology.orchestra.run.trial057.stdout:42949672973 2026-02-20T16:30:48.659 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.655+0000 7f980b1b1640 1 -- 10.20.193.57:0/1995631717 >> v1:10.20.193.57:6800/2007744879 conn(0x7f97d404c930 legacy=0x7f97d406cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.659 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.655+0000 7f980b1b1640 1 -- 10.20.193.57:0/1995631717 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f9804173320 msgr2=0x7f9804120920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:48.660 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.655+0000 7f980b1b1640 1 --2- 10.20.193.57:0/1995631717 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f9804173320 0x7f9804120920 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9800009e80 tx=0x7f980000c490 comp rx=0 tx=0).stop 2026-02-20T16:30:48.660 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.655+0000 7f980b1b1640 1 -- 10.20.193.57:0/1995631717 shutdown_connections 2026-02-20T16:30:48.660 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.655+0000 7f980b1b1640 1 --2- 10.20.193.57:0/1995631717 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f9804173320 0x7f9804120920 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.660 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.655+0000 7f980b1b1640 1 --2- 10.20.193.57:0/1995631717 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f9804085b90 0x7f98041203e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.660 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.655+0000 7f980b1b1640 1 --2- 10.20.193.57:0/1995631717 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f980407dc60 0x7f980411fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:48.660 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.655+0000 7f980b1b1640 1 -- 10.20.193.57:0/1995631717 >> 10.20.193.57:0/1995631717 conn(0x7f98040833e0 msgr2=0x7f980407c880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:48.660 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.655+0000 7f980b1b1640 1 -- 10.20.193.57:0/1995631717 shutdown_connections 2026-02-20T16:30:48.660 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:48.655+0000 7f980b1b1640 1 -- 10.20.193.57:0/1995631717 wait complete. 2026-02-20T16:30:48.661 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672976 got 42949672973 for osd.2 2026-02-20T16:30:48.662 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705680 got 38654705678 for osd.0 2026-02-20T16:30:48.663 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672976 got 42949672973 for osd.3 2026-02-20T16:30:48.665 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672976 got 42949672973 for osd.1 2026-02-20T16:30:49.662 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-20T16:30:49.663 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-20T16:30:49.663 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-20T16:30:49.666 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-20T16:30:49.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.735+0000 7fad9559d640 1 -- 10.20.193.57:0/2763495830 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fad90130220 msgr2=0x7fad90086570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:49.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.735+0000 7fad9559d640 1 --2- 10.20.193.57:0/2763495830 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fad90130220 0x7fad90086570 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fad840098c0 tx=0x7fad8402f0c0 comp rx=0 tx=0).stop 2026-02-20T16:30:49.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.735+0000 7fad9559d640 1 -- 10.20.193.57:0/2763495830 shutdown_connections 2026-02-20T16:30:49.738 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.735+0000 7fad9559d640 1 --2- 10.20.193.57:0/2763495830 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fad901368f0 0x7fad90197270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:49.738 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.735+0000 7fad9559d640 1 --2- 10.20.193.57:0/2763495830 >> v2:10.20.193.57:3300/0 conn(0x7fad90135f40 0x7fad901363b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:49.738 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.735+0000 7fad9559d640 1 --2- 10.20.193.57:0/2763495830 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fad90130220 0x7fad90086570 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:49.738 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.735+0000 7fad9559d640 1 -- 10.20.193.57:0/2763495830 >> 10.20.193.57:0/2763495830 conn(0x7fad9008aae0 msgr2=0x7fad9008aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:49.738 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.735+0000 7fad9559d640 1 -- 10.20.193.57:0/2763495830 shutdown_connections 2026-02-20T16:30:49.738 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.735+0000 7fad9559d640 1 -- 10.20.193.57:0/2763495830 wait complete. 2026-02-20T16:30:49.739 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.735+0000 7f1d559fe640 1 -- 10.20.193.57:0/809127690 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f1d50174330 msgr2=0x7f1d50194710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:49.739 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.735+0000 7f1d559fe640 1 --2- 10.20.193.57:0/809127690 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f1d50174330 0x7f1d50194710 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1d40009f10 tx=0x7f1d4002f380 comp rx=0 tx=0).stop 2026-02-20T16:30:49.739 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.735+0000 7fc0852e6640 1 -- 10.20.193.57:0/1503619059 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fc0800814c0 msgr2=0x7fc08007c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:49.739 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.735+0000 7fc0852e6640 1 --2- 10.20.193.57:0/1503619059 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fc0800814c0 0x7fc08007c400 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc068005ea0 tx=0x7fc06802f1d0 comp rx=0 tx=0).stop 2026-02-20T16:30:49.740 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.735+0000 7f1d559fe640 1 -- 10.20.193.57:0/809127690 shutdown_connections 2026-02-20T16:30:49.740 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.735+0000 7f1d559fe640 1 --2- 10.20.193.57:0/809127690 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f1d50174330 0x7f1d50194710 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:49.740 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.735+0000 7f1d559fe640 1 --2- 10.20.193.57:0/809127690 >> v2:10.20.193.57:3300/0 conn(0x7f1d5007de30 0x7f1d5007e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:49.740 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.735+0000 7fc0852e6640 1 -- 10.20.193.57:0/1503619059 shutdown_connections 2026-02-20T16:30:49.740 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.735+0000 7fc0852e6640 1 --2- 10.20.193.57:0/1503619059 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fc0800814c0 0x7fc08007c400 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:49.740 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.735+0000 7fc0852e6640 1 --2- 10.20.193.57:0/1503619059 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fc080080bb0 0x7fc080080f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:49.741 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.735+0000 7fc0852e6640 1 -- 10.20.193.57:0/1503619059 >> 10.20.193.57:0/1503619059 conn(0x7fc0800833e0 msgr2=0x7fc0800840b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:49.741 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.735+0000 7f1d559fe640 1 -- 10.20.193.57:0/809127690 >> 10.20.193.57:0/809127690 conn(0x7f1d500833e0 msgr2=0x7f1d500840b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:49.741 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.735+0000 7f1d559fe640 1 -- 10.20.193.57:0/809127690 shutdown_connections 2026-02-20T16:30:49.742 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.735+0000 7fc0852e6640 1 -- 10.20.193.57:0/1503619059 shutdown_connections 2026-02-20T16:30:49.742 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.735+0000 7fc0852e6640 1 -- 10.20.193.57:0/1503619059 wait complete. 2026-02-20T16:30:49.742 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.735+0000 7f1d559fe640 1 -- 10.20.193.57:0/809127690 wait complete. 2026-02-20T16:30:49.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.735+0000 7fad9559d640 1 Processor -- start 2026-02-20T16:30:49.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7fad9559d640 1 -- start start 2026-02-20T16:30:49.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7fad9559d640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fad90130220 0x7fad9005b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:49.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7fad9559d640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fad90135f40 0x7fad90196fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:49.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7fad9559d640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fad901368f0 0x7fad9005bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:49.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7fad9559d640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7fad90197b40 con 0x7fad90135f40 2026-02-20T16:30:49.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7fad9559d640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7fad901979c0 con 0x7fad901368f0 2026-02-20T16:30:49.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7fad9559d640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7fad90197cc0 con 0x7fad90130220 2026-02-20T16:30:49.745 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7fad8effd640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fad90130220 0x7fad9005b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:49.745 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7fad8effd640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fad90130220 0x7fad9005b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3302/0 says I am v2:10.20.193.57:48948/0 (socket says 10.20.193.57:48948) 2026-02-20T16:30:49.745 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7fad8e7fc640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fad90135f40 0x7fad90196fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:49.745 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7fad8effd640 1 -- 10.20.193.57:0/1026816814 learned_addr learned my addr 10.20.193.57:0/1026816814 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:30:49.745 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7fad8f7fe640 1 --2- 10.20.193.57:0/1026816814 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fad901368f0 0x7fad9005bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:49.746 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7fc0852e6640 1 Processor -- start 2026-02-20T16:30:49.746 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7fc0852e6640 1 -- start start 2026-02-20T16:30:49.746 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7fad8effd640 1 -- 10.20.193.57:0/1026816814 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fad901368f0 msgr2=0x7fad9005bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:49.746 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7fad8effd640 1 --2- 10.20.193.57:0/1026816814 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fad901368f0 0x7fad9005bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:49.746 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7fad8effd640 1 -- 10.20.193.57:0/1026816814 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fad90135f40 msgr2=0x7fad90196fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:49.747 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7fad8effd640 1 --2- 10.20.193.57:0/1026816814 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fad90135f40 0x7fad90196fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:49.747 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7fad8effd640 1 -- 10.20.193.57:0/1026816814 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad901307a0 con 0x7fad90130220 2026-02-20T16:30:49.747 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7fad8e7fc640 1 --2- 10.20.193.57:0/1026816814 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fad90135f40 0x7fad90196fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:30:49.747 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7f1d559fe640 1 Processor -- start 2026-02-20T16:30:49.747 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7fad8effd640 1 --2- 10.20.193.57:0/1026816814 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fad90130220 0x7fad9005b5c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fad84009460 tx=0x7fad84002900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:30:49.748 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7f1d559fe640 1 -- start start 2026-02-20T16:30:49.748 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7fc0852e6640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fc08007c940 0x7fc08011c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:49.749 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7fc0852e6640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fc080080bb0 0x7fc08011ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:49.749 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7fc0852e6640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fc0800814c0 0x7fc08011d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:49.749 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7fc0852e6640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7fc080196bf0 con 0x7fc0800814c0 2026-02-20T16:30:49.749 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7fc0852e6640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7fc080196a70 con 0x7fc080080bb0 2026-02-20T16:30:49.749 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7fc0852e6640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7fc080196d70 con 0x7fc08007c940 2026-02-20T16:30:49.749 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7fad6f7fe640 1 -- 10.20.193.57:0/1026816814 <== mon.2 v2:10.20.193.57:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad84048070 con 0x7fad90130220 2026-02-20T16:30:49.750 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7fc07e7fc640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fc080080bb0 0x7fc08011ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:49.750 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7fc07e7fc640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fc080080bb0 0x7fc08011ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3301/0 says I am v2:10.20.193.57:45382/0 (socket says 10.20.193.57:45382) 2026-02-20T16:30:49.750 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7fc07e7fc640 1 -- 10.20.193.57:0/1556870152 learned_addr learned my addr 10.20.193.57:0/1556870152 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:30:49.750 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7fad6f7fe640 1 -- 10.20.193.57:0/1026816814 <== mon.2 v2:10.20.193.57:3302/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fad8402fe00 con 0x7fad90130220 2026-02-20T16:30:49.750 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7fad9559d640 1 -- 10.20.193.57:0/1026816814 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad90197510 con 0x7fad90130220 2026-02-20T16:30:49.751 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7fc07effd640 1 --2- 10.20.193.57:0/1556870152 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fc08007c940 0x7fc08011c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:49.751 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7fc07f7fe640 1 --2- 10.20.193.57:0/1556870152 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fc0800814c0 0x7fc08011d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:49.752 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7fad6f7fe640 1 -- 10.20.193.57:0/1026816814 <== mon.2 v2:10.20.193.57:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad84043470 con 0x7fad90130220 2026-02-20T16:30:49.752 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7fad9559d640 1 -- 10.20.193.57:0/1026816814 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fad9010f960 con 0x7fad90130220 2026-02-20T16:30:49.753 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7fc07e7fc640 1 -- 10.20.193.57:0/1556870152 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fc08007c940 msgr2=0x7fc08011c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:49.753 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7fc07e7fc640 1 --2- 10.20.193.57:0/1556870152 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fc08007c940 0x7fc08011c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:49.753 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7fc07e7fc640 1 -- 10.20.193.57:0/1556870152 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fc0800814c0 msgr2=0x7fc08011d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:49.753 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7fc07e7fc640 1 --2- 10.20.193.57:0/1556870152 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fc0800814c0 0x7fc08011d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:49.754 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7fc07e7fc640 1 -- 10.20.193.57:0/1556870152 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc08005d040 con 0x7fc080080bb0 2026-02-20T16:30:49.754 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7f1d559fe640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f1d5007de30 0x7f1d50125b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:49.754 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7f1d559fe640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f1d50085b90 0x7f1d50126090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:49.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7f1d559fe640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f1d50174330 0x7f1d5007b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:49.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7f1d559fe640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f1d50195810 con 0x7f1d50085b90 2026-02-20T16:30:49.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7f1d559fe640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f1d50195690 con 0x7f1d5007de30 2026-02-20T16:30:49.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7f1d559fe640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f1d50195990 con 0x7f1d50174330 2026-02-20T16:30:49.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7f1d4e7fc640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f1d50085b90 0x7f1d50126090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:49.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7fc07e7fc640 1 --2- 10.20.193.57:0/1556870152 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fc080080bb0 0x7fc08011ce90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc06802fe70 tx=0x7fc068002900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:30:49.756 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7f1d4f7fe640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f1d50174330 0x7f1d5007b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:49.756 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7f1d4e7fc640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f1d50085b90 0x7f1d50126090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:56546/0 (socket says 10.20.193.57:56546) 2026-02-20T16:30:49.756 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7f1d4effd640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f1d5007de30 0x7f1d50125b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:49.756 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.736+0000 7f1d4e7fc640 1 -- 10.20.193.57:0/2117288047 learned_addr learned my addr 10.20.193.57:0/2117288047 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:30:49.756 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.737+0000 7f1d4e7fc640 1 -- 10.20.193.57:0/2117288047 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f1d50174330 msgr2=0x7f1d5007b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:49.757 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.737+0000 7fc05f7fe640 1 -- 10.20.193.57:0/1556870152 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc068046070 con 0x7fc080080bb0 2026-02-20T16:30:49.757 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.737+0000 7f1d4e7fc640 1 --2- 10.20.193.57:0/2117288047 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f1d50174330 0x7f1d5007b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:49.757 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.737+0000 7f1d4e7fc640 1 -- 10.20.193.57:0/2117288047 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f1d5007de30 msgr2=0x7f1d50125b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:49.757 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.737+0000 7f1d4e7fc640 1 --2- 10.20.193.57:0/2117288047 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f1d5007de30 0x7f1d50125b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:49.757 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.737+0000 7f1d4e7fc640 1 -- 10.20.193.57:0/2117288047 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d5007f8f0 con 0x7f1d50085b90 2026-02-20T16:30:49.758 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.737+0000 7fc05f7fe640 1 -- 10.20.193.57:0/1556870152 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc0680045f0 con 0x7fc080080bb0 2026-02-20T16:30:49.758 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.737+0000 7fc05f7fe640 1 -- 10.20.193.57:0/1556870152 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc068038470 con 0x7fc080080bb0 2026-02-20T16:30:49.759 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.737+0000 7fc0852e6640 1 -- 10.20.193.57:0/1556870152 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc080077ae0 con 0x7fc080080bb0 2026-02-20T16:30:49.759 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.737+0000 7fc0852e6640 1 -- 10.20.193.57:0/1556870152 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc080076730 con 0x7fc080080bb0 2026-02-20T16:30:49.759 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.737+0000 7f1d4e7fc640 1 --2- 10.20.193.57:0/2117288047 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f1d50085b90 0x7f1d50126090 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1d38005b60 tx=0x7f1d3800ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:30:49.759 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.737+0000 7fad9559d640 1 -- 10.20.193.57:0/1026816814 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad90135240 con 0x7fad90130220 2026-02-20T16:30:49.760 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.737+0000 7f1d27fff640 1 -- 10.20.193.57:0/2117288047 <== mon.0 v2:10.20.193.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3800ccc0 con 0x7f1d50085b90 2026-02-20T16:30:49.760 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.737+0000 7f1d27fff640 1 -- 10.20.193.57:0/2117288047 <== mon.0 v2:10.20.193.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1d38010430 con 0x7f1d50085b90 2026-02-20T16:30:49.760 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.737+0000 7f1d559fe640 1 -- 10.20.193.57:0/2117288047 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d5007cc90 con 0x7f1d50085b90 2026-02-20T16:30:49.760 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.737+0000 7f1d27fff640 1 -- 10.20.193.57:0/2117288047 <== mon.0 v2:10.20.193.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d38010840 con 0x7f1d50085b90 2026-02-20T16:30:49.760 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.737+0000 7f1d559fe640 1 -- 10.20.193.57:0/2117288047 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d50058510 con 0x7f1d50085b90 2026-02-20T16:30:49.761 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.737+0000 7fad6f7fe640 1 -- 10.20.193.57:0/1026816814 <== mon.2 v2:10.20.193.57:3302/0 4 ==== mgrmap(e 9) ==== 59984+0+0 (secure 0 0 0) 0x7fad84038470 con 0x7fad90130220 2026-02-20T16:30:49.761 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.737+0000 7fad6f7fe640 1 -- 10.20.193.57:0/1026816814 <== mon.2 v2:10.20.193.57:3302/0 5 ==== osd_map(20..20 src has 1..20) ==== 3020+0+0 (secure 0 0 0) 0x7fad84088020 con 0x7fad90130220 2026-02-20T16:30:49.762 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.737+0000 7fc05f7fe640 1 -- 10.20.193.57:0/1556870152 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 9) ==== 59984+0+0 (secure 0 0 0) 0x7fc068038610 con 0x7fc080080bb0 2026-02-20T16:30:49.762 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.737+0000 7f1d559fe640 1 -- 10.20.193.57:0/2117288047 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d5007d840 con 0x7f1d50085b90 2026-02-20T16:30:49.762 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.738+0000 7f1d27fff640 1 -- 10.20.193.57:0/2117288047 <== mon.0 v2:10.20.193.57:3300/0 4 ==== mgrmap(e 9) ==== 59984+0+0 (secure 0 0 0) 0x7f1d380109e0 con 0x7f1d50085b90 2026-02-20T16:30:49.763 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.738+0000 7fc05f7fe640 1 -- 10.20.193.57:0/1556870152 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 3020+0+0 (secure 0 0 0) 0x7fc068087d10 con 0x7fc080080bb0 2026-02-20T16:30:49.763 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.738+0000 7fc0852e6640 1 -- 10.20.193.57:0/1556870152 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc080080f80 con 0x7fc080080bb0 2026-02-20T16:30:49.764 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.738+0000 7f1d27fff640 1 -- 10.20.193.57:0/2117288047 <== mon.0 v2:10.20.193.57:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3020+0+0 (secure 0 0 0) 0x7f1d38064240 con 0x7f1d50085b90 2026-02-20T16:30:49.764 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.739+0000 7fad6f7fe640 1 -- 10.20.193.57:0/1026816814 <== mon.2 v2:10.20.193.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7fad90135240 con 0x7fad90130220 2026-02-20T16:30:49.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.739+0000 7f1d27fff640 1 -- 10.20.193.57:0/2117288047 <== mon.0 v2:10.20.193.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7f1d5007d840 con 0x7f1d50085b90 2026-02-20T16:30:49.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.740+0000 7fc05f7fe640 1 -- 10.20.193.57:0/1556870152 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7fc068038d90 con 0x7fc080080bb0 2026-02-20T16:30:49.779 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.775+0000 7f466b3e6640 1 -- 10.20.193.57:0/3407613843 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f4664080bb0 msgr2=0x7f4664080f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:49.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.775+0000 7f466b3e6640 1 --2- 10.20.193.57:0/3407613843 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f4664080bb0 0x7f4664080f80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4654004770 tx=0x7f465402f0e0 comp rx=0 tx=0).stop 2026-02-20T16:30:49.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.775+0000 7f466b3e6640 1 -- 10.20.193.57:0/3407613843 shutdown_connections 2026-02-20T16:30:49.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.775+0000 7f466b3e6640 1 --2- 10.20.193.57:0/3407613843 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f466407cb10 0x7f4664196150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:49.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.775+0000 7f466b3e6640 1 --2- 10.20.193.57:0/3407613843 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f4664080bb0 0x7f4664080f80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:49.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.775+0000 7f466b3e6640 1 -- 10.20.193.57:0/3407613843 >> 10.20.193.57:0/3407613843 conn(0x7f46640833e0 msgr2=0x7f46640840b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:49.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.775+0000 7f466b3e6640 1 -- 10.20.193.57:0/3407613843 shutdown_connections 2026-02-20T16:30:49.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.775+0000 7f466b3e6640 1 -- 10.20.193.57:0/3407613843 wait complete. 2026-02-20T16:30:49.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.776+0000 7f466b3e6640 1 Processor -- start 2026-02-20T16:30:49.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.776+0000 7f466b3e6640 1 -- start start 2026-02-20T16:30:49.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.776+0000 7f466b3e6640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f466407cb10 0x7f4664142550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:49.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.776+0000 7f466b3e6640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f4664080bb0 0x7f4664142a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:49.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.776+0000 7f466b3e6640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f46640814c0 0x7f4664143360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:49.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.776+0000 7f466b3e6640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f4664196a20 con 0x7f466407cb10 2026-02-20T16:30:49.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.776+0000 7f466b3e6640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f46641968a0 con 0x7f46640814c0 2026-02-20T16:30:49.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.776+0000 7f466b3e6640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f4664196ba0 con 0x7f4664080bb0 2026-02-20T16:30:49.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.776+0000 7f466915b640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f466407cb10 0x7f4664142550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:49.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.776+0000 7f466915b640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f466407cb10 0x7f4664142550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:56558/0 (socket says 10.20.193.57:56558) 2026-02-20T16:30:49.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.776+0000 7f466915b640 1 -- 10.20.193.57:0/2577446703 learned_addr learned my addr 10.20.193.57:0/2577446703 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:30:49.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.776+0000 7f466895a640 1 --2- 10.20.193.57:0/2577446703 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f4664080bb0 0x7f4664142a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:49.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.776+0000 7f466995c640 1 --2- 10.20.193.57:0/2577446703 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f46640814c0 0x7f4664143360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:49.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.776+0000 7f466915b640 1 -- 10.20.193.57:0/2577446703 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f4664080bb0 msgr2=0x7f4664142a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:49.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.776+0000 7f466915b640 1 --2- 10.20.193.57:0/2577446703 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f4664080bb0 0x7f4664142a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:49.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.776+0000 7f466915b640 1 -- 10.20.193.57:0/2577446703 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f46640814c0 msgr2=0x7f4664143360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:49.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.776+0000 7f466915b640 1 --2- 10.20.193.57:0/2577446703 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f46640814c0 0x7f4664143360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:49.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.776+0000 7f466915b640 1 -- 10.20.193.57:0/2577446703 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f466405b730 con 0x7f466407cb10 2026-02-20T16:30:49.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.776+0000 7f466995c640 1 --2- 10.20.193.57:0/2577446703 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f46640814c0 0x7f4664143360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T16:30:49.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.777+0000 7f466915b640 1 --2- 10.20.193.57:0/2577446703 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f466407cb10 0x7f4664142550 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4654009230 tx=0x7f4654002900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:30:49.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.777+0000 7f4651ffb640 1 -- 10.20.193.57:0/2577446703 <== mon.0 v2:10.20.193.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4654046070 con 0x7f466407cb10 2026-02-20T16:30:49.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.777+0000 7f4651ffb640 1 -- 10.20.193.57:0/2577446703 <== mon.0 v2:10.20.193.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4654002d30 con 0x7f466407cb10 2026-02-20T16:30:49.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.777+0000 7f466b3e6640 1 -- 10.20.193.57:0/2577446703 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f466405d3c0 con 0x7f466407cb10 2026-02-20T16:30:49.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.777+0000 7f4651ffb640 1 -- 10.20.193.57:0/2577446703 <== mon.0 v2:10.20.193.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46540386d0 con 0x7f466407cb10 2026-02-20T16:30:49.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.777+0000 7f466b3e6640 1 -- 10.20.193.57:0/2577446703 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f466405ca10 con 0x7f466407cb10 2026-02-20T16:30:49.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.777+0000 7f466b3e6640 1 -- 10.20.193.57:0/2577446703 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4664080f80 con 0x7f466407cb10 2026-02-20T16:30:49.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.777+0000 7f4651ffb640 1 -- 10.20.193.57:0/2577446703 <== mon.0 v2:10.20.193.57:3300/0 4 ==== mgrmap(e 9) ==== 59984+0+0 (secure 0 0 0) 0x7f4654038870 con 0x7f466407cb10 2026-02-20T16:30:49.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.777+0000 7f4651ffb640 1 -- 10.20.193.57:0/2577446703 <== mon.0 v2:10.20.193.57:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3020+0+0 (secure 0 0 0) 0x7f4654087f70 con 0x7f466407cb10 2026-02-20T16:30:49.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.779+0000 7f4651ffb640 1 -- 10.20.193.57:0/2577446703 <== mon.0 v2:10.20.193.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7f4654009400 con 0x7f466407cb10 2026-02-20T16:30:49.817 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.815+0000 7fad9559d640 1 -- 10.20.193.57:0/1026816814 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fad90086570 con 0x7fad90130220 2026-02-20T16:30:49.818 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.815+0000 7fad6f7fe640 1 -- 10.20.193.57:0/1026816814 <== mon.2 v2:10.20.193.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fad9012fd80 con 0x7fad90130220 2026-02-20T16:30:49.818 INFO:teuthology.orchestra.run.trial057.stdout:42949672975 2026-02-20T16:30:49.819 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.816+0000 7fc0852e6640 1 -- 10.20.193.57:0/1556870152 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fc08011dbc0 con 0x7fc080080bb0 2026-02-20T16:30:49.819 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.816+0000 7fc05f7fe640 1 -- 10.20.193.57:0/1556870152 <== mon.1 v2:10.20.193.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc0680862d0 con 0x7fc080080bb0 2026-02-20T16:30:49.820 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.816+0000 7f1d559fe640 1 -- 10.20.193.57:0/2117288047 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f1d50059270 con 0x7f1d50085b90 2026-02-20T16:30:49.820 INFO:teuthology.orchestra.run.trial057.stdout:38654705679 2026-02-20T16:30:49.821 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.816+0000 7f1d27fff640 1 -- 10.20.193.57:0/2117288047 <== mon.0 v2:10.20.193.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1d38010d00 con 0x7f1d50085b90 2026-02-20T16:30:49.821 INFO:teuthology.orchestra.run.trial057.stdout:42949672975 2026-02-20T16:30:49.823 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.817+0000 7fad9559d640 1 -- 10.20.193.57:0/1026816814 >> v1:10.20.193.57:6800/2007744879 conn(0x7fad5c04ca50 legacy=0x7fad5c06cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:49.823 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.817+0000 7fad9559d640 1 -- 10.20.193.57:0/1026816814 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fad90130220 msgr2=0x7fad9005b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:49.823 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.817+0000 7fad9559d640 1 --2- 10.20.193.57:0/1026816814 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fad90130220 0x7fad9005b5c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fad84009460 tx=0x7fad84002900 comp rx=0 tx=0).stop 2026-02-20T16:30:49.823 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.817+0000 7fad9559d640 1 -- 10.20.193.57:0/1026816814 shutdown_connections 2026-02-20T16:30:49.823 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.817+0000 7fad9559d640 1 --2- 10.20.193.57:0/1026816814 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fad901368f0 0x7fad9005bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:49.823 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.817+0000 7fad9559d640 1 --2- 10.20.193.57:0/1026816814 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fad90135f40 0x7fad90196fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:49.823 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.817+0000 7fad9559d640 1 --2- 10.20.193.57:0/1026816814 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fad90130220 0x7fad9005b5c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:49.823 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.817+0000 7fad9559d640 1 -- 10.20.193.57:0/1026816814 >> 10.20.193.57:0/1026816814 conn(0x7fad9008aae0 msgr2=0x7fad90082aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:49.824 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.817+0000 7fad9559d640 1 -- 10.20.193.57:0/1026816814 shutdown_connections 2026-02-20T16:30:49.824 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.817+0000 7fad9559d640 1 -- 10.20.193.57:0/1026816814 wait complete. 2026-02-20T16:30:49.824 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.817+0000 7fc0852e6640 1 -- 10.20.193.57:0/1556870152 >> v1:10.20.193.57:6800/2007744879 conn(0x7fc04c04ca50 legacy=0x7fc04c06cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:49.824 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.817+0000 7fc0852e6640 1 -- 10.20.193.57:0/1556870152 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fc080080bb0 msgr2=0x7fc08011ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:49.824 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.817+0000 7fc0852e6640 1 --2- 10.20.193.57:0/1556870152 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fc080080bb0 0x7fc08011ce90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc06802fe70 tx=0x7fc068002900 comp rx=0 tx=0).stop 2026-02-20T16:30:49.825 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.818+0000 7fc0852e6640 1 -- 10.20.193.57:0/1556870152 shutdown_connections 2026-02-20T16:30:49.825 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.818+0000 7fc0852e6640 1 --2- 10.20.193.57:0/1556870152 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fc0800814c0 0x7fc08011d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:49.825 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.818+0000 7fc0852e6640 1 --2- 10.20.193.57:0/1556870152 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fc080080bb0 0x7fc08011ce90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:49.825 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.818+0000 7fc0852e6640 1 --2- 10.20.193.57:0/1556870152 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fc08007c940 0x7fc08011c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:49.825 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.818+0000 7fc0852e6640 1 -- 10.20.193.57:0/1556870152 >> 10.20.193.57:0/1556870152 conn(0x7fc0800833e0 msgr2=0x7fc080132740 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:49.825 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.818+0000 7f1d559fe640 1 -- 10.20.193.57:0/2117288047 >> v1:10.20.193.57:6800/2007744879 conn(0x7f1d2004ca50 legacy=0x7f1d2006cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:49.825 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.818+0000 7f1d559fe640 1 -- 10.20.193.57:0/2117288047 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f1d50085b90 msgr2=0x7f1d50126090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:49.825 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.818+0000 7f1d559fe640 1 --2- 10.20.193.57:0/2117288047 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f1d50085b90 0x7f1d50126090 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1d38005b60 tx=0x7f1d3800ed10 comp rx=0 tx=0).stop 2026-02-20T16:30:49.826 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.818+0000 7fc0852e6640 1 -- 10.20.193.57:0/1556870152 shutdown_connections 2026-02-20T16:30:49.826 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.818+0000 7fc0852e6640 1 -- 10.20.193.57:0/1556870152 wait complete. 2026-02-20T16:30:49.826 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.818+0000 7f1d559fe640 1 -- 10.20.193.57:0/2117288047 shutdown_connections 2026-02-20T16:30:49.826 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.818+0000 7f1d559fe640 1 --2- 10.20.193.57:0/2117288047 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f1d50174330 0x7f1d5007b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:49.827 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.818+0000 7f1d559fe640 1 --2- 10.20.193.57:0/2117288047 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f1d50085b90 0x7f1d50126090 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:49.827 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.818+0000 7f1d559fe640 1 --2- 10.20.193.57:0/2117288047 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f1d5007de30 0x7f1d50125b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:49.827 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.818+0000 7f1d559fe640 1 -- 10.20.193.57:0/2117288047 >> 10.20.193.57:0/2117288047 conn(0x7f1d500833e0 msgr2=0x7f1d5005c080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:49.827 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.818+0000 7f1d559fe640 1 -- 10.20.193.57:0/2117288047 shutdown_connections 2026-02-20T16:30:49.827 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.818+0000 7f1d559fe640 1 -- 10.20.193.57:0/2117288047 wait complete. 2026-02-20T16:30:49.828 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672976 got 42949672975 for osd.3 2026-02-20T16:30:49.828 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705680 got 38654705679 for osd.0 2026-02-20T16:30:49.829 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672976 got 42949672975 for osd.2 2026-02-20T16:30:49.857 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.856+0000 7f466b3e6640 1 -- 10.20.193.57:0/2577446703 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f466405c770 con 0x7f466407cb10 2026-02-20T16:30:49.858 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.856+0000 7f4651ffb640 1 -- 10.20.193.57:0/2577446703 <== mon.0 v2:10.20.193.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f46540868b0 con 0x7f466407cb10 2026-02-20T16:30:49.858 INFO:teuthology.orchestra.run.trial057.stdout:42949672975 2026-02-20T16:30:49.859 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.857+0000 7f466b3e6640 1 -- 10.20.193.57:0/2577446703 >> v1:10.20.193.57:6800/2007744879 conn(0x7f463404ca50 legacy=0x7f463406cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:49.860 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.857+0000 7f466b3e6640 1 -- 10.20.193.57:0/2577446703 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f466407cb10 msgr2=0x7f4664142550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:49.860 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.857+0000 7f466b3e6640 1 --2- 10.20.193.57:0/2577446703 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f466407cb10 0x7f4664142550 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4654009230 tx=0x7f4654002900 comp rx=0 tx=0).stop 2026-02-20T16:30:49.860 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.857+0000 7f466b3e6640 1 -- 10.20.193.57:0/2577446703 shutdown_connections 2026-02-20T16:30:49.860 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.857+0000 7f466b3e6640 1 --2- 10.20.193.57:0/2577446703 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f46640814c0 0x7f4664143360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:49.860 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.857+0000 7f466b3e6640 1 --2- 10.20.193.57:0/2577446703 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f4664080bb0 0x7f4664142a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:49.860 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.857+0000 7f466b3e6640 1 --2- 10.20.193.57:0/2577446703 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f466407cb10 0x7f4664142550 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:49.860 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.857+0000 7f466b3e6640 1 -- 10.20.193.57:0/2577446703 >> 10.20.193.57:0/2577446703 conn(0x7f46640833e0 msgr2=0x7f4664132940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:49.860 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.857+0000 7f466b3e6640 1 -- 10.20.193.57:0/2577446703 shutdown_connections 2026-02-20T16:30:49.860 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:49.857+0000 7f466b3e6640 1 -- 10.20.193.57:0/2577446703 wait complete. 2026-02-20T16:30:49.867 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672976 got 42949672975 for osd.1 2026-02-20T16:30:50.829 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-20T16:30:50.830 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-20T16:30:50.830 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-20T16:30:50.868 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-20T16:30:50.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.900+0000 7ff8ecca8640 1 -- 10.20.193.57:0/1577567241 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7ff8e80814c0 msgr2=0x7ff8e807c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:50.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.900+0000 7ff8ecca8640 1 --2- 10.20.193.57:0/1577567241 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7ff8e80814c0 0x7ff8e807c400 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff8d00098c0 tx=0x7ff8d002f110 comp rx=0 tx=0).stop 2026-02-20T16:30:50.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.900+0000 7ff8ecca8640 1 -- 10.20.193.57:0/1577567241 shutdown_connections 2026-02-20T16:30:50.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.900+0000 7ff8ecca8640 1 --2- 10.20.193.57:0/1577567241 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7ff8e80814c0 0x7ff8e807c400 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:50.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.900+0000 7ff8ecca8640 1 --2- 10.20.193.57:0/1577567241 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7ff8e8080bb0 0x7ff8e8080f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:50.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.900+0000 7ff8ecca8640 1 -- 10.20.193.57:0/1577567241 >> 10.20.193.57:0/1577567241 conn(0x7ff8e80833e0 msgr2=0x7ff8e80840b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:50.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.900+0000 7f187251c640 1 -- 10.20.193.57:0/987256464 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f186c175670 msgr2=0x7f186c195a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:50.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.900+0000 7f187251c640 1 --2- 10.20.193.57:0/987256464 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f186c175670 0x7f186c195a50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1860009f10 tx=0x7f186002f340 comp rx=0 tx=0).stop 2026-02-20T16:30:50.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.900+0000 7ff8ecca8640 1 -- 10.20.193.57:0/1577567241 shutdown_connections 2026-02-20T16:30:50.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.900+0000 7f187251c640 1 -- 10.20.193.57:0/987256464 shutdown_connections 2026-02-20T16:30:50.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.900+0000 7f187251c640 1 --2- 10.20.193.57:0/987256464 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f186c175670 0x7f186c195a50 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:50.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.900+0000 7f187251c640 1 --2- 10.20.193.57:0/987256464 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f186c081690 0x7f186c175130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:50.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.900+0000 7f187251c640 1 -- 10.20.193.57:0/987256464 >> 10.20.193.57:0/987256464 conn(0x7f186c0833e0 msgr2=0x7f186c0840b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:50.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.900+0000 7ff8ecca8640 1 -- 10.20.193.57:0/1577567241 wait complete. 2026-02-20T16:30:50.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.900+0000 7f187251c640 1 -- 10.20.193.57:0/987256464 shutdown_connections 2026-02-20T16:30:50.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.900+0000 7f187251c640 1 -- 10.20.193.57:0/987256464 wait complete. 2026-02-20T16:30:50.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.901+0000 7f187251c640 1 Processor -- start 2026-02-20T16:30:50.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.901+0000 7ff8ecca8640 1 Processor -- start 2026-02-20T16:30:50.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.901+0000 7f187251c640 1 -- start start 2026-02-20T16:30:50.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.901+0000 7ff8ecca8640 1 -- start start 2026-02-20T16:30:50.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.901+0000 7f187251c640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f186c080bb0 0x7f186c12d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:50.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.901+0000 7ff8ecca8640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7ff8e807c940 0x7ff8e8146d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:50.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.901+0000 7f187251c640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f186c081690 0x7f186c175130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:50.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.901+0000 7ff8ecca8640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7ff8e8080bb0 0x7ff8e812c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:50.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.901+0000 7f187251c640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f186c175670 0x7f186c12df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:50.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.901+0000 7f187251c640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f186c196af0 con 0x7f186c080bb0 2026-02-20T16:30:50.909 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.901+0000 7ff8ecca8640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7ff8e80814c0 0x7ff8e812ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:50.909 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.901+0000 7f187251c640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f186c196970 con 0x7f186c081690 2026-02-20T16:30:50.909 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.901+0000 7f187251c640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f186c196c70 con 0x7f186c175670 2026-02-20T16:30:50.910 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.901+0000 7ff8ecca8640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e8196a70 con 0x7ff8e807c940 2026-02-20T16:30:50.910 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.901+0000 7ff8ecca8640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7ff8e807d260 con 0x7ff8e8080bb0 2026-02-20T16:30:50.910 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.901+0000 7ff8ecca8640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7ff8e8196bf0 con 0x7ff8e80814c0 2026-02-20T16:30:50.910 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.901+0000 7ff8e6575640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7ff8e807c940 0x7ff8e8146d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:50.910 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.901+0000 7ff8e5d74640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7ff8e8080bb0 0x7ff8e812c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:50.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.901+0000 7f186b7fe640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f186c081690 0x7f186c175130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:50.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.901+0000 7f1870a92640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f186c175670 0x7f186c12df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:50.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.901+0000 7ff8e6d76640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7ff8e80814c0 0x7ff8e812ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:50.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.901+0000 7ff8e5d74640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7ff8e8080bb0 0x7ff8e812c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3301/0 says I am v2:10.20.193.57:33216/0 (socket says 10.20.193.57:33216) 2026-02-20T16:30:50.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.901+0000 7ff8e6575640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7ff8e807c940 0x7ff8e8146d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:44686/0 (socket says 10.20.193.57:44686) 2026-02-20T16:30:50.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.901+0000 7ff8e5d74640 1 -- 10.20.193.57:0/1378916486 learned_addr learned my addr 10.20.193.57:0/1378916486 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:30:50.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.901+0000 7f186b7fe640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f186c081690 0x7f186c175130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3301/0 says I am v2:10.20.193.57:33204/0 (socket says 10.20.193.57:33204) 2026-02-20T16:30:50.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.901+0000 7f186b7fe640 1 -- 10.20.193.57:0/2177110347 learned_addr learned my addr 10.20.193.57:0/2177110347 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:30:50.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.901+0000 7f186bfff640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f186c080bb0 0x7f186c12d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:50.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.901+0000 7ff8e5d74640 1 -- 10.20.193.57:0/1378916486 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7ff8e80814c0 msgr2=0x7ff8e812ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:50.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.901+0000 7ff8e5d74640 1 --2- 10.20.193.57:0/1378916486 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7ff8e80814c0 0x7ff8e812ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:50.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.901+0000 7ff8e5d74640 1 -- 10.20.193.57:0/1378916486 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7ff8e807c940 msgr2=0x7ff8e8146d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:50.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.901+0000 7ff8e5d74640 1 --2- 10.20.193.57:0/1378916486 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7ff8e807c940 0x7ff8e8146d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:50.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.901+0000 7ff8e5d74640 1 -- 10.20.193.57:0/1378916486 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8e8146910 con 0x7ff8e8080bb0 2026-02-20T16:30:50.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.901+0000 7f186b7fe640 1 -- 10.20.193.57:0/2177110347 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f186c175670 msgr2=0x7f186c12df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:50.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.901+0000 7f186b7fe640 1 --2- 10.20.193.57:0/2177110347 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f186c175670 0x7f186c12df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:50.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.901+0000 7f186b7fe640 1 -- 10.20.193.57:0/2177110347 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f186c080bb0 msgr2=0x7f186c12d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:50.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.901+0000 7f186b7fe640 1 --2- 10.20.193.57:0/2177110347 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f186c080bb0 0x7f186c12d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:50.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.901+0000 7f186b7fe640 1 -- 10.20.193.57:0/2177110347 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f186c05cce0 con 0x7f186c081690 2026-02-20T16:30:50.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.901+0000 7ff8e5d74640 1 --2- 10.20.193.57:0/1378916486 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7ff8e8080bb0 0x7ff8e812c950 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff8d00099c0 tx=0x7ff8d0002900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:30:50.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.901+0000 7f186b7fe640 1 --2- 10.20.193.57:0/2177110347 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f186c081690 0x7f186c175130 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f185c0094b0 tx=0x7f185c00ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:30:50.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.901+0000 7ff8ceffd640 1 -- 10.20.193.57:0/1378916486 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d0046070 con 0x7ff8e8080bb0 2026-02-20T16:30:50.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.902+0000 7ff8ceffd640 1 -- 10.20.193.57:0/1378916486 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff8d0002d00 con 0x7ff8e8080bb0 2026-02-20T16:30:50.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.902+0000 7ff8ecca8640 1 -- 10.20.193.57:0/1378916486 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8e8075ec0 con 0x7ff8e8080bb0 2026-02-20T16:30:50.916 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.902+0000 7f1868ff9640 1 -- 10.20.193.57:0/2177110347 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f185c00cca0 con 0x7f186c081690 2026-02-20T16:30:50.916 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.902+0000 7ff8ceffd640 1 -- 10.20.193.57:0/1378916486 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d00386d0 con 0x7ff8e8080bb0 2026-02-20T16:30:50.917 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.902+0000 7f1868ff9640 1 -- 10.20.193.57:0/2177110347 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f185c00ce40 con 0x7f186c081690 2026-02-20T16:30:50.917 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.902+0000 7f187251c640 1 -- 10.20.193.57:0/2177110347 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f186c077380 con 0x7f186c081690 2026-02-20T16:30:50.917 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.902+0000 7ff8ecca8640 1 -- 10.20.193.57:0/1378916486 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8e8147280 con 0x7ff8e8080bb0 2026-02-20T16:30:50.918 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.902+0000 7f1868ff9640 1 -- 10.20.193.57:0/2177110347 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f185c004ae0 con 0x7f186c081690 2026-02-20T16:30:50.918 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.902+0000 7f187251c640 1 -- 10.20.193.57:0/2177110347 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f186c076e50 con 0x7f186c081690 2026-02-20T16:30:50.918 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.902+0000 7f83637cb640 1 -- 10.20.193.57:0/1891470229 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f835c080bb0 msgr2=0x7f835c080f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:50.919 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.902+0000 7f83637cb640 1 --2- 10.20.193.57:0/1891470229 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f835c080bb0 0x7f835c080f80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f834c004770 tx=0x7f834c02f0e0 comp rx=0 tx=0).stop 2026-02-20T16:30:50.919 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.902+0000 7f83637cb640 1 -- 10.20.193.57:0/1891470229 shutdown_connections 2026-02-20T16:30:50.919 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.902+0000 7f83637cb640 1 --2- 10.20.193.57:0/1891470229 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f835c07cb10 0x7f835c196150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:50.919 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.902+0000 7f83637cb640 1 --2- 10.20.193.57:0/1891470229 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f835c080bb0 0x7f835c080f80 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:50.919 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.902+0000 7f83637cb640 1 -- 10.20.193.57:0/1891470229 >> 10.20.193.57:0/1891470229 conn(0x7f835c0833e0 msgr2=0x7f835c0840b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:50.919 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.902+0000 7f83637cb640 1 -- 10.20.193.57:0/1891470229 shutdown_connections 2026-02-20T16:30:50.919 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.902+0000 7f83637cb640 1 -- 10.20.193.57:0/1891470229 wait complete. 2026-02-20T16:30:50.920 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.902+0000 7ff8ecca8640 1 -- 10.20.193.57:0/1378916486 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8e812dc60 con 0x7ff8e8080bb0 2026-02-20T16:30:50.920 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.902+0000 7f187251c640 1 -- 10.20.193.57:0/2177110347 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f186c080f80 con 0x7f186c081690 2026-02-20T16:30:50.920 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.902+0000 7ff8ceffd640 1 -- 10.20.193.57:0/1378916486 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 9) ==== 59984+0+0 (secure 0 0 0) 0x7ff8d0038870 con 0x7ff8e8080bb0 2026-02-20T16:30:50.921 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.902+0000 7f1868ff9640 1 -- 10.20.193.57:0/2177110347 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 9) ==== 59984+0+0 (secure 0 0 0) 0x7f185c004c80 con 0x7f186c081690 2026-02-20T16:30:50.921 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.903+0000 7ff8ceffd640 1 -- 10.20.193.57:0/1378916486 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 3020+0+0 (secure 0 0 0) 0x7ff8d0088030 con 0x7ff8e8080bb0 2026-02-20T16:30:50.921 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.903+0000 7f83637cb640 1 Processor -- start 2026-02-20T16:30:50.922 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.903+0000 7f1868ff9640 1 -- 10.20.193.57:0/2177110347 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 3020+0+0 (secure 0 0 0) 0x7f185c064070 con 0x7f186c081690 2026-02-20T16:30:50.924 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.903+0000 7f83637cb640 1 -- start start 2026-02-20T16:30:50.924 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.903+0000 7f83637cb640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f835c07cb10 0x7f835c12c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:50.924 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.903+0000 7f83637cb640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f835c080bb0 0x7f835c12cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:50.925 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.903+0000 7f83637cb640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f835c0814c0 0x7f835c12d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:50.925 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.903+0000 7f83637cb640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f835c196ab0 con 0x7f835c080bb0 2026-02-20T16:30:50.925 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.903+0000 7f83637cb640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f835c196930 con 0x7f835c0814c0 2026-02-20T16:30:50.925 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.903+0000 7f83637cb640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f835c196c30 con 0x7f835c07cb10 2026-02-20T16:30:50.925 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.903+0000 7f8361540640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f835c07cb10 0x7f835c12c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:50.925 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.903+0000 7f8361540640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f835c07cb10 0x7f835c12c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3302/0 says I am v2:10.20.193.57:47676/0 (socket says 10.20.193.57:47676) 2026-02-20T16:30:50.925 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.903+0000 7f8361540640 1 -- 10.20.193.57:0/632750995 learned_addr learned my addr 10.20.193.57:0/632750995 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:30:50.925 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.903+0000 7f8360d3f640 1 --2- 10.20.193.57:0/632750995 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f835c080bb0 0x7f835c12cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:50.925 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.903+0000 7f8361d41640 1 --2- 10.20.193.57:0/632750995 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f835c0814c0 0x7f835c12d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:50.926 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.903+0000 7f8361540640 1 -- 10.20.193.57:0/632750995 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f835c0814c0 msgr2=0x7f835c12d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:50.926 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.903+0000 7f8361540640 1 --2- 10.20.193.57:0/632750995 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f835c0814c0 0x7f835c12d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:50.926 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.903+0000 7f8361540640 1 -- 10.20.193.57:0/632750995 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f835c080bb0 msgr2=0x7f835c12cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:50.926 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.903+0000 7f8361540640 1 --2- 10.20.193.57:0/632750995 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f835c080bb0 0x7f835c12cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:50.926 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.903+0000 7f8361540640 1 -- 10.20.193.57:0/632750995 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f835c12e290 con 0x7f835c07cb10 2026-02-20T16:30:50.926 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.903+0000 7f8361540640 1 --2- 10.20.193.57:0/632750995 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f835c07cb10 0x7f835c12c740 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f834c009230 tx=0x7f834c002900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:30:50.926 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.903+0000 7f8349ffb640 1 -- 10.20.193.57:0/632750995 <== mon.2 v2:10.20.193.57:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834c046070 con 0x7f835c07cb10 2026-02-20T16:30:50.926 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.903+0000 7f8349ffb640 1 -- 10.20.193.57:0/632750995 <== mon.2 v2:10.20.193.57:3302/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f834c002c80 con 0x7f835c07cb10 2026-02-20T16:30:50.926 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.903+0000 7f8349ffb640 1 -- 10.20.193.57:0/632750995 <== mon.2 v2:10.20.193.57:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834c0386d0 con 0x7f835c07cb10 2026-02-20T16:30:50.926 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.903+0000 7f83637cb640 1 -- 10.20.193.57:0/632750995 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f835c076d80 con 0x7f835c07cb10 2026-02-20T16:30:50.926 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.903+0000 7f83637cb640 1 -- 10.20.193.57:0/632750995 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f835c1465c0 con 0x7f835c07cb10 2026-02-20T16:30:50.926 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.904+0000 7f83637cb640 1 -- 10.20.193.57:0/632750995 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f835c080f80 con 0x7f835c07cb10 2026-02-20T16:30:50.927 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.904+0000 7f8349ffb640 1 -- 10.20.193.57:0/632750995 <== mon.2 v2:10.20.193.57:3302/0 4 ==== mgrmap(e 9) ==== 59984+0+0 (secure 0 0 0) 0x7f834c038870 con 0x7f835c07cb10 2026-02-20T16:30:50.927 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.904+0000 7ff8ceffd640 1 -- 10.20.193.57:0/1378916486 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7ff8d0009400 con 0x7ff8e8080bb0 2026-02-20T16:30:50.927 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.904+0000 7f8349ffb640 1 -- 10.20.193.57:0/632750995 <== mon.2 v2:10.20.193.57:3302/0 5 ==== osd_map(20..20 src has 1..20) ==== 3020+0+0 (secure 0 0 0) 0x7f834c087ef0 con 0x7f835c07cb10 2026-02-20T16:30:50.928 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.906+0000 7f1868ff9640 1 -- 10.20.193.57:0/2177110347 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7f185c062970 con 0x7f186c081690 2026-02-20T16:30:50.928 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.906+0000 7f8349ffb640 1 -- 10.20.193.57:0/632750995 <== mon.2 v2:10.20.193.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7f834c009400 con 0x7f835c07cb10 2026-02-20T16:30:50.942 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.940+0000 7f8349ffb640 1 -- 10.20.193.57:0/632750995 <== mon.2 v2:10.20.193.57:3302/0 7 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7f834c0867f0 con 0x7f835c07cb10 2026-02-20T16:30:50.942 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.941+0000 7ff8ceffd640 1 -- 10.20.193.57:0/1378916486 <== mon.1 v2:10.20.193.57:3301/0 7 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7ff8d0086970 con 0x7ff8e8080bb0 2026-02-20T16:30:50.943 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.941+0000 7f1868ff9640 1 -- 10.20.193.57:0/2177110347 <== mon.1 v2:10.20.193.57:3301/0 7 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7f185c062cf0 con 0x7f186c081690 2026-02-20T16:30:50.946 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.942+0000 7f70c04ed640 1 -- 10.20.193.57:0/2410529022 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f70b812f950 msgr2=0x7f70b81328a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:50.946 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.942+0000 7f70c04ed640 1 --2- 10.20.193.57:0/2410529022 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f70b812f950 0x7f70b81328a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f70b4004af0 tx=0x7f70b402f310 comp rx=0 tx=0).stop 2026-02-20T16:30:50.946 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.942+0000 7f70c04ed640 1 -- 10.20.193.57:0/2410529022 shutdown_connections 2026-02-20T16:30:50.947 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.942+0000 7f70c04ed640 1 --2- 10.20.193.57:0/2410529022 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f70b812f950 0x7f70b81328a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:50.947 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.942+0000 7f70c04ed640 1 --2- 10.20.193.57:0/2410529022 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f70b812ec50 0x7f70b812f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:50.947 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.942+0000 7f70c04ed640 1 -- 10.20.193.57:0/2410529022 >> 10.20.193.57:0/2410529022 conn(0x7f70b8086ae0 msgr2=0x7f70b8086ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:50.947 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.942+0000 7f70c04ed640 1 -- 10.20.193.57:0/2410529022 shutdown_connections 2026-02-20T16:30:50.947 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.942+0000 7f70c04ed640 1 -- 10.20.193.57:0/2410529022 wait complete. 2026-02-20T16:30:50.947 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.943+0000 7f70c04ed640 1 Processor -- start 2026-02-20T16:30:50.947 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.943+0000 7f70c04ed640 1 -- start start 2026-02-20T16:30:50.947 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.943+0000 7f70c04ed640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f70b812ec50 0x7f70b81129a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:50.947 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.943+0000 7f70c04ed640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f70b812f560 0x7f70b8112ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:50.947 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.943+0000 7f70c04ed640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f70b812f950 0x7f70b8113420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:50.947 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.943+0000 7f70c04ed640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f70b81950a0 con 0x7f70b812ec50 2026-02-20T16:30:50.947 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.943+0000 7f70c04ed640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f70b8194f20 con 0x7f70b812f560 2026-02-20T16:30:50.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.943+0000 7f70c04ed640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f70b8195220 con 0x7f70b812f950 2026-02-20T16:30:50.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.943+0000 7f70be262640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f70b812ec50 0x7f70b81129a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:50.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.943+0000 7f70bda61640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f70b812f560 0x7f70b8112ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:50.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.943+0000 7f70be262640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f70b812ec50 0x7f70b81129a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:44712/0 (socket says 10.20.193.57:44712) 2026-02-20T16:30:50.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.943+0000 7f70bda61640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f70b812f560 0x7f70b8112ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3301/0 says I am v2:10.20.193.57:33242/0 (socket says 10.20.193.57:33242) 2026-02-20T16:30:50.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.943+0000 7f70be262640 1 -- 10.20.193.57:0/1755734731 learned_addr learned my addr 10.20.193.57:0/1755734731 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:30:50.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.943+0000 7f70bea63640 1 --2- 10.20.193.57:0/1755734731 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f70b812f950 0x7f70b8113420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:50.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.943+0000 7f70be262640 1 -- 10.20.193.57:0/1755734731 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f70b812f950 msgr2=0x7f70b8113420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:50.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.943+0000 7f70be262640 1 --2- 10.20.193.57:0/1755734731 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f70b812f950 0x7f70b8113420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:50.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.943+0000 7f70be262640 1 -- 10.20.193.57:0/1755734731 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f70b812f560 msgr2=0x7f70b8112ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:50.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.943+0000 7f70be262640 1 --2- 10.20.193.57:0/1755734731 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f70b812f560 0x7f70b8112ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:50.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.943+0000 7f70be262640 1 -- 10.20.193.57:0/1755734731 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70b8111650 con 0x7f70b812ec50 2026-02-20T16:30:50.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.943+0000 7f70be262640 1 --2- 10.20.193.57:0/1755734731 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f70b812ec50 0x7f70b81129a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f70a80059a0 tx=0x7f70a800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:30:50.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.943+0000 7f709effd640 1 -- 10.20.193.57:0/1755734731 <== mon.0 v2:10.20.193.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a800cc60 con 0x7f70b812ec50 2026-02-20T16:30:50.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.943+0000 7f709effd640 1 -- 10.20.193.57:0/1755734731 <== mon.0 v2:10.20.193.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f70a800ce00 con 0x7f70b812ec50 2026-02-20T16:30:50.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.943+0000 7f709effd640 1 -- 10.20.193.57:0/1755734731 <== mon.0 v2:10.20.193.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a8004ae0 con 0x7f70b812ec50 2026-02-20T16:30:50.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.943+0000 7f70c04ed640 1 -- 10.20.193.57:0/1755734731 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70b8111d70 con 0x7f70b812ec50 2026-02-20T16:30:50.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.943+0000 7f70c04ed640 1 -- 10.20.193.57:0/1755734731 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70b811fa40 con 0x7f70b812ec50 2026-02-20T16:30:50.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.944+0000 7f70c04ed640 1 -- 10.20.193.57:0/1755734731 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70b8130660 con 0x7f70b812ec50 2026-02-20T16:30:50.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.944+0000 7f709effd640 1 -- 10.20.193.57:0/1755734731 <== mon.0 v2:10.20.193.57:3300/0 4 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7f70a8004c80 con 0x7f70b812ec50 2026-02-20T16:30:50.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.944+0000 7f709effd640 1 -- 10.20.193.57:0/1755734731 <== mon.0 v2:10.20.193.57:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3020+0+0 (secure 0 0 0) 0x7f70a8064080 con 0x7f70b812ec50 2026-02-20T16:30:50.950 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.946+0000 7f709effd640 1 -- 10.20.193.57:0/1755734731 <== mon.0 v2:10.20.193.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7f70b8130660 con 0x7f70b812ec50 2026-02-20T16:30:50.983 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.981+0000 7ff8ecca8640 1 -- 10.20.193.57:0/1378916486 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7ff8e8080f80 con 0x7ff8e8080bb0 2026-02-20T16:30:50.983 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.981+0000 7f187251c640 1 -- 10.20.193.57:0/2177110347 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f186c053200 con 0x7f186c081690 2026-02-20T16:30:50.984 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.982+0000 7f1868ff9640 1 -- 10.20.193.57:0/2177110347 <== mon.1 v2:10.20.193.57:3301/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f185c004a80 con 0x7f186c081690 2026-02-20T16:30:50.984 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.982+0000 7ff8ceffd640 1 -- 10.20.193.57:0/1378916486 <== mon.1 v2:10.20.193.57:3301/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff8d0038670 con 0x7ff8e8080bb0 2026-02-20T16:30:50.984 INFO:teuthology.orchestra.run.trial057.stdout:38654705680 2026-02-20T16:30:50.985 INFO:teuthology.orchestra.run.trial057.stdout:42949672976 2026-02-20T16:30:50.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.983+0000 7f187251c640 1 -- 10.20.193.57:0/2177110347 >> v1:10.20.193.57:6800/2007744879 conn(0x7f183c04ca50 legacy=0x7f183c06cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:50.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.983+0000 7f187251c640 1 -- 10.20.193.57:0/2177110347 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f186c081690 msgr2=0x7f186c175130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:50.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.983+0000 7f187251c640 1 --2- 10.20.193.57:0/2177110347 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f186c081690 0x7f186c175130 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f185c0094b0 tx=0x7f185c00ee60 comp rx=0 tx=0).stop 2026-02-20T16:30:50.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.983+0000 7f187251c640 1 -- 10.20.193.57:0/2177110347 shutdown_connections 2026-02-20T16:30:50.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.983+0000 7f187251c640 1 --2- 10.20.193.57:0/2177110347 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f186c175670 0x7f186c12df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:50.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.983+0000 7f187251c640 1 --2- 10.20.193.57:0/2177110347 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f186c081690 0x7f186c175130 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:50.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.983+0000 7f187251c640 1 --2- 10.20.193.57:0/2177110347 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f186c080bb0 0x7f186c12d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:50.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.983+0000 7f187251c640 1 -- 10.20.193.57:0/2177110347 >> 10.20.193.57:0/2177110347 conn(0x7f186c0833e0 msgr2=0x7f186c132350 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:50.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.983+0000 7f187251c640 1 -- 10.20.193.57:0/2177110347 shutdown_connections 2026-02-20T16:30:50.987 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.983+0000 7f187251c640 1 -- 10.20.193.57:0/2177110347 wait complete. 2026-02-20T16:30:50.987 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.983+0000 7ff8ecca8640 1 -- 10.20.193.57:0/1378916486 >> v1:10.20.193.57:6800/2007744879 conn(0x7ff8b404ca40 legacy=0x7ff8b406cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:50.987 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.983+0000 7ff8ecca8640 1 -- 10.20.193.57:0/1378916486 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7ff8e8080bb0 msgr2=0x7ff8e812c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:50.987 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.983+0000 7ff8ecca8640 1 --2- 10.20.193.57:0/1378916486 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7ff8e8080bb0 0x7ff8e812c950 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff8d00099c0 tx=0x7ff8d0002900 comp rx=0 tx=0).stop 2026-02-20T16:30:50.988 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.983+0000 7ff8ecca8640 1 -- 10.20.193.57:0/1378916486 shutdown_connections 2026-02-20T16:30:50.988 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.983+0000 7ff8ecca8640 1 --2- 10.20.193.57:0/1378916486 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7ff8e80814c0 0x7ff8e812ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:50.988 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.983+0000 7ff8ecca8640 1 --2- 10.20.193.57:0/1378916486 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7ff8e8080bb0 0x7ff8e812c950 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:50.988 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.983+0000 7ff8ecca8640 1 --2- 10.20.193.57:0/1378916486 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7ff8e807c940 0x7ff8e8146d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:50.988 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.983+0000 7ff8ecca8640 1 -- 10.20.193.57:0/1378916486 >> 10.20.193.57:0/1378916486 conn(0x7ff8e80833e0 msgr2=0x7ff8e805c060 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:50.988 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.983+0000 7f83637cb640 1 -- 10.20.193.57:0/632750995 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f835c053200 con 0x7f835c07cb10 2026-02-20T16:30:50.989 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.983+0000 7ff8ecca8640 1 -- 10.20.193.57:0/1378916486 shutdown_connections 2026-02-20T16:30:50.989 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.984+0000 7ff8ecca8640 1 -- 10.20.193.57:0/1378916486 wait complete. 2026-02-20T16:30:50.989 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.984+0000 7f8349ffb640 1 -- 10.20.193.57:0/632750995 <== mon.2 v2:10.20.193.57:3302/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f834c038670 con 0x7f835c07cb10 2026-02-20T16:30:50.990 INFO:teuthology.orchestra.run.trial057.stdout:42949672976 2026-02-20T16:30:50.991 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.987+0000 7f83637cb640 1 -- 10.20.193.57:0/632750995 >> v1:10.20.193.57:6800/2007744879 conn(0x7f832c04ca50 legacy=0x7f832c06cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:50.991 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.987+0000 7f83637cb640 1 -- 10.20.193.57:0/632750995 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f835c07cb10 msgr2=0x7f835c12c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:50.991 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.987+0000 7f83637cb640 1 --2- 10.20.193.57:0/632750995 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f835c07cb10 0x7f835c12c740 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f834c009230 tx=0x7f834c002900 comp rx=0 tx=0).stop 2026-02-20T16:30:50.991 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.987+0000 7f83637cb640 1 -- 10.20.193.57:0/632750995 shutdown_connections 2026-02-20T16:30:50.991 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.987+0000 7f83637cb640 1 --2- 10.20.193.57:0/632750995 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f835c0814c0 0x7f835c12d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:50.991 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.987+0000 7f83637cb640 1 --2- 10.20.193.57:0/632750995 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f835c080bb0 0x7f835c12cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:50.991 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.987+0000 7f83637cb640 1 --2- 10.20.193.57:0/632750995 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f835c07cb10 0x7f835c12c740 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:50.991 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.987+0000 7f83637cb640 1 -- 10.20.193.57:0/632750995 >> 10.20.193.57:0/632750995 conn(0x7f835c0833e0 msgr2=0x7f835c05c060 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:50.991 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.987+0000 7f83637cb640 1 -- 10.20.193.57:0/632750995 shutdown_connections 2026-02-20T16:30:50.991 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:50.987+0000 7f83637cb640 1 -- 10.20.193.57:0/632750995 wait complete. 2026-02-20T16:30:50.993 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705680 got 38654705680 for osd.0 2026-02-20T16:30:50.994 DEBUG:teuthology.parallel:result is None 2026-02-20T16:30:50.995 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672976 got 42949672976 for osd.3 2026-02-20T16:30:50.995 DEBUG:teuthology.parallel:result is None 2026-02-20T16:30:50.998 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672976 got 42949672976 for osd.2 2026-02-20T16:30:50.998 DEBUG:teuthology.parallel:result is None 2026-02-20T16:30:51.024 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.022+0000 7f70c04ed640 1 -- 10.20.193.57:0/1755734731 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f70b812f020 con 0x7f70b812ec50 2026-02-20T16:30:51.024 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.023+0000 7f709effd640 1 -- 10.20.193.57:0/1755734731 <== mon.0 v2:10.20.193.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f70a8063160 con 0x7f70b812ec50 2026-02-20T16:30:51.025 INFO:teuthology.orchestra.run.trial057.stdout:42949672976 2026-02-20T16:30:51.026 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.024+0000 7f70c04ed640 1 -- 10.20.193.57:0/1755734731 >> v1:10.20.193.57:6800/2007744879 conn(0x7f708804cae0 legacy=0x7f708806cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:51.026 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.024+0000 7f70c04ed640 1 -- 10.20.193.57:0/1755734731 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f70b812ec50 msgr2=0x7f70b81129a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:51.026 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.024+0000 7f70c04ed640 1 --2- 10.20.193.57:0/1755734731 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f70b812ec50 0x7f70b81129a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f70a80059a0 tx=0x7f70a800ee60 comp rx=0 tx=0).stop 2026-02-20T16:30:51.026 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.024+0000 7f70c04ed640 1 -- 10.20.193.57:0/1755734731 shutdown_connections 2026-02-20T16:30:51.026 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.024+0000 7f70c04ed640 1 --2- 10.20.193.57:0/1755734731 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f70b812f950 0x7f70b8113420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:51.026 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.024+0000 7f70c04ed640 1 --2- 10.20.193.57:0/1755734731 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f70b812f560 0x7f70b8112ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:51.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.024+0000 7f70c04ed640 1 --2- 10.20.193.57:0/1755734731 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f70b812ec50 0x7f70b81129a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:51.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.024+0000 7f70c04ed640 1 -- 10.20.193.57:0/1755734731 >> 10.20.193.57:0/1755734731 conn(0x7f70b8086ae0 msgr2=0x7f70b8114ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:51.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.024+0000 7f70c04ed640 1 -- 10.20.193.57:0/1755734731 shutdown_connections 2026-02-20T16:30:51.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.024+0000 7f70c04ed640 1 -- 10.20.193.57:0/1755734731 wait complete. 2026-02-20T16:30:51.033 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672976 got 42949672976 for osd.1 2026-02-20T16:30:51.034 DEBUG:teuthology.parallel:result is None 2026-02-20T16:30:51.034 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-20T16:30:51.034 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T16:30:51.144 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.139+0000 7f073a107640 1 -- 10.20.193.57:0/3825345690 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f073405c060 msgr2=0x7f073405c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:51.144 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.139+0000 7f073a107640 1 --2- 10.20.193.57:0/3825345690 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f073405c060 0x7f073405c430 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0720005ea0 tx=0x7f072002f1d0 comp rx=0 tx=0).stop 2026-02-20T16:30:51.144 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.139+0000 7f073a107640 1 -- 10.20.193.57:0/3825345690 shutdown_connections 2026-02-20T16:30:51.144 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.139+0000 7f073a107640 1 --2- 10.20.193.57:0/3825345690 >> v2:10.20.193.57:3300/0 conn(0x7f0734177a70 0x7f0734197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:51.144 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.139+0000 7f073a107640 1 --2- 10.20.193.57:0/3825345690 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f073405c060 0x7f073405c430 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:51.144 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.139+0000 7f073a107640 1 -- 10.20.193.57:0/3825345690 >> 10.20.193.57:0/3825345690 conn(0x7f07340833e0 msgr2=0x7f07340840b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:51.144 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.139+0000 7f073a107640 1 -- 10.20.193.57:0/3825345690 shutdown_connections 2026-02-20T16:30:51.145 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.139+0000 7f073a107640 1 -- 10.20.193.57:0/3825345690 wait complete. 2026-02-20T16:30:51.145 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.140+0000 7f073a107640 1 Processor -- start 2026-02-20T16:30:51.145 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.140+0000 7f073a107640 1 -- start start 2026-02-20T16:30:51.145 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.140+0000 7f073a107640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f073405c060 0x7f0734177e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:51.145 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.140+0000 7f073a107640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f073405c970 0x7f0734178380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:51.145 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.140+0000 7f073a107640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f0734177a70 0x7f07341788c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:51.145 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.140+0000 7f073a107640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f0734198dc0 con 0x7f073405c970 2026-02-20T16:30:51.145 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.140+0000 7f073a107640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f0734198c40 con 0x7f0734177a70 2026-02-20T16:30:51.145 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.140+0000 7f073a107640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f0734198f40 con 0x7f073405c060 2026-02-20T16:30:51.145 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.140+0000 7f0732ffd640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f073405c970 0x7f0734178380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:51.145 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.140+0000 7f07337fe640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f073405c060 0x7f0734177e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:51.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.140+0000 7f0732ffd640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f073405c970 0x7f0734178380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:44736/0 (socket says 10.20.193.57:44736) 2026-02-20T16:30:51.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.140+0000 7f07337fe640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f073405c060 0x7f0734177e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3302/0 says I am v2:10.20.193.57:47706/0 (socket says 10.20.193.57:47706) 2026-02-20T16:30:51.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.140+0000 7f0732ffd640 1 -- 10.20.193.57:0/666996494 learned_addr learned my addr 10.20.193.57:0/666996494 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:30:51.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.140+0000 7f0733fff640 1 --2- 10.20.193.57:0/666996494 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f0734177a70 0x7f07341788c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:51.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.140+0000 7f07337fe640 1 -- 10.20.193.57:0/666996494 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f0734177a70 msgr2=0x7f07341788c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:51.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.140+0000 7f07337fe640 1 --2- 10.20.193.57:0/666996494 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f0734177a70 0x7f07341788c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:51.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.140+0000 7f07337fe640 1 -- 10.20.193.57:0/666996494 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f073405c970 msgr2=0x7f0734178380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:51.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.140+0000 7f07337fe640 1 --2- 10.20.193.57:0/666996494 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f073405c970 0x7f0734178380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:51.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.140+0000 7f07337fe640 1 -- 10.20.193.57:0/666996494 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0734186eb0 con 0x7f073405c060 2026-02-20T16:30:51.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.140+0000 7f0732ffd640 1 --2- 10.20.193.57:0/666996494 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f073405c970 0x7f0734178380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:30:51.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.140+0000 7f07337fe640 1 --2- 10.20.193.57:0/666996494 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f073405c060 0x7f0734177e40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0734081bf0 tx=0x7f0720002900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:30:51.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.140+0000 7f070ffff640 1 -- 10.20.193.57:0/666996494 <== mon.2 v2:10.20.193.57:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0720046070 con 0x7f073405c060 2026-02-20T16:30:51.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.140+0000 7f070ffff640 1 -- 10.20.193.57:0/666996494 <== mon.2 v2:10.20.193.57:3302/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0720002d00 con 0x7f073405c060 2026-02-20T16:30:51.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.140+0000 7f073a107640 1 -- 10.20.193.57:0/666996494 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f073417ab70 con 0x7f073405c060 2026-02-20T16:30:51.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.140+0000 7f070ffff640 1 -- 10.20.193.57:0/666996494 <== mon.2 v2:10.20.193.57:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07200386d0 con 0x7f073405c060 2026-02-20T16:30:51.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.140+0000 7f073a107640 1 -- 10.20.193.57:0/666996494 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f0734179730 con 0x7f073405c060 2026-02-20T16:30:51.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.141+0000 7f073a107640 1 -- 10.20.193.57:0/666996494 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f073405c430 con 0x7f073405c060 2026-02-20T16:30:51.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.141+0000 7f070ffff640 1 -- 10.20.193.57:0/666996494 <== mon.2 v2:10.20.193.57:3302/0 4 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7f0720038870 con 0x7f073405c060 2026-02-20T16:30:51.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.141+0000 7f070ffff640 1 -- 10.20.193.57:0/666996494 <== mon.2 v2:10.20.193.57:3302/0 5 ==== osd_map(20..20 src has 1..20) ==== 3020+0+0 (secure 0 0 0) 0x7f0720087f10 con 0x7f073405c060 2026-02-20T16:30:51.148 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.143+0000 7f070ffff640 1 -- 10.20.193.57:0/666996494 <== mon.2 v2:10.20.193.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7f0720005be0 con 0x7f073405c060 2026-02-20T16:30:51.217 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.215+0000 7f073a107640 1 -- 10.20.193.57:0/666996494 --> v1:10.20.193.57:6800/2007744879 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0734053200 con 0x7f070404cae0 2026-02-20T16:30:51.219 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.216+0000 7f070ffff640 1 -- 10.20.193.57:0/666996494 <== mgr.14109 v1:10.20.193.57:6800/2007744879 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31959 (unknown 2965378022 0 1012324591) 0x7f0734053200 con 0x7f070404cae0 2026-02-20T16:30:51.219 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:30:51.221 INFO:teuthology.orchestra.run.trial057.stderr:dumped all 2026-02-20T16:30:51.221 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.217+0000 7f073a107640 1 -- 10.20.193.57:0/666996494 >> v1:10.20.193.57:6800/2007744879 conn(0x7f070404cae0 legacy=0x7f070406cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:51.221 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.217+0000 7f073a107640 1 -- 10.20.193.57:0/666996494 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f073405c060 msgr2=0x7f0734177e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:51.221 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.217+0000 7f073a107640 1 --2- 10.20.193.57:0/666996494 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f073405c060 0x7f0734177e40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0734081bf0 tx=0x7f0720002900 comp rx=0 tx=0).stop 2026-02-20T16:30:51.221 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.217+0000 7f073a107640 1 -- 10.20.193.57:0/666996494 shutdown_connections 2026-02-20T16:30:51.221 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.217+0000 7f073a107640 1 --2- 10.20.193.57:0/666996494 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f0734177a70 0x7f07341788c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:51.221 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.217+0000 7f073a107640 1 --2- 10.20.193.57:0/666996494 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f073405c970 0x7f0734178380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:51.221 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.217+0000 7f073a107640 1 --2- 10.20.193.57:0/666996494 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f073405c060 0x7f0734177e40 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:51.222 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.217+0000 7f073a107640 1 -- 10.20.193.57:0/666996494 >> 10.20.193.57:0/666996494 conn(0x7f07340833e0 msgr2=0x7f073407de00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:51.222 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.217+0000 7f073a107640 1 -- 10.20.193.57:0/666996494 shutdown_connections 2026-02-20T16:30:51.222 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.217+0000 7f073a107640 1 -- 10.20.193.57:0/666996494 wait complete. 2026-02-20T16:30:51.226 INFO:teuthology.orchestra.run.trial057.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2026-02-20T16:30:50.930890+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109688,"kb_used_data":1832,"kb_used_omap":6,"kb_used_meta":107769,"kb_avail":377377672,"statfs":{"total":386547056640,"available":386434736128,"internally_reserved":0,"allocated":1875968,"data_stored":1380283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6373,"internal_metadata":110356251},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.996990"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-20T16:30:46.928746+0000","last_change":"2026-02-20T16:29:41.746889+0000","last_active":"2026-02-20T16:30:46.928746+0000","last_peered":"2026-02-20T16:30:46.928746+0000","last_clean":"2026-02-20T16:30:46.928746+0000","last_became_active":"2026-02-20T16:29:39.745934+0000","last_became_peered":"2026-02-20T16:29:39.745934+0000","last_unstale":"2026-02-20T16:30:46.928746+0000","last_undegraded":"2026-02-20T16:30:46.928746+0000","last_fullsized":"2026-02-20T16:30:46.928746+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:02:11.864227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001161203,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":24,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-20T16:30:46.945846+0000","last_change":"2026-02-20T16:29:41.745860+0000","last_active":"2026-02-20T16:30:46.945846+0000","last_peered":"2026-02-20T16:30:46.945846+0000","last_clean":"2026-02-20T16:30:46.945846+0000","last_became_active":"2026-02-20T16:29:39.747939+0000","last_became_peered":"2026-02-20T16:29:39.747939+0000","last_unstale":"2026-02-20T16:30:46.945846+0000","last_undegraded":"2026-02-20T16:30:46.945846+0000","last_fullsized":"2026-02-20T16:30:46.945846+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T01:15:51.058340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033720799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-20T16:30:46.928779+0000","last_change":"2026-02-20T16:29:41.746928+0000","last_active":"2026-02-20T16:30:46.928779+0000","last_peered":"2026-02-20T16:30:46.928779+0000","last_clean":"2026-02-20T16:30:46.928779+0000","last_became_active":"2026-02-20T16:29:39.746070+0000","last_became_peered":"2026-02-20T16:29:39.746070+0000","last_unstale":"2026-02-20T16:30:46.928779+0000","last_undegraded":"2026-02-20T16:30:46.928779+0000","last_fullsized":"2026-02-20T16:30:46.928779+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:10:54.031743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001207149,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-20T16:30:46.945843+0000","last_change":"2026-02-20T16:29:41.745829+0000","last_active":"2026-02-20T16:30:46.945843+0000","last_peered":"2026-02-20T16:30:46.945843+0000","last_clean":"2026-02-20T16:30:46.945843+0000","last_became_active":"2026-02-20T16:29:39.747943+0000","last_became_peered":"2026-02-20T16:29:39.747943+0000","last_unstale":"2026-02-20T16:30:46.945843+0000","last_undegraded":"2026-02-20T16:30:46.945843+0000","last_fullsized":"2026-02-20T16:30:46.945843+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T01:50:47.446286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000271997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-20T16:30:46.928722+0000","last_change":"2026-02-20T16:29:41.746443+0000","last_active":"2026-02-20T16:30:46.928722+0000","last_peered":"2026-02-20T16:30:46.928722+0000","last_clean":"2026-02-20T16:30:46.928722+0000","last_became_active":"2026-02-20T16:29:39.748192+0000","last_became_peered":"2026-02-20T16:29:39.748192+0000","last_unstale":"2026-02-20T16:30:46.928722+0000","last_undegraded":"2026-02-20T16:30:46.928722+0000","last_fullsized":"2026-02-20T16:30:46.928722+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:35:42.345489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092195700000000005,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-20T16:30:46.944254+0000","last_change":"2026-02-20T16:29:42.394517+0000","last_active":"2026-02-20T16:30:46.944254+0000","last_peered":"2026-02-20T16:30:46.944254+0000","last_clean":"2026-02-20T16:30:46.944254+0000","last_became_active":"2026-02-20T16:29:39.747810+0000","last_became_peered":"2026-02-20T16:29:39.747810+0000","last_unstale":"2026-02-20T16:30:46.944254+0000","last_undegraded":"2026-02-20T16:30:46.944254+0000","last_fullsized":"2026-02-20T16:30:46.944254+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:21:15.349172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025212999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-20T16:30:46.928701+0000","last_change":"2026-02-20T16:29:41.746669+0000","last_active":"2026-02-20T16:30:46.928701+0000","last_peered":"2026-02-20T16:30:46.928701+0000","last_clean":"2026-02-20T16:30:46.928701+0000","last_became_active":"2026-02-20T16:29:39.748363+0000","last_became_peered":"2026-02-20T16:29:39.748363+0000","last_unstale":"2026-02-20T16:30:46.928701+0000","last_undegraded":"2026-02-20T16:30:46.928701+0000","last_fullsized":"2026-02-20T16:30:46.928701+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:12:49.948165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010429829999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":26,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-20T16:30:46.928757+0000","last_change":"2026-02-20T16:29:41.746516+0000","last_active":"2026-02-20T16:30:46.928757+0000","last_peered":"2026-02-20T16:30:46.928757+0000","last_clean":"2026-02-20T16:30:46.928757+0000","last_became_active":"2026-02-20T16:29:39.747501+0000","last_became_peered":"2026-02-20T16:29:39.747501+0000","last_unstale":"2026-02-20T16:30:46.928757+0000","last_undegraded":"2026-02-20T16:30:46.928757+0000","last_fullsized":"2026-02-20T16:30:46.928757+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:28:35.250145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093713599999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'72","reported_seq":115,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-20T16:30:46.945899+0000","last_change":"2026-02-20T16:29:35.927618+0000","last_active":"2026-02-20T16:30:46.945899+0000","last_peered":"2026-02-20T16:30:46.945899+0000","last_clean":"2026-02-20T16:30:46.945899+0000","last_became_active":"2026-02-20T16:29:35.927174+0000","last_became_peered":"2026-02-20T16:29:35.927174+0000","last_unstale":"2026-02-20T16:30:46.945899+0000","last_undegraded":"2026-02-20T16:30:46.945899+0000","last_fullsized":"2026-02-20T16:30:46.945899+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:34.730052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:34.730052+0000","last_clean_scrub_stamp":"2026-02-20T16:29:34.730052+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T04:24:55.154240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672976,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27136,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344704,"statfs":{"total":96636764160,"available":96608976896,"internally_reserved":0,"allocated":176128,"data_stored":50755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672976,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27132,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344708,"statfs":{"total":96636764160,"available":96608980992,"internally_reserved":0,"allocated":172032,"data_stored":50736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672976,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27716,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344124,"statfs":{"total":96636764160,"available":96608382976,"internally_reserved":0,"allocated":770048,"data_stored":641123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705680,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":757760,"data_stored":637669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T16:30:51.227 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T16:30:51.294 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.293+0000 7f578d20f640 1 -- 10.20.193.57:0/4084954389 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f578805cb40 msgr2=0x7f5788177360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:51.294 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.293+0000 7f578d20f640 1 --2- 10.20.193.57:0/4084954389 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f578805cb40 0x7f5788177360 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5770005ea0 tx=0x7f577002f1d0 comp rx=0 tx=0).stop 2026-02-20T16:30:51.294 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.293+0000 7f578d20f640 1 -- 10.20.193.57:0/4084954389 shutdown_connections 2026-02-20T16:30:51.294 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.293+0000 7f578d20f640 1 --2- 10.20.193.57:0/4084954389 >> v2:10.20.193.57:3300/0 conn(0x7f57881778a0 0x7f5788197c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:51.294 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.293+0000 7f578d20f640 1 --2- 10.20.193.57:0/4084954389 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f578805cb40 0x7f5788177360 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:51.294 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.293+0000 7f578d20f640 1 -- 10.20.193.57:0/4084954389 >> 10.20.193.57:0/4084954389 conn(0x7f57880833e0 msgr2=0x7f57880840b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:51.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.293+0000 7f578d20f640 1 -- 10.20.193.57:0/4084954389 shutdown_connections 2026-02-20T16:30:51.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.293+0000 7f578d20f640 1 -- 10.20.193.57:0/4084954389 wait complete. 2026-02-20T16:30:51.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.293+0000 7f578d20f640 1 Processor -- start 2026-02-20T16:30:51.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.293+0000 7f578d20f640 1 -- start start 2026-02-20T16:30:51.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.294+0000 7f578d20f640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f578805c060 0x7f57881822f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:51.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.294+0000 7f578d20f640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f578805cb40 0x7f5788182830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:51.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.294+0000 7f578d20f640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f57881778a0 0x7f5788182d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:51.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.294+0000 7f578d20f640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f5788198c40 con 0x7f578805cb40 2026-02-20T16:30:51.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.294+0000 7f578d20f640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f5788198ac0 con 0x7f57881778a0 2026-02-20T16:30:51.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.294+0000 7f578d20f640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f5788198dc0 con 0x7f578805c060 2026-02-20T16:30:51.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.294+0000 7f5786575640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f578805cb40 0x7f5788182830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:51.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.294+0000 7f5786d76640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f578805c060 0x7f57881822f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:51.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.294+0000 7f5786575640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f578805cb40 0x7f5788182830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:44754/0 (socket says 10.20.193.57:44754) 2026-02-20T16:30:51.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.294+0000 7f5786575640 1 -- 10.20.193.57:0/2116439911 learned_addr learned my addr 10.20.193.57:0/2116439911 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:30:51.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.294+0000 7f5787577640 1 --2- 10.20.193.57:0/2116439911 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f57881778a0 0x7f5788182d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:51.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.294+0000 7f5786575640 1 -- 10.20.193.57:0/2116439911 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f578805c060 msgr2=0x7f57881822f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:51.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.294+0000 7f5786575640 1 --2- 10.20.193.57:0/2116439911 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f578805c060 0x7f57881822f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:51.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.294+0000 7f5786575640 1 -- 10.20.193.57:0/2116439911 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f57881778a0 msgr2=0x7f5788182d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:51.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.294+0000 7f5786575640 1 --2- 10.20.193.57:0/2116439911 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f57881778a0 0x7f5788182d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:51.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.294+0000 7f5786575640 1 -- 10.20.193.57:0/2116439911 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f578818bba0 con 0x7f578805cb40 2026-02-20T16:30:51.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.294+0000 7f5786d76640 1 --2- 10.20.193.57:0/2116439911 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f578805c060 0x7f57881822f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T16:30:51.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.294+0000 7f5786575640 1 --2- 10.20.193.57:0/2116439911 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f578805cb40 0x7f5788182830 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f577002fe70 tx=0x7f5770002900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:30:51.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.294+0000 7f57677fe640 1 -- 10.20.193.57:0/2116439911 <== mon.0 v2:10.20.193.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5770046070 con 0x7f578805cb40 2026-02-20T16:30:51.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.294+0000 7f57677fe640 1 -- 10.20.193.57:0/2116439911 <== mon.0 v2:10.20.193.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f57700045f0 con 0x7f578805cb40 2026-02-20T16:30:51.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.294+0000 7f578d20f640 1 -- 10.20.193.57:0/2116439911 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f578818a7f0 con 0x7f578805cb40 2026-02-20T16:30:51.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.294+0000 7f57677fe640 1 -- 10.20.193.57:0/2116439911 <== mon.0 v2:10.20.193.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5770038470 con 0x7f578805cb40 2026-02-20T16:30:51.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.294+0000 7f578d20f640 1 -- 10.20.193.57:0/2116439911 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f578807c250 con 0x7f578805cb40 2026-02-20T16:30:51.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.294+0000 7f578d20f640 1 -- 10.20.193.57:0/2116439911 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f578807fc50 con 0x7f578805cb40 2026-02-20T16:30:51.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.295+0000 7f57677fe640 1 -- 10.20.193.57:0/2116439911 <== mon.0 v2:10.20.193.57:3300/0 4 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7f5770038610 con 0x7f578805cb40 2026-02-20T16:30:51.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.295+0000 7f57677fe640 1 -- 10.20.193.57:0/2116439911 <== mon.0 v2:10.20.193.57:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3020+0+0 (secure 0 0 0) 0x7f5770087e60 con 0x7f578805cb40 2026-02-20T16:30:51.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.296+0000 7f57677fe640 1 -- 10.20.193.57:0/2116439911 <== mon.0 v2:10.20.193.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7f578807fc50 con 0x7f578805cb40 2026-02-20T16:30:51.370 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.369+0000 7f578d20f640 1 -- 10.20.193.57:0/2116439911 --> v1:10.20.193.57:6800/2007744879 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f578807c4b0 con 0x7f575404cae0 2026-02-20T16:30:51.370 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.369+0000 7f57677fe640 1 -- 10.20.193.57:0/2116439911 <== mgr.14109 v1:10.20.193.57:6800/2007744879 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31959 (unknown 2965378022 0 1012324591) 0x7f578807c4b0 con 0x7f575404cae0 2026-02-20T16:30:51.371 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:30:51.372 INFO:teuthology.orchestra.run.trial057.stderr:dumped all 2026-02-20T16:30:51.372 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.370+0000 7f578d20f640 1 -- 10.20.193.57:0/2116439911 >> v1:10.20.193.57:6800/2007744879 conn(0x7f575404cae0 legacy=0x7f575406cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:51.372 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.370+0000 7f578d20f640 1 -- 10.20.193.57:0/2116439911 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f578805cb40 msgr2=0x7f5788182830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:51.372 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.370+0000 7f578d20f640 1 --2- 10.20.193.57:0/2116439911 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f578805cb40 0x7f5788182830 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f577002fe70 tx=0x7f5770002900 comp rx=0 tx=0).stop 2026-02-20T16:30:51.372 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.370+0000 7f578d20f640 1 -- 10.20.193.57:0/2116439911 shutdown_connections 2026-02-20T16:30:51.372 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.370+0000 7f578d20f640 1 --2- 10.20.193.57:0/2116439911 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f57881778a0 0x7f5788182d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:51.372 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.370+0000 7f578d20f640 1 --2- 10.20.193.57:0/2116439911 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f578805cb40 0x7f5788182830 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:51.372 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.370+0000 7f578d20f640 1 --2- 10.20.193.57:0/2116439911 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f578805c060 0x7f57881822f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:51.372 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.370+0000 7f578d20f640 1 -- 10.20.193.57:0/2116439911 >> 10.20.193.57:0/2116439911 conn(0x7f57880833e0 msgr2=0x7f5788187de0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:51.372 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.370+0000 7f578d20f640 1 -- 10.20.193.57:0/2116439911 shutdown_connections 2026-02-20T16:30:51.372 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.370+0000 7f578d20f640 1 -- 10.20.193.57:0/2116439911 wait complete. 2026-02-20T16:30:51.378 INFO:teuthology.orchestra.run.trial057.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2026-02-20T16:30:50.930890+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109688,"kb_used_data":1832,"kb_used_omap":6,"kb_used_meta":107769,"kb_avail":377377672,"statfs":{"total":386547056640,"available":386434736128,"internally_reserved":0,"allocated":1875968,"data_stored":1380283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6373,"internal_metadata":110356251},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.996990"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-20T16:30:46.928746+0000","last_change":"2026-02-20T16:29:41.746889+0000","last_active":"2026-02-20T16:30:46.928746+0000","last_peered":"2026-02-20T16:30:46.928746+0000","last_clean":"2026-02-20T16:30:46.928746+0000","last_became_active":"2026-02-20T16:29:39.745934+0000","last_became_peered":"2026-02-20T16:29:39.745934+0000","last_unstale":"2026-02-20T16:30:46.928746+0000","last_undegraded":"2026-02-20T16:30:46.928746+0000","last_fullsized":"2026-02-20T16:30:46.928746+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:02:11.864227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001161203,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":24,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-20T16:30:46.945846+0000","last_change":"2026-02-20T16:29:41.745860+0000","last_active":"2026-02-20T16:30:46.945846+0000","last_peered":"2026-02-20T16:30:46.945846+0000","last_clean":"2026-02-20T16:30:46.945846+0000","last_became_active":"2026-02-20T16:29:39.747939+0000","last_became_peered":"2026-02-20T16:29:39.747939+0000","last_unstale":"2026-02-20T16:30:46.945846+0000","last_undegraded":"2026-02-20T16:30:46.945846+0000","last_fullsized":"2026-02-20T16:30:46.945846+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T01:15:51.058340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033720799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-20T16:30:46.928779+0000","last_change":"2026-02-20T16:29:41.746928+0000","last_active":"2026-02-20T16:30:46.928779+0000","last_peered":"2026-02-20T16:30:46.928779+0000","last_clean":"2026-02-20T16:30:46.928779+0000","last_became_active":"2026-02-20T16:29:39.746070+0000","last_became_peered":"2026-02-20T16:29:39.746070+0000","last_unstale":"2026-02-20T16:30:46.928779+0000","last_undegraded":"2026-02-20T16:30:46.928779+0000","last_fullsized":"2026-02-20T16:30:46.928779+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:10:54.031743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001207149,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-20T16:30:46.945843+0000","last_change":"2026-02-20T16:29:41.745829+0000","last_active":"2026-02-20T16:30:46.945843+0000","last_peered":"2026-02-20T16:30:46.945843+0000","last_clean":"2026-02-20T16:30:46.945843+0000","last_became_active":"2026-02-20T16:29:39.747943+0000","last_became_peered":"2026-02-20T16:29:39.747943+0000","last_unstale":"2026-02-20T16:30:46.945843+0000","last_undegraded":"2026-02-20T16:30:46.945843+0000","last_fullsized":"2026-02-20T16:30:46.945843+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T01:50:47.446286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000271997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-20T16:30:46.928722+0000","last_change":"2026-02-20T16:29:41.746443+0000","last_active":"2026-02-20T16:30:46.928722+0000","last_peered":"2026-02-20T16:30:46.928722+0000","last_clean":"2026-02-20T16:30:46.928722+0000","last_became_active":"2026-02-20T16:29:39.748192+0000","last_became_peered":"2026-02-20T16:29:39.748192+0000","last_unstale":"2026-02-20T16:30:46.928722+0000","last_undegraded":"2026-02-20T16:30:46.928722+0000","last_fullsized":"2026-02-20T16:30:46.928722+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:35:42.345489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092195700000000005,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-20T16:30:46.944254+0000","last_change":"2026-02-20T16:29:42.394517+0000","last_active":"2026-02-20T16:30:46.944254+0000","last_peered":"2026-02-20T16:30:46.944254+0000","last_clean":"2026-02-20T16:30:46.944254+0000","last_became_active":"2026-02-20T16:29:39.747810+0000","last_became_peered":"2026-02-20T16:29:39.747810+0000","last_unstale":"2026-02-20T16:30:46.944254+0000","last_undegraded":"2026-02-20T16:30:46.944254+0000","last_fullsized":"2026-02-20T16:30:46.944254+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:21:15.349172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025212999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-20T16:30:46.928701+0000","last_change":"2026-02-20T16:29:41.746669+0000","last_active":"2026-02-20T16:30:46.928701+0000","last_peered":"2026-02-20T16:30:46.928701+0000","last_clean":"2026-02-20T16:30:46.928701+0000","last_became_active":"2026-02-20T16:29:39.748363+0000","last_became_peered":"2026-02-20T16:29:39.748363+0000","last_unstale":"2026-02-20T16:30:46.928701+0000","last_undegraded":"2026-02-20T16:30:46.928701+0000","last_fullsized":"2026-02-20T16:30:46.928701+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:12:49.948165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010429829999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":26,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-20T16:30:46.928757+0000","last_change":"2026-02-20T16:29:41.746516+0000","last_active":"2026-02-20T16:30:46.928757+0000","last_peered":"2026-02-20T16:30:46.928757+0000","last_clean":"2026-02-20T16:30:46.928757+0000","last_became_active":"2026-02-20T16:29:39.747501+0000","last_became_peered":"2026-02-20T16:29:39.747501+0000","last_unstale":"2026-02-20T16:30:46.928757+0000","last_undegraded":"2026-02-20T16:30:46.928757+0000","last_fullsized":"2026-02-20T16:30:46.928757+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:28:35.250145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093713599999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'72","reported_seq":115,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-20T16:30:46.945899+0000","last_change":"2026-02-20T16:29:35.927618+0000","last_active":"2026-02-20T16:30:46.945899+0000","last_peered":"2026-02-20T16:30:46.945899+0000","last_clean":"2026-02-20T16:30:46.945899+0000","last_became_active":"2026-02-20T16:29:35.927174+0000","last_became_peered":"2026-02-20T16:29:35.927174+0000","last_unstale":"2026-02-20T16:30:46.945899+0000","last_undegraded":"2026-02-20T16:30:46.945899+0000","last_fullsized":"2026-02-20T16:30:46.945899+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:34.730052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:34.730052+0000","last_clean_scrub_stamp":"2026-02-20T16:29:34.730052+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T04:24:55.154240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672976,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27136,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344704,"statfs":{"total":96636764160,"available":96608976896,"internally_reserved":0,"allocated":176128,"data_stored":50755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672976,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27132,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344708,"statfs":{"total":96636764160,"available":96608980992,"internally_reserved":0,"allocated":172032,"data_stored":50736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672976,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27716,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344124,"statfs":{"total":96636764160,"available":96608382976,"internally_reserved":0,"allocated":770048,"data_stored":641123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705680,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":757760,"data_stored":637669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T16:30:51.379 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-20T16:30:51.379 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-20T16:30:51.379 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-20T16:30:51.380 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-20T16:30:51.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.447+0000 7fe277ce8640 1 -- 10.20.193.57:0/3994910194 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fe270080bb0 msgr2=0x7fe270080f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:51.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.447+0000 7fe277ce8640 1 --2- 10.20.193.57:0/3994910194 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fe270080bb0 0x7fe270080f80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe260005ea0 tx=0x7fe26002f190 comp rx=0 tx=0).stop 2026-02-20T16:30:51.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.447+0000 7fe277ce8640 1 -- 10.20.193.57:0/3994910194 shutdown_connections 2026-02-20T16:30:51.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.447+0000 7fe277ce8640 1 --2- 10.20.193.57:0/3994910194 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fe27007c940 0x7fe27007cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:51.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.447+0000 7fe277ce8640 1 --2- 10.20.193.57:0/3994910194 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fe2700814c0 0x7fe27007c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:51.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.447+0000 7fe277ce8640 1 --2- 10.20.193.57:0/3994910194 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fe270080bb0 0x7fe270080f80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:51.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.447+0000 7fe277ce8640 1 -- 10.20.193.57:0/3994910194 >> 10.20.193.57:0/3994910194 conn(0x7fe2700833e0 msgr2=0x7fe2700840b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:51.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.447+0000 7fe277ce8640 1 -- 10.20.193.57:0/3994910194 shutdown_connections 2026-02-20T16:30:51.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.447+0000 7fe277ce8640 1 -- 10.20.193.57:0/3994910194 wait complete. 2026-02-20T16:30:51.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.447+0000 7fe277ce8640 1 Processor -- start 2026-02-20T16:30:51.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.447+0000 7fe277ce8640 1 -- start start 2026-02-20T16:30:51.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.447+0000 7fe277ce8640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fe27007c940 0x7fe270144470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:51.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.447+0000 7fe277ce8640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fe270080bb0 0x7fe2701449b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:51.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.447+0000 7fe277ce8640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fe2700814c0 0x7fe270059ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:51.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.447+0000 7fe277ce8640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7fe270195920 con 0x7fe2700814c0 2026-02-20T16:30:51.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.447+0000 7fe277ce8640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7fe2701957a0 con 0x7fe27007c940 2026-02-20T16:30:51.453 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.447+0000 7fe277ce8640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7fe270195aa0 con 0x7fe270080bb0 2026-02-20T16:30:51.453 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.447+0000 7fe275a5d640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fe27007c940 0x7fe270144470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:51.453 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.447+0000 7fe27525c640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fe270080bb0 0x7fe2701449b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:51.453 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.447+0000 7fe275a5d640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fe27007c940 0x7fe270144470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3301/0 says I am v2:10.20.193.57:33272/0 (socket says 10.20.193.57:33272) 2026-02-20T16:30:51.453 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.447+0000 7fe275a5d640 1 -- 10.20.193.57:0/451677735 learned_addr learned my addr 10.20.193.57:0/451677735 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:30:51.453 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.447+0000 7fe27625e640 1 --2- 10.20.193.57:0/451677735 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fe2700814c0 0x7fe270059ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:51.453 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.448+0000 7fe275a5d640 1 -- 10.20.193.57:0/451677735 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fe270080bb0 msgr2=0x7fe2701449b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:51.453 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.448+0000 7fe275a5d640 1 --2- 10.20.193.57:0/451677735 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fe270080bb0 0x7fe2701449b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:51.453 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.448+0000 7fe275a5d640 1 -- 10.20.193.57:0/451677735 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fe2700814c0 msgr2=0x7fe270059ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:51.453 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.448+0000 7fe275a5d640 1 --2- 10.20.193.57:0/451677735 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fe2700814c0 0x7fe270059ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:51.453 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.448+0000 7fe275a5d640 1 -- 10.20.193.57:0/451677735 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe27005d0b0 con 0x7fe27007c940 2026-02-20T16:30:51.454 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.448+0000 7fe275a5d640 1 --2- 10.20.193.57:0/451677735 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fe27007c940 0x7fe270144470 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe26002fe20 tx=0x7fe260002900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:30:51.454 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.448+0000 7fe25e7fc640 1 -- 10.20.193.57:0/451677735 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe260046070 con 0x7fe27007c940 2026-02-20T16:30:51.454 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.448+0000 7fe25e7fc640 1 -- 10.20.193.57:0/451677735 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe2600045b0 con 0x7fe27007c940 2026-02-20T16:30:51.454 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.448+0000 7fe277ce8640 1 -- 10.20.193.57:0/451677735 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe27005c1f0 con 0x7fe27007c940 2026-02-20T16:30:51.454 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.448+0000 7fe25e7fc640 1 -- 10.20.193.57:0/451677735 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe260038470 con 0x7fe27007c940 2026-02-20T16:30:51.454 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.448+0000 7fe277ce8640 1 -- 10.20.193.57:0/451677735 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe270144ef0 con 0x7fe27007c940 2026-02-20T16:30:51.454 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.448+0000 7fe277ce8640 1 -- 10.20.193.57:0/451677735 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe270080f80 con 0x7fe27007c940 2026-02-20T16:30:51.454 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.448+0000 7fe25e7fc640 1 -- 10.20.193.57:0/451677735 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7fe260038610 con 0x7fe27007c940 2026-02-20T16:30:51.454 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.449+0000 7fe25e7fc640 1 -- 10.20.193.57:0/451677735 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 3020+0+0 (secure 0 0 0) 0x7fe260087f10 con 0x7fe27007c940 2026-02-20T16:30:51.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.450+0000 7fe25e7fc640 1 -- 10.20.193.57:0/451677735 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7fe260086ff0 con 0x7fe27007c940 2026-02-20T16:30:51.539 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.537+0000 7fe277ce8640 1 -- 10.20.193.57:0/451677735 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe270053200 con 0x7fe27007c940 2026-02-20T16:30:51.539 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.537+0000 7fe25e7fc640 1 -- 10.20.193.57:0/451677735 <== mon.1 v2:10.20.193.57:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fe260038d90 con 0x7fe27007c940 2026-02-20T16:30:51.540 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:30:51.540 INFO:teuthology.orchestra.run.trial057.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-20T16:30:51.541 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.538+0000 7fe277ce8640 1 -- 10.20.193.57:0/451677735 >> v1:10.20.193.57:6800/2007744879 conn(0x7fe24004cad0 legacy=0x7fe24006cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:51.541 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.538+0000 7fe277ce8640 1 -- 10.20.193.57:0/451677735 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fe27007c940 msgr2=0x7fe270144470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:51.541 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.538+0000 7fe277ce8640 1 --2- 10.20.193.57:0/451677735 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fe27007c940 0x7fe270144470 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe26002fe20 tx=0x7fe260002900 comp rx=0 tx=0).stop 2026-02-20T16:30:51.541 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.538+0000 7fe277ce8640 1 -- 10.20.193.57:0/451677735 shutdown_connections 2026-02-20T16:30:51.541 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.538+0000 7fe277ce8640 1 --2- 10.20.193.57:0/451677735 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fe2700814c0 0x7fe270059ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:51.541 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.538+0000 7fe277ce8640 1 --2- 10.20.193.57:0/451677735 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fe270080bb0 0x7fe2701449b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:51.541 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.538+0000 7fe277ce8640 1 --2- 10.20.193.57:0/451677735 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fe27007c940 0x7fe270144470 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:51.541 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.538+0000 7fe277ce8640 1 -- 10.20.193.57:0/451677735 >> 10.20.193.57:0/451677735 conn(0x7fe2700833e0 msgr2=0x7fe270134590 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:51.542 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.538+0000 7fe277ce8640 1 -- 10.20.193.57:0/451677735 shutdown_connections 2026-02-20T16:30:51.542 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.538+0000 7fe277ce8640 1 -- 10.20.193.57:0/451677735 wait complete. 2026-02-20T16:30:51.547 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-20T16:30:51.548 INFO:teuthology.run_tasks:Running task ceph.restart... 2026-02-20T16:30:51.564 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-20T16:30:51.564 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T16:30:51.593 INFO:tasks.ceph.osd.0:Stopped 2026-02-20T16:30:51.593 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 0 2026-02-20T16:30:51.703 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.699+0000 7f33608ee640 1 -- 10.20.193.57:0/2996401247 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f3358174330 msgr2=0x7f3358194710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:51.703 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.699+0000 7f33608ee640 1 --2- 10.20.193.57:0/2996401247 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f3358174330 0x7f3358194710 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f334c004af0 tx=0x7f334c02f390 comp rx=0 tx=0).stop 2026-02-20T16:30:51.703 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.699+0000 7f33608ee640 1 -- 10.20.193.57:0/2996401247 shutdown_connections 2026-02-20T16:30:51.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.699+0000 7f33608ee640 1 --2- 10.20.193.57:0/2996401247 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f3358174330 0x7f3358194710 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:51.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.699+0000 7f33608ee640 1 --2- 10.20.193.57:0/2996401247 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f3358085b90 0x7f335807d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:51.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.699+0000 7f33608ee640 1 -- 10.20.193.57:0/2996401247 >> 10.20.193.57:0/2996401247 conn(0x7f33580833e0 msgr2=0x7f33580840b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:51.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.699+0000 7f33608ee640 1 -- 10.20.193.57:0/2996401247 shutdown_connections 2026-02-20T16:30:51.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.699+0000 7f33608ee640 1 -- 10.20.193.57:0/2996401247 wait complete. 2026-02-20T16:30:51.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.699+0000 7f33608ee640 1 Processor -- start 2026-02-20T16:30:51.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.699+0000 7f33608ee640 1 -- start start 2026-02-20T16:30:51.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.700+0000 7f33608ee640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f335807dc60 0x7f3358057df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:51.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.700+0000 7f33608ee640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f3358085b90 0x7f3358058330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:51.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.700+0000 7f33608ee640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f3358174330 0x7f3358058870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:51.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.700+0000 7f33608ee640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f3358195810 con 0x7f3358174330 2026-02-20T16:30:51.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.700+0000 7f33608ee640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f3358195690 con 0x7f335807dc60 2026-02-20T16:30:51.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.700+0000 7f33608ee640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f3358195990 con 0x7f3358085b90 2026-02-20T16:30:51.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.700+0000 7f335de62640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f3358085b90 0x7f3358058330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:51.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.700+0000 7f335de62640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f3358085b90 0x7f3358058330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3302/0 says I am v2:10.20.193.57:47772/0 (socket says 10.20.193.57:47772) 2026-02-20T16:30:51.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.700+0000 7f335de62640 1 -- 10.20.193.57:0/2954501745 learned_addr learned my addr 10.20.193.57:0/2954501745 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:30:51.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.700+0000 7f335ee64640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f3358174330 0x7f3358058870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:51.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.700+0000 7f335e663640 1 --2- 10.20.193.57:0/2954501745 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f335807dc60 0x7f3358057df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:51.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.700+0000 7f335de62640 1 -- 10.20.193.57:0/2954501745 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f335807dc60 msgr2=0x7f3358057df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:51.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.700+0000 7f335de62640 1 --2- 10.20.193.57:0/2954501745 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f335807dc60 0x7f3358057df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:51.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.700+0000 7f335de62640 1 -- 10.20.193.57:0/2954501745 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f3358174330 msgr2=0x7f3358058870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:51.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.700+0000 7f335de62640 1 --2- 10.20.193.57:0/2954501745 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f3358174330 0x7f3358058870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:51.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.700+0000 7f335de62640 1 -- 10.20.193.57:0/2954501745 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f335807c330 con 0x7f3358085b90 2026-02-20T16:30:51.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.700+0000 7f335ee64640 1 --2- 10.20.193.57:0/2954501745 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f3358174330 0x7f3358058870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:30:51.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.700+0000 7f335de62640 1 --2- 10.20.193.57:0/2954501745 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f3358085b90 0x7f3358058330 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f334400c4d0 tx=0x7f334400c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:30:51.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.700+0000 7f3342ffd640 1 -- 10.20.193.57:0/2954501745 <== mon.2 v2:10.20.193.57:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3344016020 con 0x7f3358085b90 2026-02-20T16:30:51.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.700+0000 7f3342ffd640 1 -- 10.20.193.57:0/2954501745 <== mon.2 v2:10.20.193.57:3302/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3344012920 con 0x7f3358085b90 2026-02-20T16:30:51.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.700+0000 7f33608ee640 1 -- 10.20.193.57:0/2954501745 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3358058db0 con 0x7f3358085b90 2026-02-20T16:30:51.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.700+0000 7f3342ffd640 1 -- 10.20.193.57:0/2954501745 <== mon.2 v2:10.20.193.57:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3344012d10 con 0x7f3358085b90 2026-02-20T16:30:51.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.700+0000 7f33608ee640 1 -- 10.20.193.57:0/2954501745 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f335807ba40 con 0x7f3358085b90 2026-02-20T16:30:51.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.701+0000 7f33608ee640 1 -- 10.20.193.57:0/2954501745 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f335807d720 con 0x7f3358085b90 2026-02-20T16:30:51.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.701+0000 7f3342ffd640 1 -- 10.20.193.57:0/2954501745 <== mon.2 v2:10.20.193.57:3302/0 4 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7f334401b400 con 0x7f3358085b90 2026-02-20T16:30:51.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.701+0000 7f3342ffd640 1 -- 10.20.193.57:0/2954501745 <== mon.2 v2:10.20.193.57:3302/0 5 ==== osd_map(20..20 src has 1..20) ==== 3020+0+0 (secure 0 0 0) 0x7f3344063a70 con 0x7f3358085b90 2026-02-20T16:30:51.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.703+0000 7f3342ffd640 1 -- 10.20.193.57:0/2954501745 <== mon.2 v2:10.20.193.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7f3344020020 con 0x7f3358085b90 2026-02-20T16:30:51.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.782+0000 7f33608ee640 1 -- 10.20.193.57:0/2954501745 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_command({"prefix": "osd down", "ids": ["0"]} v 0) -- 0x7f3358053200 con 0x7f3358085b90 2026-02-20T16:30:51.784 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-20T16:30:51.782+0000 7fe5009cd640 -1 mon.a@0(leader).osd e20 definitely_dead 0 2026-02-20T16:30:51.945 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.943+0000 7f3342ffd640 1 -- 10.20.193.57:0/2954501745 <== mon.2 v2:10.20.193.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["0"]}]=0 marked down osd.0. v21) ==== 89+0+0 (secure 0 0 0) 0x7f3344063e20 con 0x7f3358085b90 2026-02-20T16:30:51.945 INFO:teuthology.orchestra.run.trial057.stderr:marked down osd.0. 2026-02-20T16:30:51.946 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.944+0000 7f33608ee640 1 -- 10.20.193.57:0/2954501745 >> v1:10.20.193.57:6800/2007744879 conn(0x7f332804cae0 legacy=0x7f332806cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:51.946 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.944+0000 7f33608ee640 1 -- 10.20.193.57:0/2954501745 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f3358085b90 msgr2=0x7f3358058330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:51.946 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.944+0000 7f33608ee640 1 --2- 10.20.193.57:0/2954501745 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f3358085b90 0x7f3358058330 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f334400c4d0 tx=0x7f334400c9a0 comp rx=0 tx=0).stop 2026-02-20T16:30:51.946 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.944+0000 7f33608ee640 1 -- 10.20.193.57:0/2954501745 shutdown_connections 2026-02-20T16:30:51.946 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.944+0000 7f33608ee640 1 --2- 10.20.193.57:0/2954501745 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f3358174330 0x7f3358058870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:51.946 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.944+0000 7f33608ee640 1 --2- 10.20.193.57:0/2954501745 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f3358085b90 0x7f3358058330 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:51.947 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.944+0000 7f33608ee640 1 --2- 10.20.193.57:0/2954501745 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f335807dc60 0x7f3358057df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:51.947 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.944+0000 7f33608ee640 1 -- 10.20.193.57:0/2954501745 >> 10.20.193.57:0/2954501745 conn(0x7f33580833e0 msgr2=0x7f3358059de0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:51.947 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.944+0000 7f33608ee640 1 -- 10.20.193.57:0/2954501745 shutdown_connections 2026-02-20T16:30:51.947 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:51.944+0000 7f33608ee640 1 -- 10.20.193.57:0/2954501745 wait complete. 2026-02-20T16:30:51.954 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-20T16:30:51.954 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2026-02-20T16:30:51.956 INFO:tasks.ceph.osd.0:Started 2026-02-20T16:30:51.957 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-20T16:30:51.957 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T16:30:51.999 INFO:tasks.ceph.osd.1:Stopped 2026-02-20T16:30:51.999 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 1 2026-02-20T16:30:52.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:52.103+0000 7fe883e61640 1 -- 10.20.193.57:0/3336626161 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fe87c05c060 msgr2=0x7fe87c05c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:52.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:52.103+0000 7fe883e61640 1 --2- 10.20.193.57:0/3336626161 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fe87c05c060 0x7fe87c05c430 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe86c004770 tx=0x7fe86c02f0e0 comp rx=0 tx=0).stop 2026-02-20T16:30:52.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:52.103+0000 7fe883e61640 1 -- 10.20.193.57:0/3336626161 shutdown_connections 2026-02-20T16:30:52.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:52.103+0000 7fe883e61640 1 --2- 10.20.193.57:0/3336626161 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fe87c177a70 0x7fe87c197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:52.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:52.103+0000 7fe883e61640 1 --2- 10.20.193.57:0/3336626161 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fe87c05c060 0x7fe87c05c430 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:52.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:52.103+0000 7fe883e61640 1 -- 10.20.193.57:0/3336626161 >> 10.20.193.57:0/3336626161 conn(0x7fe87c0833e0 msgr2=0x7fe87c0840b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:52.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:52.104+0000 7fe883e61640 1 -- 10.20.193.57:0/3336626161 shutdown_connections 2026-02-20T16:30:52.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:52.104+0000 7fe883e61640 1 -- 10.20.193.57:0/3336626161 wait complete. 2026-02-20T16:30:52.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:52.104+0000 7fe883e61640 1 Processor -- start 2026-02-20T16:30:52.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:52.104+0000 7fe883e61640 1 -- start start 2026-02-20T16:30:52.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:52.104+0000 7fe883e61640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fe87c05c060 0x7fe87c187a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:52.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:52.104+0000 7fe883e61640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fe87c05c970 0x7fe87c182180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:52.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:52.104+0000 7fe883e61640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fe87c177a70 0x7fe87c1826c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:52.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:52.104+0000 7fe883e61640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7fe87c198e10 con 0x7fe87c05c060 2026-02-20T16:30:52.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:52.104+0000 7fe883e61640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7fe87c198c90 con 0x7fe87c05c970 2026-02-20T16:30:52.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:52.104+0000 7fe883e61640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7fe87c198f90 con 0x7fe87c177a70 2026-02-20T16:30:52.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:52.104+0000 7fe881bd6640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fe87c05c060 0x7fe87c187a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:52.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:52.104+0000 7fe8813d5640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fe87c05c970 0x7fe87c182180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:52.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:52.104+0000 7fe881bd6640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fe87c05c060 0x7fe87c187a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:44810/0 (socket says 10.20.193.57:44810) 2026-02-20T16:30:52.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:52.104+0000 7fe881bd6640 1 -- 10.20.193.57:0/1869875415 learned_addr learned my addr 10.20.193.57:0/1869875415 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:30:52.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:52.104+0000 7fe8823d7640 1 --2- 10.20.193.57:0/1869875415 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fe87c177a70 0x7fe87c1826c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:52.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:52.104+0000 7fe8813d5640 1 -- 10.20.193.57:0/1869875415 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fe87c177a70 msgr2=0x7fe87c1826c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:52.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:52.104+0000 7fe8813d5640 1 --2- 10.20.193.57:0/1869875415 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fe87c177a70 0x7fe87c1826c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:52.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:52.104+0000 7fe8813d5640 1 -- 10.20.193.57:0/1869875415 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fe87c05c060 msgr2=0x7fe87c187a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:52.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:52.104+0000 7fe8813d5640 1 --2- 10.20.193.57:0/1869875415 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fe87c05c060 0x7fe87c187a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:52.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:52.104+0000 7fe8813d5640 1 -- 10.20.193.57:0/1869875415 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe87c18a730 con 0x7fe87c05c970 2026-02-20T16:30:52.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:52.104+0000 7fe881bd6640 1 --2- 10.20.193.57:0/1869875415 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fe87c05c060 0x7fe87c187a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:30:52.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:52.105+0000 7fe8813d5640 1 --2- 10.20.193.57:0/1869875415 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fe87c05c970 0x7fe87c182180 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe870002760 tx=0x7fe87000c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:30:52.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:52.105+0000 7fe86a7fc640 1 -- 10.20.193.57:0/1869875415 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe870005480 con 0x7fe87c05c970 2026-02-20T16:30:52.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:52.105+0000 7fe86a7fc640 1 -- 10.20.193.57:0/1869875415 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe8700036c0 con 0x7fe87c05c970 2026-02-20T16:30:52.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:52.105+0000 7fe883e61640 1 -- 10.20.193.57:0/1869875415 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe87c07c130 con 0x7fe87c05c970 2026-02-20T16:30:52.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:52.105+0000 7fe86a7fc640 1 -- 10.20.193.57:0/1869875415 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe870003af0 con 0x7fe87c05c970 2026-02-20T16:30:52.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:52.105+0000 7fe883e61640 1 -- 10.20.193.57:0/1869875415 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe87c182c00 con 0x7fe87c05c970 2026-02-20T16:30:52.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:52.105+0000 7fe86a7fc640 1 -- 10.20.193.57:0/1869875415 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7fe870003c90 con 0x7fe87c05c970 2026-02-20T16:30:52.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:52.105+0000 7fe883e61640 1 -- 10.20.193.57:0/1869875415 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe87c05c430 con 0x7fe87c05c970 2026-02-20T16:30:52.111 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:52.106+0000 7fe86a7fc640 1 -- 10.20.193.57:0/1869875415 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 3020+0+0 (secure 0 0 0) 0x7fe870063270 con 0x7fe87c05c970 2026-02-20T16:30:52.111 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:52.107+0000 7fe86a7fc640 1 -- 10.20.193.57:0/1869875415 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7fe870062350 con 0x7fe87c05c970 2026-02-20T16:30:52.186 INFO:tasks.ceph.osd.0.trial057.stderr:2026-02-20T16:30:52.184+0000 7fa8becb8900 -1 Falling back to public interface 2026-02-20T16:30:52.188 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:52.186+0000 7fe883e61640 1 -- 10.20.193.57:0/1869875415 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "osd down", "ids": ["1"]} v 0) -- 0x7fe87c182e90 con 0x7fe87c05c970 2026-02-20T16:30:52.188 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-20T16:30:52.187+0000 7fe5009cd640 -1 mon.a@0(leader).osd e21 definitely_dead 0 2026-02-20T16:30:52.635 INFO:tasks.ceph.osd.0.trial057.stderr:2026-02-20T16:30:52.633+0000 7fa8becb8900 -1 osd.0 20 log_to_monitors true 2026-02-20T16:30:52.947 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:52.945+0000 7fe86a7fc640 1 -- 10.20.193.57:0/1869875415 <== mon.1 v2:10.20.193.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["1"]}]=0 marked down osd.1. v22) ==== 89+0+0 (secure 0 0 0) 0x7fe870061b40 con 0x7fe87c05c970 2026-02-20T16:30:52.947 INFO:teuthology.orchestra.run.trial057.stderr:marked down osd.1. 2026-02-20T16:30:52.948 INFO:tasks.ceph.osd.0.trial057.stderr:2026-02-20T16:30:52.947+0000 7fa8b2234640 -1 osd.0 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T16:30:52.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:52.947+0000 7fe883e61640 1 -- 10.20.193.57:0/1869875415 >> v1:10.20.193.57:6800/2007744879 conn(0x7fe84c04cae0 legacy=0x7fe84c06cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:52.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:52.947+0000 7fe883e61640 1 -- 10.20.193.57:0/1869875415 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fe87c05c970 msgr2=0x7fe87c182180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:52.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:52.947+0000 7fe883e61640 1 --2- 10.20.193.57:0/1869875415 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fe87c05c970 0x7fe87c182180 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe870002760 tx=0x7fe87000c970 comp rx=0 tx=0).stop 2026-02-20T16:30:52.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:52.947+0000 7fe883e61640 1 -- 10.20.193.57:0/1869875415 shutdown_connections 2026-02-20T16:30:52.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:52.947+0000 7fe883e61640 1 --2- 10.20.193.57:0/1869875415 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fe87c177a70 0x7fe87c1826c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:52.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:52.947+0000 7fe883e61640 1 --2- 10.20.193.57:0/1869875415 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fe87c05c970 0x7fe87c182180 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:52.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:52.947+0000 7fe883e61640 1 --2- 10.20.193.57:0/1869875415 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fe87c05c060 0x7fe87c187a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:52.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:52.947+0000 7fe883e61640 1 -- 10.20.193.57:0/1869875415 >> 10.20.193.57:0/1869875415 conn(0x7fe87c0833e0 msgr2=0x7fe87c187fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:52.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:52.947+0000 7fe883e61640 1 -- 10.20.193.57:0/1869875415 shutdown_connections 2026-02-20T16:30:52.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:52.947+0000 7fe883e61640 1 -- 10.20.193.57:0/1869875415 wait complete. 2026-02-20T16:30:52.957 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-20T16:30:52.957 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2026-02-20T16:30:52.958 INFO:tasks.ceph.osd.1:Started 2026-02-20T16:30:52.959 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-20T16:30:52.959 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T16:30:53.011 INFO:tasks.ceph.osd.2:Stopped 2026-02-20T16:30:53.011 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 2 2026-02-20T16:30:53.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:53.079+0000 7f5ddab53640 1 -- 10.20.193.57:0/1299902945 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f5dd4080bb0 msgr2=0x7f5dd4080f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:53.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:53.079+0000 7f5ddab53640 1 --2- 10.20.193.57:0/1299902945 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f5dd4080bb0 0x7f5dd4080f80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5dc40098c0 tx=0x7f5dc402f110 comp rx=0 tx=0).stop 2026-02-20T16:30:53.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:53.079+0000 7f5ddab53640 1 -- 10.20.193.57:0/1299902945 shutdown_connections 2026-02-20T16:30:53.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:53.079+0000 7f5ddab53640 1 --2- 10.20.193.57:0/1299902945 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f5dd407cb10 0x7f5dd4196150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:53.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:53.079+0000 7f5ddab53640 1 --2- 10.20.193.57:0/1299902945 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f5dd4080bb0 0x7f5dd4080f80 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:53.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:53.079+0000 7f5ddab53640 1 -- 10.20.193.57:0/1299902945 >> 10.20.193.57:0/1299902945 conn(0x7f5dd40833e0 msgr2=0x7f5dd40840b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:53.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:53.079+0000 7f5ddab53640 1 -- 10.20.193.57:0/1299902945 shutdown_connections 2026-02-20T16:30:53.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:53.079+0000 7f5ddab53640 1 -- 10.20.193.57:0/1299902945 wait complete. 2026-02-20T16:30:53.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:53.079+0000 7f5ddab53640 1 Processor -- start 2026-02-20T16:30:53.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:53.079+0000 7f5ddab53640 1 -- start start 2026-02-20T16:30:53.082 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:53.080+0000 7f5ddab53640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f5dd407cb10 0x7f5dd407b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:53.082 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:53.080+0000 7f5ddab53640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f5dd4080bb0 0x7f5dd407b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:53.082 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:53.080+0000 7f5ddab53640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f5dd40814c0 0x7f5dd41464c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:53.082 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:53.080+0000 7f5ddab53640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd4196b70 con 0x7f5dd407cb10 2026-02-20T16:30:53.082 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:53.080+0000 7f5ddab53640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f5dd41969f0 con 0x7f5dd4080bb0 2026-02-20T16:30:53.082 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:53.080+0000 7f5ddab53640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f5dd4196cf0 con 0x7f5dd40814c0 2026-02-20T16:30:53.082 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:53.080+0000 7f5dcbfff640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f5dd4080bb0 0x7f5dd407b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:53.082 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:53.080+0000 7f5dd88c8640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f5dd407cb10 0x7f5dd407b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:53.082 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:53.080+0000 7f5dcbfff640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f5dd4080bb0 0x7f5dd407b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3301/0 says I am v2:10.20.193.57:33352/0 (socket says 10.20.193.57:33352) 2026-02-20T16:30:53.083 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:53.080+0000 7f5dd88c8640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f5dd407cb10 0x7f5dd407b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:44826/0 (socket says 10.20.193.57:44826) 2026-02-20T16:30:53.083 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:53.080+0000 7f5dcbfff640 1 -- 10.20.193.57:0/2398068822 learned_addr learned my addr 10.20.193.57:0/2398068822 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:30:53.083 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:53.080+0000 7f5dd90c9640 1 --2- 10.20.193.57:0/2398068822 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f5dd40814c0 0x7f5dd41464c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:53.083 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:53.080+0000 7f5dcbfff640 1 -- 10.20.193.57:0/2398068822 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f5dd40814c0 msgr2=0x7f5dd41464c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:53.083 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:53.080+0000 7f5dcbfff640 1 --2- 10.20.193.57:0/2398068822 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f5dd40814c0 0x7f5dd41464c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:53.083 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:53.080+0000 7f5dcbfff640 1 -- 10.20.193.57:0/2398068822 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f5dd407cb10 msgr2=0x7f5dd407b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:53.083 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:53.080+0000 7f5dcbfff640 1 --2- 10.20.193.57:0/2398068822 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f5dd407cb10 0x7f5dd407b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:53.083 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:53.080+0000 7f5dcbfff640 1 -- 10.20.193.57:0/2398068822 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dd407f0e0 con 0x7f5dd4080bb0 2026-02-20T16:30:53.083 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:53.080+0000 7f5dcbfff640 1 --2- 10.20.193.57:0/2398068822 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f5dd4080bb0 0x7f5dd407b730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc00c520 tx=0x7f5dbc00c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:30:53.083 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:53.080+0000 7f5dc97fa640 1 -- 10.20.193.57:0/2398068822 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc016020 con 0x7f5dd4080bb0 2026-02-20T16:30:53.083 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:53.080+0000 7f5dc97fa640 1 -- 10.20.193.57:0/2398068822 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5dbc012920 con 0x7f5dd4080bb0 2026-02-20T16:30:53.083 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:53.080+0000 7f5ddab53640 1 -- 10.20.193.57:0/2398068822 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dd407acc0 con 0x7f5dd4080bb0 2026-02-20T16:30:53.083 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:53.080+0000 7f5dc97fa640 1 -- 10.20.193.57:0/2398068822 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc012d30 con 0x7f5dd4080bb0 2026-02-20T16:30:53.083 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:53.080+0000 7f5ddab53640 1 -- 10.20.193.57:0/2398068822 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dd407bc70 con 0x7f5dd4080bb0 2026-02-20T16:30:53.083 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:53.081+0000 7f5ddab53640 1 -- 10.20.193.57:0/2398068822 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dd4080f80 con 0x7f5dd4080bb0 2026-02-20T16:30:53.083 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:53.081+0000 7f5dc97fa640 1 -- 10.20.193.57:0/2398068822 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7f5dbc01b400 con 0x7f5dd4080bb0 2026-02-20T16:30:53.083 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:53.081+0000 7f5dc97fa640 1 -- 10.20.193.57:0/2398068822 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 3020+0+0 (secure 0 0 0) 0x7f5dbc0637f0 con 0x7f5dd4080bb0 2026-02-20T16:30:53.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:53.083+0000 7f5dc97fa640 1 -- 10.20.193.57:0/2398068822 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7f5dbc020030 con 0x7f5dd4080bb0 2026-02-20T16:30:53.165 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:53.164+0000 7f5ddab53640 1 -- 10.20.193.57:0/2398068822 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "osd down", "ids": ["2"]} v 0) -- 0x7f5dd40008d0 con 0x7f5dd4080bb0 2026-02-20T16:30:53.166 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-20T16:30:53.164+0000 7fe5009cd640 -1 mon.a@0(leader).osd e22 definitely_dead 0 2026-02-20T16:30:53.181 INFO:tasks.ceph.osd.1.trial057.stderr:2026-02-20T16:30:53.179+0000 7f677d215900 -1 Falling back to public interface 2026-02-20T16:30:53.603 INFO:tasks.ceph.osd.1.trial057.stderr:2026-02-20T16:30:53.602+0000 7f677d215900 -1 osd.1 21 log_to_monitors true 2026-02-20T16:30:53.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:53.947+0000 7f5dc97fa640 1 -- 10.20.193.57:0/2398068822 <== mon.1 v2:10.20.193.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["2"]}]=0 marked down osd.2. v23) ==== 89+0+0 (secure 0 0 0) 0x7f5dbc0628d0 con 0x7f5dd4080bb0 2026-02-20T16:30:53.948 INFO:teuthology.orchestra.run.trial057.stderr:marked down osd.2. 2026-02-20T16:30:53.950 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:53.949+0000 7f5ddab53640 1 -- 10.20.193.57:0/2398068822 >> v1:10.20.193.57:6800/2007744879 conn(0x7f5da404cae0 legacy=0x7f5da406cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:53.950 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:53.949+0000 7f5ddab53640 1 -- 10.20.193.57:0/2398068822 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f5dd4080bb0 msgr2=0x7f5dd407b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:53.950 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:53.949+0000 7f5ddab53640 1 --2- 10.20.193.57:0/2398068822 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f5dd4080bb0 0x7f5dd407b730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc00c520 tx=0x7f5dbc00c9f0 comp rx=0 tx=0).stop 2026-02-20T16:30:53.950 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:53.949+0000 7f5ddab53640 1 -- 10.20.193.57:0/2398068822 shutdown_connections 2026-02-20T16:30:53.950 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:53.949+0000 7f5ddab53640 1 --2- 10.20.193.57:0/2398068822 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f5dd40814c0 0x7f5dd41464c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:53.950 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:53.949+0000 7f5ddab53640 1 --2- 10.20.193.57:0/2398068822 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f5dd4080bb0 0x7f5dd407b730 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:53.950 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:53.949+0000 7f5ddab53640 1 --2- 10.20.193.57:0/2398068822 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f5dd407cb10 0x7f5dd407b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:53.950 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:53.949+0000 7f5ddab53640 1 -- 10.20.193.57:0/2398068822 >> 10.20.193.57:0/2398068822 conn(0x7f5dd40833e0 msgr2=0x7f5dd41328b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:53.950 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:53.949+0000 7f5ddab53640 1 -- 10.20.193.57:0/2398068822 shutdown_connections 2026-02-20T16:30:53.950 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:53.949+0000 7f5ddab53640 1 -- 10.20.193.57:0/2398068822 wait complete. 2026-02-20T16:30:53.955 INFO:tasks.ceph.osd.1.trial057.stderr:2026-02-20T16:30:53.954+0000 7f676fe90640 -1 osd.1 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T16:30:53.959 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-20T16:30:53.959 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2026-02-20T16:30:53.960 INFO:tasks.ceph.osd.2:Started 2026-02-20T16:30:53.960 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-20T16:30:53.960 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T16:30:54.008 INFO:tasks.ceph.osd.3:Stopped 2026-02-20T16:30:54.008 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 3 2026-02-20T16:30:54.078 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:54.077+0000 7f505b3e4640 1 -- 10.20.193.57:0/2133134466 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f505405cb40 msgr2=0x7f5054177360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:54.078 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:54.077+0000 7f505b3e4640 1 --2- 10.20.193.57:0/2133134466 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f505405cb40 0x7f5054177360 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5048004770 tx=0x7f504802f0e0 comp rx=0 tx=0).stop 2026-02-20T16:30:54.078 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:54.077+0000 7f505b3e4640 1 -- 10.20.193.57:0/2133134466 shutdown_connections 2026-02-20T16:30:54.078 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:54.077+0000 7f505b3e4640 1 --2- 10.20.193.57:0/2133134466 >> v2:10.20.193.57:3300/0 conn(0x7f50541778a0 0x7f5054197c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:54.078 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:54.077+0000 7f505b3e4640 1 --2- 10.20.193.57:0/2133134466 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f505405cb40 0x7f5054177360 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:54.079 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:54.077+0000 7f505b3e4640 1 -- 10.20.193.57:0/2133134466 >> 10.20.193.57:0/2133134466 conn(0x7f50540833e0 msgr2=0x7f50540840b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:54.079 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:54.077+0000 7f505b3e4640 1 -- 10.20.193.57:0/2133134466 shutdown_connections 2026-02-20T16:30:54.079 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:54.077+0000 7f505b3e4640 1 -- 10.20.193.57:0/2133134466 wait complete. 2026-02-20T16:30:54.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:54.077+0000 7f505b3e4640 1 Processor -- start 2026-02-20T16:30:54.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:54.077+0000 7f505b3e4640 1 -- start start 2026-02-20T16:30:54.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:54.078+0000 7f505b3e4640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f505405c060 0x7f5054122030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:54.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:54.078+0000 7f505b3e4640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f505405cb40 0x7f5054122570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:54.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:54.078+0000 7f505b3e4640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f50541778a0 0x7f50541253f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:54.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:54.078+0000 7f505b3e4640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f5054198c40 con 0x7f505405c060 2026-02-20T16:30:54.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:54.078+0000 7f505b3e4640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f5054198ac0 con 0x7f50541778a0 2026-02-20T16:30:54.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:54.078+0000 7f505b3e4640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f5054198dc0 con 0x7f505405cb40 2026-02-20T16:30:54.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:54.078+0000 7f5059159640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f505405c060 0x7f5054122030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:54.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:54.078+0000 7f5059159640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f505405c060 0x7f5054122030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:44850/0 (socket says 10.20.193.57:44850) 2026-02-20T16:30:54.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:54.078+0000 7f5059159640 1 -- 10.20.193.57:0/1908652638 learned_addr learned my addr 10.20.193.57:0/1908652638 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:30:54.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:54.078+0000 7f5058958640 1 --2- 10.20.193.57:0/1908652638 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f505405cb40 0x7f5054122570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:54.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:54.078+0000 7f505995a640 1 --2- 10.20.193.57:0/1908652638 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f50541778a0 0x7f50541253f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:54.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:54.078+0000 7f5059159640 1 -- 10.20.193.57:0/1908652638 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f505405cb40 msgr2=0x7f5054122570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:54.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:54.078+0000 7f5059159640 1 --2- 10.20.193.57:0/1908652638 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f505405cb40 0x7f5054122570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:54.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:54.078+0000 7f5059159640 1 -- 10.20.193.57:0/1908652638 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f50541778a0 msgr2=0x7f50541253f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:54.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:54.078+0000 7f5059159640 1 --2- 10.20.193.57:0/1908652638 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f50541778a0 0x7f50541253f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:54.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:54.078+0000 7f5059159640 1 -- 10.20.193.57:0/1908652638 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f505410cb70 con 0x7f505405c060 2026-02-20T16:30:54.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:54.078+0000 7f5059159640 1 --2- 10.20.193.57:0/1908652638 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f505405c060 0x7f5054122030 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f504400c4f0 tx=0x7f504400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:30:54.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:54.078+0000 7f5041ffb640 1 -- 10.20.193.57:0/1908652638 <== mon.0 v2:10.20.193.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5044016020 con 0x7f505405c060 2026-02-20T16:30:54.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:54.078+0000 7f5041ffb640 1 -- 10.20.193.57:0/1908652638 <== mon.0 v2:10.20.193.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5044012920 con 0x7f505405c060 2026-02-20T16:30:54.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:54.078+0000 7f505b3e4640 1 -- 10.20.193.57:0/1908652638 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f505410e390 con 0x7f505405c060 2026-02-20T16:30:54.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:54.078+0000 7f5041ffb640 1 -- 10.20.193.57:0/1908652638 <== mon.0 v2:10.20.193.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5044012d30 con 0x7f505405c060 2026-02-20T16:30:54.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:54.078+0000 7f505b3e4640 1 -- 10.20.193.57:0/1908652638 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5054122ab0 con 0x7f505405c060 2026-02-20T16:30:54.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:54.078+0000 7f505b3e4640 1 -- 10.20.193.57:0/1908652638 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f505405c430 con 0x7f505405c060 2026-02-20T16:30:54.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:54.079+0000 7f5041ffb640 1 -- 10.20.193.57:0/1908652638 <== mon.0 v2:10.20.193.57:3300/0 4 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7f504401b400 con 0x7f505405c060 2026-02-20T16:30:54.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:54.079+0000 7f5041ffb640 1 -- 10.20.193.57:0/1908652638 <== mon.0 v2:10.20.193.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 3020+0+0 (secure 0 0 0) 0x7f50440637b0 con 0x7f505405c060 2026-02-20T16:30:54.082 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:54.080+0000 7f5041ffb640 1 -- 10.20.193.57:0/1908652638 <== mon.0 v2:10.20.193.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7f5044020030 con 0x7f505405c060 2026-02-20T16:30:54.160 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:54.159+0000 7f505b3e4640 1 -- 10.20.193.57:0/1908652638 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "osd down", "ids": ["3"]} v 0) -- 0x7f5054053200 con 0x7f505405c060 2026-02-20T16:30:54.161 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-20T16:30:54.159+0000 7fe5009cd640 -1 mon.a@0(leader).osd e23 definitely_dead 0 2026-02-20T16:30:54.208 INFO:tasks.ceph.osd.2.trial057.stderr:2026-02-20T16:30:54.207+0000 7f0f91b39900 -1 Falling back to public interface 2026-02-20T16:30:54.655 INFO:tasks.ceph.osd.2.trial057.stderr:2026-02-20T16:30:54.654+0000 7f0f91b39900 -1 osd.2 22 log_to_monitors true 2026-02-20T16:30:54.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:54.946+0000 7f5041ffb640 1 -- 10.20.193.57:0/1908652638 <== mon.0 v2:10.20.193.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["3"]}]=0 marked down osd.3. v24) ==== 89+0+0 (secure 0 0 0) 0x7f5044062850 con 0x7f505405c060 2026-02-20T16:30:54.948 INFO:teuthology.orchestra.run.trial057.stderr:marked down osd.3. 2026-02-20T16:30:54.950 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:54.948+0000 7f505b3e4640 1 -- 10.20.193.57:0/1908652638 >> v1:10.20.193.57:6800/2007744879 conn(0x7f502404cae0 legacy=0x7f502406cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:54.950 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:54.948+0000 7f505b3e4640 1 -- 10.20.193.57:0/1908652638 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f505405c060 msgr2=0x7f5054122030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:54.950 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:54.948+0000 7f505b3e4640 1 --2- 10.20.193.57:0/1908652638 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f505405c060 0x7f5054122030 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f504400c4f0 tx=0x7f504400c9c0 comp rx=0 tx=0).stop 2026-02-20T16:30:54.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:54.948+0000 7f505b3e4640 1 -- 10.20.193.57:0/1908652638 shutdown_connections 2026-02-20T16:30:54.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:54.948+0000 7f505b3e4640 1 --2- 10.20.193.57:0/1908652638 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f50541778a0 0x7f50541253f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:54.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:54.948+0000 7f505b3e4640 1 --2- 10.20.193.57:0/1908652638 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f505405cb40 0x7f5054122570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:54.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:54.948+0000 7f505b3e4640 1 --2- 10.20.193.57:0/1908652638 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f505405c060 0x7f5054122030 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:54.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:54.948+0000 7f505b3e4640 1 -- 10.20.193.57:0/1908652638 >> 10.20.193.57:0/1908652638 conn(0x7f50540833e0 msgr2=0x7f5054075b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:54.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:54.948+0000 7f505b3e4640 1 -- 10.20.193.57:0/1908652638 shutdown_connections 2026-02-20T16:30:54.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:54.948+0000 7f505b3e4640 1 -- 10.20.193.57:0/1908652638 wait complete. 2026-02-20T16:30:54.953 INFO:tasks.ceph.osd.2.trial057.stderr:2026-02-20T16:30:54.952+0000 7f0f850b5640 -1 osd.2 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T16:30:54.959 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-20T16:30:54.959 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2026-02-20T16:30:54.961 INFO:tasks.ceph.osd.3:Started 2026-02-20T16:30:54.962 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-20T16:30:54.962 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-20T16:30:55.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:55.028+0000 7fafc3d12640 1 -- 10.20.193.57:0/3998285662 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fafbc05c060 msgr2=0x7fafbc05c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:55.033 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:55.028+0000 7fafc3d12640 1 --2- 10.20.193.57:0/3998285662 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fafbc05c060 0x7fafbc05c430 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fafac004770 tx=0x7fafac02f0e0 comp rx=0 tx=0).stop 2026-02-20T16:30:55.033 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:55.028+0000 7fafc3d12640 1 -- 10.20.193.57:0/3998285662 shutdown_connections 2026-02-20T16:30:55.033 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:55.028+0000 7fafc3d12640 1 --2- 10.20.193.57:0/3998285662 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fafbc177a70 0x7fafbc197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:55.033 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:55.028+0000 7fafc3d12640 1 --2- 10.20.193.57:0/3998285662 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fafbc05c060 0x7fafbc05c430 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:55.033 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:55.028+0000 7fafc3d12640 1 -- 10.20.193.57:0/3998285662 >> 10.20.193.57:0/3998285662 conn(0x7fafbc0833e0 msgr2=0x7fafbc0840b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:55.033 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:55.028+0000 7fafc3d12640 1 -- 10.20.193.57:0/3998285662 shutdown_connections 2026-02-20T16:30:55.033 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:55.028+0000 7fafc3d12640 1 -- 10.20.193.57:0/3998285662 wait complete. 2026-02-20T16:30:55.033 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:55.028+0000 7fafc3d12640 1 Processor -- start 2026-02-20T16:30:55.033 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:55.028+0000 7fafc3d12640 1 -- start start 2026-02-20T16:30:55.033 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:55.029+0000 7fafc3d12640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fafbc05c060 0x7fafbc177e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:55.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:55.029+0000 7fafc3d12640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fafbc05c970 0x7fafbc178380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:55.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:55.029+0000 7fafc3d12640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fafbc177a70 0x7fafbc1788c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:55.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:55.029+0000 7fafc3d12640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7fafbc198e10 con 0x7fafbc177a70 2026-02-20T16:30:55.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:55.029+0000 7fafc3d12640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7fafbc198c90 con 0x7fafbc05c060 2026-02-20T16:30:55.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:55.029+0000 7fafc3d12640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7fafbc198f90 con 0x7fafbc05c970 2026-02-20T16:30:55.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:55.029+0000 7fafc1286640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fafbc05c970 0x7fafbc178380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:55.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:55.029+0000 7fafc1a87640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fafbc05c060 0x7fafbc177e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:55.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:55.029+0000 7fafc2288640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fafbc177a70 0x7fafbc1788c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:55.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:55.029+0000 7fafc1286640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fafbc05c970 0x7fafbc178380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3302/0 says I am v2:10.20.193.57:47840/0 (socket says 10.20.193.57:47840) 2026-02-20T16:30:55.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:55.029+0000 7fafc2288640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fafbc177a70 0x7fafbc1788c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:44878/0 (socket says 10.20.193.57:44878) 2026-02-20T16:30:55.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:55.029+0000 7fafc1a87640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fafbc05c060 0x7fafbc177e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3301/0 says I am v2:10.20.193.57:33396/0 (socket says 10.20.193.57:33396) 2026-02-20T16:30:55.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:55.029+0000 7fafc2288640 1 -- 10.20.193.57:0/3380256233 learned_addr learned my addr 10.20.193.57:0/3380256233 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:30:55.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:55.029+0000 7fafc2288640 1 -- 10.20.193.57:0/3380256233 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fafbc05c970 msgr2=0x7fafbc178380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:55.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:55.029+0000 7fafc2288640 1 --2- 10.20.193.57:0/3380256233 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fafbc05c970 0x7fafbc178380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:55.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:55.029+0000 7fafc2288640 1 -- 10.20.193.57:0/3380256233 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fafbc05c060 msgr2=0x7fafbc177e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:55.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:55.029+0000 7fafc2288640 1 --2- 10.20.193.57:0/3380256233 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fafbc05c060 0x7fafbc177e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:55.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:55.029+0000 7fafc2288640 1 -- 10.20.193.57:0/3380256233 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafbc081f00 con 0x7fafbc177a70 2026-02-20T16:30:55.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:55.029+0000 7fafc1a87640 1 --2- 10.20.193.57:0/3380256233 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fafbc05c060 0x7fafbc177e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:30:55.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:55.029+0000 7fafc2288640 1 --2- 10.20.193.57:0/3380256233 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fafbc177a70 0x7fafbc1788c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fafb80090d0 tx=0x7fafb800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:30:55.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:55.029+0000 7fafaa7fc640 1 -- 10.20.193.57:0/3380256233 <== mon.0 v2:10.20.193.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb8018070 con 0x7fafbc177a70 2026-02-20T16:30:55.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:55.029+0000 7fafaa7fc640 1 -- 10.20.193.57:0/3380256233 <== mon.0 v2:10.20.193.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fafb8002b40 con 0x7fafbc177a70 2026-02-20T16:30:55.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:55.029+0000 7fafc3d12640 1 -- 10.20.193.57:0/3380256233 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafbc07cc10 con 0x7fafbc177a70 2026-02-20T16:30:55.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:55.029+0000 7fafaa7fc640 1 -- 10.20.193.57:0/3380256233 <== mon.0 v2:10.20.193.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb80040d0 con 0x7fafbc177a70 2026-02-20T16:30:55.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:55.029+0000 7fafc3d12640 1 -- 10.20.193.57:0/3380256233 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafbc17a4b0 con 0x7fafbc177a70 2026-02-20T16:30:55.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:55.030+0000 7fafc3d12640 1 -- 10.20.193.57:0/3380256233 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafbc07d230 con 0x7fafbc177a70 2026-02-20T16:30:55.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:55.030+0000 7fafaa7fc640 1 -- 10.20.193.57:0/3380256233 <== mon.0 v2:10.20.193.57:3300/0 4 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7fafb8012030 con 0x7fafbc177a70 2026-02-20T16:30:55.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:55.030+0000 7fafaa7fc640 1 -- 10.20.193.57:0/3380256233 <== mon.0 v2:10.20.193.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 3020+0+0 (secure 0 0 0) 0x7fafb80633d0 con 0x7fafbc177a70 2026-02-20T16:30:55.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:55.031+0000 7fafaa7fc640 1 -- 10.20.193.57:0/3380256233 <== mon.0 v2:10.20.193.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7fafbc07d230 con 0x7fafbc177a70 2026-02-20T16:30:55.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:55.107+0000 7fafc3d12640 1 -- 10.20.193.57:0/3380256233 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fafbc1879d0 con 0x7fafbc177a70 2026-02-20T16:30:55.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:55.108+0000 7fafaa7fc640 1 -- 10.20.193.57:0/3380256233 <== mon.0 v2:10.20.193.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+9129 (secure 0 0 0) 0x7fafbc1879d0 con 0x7fafbc177a70 2026-02-20T16:30:55.110 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:30:55.110 INFO:teuthology.orchestra.run.trial057.stdout:{"epoch":24,"fsid":"3b3c5c1a-0a2b-40b9-ac1d-921ada466f9e","created":"2026-02-20T16:29:22.501479+0000","modified":"2026-02-20T16:30:54.945738+0000","last_up_change":"2026-02-20T16:30:54.945738+0000","last_in_change":"2026-02-20T16:29:24.294147+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"squid","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T16:29:34.029059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-20T16:29:38.191724+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"error_message":"pool 2 has some PGs where all OSDs are with primary_affinity 0 (at least pg 2.1), read balance score may not be reliable","score_acting":0,"score_stable":0}}],"osds":[{"osd":0,"uuid":"a3139827-dc3c-46f9-b211-d376e3dc92f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":20,"up_from":23,"up_thru":23,"down_at":21,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6801","nonce":4246367706}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6802","nonce":4246367706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6804","nonce":4246367706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6803","nonce":4246367706}]},"public_addr":"10.20.193.57:6801/4246367706","cluster_addr":"10.20.193.57:6802/4246367706","heartbeat_back_addr":"10.20.193.57:6804/4246367706","heartbeat_front_addr":"10.20.193.57:6803/4246367706","state":["exists","up"]},{"osd":1,"uuid":"00e7cb17-534c-4ac2-8486-585b3b8db0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":21,"up_from":24,"up_thru":21,"down_at":22,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6805","nonce":3794545817}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6806","nonce":3794545817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6808","nonce":3794545817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6807","nonce":3794545817}]},"public_addr":"10.20.193.57:6805/3794545817","cluster_addr":"10.20.193.57:6806/3794545817","heartbeat_back_addr":"10.20.193.57:6808/3794545817","heartbeat_front_addr":"10.20.193.57:6807/3794545817","state":["exists","up"]},{"osd":2,"uuid":"d0b55b31-45df-4c58-bf11-a72d44f21a00","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6809","nonce":1926844368}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6810","nonce":1926844368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6812","nonce":1926844368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6811","nonce":1926844368}]},"public_addr":"10.20.193.57:6809/1926844368","cluster_addr":"10.20.193.57:6810/1926844368","heartbeat_back_addr":"10.20.193.57:6812/1926844368","heartbeat_front_addr":"10.20.193.57:6811/1926844368","state":["exists"]},{"osd":3,"uuid":"b3bfbbd8-cfaf-4360-9a5b-c52e89ac3f75","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":23,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6813","nonce":3124429028}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6814","nonce":3124429028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6816","nonce":3124429028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6815","nonce":3124429028}]},"public_addr":"10.20.193.57:6813/3124429028","cluster_addr":"10.20.193.57:6814/3124429028","heartbeat_back_addr":"10.20.193.57:6816/3124429028","heartbeat_front_addr":"10.20.193.57:6815/3124429028","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T16:29:31.711310+0000","dead_epoch":21},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T16:29:31.724521+0000","dead_epoch":22},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T16:29:31.770683+0000","dead_epoch":23},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T16:29:31.821531+0000","dead_epoch":24}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.57:0/4240799477":"2026-02-21T16:30:46.924862+0000","10.20.193.57:0/1295824105":"2026-02-21T16:30:46.924862+0000","10.20.193.57:0/2316661359":"2026-02-21T16:30:46.924862+0000","10.20.193.57:0/3729051198":"2026-02-21T16:30:46.924862+0000","10.20.193.57:6800/4138285113":"2026-02-21T16:30:46.924862+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T16:30:55.111 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:55.109+0000 7fafc3d12640 1 -- 10.20.193.57:0/3380256233 >> v1:10.20.193.57:6800/2007744879 conn(0x7faf8c04cae0 legacy=0x7faf8c06cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:55.111 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:55.109+0000 7fafc3d12640 1 -- 10.20.193.57:0/3380256233 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fafbc177a70 msgr2=0x7fafbc1788c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:55.111 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:55.109+0000 7fafc3d12640 1 --2- 10.20.193.57:0/3380256233 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fafbc177a70 0x7fafbc1788c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fafb80090d0 tx=0x7fafb800d4a0 comp rx=0 tx=0).stop 2026-02-20T16:30:55.111 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:55.109+0000 7fafc3d12640 1 -- 10.20.193.57:0/3380256233 shutdown_connections 2026-02-20T16:30:55.112 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:55.109+0000 7fafc3d12640 1 --2- 10.20.193.57:0/3380256233 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fafbc177a70 0x7fafbc1788c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:55.112 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:55.109+0000 7fafc3d12640 1 --2- 10.20.193.57:0/3380256233 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fafbc05c970 0x7fafbc178380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:55.112 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:55.109+0000 7fafc3d12640 1 --2- 10.20.193.57:0/3380256233 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fafbc05c060 0x7fafbc177e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:55.112 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:55.109+0000 7fafc3d12640 1 -- 10.20.193.57:0/3380256233 >> 10.20.193.57:0/3380256233 conn(0x7fafbc0833e0 msgr2=0x7fafbc07dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:55.112 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:55.109+0000 7fafc3d12640 1 -- 10.20.193.57:0/3380256233 shutdown_connections 2026-02-20T16:30:55.112 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:55.109+0000 7fafc3d12640 1 -- 10.20.193.57:0/3380256233 wait complete. 2026-02-20T16:30:55.203 INFO:tasks.ceph.osd.3.trial057.stderr:2026-02-20T16:30:55.201+0000 7f18fdf2d900 -1 Falling back to public interface 2026-02-20T16:30:55.622 INFO:tasks.ceph.osd.3.trial057.stderr:2026-02-20T16:30:55.621+0000 7f18fdf2d900 -1 osd.3 23 log_to_monitors true 2026-02-20T16:30:55.956 INFO:tasks.ceph.osd.3.trial057.stderr:2026-02-20T16:30:55.955+0000 7f18f14ab640 -1 osd.3 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T16:30:58.120 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-20T16:30:58.194 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.190+0000 7f46a69fe640 1 -- 10.20.193.57:0/3909412059 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f46a0080bb0 msgr2=0x7f46a0080f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:58.195 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.190+0000 7f46a69fe640 1 --2- 10.20.193.57:0/3909412059 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f46a0080bb0 0x7f46a0080f80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f468c005ea0 tx=0x7f468c02f1d0 comp rx=0 tx=0).stop 2026-02-20T16:30:58.195 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.190+0000 7f46a69fe640 1 -- 10.20.193.57:0/3909412059 shutdown_connections 2026-02-20T16:30:58.195 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.190+0000 7f46a69fe640 1 --2- 10.20.193.57:0/3909412059 >> v2:10.20.193.57:3300/0 conn(0x7f46a007cb10 0x7f46a0196150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:58.195 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.190+0000 7f46a69fe640 1 --2- 10.20.193.57:0/3909412059 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f46a0080bb0 0x7f46a0080f80 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:58.195 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.190+0000 7f46a69fe640 1 -- 10.20.193.57:0/3909412059 >> 10.20.193.57:0/3909412059 conn(0x7f46a00833e0 msgr2=0x7f46a00840b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:58.195 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.190+0000 7f46a69fe640 1 -- 10.20.193.57:0/3909412059 shutdown_connections 2026-02-20T16:30:58.195 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.190+0000 7f46a69fe640 1 -- 10.20.193.57:0/3909412059 wait complete. 2026-02-20T16:30:58.195 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.191+0000 7f46a69fe640 1 Processor -- start 2026-02-20T16:30:58.195 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.191+0000 7f46a69fe640 1 -- start start 2026-02-20T16:30:58.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.191+0000 7f46a69fe640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f46a007cb10 0x7f46a007e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:58.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.191+0000 7f46a69fe640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f46a0080bb0 0x7f46a007aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:58.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.191+0000 7f46a69fe640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f46a00814c0 0x7f46a007b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:58.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.191+0000 7f46a69fe640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f46a0196aa0 con 0x7f46a00814c0 2026-02-20T16:30:58.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.191+0000 7f46a69fe640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f46a0196920 con 0x7f46a007cb10 2026-02-20T16:30:58.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.191+0000 7f46a69fe640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f46a0196c20 con 0x7f46a0080bb0 2026-02-20T16:30:58.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.191+0000 7f469f7fe640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f46a0080bb0 0x7f46a007aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:58.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.191+0000 7f46a4f74640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f46a00814c0 0x7f46a007b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:58.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.191+0000 7f469ffff640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f46a007cb10 0x7f46a007e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:58.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.191+0000 7f46a4f74640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f46a00814c0 0x7f46a007b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:44898/0 (socket says 10.20.193.57:44898) 2026-02-20T16:30:58.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.191+0000 7f46a4f74640 1 -- 10.20.193.57:0/1262165788 learned_addr learned my addr 10.20.193.57:0/1262165788 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:30:58.197 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.191+0000 7f46a4f74640 1 -- 10.20.193.57:0/1262165788 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f46a0080bb0 msgr2=0x7f46a007aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:58.197 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.191+0000 7f46a4f74640 1 --2- 10.20.193.57:0/1262165788 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f46a0080bb0 0x7f46a007aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:58.197 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.191+0000 7f46a4f74640 1 -- 10.20.193.57:0/1262165788 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f46a007cb10 msgr2=0x7f46a007e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:58.197 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.191+0000 7f46a4f74640 1 --2- 10.20.193.57:0/1262165788 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f46a007cb10 0x7f46a007e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:58.197 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.191+0000 7f46a4f74640 1 -- 10.20.193.57:0/1262165788 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46a005d740 con 0x7f46a00814c0 2026-02-20T16:30:58.197 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.191+0000 7f469f7fe640 1 --2- 10.20.193.57:0/1262165788 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f46a0080bb0 0x7f46a007aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:30:58.197 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.191+0000 7f46a4f74640 1 --2- 10.20.193.57:0/1262165788 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f46a00814c0 0x7f46a007b410 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4694009550 tx=0x7f469400e5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:30:58.197 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.191+0000 7f469cff9640 1 -- 10.20.193.57:0/1262165788 <== mon.0 v2:10.20.193.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4694019070 con 0x7f46a00814c0 2026-02-20T16:30:58.197 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.191+0000 7f469cff9640 1 -- 10.20.193.57:0/1262165788 <== mon.0 v2:10.20.193.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4694002c50 con 0x7f46a00814c0 2026-02-20T16:30:58.197 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.191+0000 7f46a69fe640 1 -- 10.20.193.57:0/1262165788 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46a007f040 con 0x7f46a00814c0 2026-02-20T16:30:58.197 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.191+0000 7f469cff9640 1 -- 10.20.193.57:0/1262165788 <== mon.0 v2:10.20.193.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4694004330 con 0x7f46a00814c0 2026-02-20T16:30:58.197 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.191+0000 7f46a69fe640 1 -- 10.20.193.57:0/1262165788 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46a007b950 con 0x7f46a00814c0 2026-02-20T16:30:58.198 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.192+0000 7f46a69fe640 1 -- 10.20.193.57:0/1262165788 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46a0080f80 con 0x7f46a00814c0 2026-02-20T16:30:58.198 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.192+0000 7f469cff9640 1 -- 10.20.193.57:0/1262165788 <== mon.0 v2:10.20.193.57:3300/0 4 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7f46940044d0 con 0x7f46a00814c0 2026-02-20T16:30:58.198 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.192+0000 7f469cff9640 1 -- 10.20.193.57:0/1262165788 <== mon.0 v2:10.20.193.57:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3020+0+0 (secure 0 0 0) 0x7f4694063cf0 con 0x7f46a00814c0 2026-02-20T16:30:58.198 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.194+0000 7f469cff9640 1 -- 10.20.193.57:0/1262165788 <== mon.0 v2:10.20.193.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7f4694010040 con 0x7f46a00814c0 2026-02-20T16:30:58.272 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.270+0000 7f46a69fe640 1 -- 10.20.193.57:0/1262165788 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f46a0079bf0 con 0x7f46a00814c0 2026-02-20T16:30:58.272 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.270+0000 7f469cff9640 1 -- 10.20.193.57:0/1262165788 <== mon.0 v2:10.20.193.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+9202 (secure 0 0 0) 0x7f469403e0c0 con 0x7f46a00814c0 2026-02-20T16:30:58.272 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:30:58.273 INFO:teuthology.orchestra.run.trial057.stdout:{"epoch":27,"fsid":"3b3c5c1a-0a2b-40b9-ac1d-921ada466f9e","created":"2026-02-20T16:29:22.501479+0000","modified":"2026-02-20T16:30:57.950959+0000","last_up_change":"2026-02-20T16:30:56.950147+0000","last_in_change":"2026-02-20T16:29:24.294147+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":9,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"squid","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T16:29:34.029059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-20T16:29:38.191724+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a3139827-dc3c-46f9-b211-d376e3dc92f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":20,"up_from":23,"up_thru":24,"down_at":21,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6801","nonce":4246367706}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6802","nonce":4246367706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6804","nonce":4246367706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6803","nonce":4246367706}]},"public_addr":"10.20.193.57:6801/4246367706","cluster_addr":"10.20.193.57:6802/4246367706","heartbeat_back_addr":"10.20.193.57:6804/4246367706","heartbeat_front_addr":"10.20.193.57:6803/4246367706","state":["exists","up"]},{"osd":1,"uuid":"00e7cb17-534c-4ac2-8486-585b3b8db0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":21,"up_from":24,"up_thru":24,"down_at":22,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6805","nonce":3794545817}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6806","nonce":3794545817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6808","nonce":3794545817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6807","nonce":3794545817}]},"public_addr":"10.20.193.57:6805/3794545817","cluster_addr":"10.20.193.57:6806/3794545817","heartbeat_back_addr":"10.20.193.57:6808/3794545817","heartbeat_front_addr":"10.20.193.57:6807/3794545817","state":["exists","up"]},{"osd":2,"uuid":"d0b55b31-45df-4c58-bf11-a72d44f21a00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":22,"up_from":25,"up_thru":26,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6809","nonce":3959776128}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6810","nonce":3959776128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6812","nonce":3959776128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6811","nonce":3959776128}]},"public_addr":"10.20.193.57:6809/3959776128","cluster_addr":"10.20.193.57:6810/3959776128","heartbeat_back_addr":"10.20.193.57:6812/3959776128","heartbeat_front_addr":"10.20.193.57:6811/3959776128","state":["exists","up"]},{"osd":3,"uuid":"b3bfbbd8-cfaf-4360-9a5b-c52e89ac3f75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":23,"up_from":26,"up_thru":26,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6813","nonce":2476353628}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6814","nonce":2476353628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6816","nonce":2476353628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6815","nonce":2476353628}]},"public_addr":"10.20.193.57:6813/2476353628","cluster_addr":"10.20.193.57:6814/2476353628","heartbeat_back_addr":"10.20.193.57:6816/2476353628","heartbeat_front_addr":"10.20.193.57:6815/2476353628","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T16:29:31.711310+0000","dead_epoch":21},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T16:29:31.724521+0000","dead_epoch":22},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T16:29:31.770683+0000","dead_epoch":23},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T16:29:31.821531+0000","dead_epoch":24}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.57:0/4240799477":"2026-02-21T16:30:46.924862+0000","10.20.193.57:0/1295824105":"2026-02-21T16:30:46.924862+0000","10.20.193.57:0/2316661359":"2026-02-21T16:30:46.924862+0000","10.20.193.57:0/3729051198":"2026-02-21T16:30:46.924862+0000","10.20.193.57:6800/4138285113":"2026-02-21T16:30:46.924862+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T16:30:58.273 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.271+0000 7f46a69fe640 1 -- 10.20.193.57:0/1262165788 >> v1:10.20.193.57:6800/2007744879 conn(0x7f467004cad0 legacy=0x7f467006cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:58.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.271+0000 7f46a69fe640 1 -- 10.20.193.57:0/1262165788 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f46a00814c0 msgr2=0x7f46a007b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:58.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.271+0000 7f46a69fe640 1 --2- 10.20.193.57:0/1262165788 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f46a00814c0 0x7f46a007b410 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4694009550 tx=0x7f469400e5e0 comp rx=0 tx=0).stop 2026-02-20T16:30:58.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.271+0000 7f46a69fe640 1 -- 10.20.193.57:0/1262165788 shutdown_connections 2026-02-20T16:30:58.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.271+0000 7f46a69fe640 1 --2- 10.20.193.57:0/1262165788 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f46a00814c0 0x7f46a007b410 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:58.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.271+0000 7f46a69fe640 1 --2- 10.20.193.57:0/1262165788 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f46a0080bb0 0x7f46a007aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:58.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.271+0000 7f46a69fe640 1 --2- 10.20.193.57:0/1262165788 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f46a007cb10 0x7f46a007e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:58.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.271+0000 7f46a69fe640 1 -- 10.20.193.57:0/1262165788 >> 10.20.193.57:0/1262165788 conn(0x7f46a00833e0 msgr2=0x7f46a012ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:58.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.271+0000 7f46a69fe640 1 -- 10.20.193.57:0/1262165788 shutdown_connections 2026-02-20T16:30:58.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.271+0000 7f46a69fe640 1 -- 10.20.193.57:0/1262165788 wait complete. 2026-02-20T16:30:58.280 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-20T16:30:58.281 INFO:teuthology.run_tasks:Running task exec... 2026-02-20T16:30:58.299 INFO:teuthology.task.exec:Executing custom commands... 2026-02-20T16:30:58.300 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@trial057.front.sepia.ceph.com 2026-02-20T16:30:58.300 DEBUG:teuthology.orchestra.run.trial057:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph versions' 2026-02-20T16:30:58.367 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.363+0000 7f8a178cf640 1 -- 10.20.193.57:0/4188417675 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f8a100811d0 msgr2=0x7f8a100815a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:58.367 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.363+0000 7f8a178cf640 1 --2- 10.20.193.57:0/4188417675 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f8a100811d0 0x7f8a100815a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8a00005ea0 tx=0x7f8a0002f1d0 comp rx=0 tx=0).stop 2026-02-20T16:30:58.367 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.363+0000 7f8a178cf640 1 -- 10.20.193.57:0/4188417675 shutdown_connections 2026-02-20T16:30:58.368 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.363+0000 7f8a178cf640 1 --2- 10.20.193.57:0/4188417675 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8a10081ae0 0x7f8a10136590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:58.368 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.363+0000 7f8a178cf640 1 --2- 10.20.193.57:0/4188417675 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f8a100811d0 0x7f8a100815a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:58.368 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.363+0000 7f8a178cf640 1 -- 10.20.193.57:0/4188417675 >> 10.20.193.57:0/4188417675 conn(0x7f8a10084730 msgr2=0x7f8a10084b30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:58.368 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.363+0000 7f8a178cf640 1 -- 10.20.193.57:0/4188417675 shutdown_connections 2026-02-20T16:30:58.368 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.363+0000 7f8a178cf640 1 -- 10.20.193.57:0/4188417675 wait complete. 2026-02-20T16:30:58.368 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.363+0000 7f8a178cf640 1 Processor -- start 2026-02-20T16:30:58.368 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.363+0000 7f8a178cf640 1 -- start start 2026-02-20T16:30:58.368 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.364+0000 7f8a178cf640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f8a100811d0 0x7f8a10125d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:58.368 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.364+0000 7f8a178cf640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8a10081ae0 0x7f8a10126250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:58.368 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.364+0000 7f8a178cf640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8a10136ad0 0x7f8a10126790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:58.368 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.364+0000 7f8a178cf640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f8a10198f00 con 0x7f8a100811d0 2026-02-20T16:30:58.369 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.364+0000 7f8a178cf640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f8a101373e0 con 0x7f8a10136ad0 2026-02-20T16:30:58.369 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.364+0000 7f8a178cf640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f8a10199080 con 0x7f8a10081ae0 2026-02-20T16:30:58.369 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.364+0000 7f8a14e43640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8a10081ae0 0x7f8a10126250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:58.369 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.364+0000 7f8a15644640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f8a100811d0 0x7f8a10125d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:58.369 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.364+0000 7f8a14e43640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8a10081ae0 0x7f8a10126250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3302/0 says I am v2:10.20.193.57:47870/0 (socket says 10.20.193.57:47870) 2026-02-20T16:30:58.369 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.364+0000 7f8a14e43640 1 -- 10.20.193.57:0/1537731042 learned_addr learned my addr 10.20.193.57:0/1537731042 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:30:58.369 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.364+0000 7f8a15644640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f8a100811d0 0x7f8a10125d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:44916/0 (socket says 10.20.193.57:44916) 2026-02-20T16:30:58.369 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.364+0000 7f8a15e45640 1 --2- 10.20.193.57:0/1537731042 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8a10136ad0 0x7f8a10126790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:58.369 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.364+0000 7f8a14e43640 1 -- 10.20.193.57:0/1537731042 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8a10136ad0 msgr2=0x7f8a10126790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:58.369 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.364+0000 7f8a14e43640 1 --2- 10.20.193.57:0/1537731042 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8a10136ad0 0x7f8a10126790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:58.369 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.364+0000 7f8a14e43640 1 -- 10.20.193.57:0/1537731042 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f8a100811d0 msgr2=0x7f8a10125d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:58.369 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.364+0000 7f8a14e43640 1 --2- 10.20.193.57:0/1537731042 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f8a100811d0 0x7f8a10125d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:58.370 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.364+0000 7f8a14e43640 1 -- 10.20.193.57:0/1537731042 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a1005d0b0 con 0x7f8a10081ae0 2026-02-20T16:30:58.370 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.364+0000 7f8a15644640 1 --2- 10.20.193.57:0/1537731042 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f8a100811d0 0x7f8a10125d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:30:58.370 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.364+0000 7f8a14e43640 1 --2- 10.20.193.57:0/1537731042 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8a10081ae0 0x7f8a10126250 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8a040094b0 tx=0x7f8a0400ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:30:58.370 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.364+0000 7f89fdffb640 1 -- 10.20.193.57:0/1537731042 <== mon.2 v2:10.20.193.57:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a0400cd20 con 0x7f8a10081ae0 2026-02-20T16:30:58.370 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.364+0000 7f89fdffb640 1 -- 10.20.193.57:0/1537731042 <== mon.2 v2:10.20.193.57:3302/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a04004880 con 0x7f8a10081ae0 2026-02-20T16:30:58.370 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.364+0000 7f8a178cf640 1 -- 10.20.193.57:0/1537731042 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a1005da80 con 0x7f8a10081ae0 2026-02-20T16:30:58.370 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.364+0000 7f89fdffb640 1 -- 10.20.193.57:0/1537731042 <== mon.2 v2:10.20.193.57:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a04004cd0 con 0x7f8a10081ae0 2026-02-20T16:30:58.370 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.364+0000 7f8a178cf640 1 -- 10.20.193.57:0/1537731042 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a1010d560 con 0x7f8a10081ae0 2026-02-20T16:30:58.370 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.365+0000 7f89fdffb640 1 -- 10.20.193.57:0/1537731042 <== mon.2 v2:10.20.193.57:3302/0 4 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7f8a04004080 con 0x7f8a10081ae0 2026-02-20T16:30:58.370 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.365+0000 7f8a178cf640 1 -- 10.20.193.57:0/1537731042 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a100815a0 con 0x7f8a10081ae0 2026-02-20T16:30:58.370 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.365+0000 7f89fdffb640 1 -- 10.20.193.57:0/1537731042 <== mon.2 v2:10.20.193.57:3302/0 5 ==== osd_map(27..27 src has 1..27) ==== 3020+0+0 (secure 0 0 0) 0x7f8a040640f0 con 0x7f8a10081ae0 2026-02-20T16:30:58.371 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.367+0000 7f89fdffb640 1 -- 10.20.193.57:0/1537731042 <== mon.2 v2:10.20.193.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7f8a040631d0 con 0x7f8a10081ae0 2026-02-20T16:30:58.469 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.467+0000 7f8a178cf640 1 -- 10.20.193.57:0/1537731042 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f8a10119440 con 0x7f8a10081ae0 2026-02-20T16:30:58.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.468+0000 7f89fdffb640 1 -- 10.20.193.57:0/1537731042 <== mon.2 v2:10.20.193.57:3302/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+587 (secure 0 0 0) 0x7f8a040629c0 con 0x7f8a10081ae0 2026-02-20T16:30:58.470 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-20T16:30:58.470 INFO:teuthology.orchestra.run.trial057.stdout: "mon": { 2026-02-20T16:30:58.470 INFO:teuthology.orchestra.run.trial057.stdout: "ceph version 20.2.0-677-gf7870454 (f7870454149f22574086dd2ff55d050585136531) tentacle (stable - RelWithDebInfo)": 3 2026-02-20T16:30:58.470 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-20T16:30:58.470 INFO:teuthology.orchestra.run.trial057.stdout: "mgr": { 2026-02-20T16:30:58.471 INFO:teuthology.orchestra.run.trial057.stdout: "ceph version 20.2.0-677-gf7870454 (f7870454149f22574086dd2ff55d050585136531) tentacle (stable - RelWithDebInfo)": 2 2026-02-20T16:30:58.471 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-20T16:30:58.471 INFO:teuthology.orchestra.run.trial057.stdout: "osd": { 2026-02-20T16:30:58.471 INFO:teuthology.orchestra.run.trial057.stdout: "ceph version 20.2.0-677-gf7870454 (f7870454149f22574086dd2ff55d050585136531) tentacle (stable - RelWithDebInfo)": 4 2026-02-20T16:30:58.471 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-20T16:30:58.471 INFO:teuthology.orchestra.run.trial057.stdout: "overall": { 2026-02-20T16:30:58.471 INFO:teuthology.orchestra.run.trial057.stdout: "ceph version 20.2.0-677-gf7870454 (f7870454149f22574086dd2ff55d050585136531) tentacle (stable - RelWithDebInfo)": 9 2026-02-20T16:30:58.471 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-20T16:30:58.471 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-20T16:30:58.472 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.468+0000 7f8a178cf640 1 -- 10.20.193.57:0/1537731042 >> v1:10.20.193.57:6800/2007744879 conn(0x7f89e004cae0 legacy=0x7f89e006cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:58.472 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.468+0000 7f8a178cf640 1 -- 10.20.193.57:0/1537731042 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8a10081ae0 msgr2=0x7f8a10126250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:58.472 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.468+0000 7f8a178cf640 1 --2- 10.20.193.57:0/1537731042 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8a10081ae0 0x7f8a10126250 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8a040094b0 tx=0x7f8a0400ee60 comp rx=0 tx=0).stop 2026-02-20T16:30:58.472 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.468+0000 7f8a178cf640 1 -- 10.20.193.57:0/1537731042 shutdown_connections 2026-02-20T16:30:58.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.468+0000 7f8a178cf640 1 --2- 10.20.193.57:0/1537731042 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8a10136ad0 0x7f8a10126790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:58.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.468+0000 7f8a178cf640 1 --2- 10.20.193.57:0/1537731042 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8a10081ae0 0x7f8a10126250 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:58.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.468+0000 7f8a178cf640 1 --2- 10.20.193.57:0/1537731042 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f8a100811d0 0x7f8a10125d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:58.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.468+0000 7f8a178cf640 1 -- 10.20.193.57:0/1537731042 >> 10.20.193.57:0/1537731042 conn(0x7f8a10084730 msgr2=0x7f8a1007b250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:58.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.468+0000 7f8a178cf640 1 -- 10.20.193.57:0/1537731042 shutdown_connections 2026-02-20T16:30:58.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.468+0000 7f8a178cf640 1 -- 10.20.193.57:0/1537731042 wait complete. 2026-02-20T16:30:58.478 DEBUG:teuthology.orchestra.run.trial057:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd dump -f json-pretty' 2026-02-20T16:30:58.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.542+0000 7f8ac4b91640 1 -- 10.20.193.57:0/909973305 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8ac0082160 msgr2=0x7f8ac01945a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:58.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.542+0000 7f8ac4b91640 1 --2- 10.20.193.57:0/909973305 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8ac0082160 0x7f8ac01945a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8ab0009fd0 tx=0x7f8ab002f440 comp rx=0 tx=0).stop 2026-02-20T16:30:58.547 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.542+0000 7f8ac4b91640 1 -- 10.20.193.57:0/909973305 shutdown_connections 2026-02-20T16:30:58.547 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.542+0000 7f8ac4b91640 1 --2- 10.20.193.57:0/909973305 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8ac0082160 0x7f8ac01945a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:58.547 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.542+0000 7f8ac4b91640 1 --2- 10.20.193.57:0/909973305 >> v2:10.20.193.57:3300/0 conn(0x7f8ac0081810 0x7f8ac0081c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:58.547 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.542+0000 7f8ac4b91640 1 --2- 10.20.193.57:0/909973305 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8ac0080670 0x7f8ac00812d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:58.547 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.542+0000 7f8ac4b91640 1 -- 10.20.193.57:0/909973305 >> 10.20.193.57:0/909973305 conn(0x7f8ac0084730 msgr2=0x7f8ac0084b30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:58.547 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.542+0000 7f8ac4b91640 1 -- 10.20.193.57:0/909973305 shutdown_connections 2026-02-20T16:30:58.547 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.542+0000 7f8ac4b91640 1 -- 10.20.193.57:0/909973305 wait complete. 2026-02-20T16:30:58.547 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.542+0000 7f8ac4b91640 1 Processor -- start 2026-02-20T16:30:58.547 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.542+0000 7f8ac4b91640 1 -- start start 2026-02-20T16:30:58.547 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.543+0000 7f8ac4b91640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8ac0080670 0x7f8ac0078e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:58.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.543+0000 7f8ac4b91640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f8ac0081810 0x7f8ac0079350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:58.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.543+0000 7f8ac4b91640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8ac0082160 0x7f8ac01cba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:58.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.543+0000 7f8ac4b91640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac0195920 con 0x7f8ac0081810 2026-02-20T16:30:58.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.543+0000 7f8ac4b91640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f8ac01957a0 con 0x7f8ac0082160 2026-02-20T16:30:58.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.543+0000 7f8ac4b91640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f8ac0195aa0 con 0x7f8ac0080670 2026-02-20T16:30:58.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.543+0000 7f8abe575640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8ac0080670 0x7f8ac0078e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:58.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.543+0000 7f8abdd74640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f8ac0081810 0x7f8ac0079350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:58.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.543+0000 7f8abe575640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8ac0080670 0x7f8ac0078e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3302/0 says I am v2:10.20.193.57:47884/0 (socket says 10.20.193.57:47884) 2026-02-20T16:30:58.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.543+0000 7f8abe575640 1 -- 10.20.193.57:0/1674548280 learned_addr learned my addr 10.20.193.57:0/1674548280 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:30:58.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.543+0000 7f8abed76640 1 --2- 10.20.193.57:0/1674548280 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8ac0082160 0x7f8ac01cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:58.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.543+0000 7f8abe575640 1 -- 10.20.193.57:0/1674548280 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8ac0082160 msgr2=0x7f8ac01cba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:58.549 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.543+0000 7f8abe575640 1 --2- 10.20.193.57:0/1674548280 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8ac0082160 0x7f8ac01cba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:58.549 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.543+0000 7f8abe575640 1 -- 10.20.193.57:0/1674548280 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f8ac0081810 msgr2=0x7f8ac0079350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:58.549 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.543+0000 7f8abe575640 1 --2- 10.20.193.57:0/1674548280 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f8ac0081810 0x7f8ac0079350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:58.549 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.543+0000 7f8abe575640 1 -- 10.20.193.57:0/1674548280 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ac005dc40 con 0x7f8ac0080670 2026-02-20T16:30:58.549 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.543+0000 7f8abdd74640 1 --2- 10.20.193.57:0/1674548280 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f8ac0081810 0x7f8ac0079350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:30:58.549 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.543+0000 7f8abe575640 1 --2- 10.20.193.57:0/1674548280 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8ac0080670 0x7f8ac0078e10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8ab400e940 tx=0x7f8ab400ee10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:30:58.549 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.543+0000 7f8aa6ffd640 1 -- 10.20.193.57:0/1674548280 <== mon.2 v2:10.20.193.57:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab400ccc0 con 0x7f8ac0080670 2026-02-20T16:30:58.549 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.543+0000 7f8aa6ffd640 1 -- 10.20.193.57:0/1674548280 <== mon.2 v2:10.20.193.57:3302/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ab4004880 con 0x7f8ac0080670 2026-02-20T16:30:58.549 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.543+0000 7f8ac4b91640 1 -- 10.20.193.57:0/1674548280 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ac0059210 con 0x7f8ac0080670 2026-02-20T16:30:58.549 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.543+0000 7f8aa6ffd640 1 -- 10.20.193.57:0/1674548280 <== mon.2 v2:10.20.193.57:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4004cd0 con 0x7f8ac0080670 2026-02-20T16:30:58.549 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.543+0000 7f8ac4b91640 1 -- 10.20.193.57:0/1674548280 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ac0058990 con 0x7f8ac0080670 2026-02-20T16:30:58.550 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.543+0000 7f8ac4b91640 1 -- 10.20.193.57:0/1674548280 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ac00812d0 con 0x7f8ac0080670 2026-02-20T16:30:58.550 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.544+0000 7f8aa6ffd640 1 -- 10.20.193.57:0/1674548280 <== mon.2 v2:10.20.193.57:3302/0 4 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7f8ab4004e70 con 0x7f8ac0080670 2026-02-20T16:30:58.550 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.544+0000 7f8aa6ffd640 1 -- 10.20.193.57:0/1674548280 <== mon.2 v2:10.20.193.57:3302/0 5 ==== osd_map(27..27 src has 1..27) ==== 3020+0+0 (secure 0 0 0) 0x7f8ab4064150 con 0x7f8ac0080670 2026-02-20T16:30:58.550 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.545+0000 7f8aa6ffd640 1 -- 10.20.193.57:0/1674548280 <== mon.2 v2:10.20.193.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7f8ab4063230 con 0x7f8ac0080670 2026-02-20T16:30:58.621 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.620+0000 7f8ac4b91640 1 -- 10.20.193.57:0/1674548280 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f8ac0056b00 con 0x7f8ac0080670 2026-02-20T16:30:58.622 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.620+0000 7f8aa6ffd640 1 -- 10.20.193.57:0/1674548280 <== mon.2 v2:10.20.193.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v27) ==== 81+0+16894 (secure 0 0 0) 0x7f8ab40626a0 con 0x7f8ac0080670 2026-02-20T16:30:58.622 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:30:58.622 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-20T16:30:58.622 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 27, 2026-02-20T16:30:58.623 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "3b3c5c1a-0a2b-40b9-ac1d-921ada466f9e", 2026-02-20T16:30:58.623 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-20T16:29:22.501479+0000", 2026-02-20T16:30:58.623 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-20T16:30:57.950959+0000", 2026-02-20T16:30:58.623 INFO:teuthology.orchestra.run.trial057.stdout: "last_up_change": "2026-02-20T16:30:56.950147+0000", 2026-02-20T16:30:58.623 INFO:teuthology.orchestra.run.trial057.stdout: "last_in_change": "2026-02-20T16:29:24.294147+0000", 2026-02-20T16:30:58.623 INFO:teuthology.orchestra.run.trial057.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-20T16:30:58.623 INFO:teuthology.orchestra.run.trial057.stdout: "flags_num": 5799936, 2026-02-20T16:30:58.623 INFO:teuthology.orchestra.run.trial057.stdout: "flags_set": [ 2026-02-20T16:30:58.623 INFO:teuthology.orchestra.run.trial057.stdout: "pglog_hardlimit", 2026-02-20T16:30:58.623 INFO:teuthology.orchestra.run.trial057.stdout: "purged_snapdirs", 2026-02-20T16:30:58.623 INFO:teuthology.orchestra.run.trial057.stdout: "recovery_deletes", 2026-02-20T16:30:58.624 INFO:teuthology.orchestra.run.trial057.stdout: "sortbitwise" 2026-02-20T16:30:58.624 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-20T16:30:58.624 INFO:teuthology.orchestra.run.trial057.stdout: "crush_version": 9, 2026-02-20T16:30:58.624 INFO:teuthology.orchestra.run.trial057.stdout: "full_ratio": 0.94999998807907104, 2026-02-20T16:30:58.624 INFO:teuthology.orchestra.run.trial057.stdout: "backfillfull_ratio": 0.89999997615814209, 2026-02-20T16:30:58.624 INFO:teuthology.orchestra.run.trial057.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-20T16:30:58.624 INFO:teuthology.orchestra.run.trial057.stdout: "cluster_snapshot": "", 2026-02-20T16:30:58.624 INFO:teuthology.orchestra.run.trial057.stdout: "pool_max": 2, 2026-02-20T16:30:58.624 INFO:teuthology.orchestra.run.trial057.stdout: "max_osd": 4, 2026-02-20T16:30:58.624 INFO:teuthology.orchestra.run.trial057.stdout: "require_min_compat_client": "squid", 2026-02-20T16:30:58.624 INFO:teuthology.orchestra.run.trial057.stdout: "min_compat_client": "jewel", 2026-02-20T16:30:58.624 INFO:teuthology.orchestra.run.trial057.stdout: "require_osd_release": "squid", 2026-02-20T16:30:58.624 INFO:teuthology.orchestra.run.trial057.stdout: "allow_crimson": false, 2026-02-20T16:30:58.625 INFO:teuthology.orchestra.run.trial057.stdout: "pools": [ 2026-02-20T16:30:58.625 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-20T16:30:58.625 INFO:teuthology.orchestra.run.trial057.stdout: "pool": 1, 2026-02-20T16:30:58.625 INFO:teuthology.orchestra.run.trial057.stdout: "pool_name": ".mgr", 2026-02-20T16:30:58.625 INFO:teuthology.orchestra.run.trial057.stdout: "create_time": "2026-02-20T16:29:34.029059+0000", 2026-02-20T16:30:58.625 INFO:teuthology.orchestra.run.trial057.stdout: "flags": 1, 2026-02-20T16:30:58.625 INFO:teuthology.orchestra.run.trial057.stdout: "flags_names": "hashpspool", 2026-02-20T16:30:58.625 INFO:teuthology.orchestra.run.trial057.stdout: "type": 1, 2026-02-20T16:30:58.625 INFO:teuthology.orchestra.run.trial057.stdout: "size": 2, 2026-02-20T16:30:58.625 INFO:teuthology.orchestra.run.trial057.stdout: "min_size": 1, 2026-02-20T16:30:58.625 INFO:teuthology.orchestra.run.trial057.stdout: "crush_rule": 0, 2026-02-20T16:30:58.626 INFO:teuthology.orchestra.run.trial057.stdout: "peering_crush_bucket_count": 0, 2026-02-20T16:30:58.626 INFO:teuthology.orchestra.run.trial057.stdout: "peering_crush_bucket_target": 0, 2026-02-20T16:30:58.626 INFO:teuthology.orchestra.run.trial057.stdout: "peering_crush_bucket_barrier": 0, 2026-02-20T16:30:58.626 INFO:teuthology.orchestra.run.trial057.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-20T16:30:58.626 INFO:teuthology.orchestra.run.trial057.stdout: "is_stretch_pool": false, 2026-02-20T16:30:58.626 INFO:teuthology.orchestra.run.trial057.stdout: "object_hash": 2, 2026-02-20T16:30:58.626 INFO:teuthology.orchestra.run.trial057.stdout: "pg_autoscale_mode": "off", 2026-02-20T16:30:58.626 INFO:teuthology.orchestra.run.trial057.stdout: "pg_num": 1, 2026-02-20T16:30:58.626 INFO:teuthology.orchestra.run.trial057.stdout: "pg_placement_num": 1, 2026-02-20T16:30:58.626 INFO:teuthology.orchestra.run.trial057.stdout: "pg_placement_num_target": 1, 2026-02-20T16:30:58.626 INFO:teuthology.orchestra.run.trial057.stdout: "pg_num_target": 1, 2026-02-20T16:30:58.626 INFO:teuthology.orchestra.run.trial057.stdout: "pg_num_pending": 1, 2026-02-20T16:30:58.627 INFO:teuthology.orchestra.run.trial057.stdout: "last_pg_merge_meta": { 2026-02-20T16:30:58.627 INFO:teuthology.orchestra.run.trial057.stdout: "source_pgid": "0.0", 2026-02-20T16:30:58.627 INFO:teuthology.orchestra.run.trial057.stdout: "ready_epoch": 0, 2026-02-20T16:30:58.627 INFO:teuthology.orchestra.run.trial057.stdout: "last_epoch_started": 0, 2026-02-20T16:30:58.627 INFO:teuthology.orchestra.run.trial057.stdout: "last_epoch_clean": 0, 2026-02-20T16:30:58.627 INFO:teuthology.orchestra.run.trial057.stdout: "source_version": "0'0", 2026-02-20T16:30:58.627 INFO:teuthology.orchestra.run.trial057.stdout: "target_version": "0'0" 2026-02-20T16:30:58.627 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-20T16:30:58.627 INFO:teuthology.orchestra.run.trial057.stdout: "last_change": "13", 2026-02-20T16:30:58.627 INFO:teuthology.orchestra.run.trial057.stdout: "last_force_op_resend": "0", 2026-02-20T16:30:58.627 INFO:teuthology.orchestra.run.trial057.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-20T16:30:58.627 INFO:teuthology.orchestra.run.trial057.stdout: "last_force_op_resend_preluminous": "0", 2026-02-20T16:30:58.627 INFO:teuthology.orchestra.run.trial057.stdout: "auid": 0, 2026-02-20T16:30:58.628 INFO:teuthology.orchestra.run.trial057.stdout: "snap_mode": "selfmanaged", 2026-02-20T16:30:58.628 INFO:teuthology.orchestra.run.trial057.stdout: "snap_seq": 0, 2026-02-20T16:30:58.628 INFO:teuthology.orchestra.run.trial057.stdout: "snap_epoch": 0, 2026-02-20T16:30:58.628 INFO:teuthology.orchestra.run.trial057.stdout: "pool_snaps": [], 2026-02-20T16:30:58.628 INFO:teuthology.orchestra.run.trial057.stdout: "removed_snaps": "[]", 2026-02-20T16:30:58.628 INFO:teuthology.orchestra.run.trial057.stdout: "quota_max_bytes": 0, 2026-02-20T16:30:58.628 INFO:teuthology.orchestra.run.trial057.stdout: "quota_max_objects": 0, 2026-02-20T16:30:58.628 INFO:teuthology.orchestra.run.trial057.stdout: "tiers": [], 2026-02-20T16:30:58.628 INFO:teuthology.orchestra.run.trial057.stdout: "tier_of": -1, 2026-02-20T16:30:58.628 INFO:teuthology.orchestra.run.trial057.stdout: "read_tier": -1, 2026-02-20T16:30:58.628 INFO:teuthology.orchestra.run.trial057.stdout: "write_tier": -1, 2026-02-20T16:30:58.628 INFO:teuthology.orchestra.run.trial057.stdout: "cache_mode": "none", 2026-02-20T16:30:58.629 INFO:teuthology.orchestra.run.trial057.stdout: "target_max_bytes": 0, 2026-02-20T16:30:58.629 INFO:teuthology.orchestra.run.trial057.stdout: "target_max_objects": 0, 2026-02-20T16:30:58.629 INFO:teuthology.orchestra.run.trial057.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-20T16:30:58.629 INFO:teuthology.orchestra.run.trial057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-20T16:30:58.629 INFO:teuthology.orchestra.run.trial057.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-20T16:30:58.629 INFO:teuthology.orchestra.run.trial057.stdout: "cache_min_flush_age": 0, 2026-02-20T16:30:58.629 INFO:teuthology.orchestra.run.trial057.stdout: "cache_min_evict_age": 0, 2026-02-20T16:30:58.629 INFO:teuthology.orchestra.run.trial057.stdout: "erasure_code_profile": "", 2026-02-20T16:30:58.629 INFO:teuthology.orchestra.run.trial057.stdout: "hit_set_params": { 2026-02-20T16:30:58.629 INFO:teuthology.orchestra.run.trial057.stdout: "type": "none" 2026-02-20T16:30:58.629 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-20T16:30:58.629 INFO:teuthology.orchestra.run.trial057.stdout: "hit_set_period": 0, 2026-02-20T16:30:58.629 INFO:teuthology.orchestra.run.trial057.stdout: "hit_set_count": 0, 2026-02-20T16:30:58.630 INFO:teuthology.orchestra.run.trial057.stdout: "use_gmt_hitset": true, 2026-02-20T16:30:58.630 INFO:teuthology.orchestra.run.trial057.stdout: "min_read_recency_for_promote": 0, 2026-02-20T16:30:58.630 INFO:teuthology.orchestra.run.trial057.stdout: "min_write_recency_for_promote": 0, 2026-02-20T16:30:58.630 INFO:teuthology.orchestra.run.trial057.stdout: "hit_set_grade_decay_rate": 0, 2026-02-20T16:30:58.630 INFO:teuthology.orchestra.run.trial057.stdout: "hit_set_search_last_n": 0, 2026-02-20T16:30:58.630 INFO:teuthology.orchestra.run.trial057.stdout: "grade_table": [], 2026-02-20T16:30:58.630 INFO:teuthology.orchestra.run.trial057.stdout: "stripe_width": 0, 2026-02-20T16:30:58.630 INFO:teuthology.orchestra.run.trial057.stdout: "expected_num_objects": 0, 2026-02-20T16:30:58.630 INFO:teuthology.orchestra.run.trial057.stdout: "fast_read": false, 2026-02-20T16:30:58.630 INFO:teuthology.orchestra.run.trial057.stdout: "nonprimary_shards": "{}", 2026-02-20T16:30:58.630 INFO:teuthology.orchestra.run.trial057.stdout: "options": { 2026-02-20T16:30:58.630 INFO:teuthology.orchestra.run.trial057.stdout: "pg_num_max": 32, 2026-02-20T16:30:58.631 INFO:teuthology.orchestra.run.trial057.stdout: "pg_num_min": 1 2026-02-20T16:30:58.631 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-20T16:30:58.631 INFO:teuthology.orchestra.run.trial057.stdout: "application_metadata": { 2026-02-20T16:30:58.631 INFO:teuthology.orchestra.run.trial057.stdout: "mgr": {} 2026-02-20T16:30:58.631 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-20T16:30:58.631 INFO:teuthology.orchestra.run.trial057.stdout: "read_balance": { 2026-02-20T16:30:58.631 INFO:teuthology.orchestra.run.trial057.stdout: "score_type": "Fair distribution", 2026-02-20T16:30:58.631 INFO:teuthology.orchestra.run.trial057.stdout: "score_acting": 4, 2026-02-20T16:30:58.631 INFO:teuthology.orchestra.run.trial057.stdout: "score_stable": 4, 2026-02-20T16:30:58.631 INFO:teuthology.orchestra.run.trial057.stdout: "optimal_score": 0.5, 2026-02-20T16:30:58.631 INFO:teuthology.orchestra.run.trial057.stdout: "raw_score_acting": 2, 2026-02-20T16:30:58.631 INFO:teuthology.orchestra.run.trial057.stdout: "raw_score_stable": 2, 2026-02-20T16:30:58.631 INFO:teuthology.orchestra.run.trial057.stdout: "primary_affinity_weighted": 1, 2026-02-20T16:30:58.632 INFO:teuthology.orchestra.run.trial057.stdout: "average_primary_affinity": 1, 2026-02-20T16:30:58.632 INFO:teuthology.orchestra.run.trial057.stdout: "average_primary_affinity_weighted": 1 2026-02-20T16:30:58.632 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-20T16:30:58.632 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-20T16:30:58.632 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-20T16:30:58.632 INFO:teuthology.orchestra.run.trial057.stdout: "pool": 2, 2026-02-20T16:30:58.632 INFO:teuthology.orchestra.run.trial057.stdout: "pool_name": "rbd", 2026-02-20T16:30:58.632 INFO:teuthology.orchestra.run.trial057.stdout: "create_time": "2026-02-20T16:29:38.191724+0000", 2026-02-20T16:30:58.632 INFO:teuthology.orchestra.run.trial057.stdout: "flags": 8193, 2026-02-20T16:30:58.632 INFO:teuthology.orchestra.run.trial057.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2026-02-20T16:30:58.633 INFO:teuthology.orchestra.run.trial057.stdout: "type": 1, 2026-02-20T16:30:58.633 INFO:teuthology.orchestra.run.trial057.stdout: "size": 2, 2026-02-20T16:30:58.633 INFO:teuthology.orchestra.run.trial057.stdout: "min_size": 1, 2026-02-20T16:30:58.633 INFO:teuthology.orchestra.run.trial057.stdout: "crush_rule": 0, 2026-02-20T16:30:58.633 INFO:teuthology.orchestra.run.trial057.stdout: "peering_crush_bucket_count": 0, 2026-02-20T16:30:58.633 INFO:teuthology.orchestra.run.trial057.stdout: "peering_crush_bucket_target": 0, 2026-02-20T16:30:58.633 INFO:teuthology.orchestra.run.trial057.stdout: "peering_crush_bucket_barrier": 0, 2026-02-20T16:30:58.633 INFO:teuthology.orchestra.run.trial057.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-20T16:30:58.633 INFO:teuthology.orchestra.run.trial057.stdout: "is_stretch_pool": false, 2026-02-20T16:30:58.633 INFO:teuthology.orchestra.run.trial057.stdout: "object_hash": 2, 2026-02-20T16:30:58.633 INFO:teuthology.orchestra.run.trial057.stdout: "pg_autoscale_mode": "off", 2026-02-20T16:30:58.633 INFO:teuthology.orchestra.run.trial057.stdout: "pg_num": 8, 2026-02-20T16:30:58.634 INFO:teuthology.orchestra.run.trial057.stdout: "pg_placement_num": 8, 2026-02-20T16:30:58.634 INFO:teuthology.orchestra.run.trial057.stdout: "pg_placement_num_target": 8, 2026-02-20T16:30:58.634 INFO:teuthology.orchestra.run.trial057.stdout: "pg_num_target": 8, 2026-02-20T16:30:58.634 INFO:teuthology.orchestra.run.trial057.stdout: "pg_num_pending": 8, 2026-02-20T16:30:58.634 INFO:teuthology.orchestra.run.trial057.stdout: "last_pg_merge_meta": { 2026-02-20T16:30:58.634 INFO:teuthology.orchestra.run.trial057.stdout: "source_pgid": "0.0", 2026-02-20T16:30:58.634 INFO:teuthology.orchestra.run.trial057.stdout: "ready_epoch": 0, 2026-02-20T16:30:58.634 INFO:teuthology.orchestra.run.trial057.stdout: "last_epoch_started": 0, 2026-02-20T16:30:58.634 INFO:teuthology.orchestra.run.trial057.stdout: "last_epoch_clean": 0, 2026-02-20T16:30:58.634 INFO:teuthology.orchestra.run.trial057.stdout: "source_version": "0'0", 2026-02-20T16:30:58.634 INFO:teuthology.orchestra.run.trial057.stdout: "target_version": "0'0" 2026-02-20T16:30:58.634 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-20T16:30:58.635 INFO:teuthology.orchestra.run.trial057.stdout: "last_change": "17", 2026-02-20T16:30:58.635 INFO:teuthology.orchestra.run.trial057.stdout: "last_force_op_resend": "0", 2026-02-20T16:30:58.635 INFO:teuthology.orchestra.run.trial057.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-20T16:30:58.635 INFO:teuthology.orchestra.run.trial057.stdout: "last_force_op_resend_preluminous": "0", 2026-02-20T16:30:58.635 INFO:teuthology.orchestra.run.trial057.stdout: "auid": 0, 2026-02-20T16:30:58.635 INFO:teuthology.orchestra.run.trial057.stdout: "snap_mode": "selfmanaged", 2026-02-20T16:30:58.635 INFO:teuthology.orchestra.run.trial057.stdout: "snap_seq": 2, 2026-02-20T16:30:58.635 INFO:teuthology.orchestra.run.trial057.stdout: "snap_epoch": 17, 2026-02-20T16:30:58.635 INFO:teuthology.orchestra.run.trial057.stdout: "pool_snaps": [], 2026-02-20T16:30:58.635 INFO:teuthology.orchestra.run.trial057.stdout: "removed_snaps": "[]", 2026-02-20T16:30:58.635 INFO:teuthology.orchestra.run.trial057.stdout: "quota_max_bytes": 0, 2026-02-20T16:30:58.635 INFO:teuthology.orchestra.run.trial057.stdout: "quota_max_objects": 0, 2026-02-20T16:30:58.635 INFO:teuthology.orchestra.run.trial057.stdout: "tiers": [], 2026-02-20T16:30:58.636 INFO:teuthology.orchestra.run.trial057.stdout: "tier_of": -1, 2026-02-20T16:30:58.636 INFO:teuthology.orchestra.run.trial057.stdout: "read_tier": -1, 2026-02-20T16:30:58.636 INFO:teuthology.orchestra.run.trial057.stdout: "write_tier": -1, 2026-02-20T16:30:58.636 INFO:teuthology.orchestra.run.trial057.stdout: "cache_mode": "none", 2026-02-20T16:30:58.636 INFO:teuthology.orchestra.run.trial057.stdout: "target_max_bytes": 0, 2026-02-20T16:30:58.636 INFO:teuthology.orchestra.run.trial057.stdout: "target_max_objects": 0, 2026-02-20T16:30:58.636 INFO:teuthology.orchestra.run.trial057.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-20T16:30:58.636 INFO:teuthology.orchestra.run.trial057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-20T16:30:58.636 INFO:teuthology.orchestra.run.trial057.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-20T16:30:58.636 INFO:teuthology.orchestra.run.trial057.stdout: "cache_min_flush_age": 0, 2026-02-20T16:30:58.636 INFO:teuthology.orchestra.run.trial057.stdout: "cache_min_evict_age": 0, 2026-02-20T16:30:58.636 INFO:teuthology.orchestra.run.trial057.stdout: "erasure_code_profile": "", 2026-02-20T16:30:58.636 INFO:teuthology.orchestra.run.trial057.stdout: "hit_set_params": { 2026-02-20T16:30:58.637 INFO:teuthology.orchestra.run.trial057.stdout: "type": "none" 2026-02-20T16:30:58.637 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-20T16:30:58.637 INFO:teuthology.orchestra.run.trial057.stdout: "hit_set_period": 0, 2026-02-20T16:30:58.637 INFO:teuthology.orchestra.run.trial057.stdout: "hit_set_count": 0, 2026-02-20T16:30:58.637 INFO:teuthology.orchestra.run.trial057.stdout: "use_gmt_hitset": true, 2026-02-20T16:30:58.637 INFO:teuthology.orchestra.run.trial057.stdout: "min_read_recency_for_promote": 0, 2026-02-20T16:30:58.637 INFO:teuthology.orchestra.run.trial057.stdout: "min_write_recency_for_promote": 0, 2026-02-20T16:30:58.637 INFO:teuthology.orchestra.run.trial057.stdout: "hit_set_grade_decay_rate": 0, 2026-02-20T16:30:58.637 INFO:teuthology.orchestra.run.trial057.stdout: "hit_set_search_last_n": 0, 2026-02-20T16:30:58.637 INFO:teuthology.orchestra.run.trial057.stdout: "grade_table": [], 2026-02-20T16:30:58.637 INFO:teuthology.orchestra.run.trial057.stdout: "stripe_width": 0, 2026-02-20T16:30:58.637 INFO:teuthology.orchestra.run.trial057.stdout: "expected_num_objects": 0, 2026-02-20T16:30:58.638 INFO:teuthology.orchestra.run.trial057.stdout: "fast_read": false, 2026-02-20T16:30:58.638 INFO:teuthology.orchestra.run.trial057.stdout: "nonprimary_shards": "{}", 2026-02-20T16:30:58.638 INFO:teuthology.orchestra.run.trial057.stdout: "options": {}, 2026-02-20T16:30:58.638 INFO:teuthology.orchestra.run.trial057.stdout: "application_metadata": { 2026-02-20T16:30:58.638 INFO:teuthology.orchestra.run.trial057.stdout: "rbd": {} 2026-02-20T16:30:58.638 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-20T16:30:58.638 INFO:teuthology.orchestra.run.trial057.stdout: "read_balance": { 2026-02-20T16:30:58.638 INFO:teuthology.orchestra.run.trial057.stdout: "score_type": "Fair distribution", 2026-02-20T16:30:58.638 INFO:teuthology.orchestra.run.trial057.stdout: "score_acting": 2.5, 2026-02-20T16:30:58.638 INFO:teuthology.orchestra.run.trial057.stdout: "score_stable": 2.5, 2026-02-20T16:30:58.638 INFO:teuthology.orchestra.run.trial057.stdout: "optimal_score": 1, 2026-02-20T16:30:58.638 INFO:teuthology.orchestra.run.trial057.stdout: "raw_score_acting": 2.5, 2026-02-20T16:30:58.639 INFO:teuthology.orchestra.run.trial057.stdout: "raw_score_stable": 2.5, 2026-02-20T16:30:58.639 INFO:teuthology.orchestra.run.trial057.stdout: "primary_affinity_weighted": 1, 2026-02-20T16:30:58.639 INFO:teuthology.orchestra.run.trial057.stdout: "average_primary_affinity": 1, 2026-02-20T16:30:58.639 INFO:teuthology.orchestra.run.trial057.stdout: "average_primary_affinity_weighted": 1 2026-02-20T16:30:58.639 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-20T16:30:58.639 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-20T16:30:58.639 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-20T16:30:58.639 INFO:teuthology.orchestra.run.trial057.stdout: "osds": [ 2026-02-20T16:30:58.639 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-20T16:30:58.639 INFO:teuthology.orchestra.run.trial057.stdout: "osd": 0, 2026-02-20T16:30:58.639 INFO:teuthology.orchestra.run.trial057.stdout: "uuid": "a3139827-dc3c-46f9-b211-d376e3dc92f9", 2026-02-20T16:30:58.639 INFO:teuthology.orchestra.run.trial057.stdout: "up": 1, 2026-02-20T16:30:58.640 INFO:teuthology.orchestra.run.trial057.stdout: "in": 1, 2026-02-20T16:30:58.640 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 1, 2026-02-20T16:30:58.640 INFO:teuthology.orchestra.run.trial057.stdout: "primary_affinity": 1, 2026-02-20T16:30:58.640 INFO:teuthology.orchestra.run.trial057.stdout: "last_clean_begin": 9, 2026-02-20T16:30:58.640 INFO:teuthology.orchestra.run.trial057.stdout: "last_clean_end": 20, 2026-02-20T16:30:58.640 INFO:teuthology.orchestra.run.trial057.stdout: "up_from": 23, 2026-02-20T16:30:58.640 INFO:teuthology.orchestra.run.trial057.stdout: "up_thru": 24, 2026-02-20T16:30:58.640 INFO:teuthology.orchestra.run.trial057.stdout: "down_at": 21, 2026-02-20T16:30:58.640 INFO:teuthology.orchestra.run.trial057.stdout: "lost_at": 0, 2026-02-20T16:30:58.640 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-20T16:30:58.640 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-20T16:30:58.640 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-20T16:30:58.640 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-20T16:30:58.641 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6801", 2026-02-20T16:30:58.641 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 4246367706 2026-02-20T16:30:58.641 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-20T16:30:58.641 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-20T16:30:58.641 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-20T16:30:58.641 INFO:teuthology.orchestra.run.trial057.stdout: "cluster_addrs": { 2026-02-20T16:30:58.641 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-20T16:30:58.641 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-20T16:30:58.641 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-20T16:30:58.641 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6802", 2026-02-20T16:30:58.641 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 4246367706 2026-02-20T16:30:58.641 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-20T16:30:58.641 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-20T16:30:58.642 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-20T16:30:58.642 INFO:teuthology.orchestra.run.trial057.stdout: "heartbeat_back_addrs": { 2026-02-20T16:30:58.642 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-20T16:30:58.642 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-20T16:30:58.642 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-20T16:30:58.642 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6804", 2026-02-20T16:30:58.642 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 4246367706 2026-02-20T16:30:58.642 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-20T16:30:58.642 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-20T16:30:58.642 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-20T16:30:58.642 INFO:teuthology.orchestra.run.trial057.stdout: "heartbeat_front_addrs": { 2026-02-20T16:30:58.642 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-20T16:30:58.643 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-20T16:30:58.643 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-20T16:30:58.643 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6803", 2026-02-20T16:30:58.643 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 4246367706 2026-02-20T16:30:58.643 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-20T16:30:58.643 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-20T16:30:58.643 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-20T16:30:58.643 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6801/4246367706", 2026-02-20T16:30:58.643 INFO:teuthology.orchestra.run.trial057.stdout: "cluster_addr": "10.20.193.57:6802/4246367706", 2026-02-20T16:30:58.643 INFO:teuthology.orchestra.run.trial057.stdout: "heartbeat_back_addr": "10.20.193.57:6804/4246367706", 2026-02-20T16:30:58.643 INFO:teuthology.orchestra.run.trial057.stdout: "heartbeat_front_addr": "10.20.193.57:6803/4246367706", 2026-02-20T16:30:58.643 INFO:teuthology.orchestra.run.trial057.stdout: "state": [ 2026-02-20T16:30:58.644 INFO:teuthology.orchestra.run.trial057.stdout: "exists", 2026-02-20T16:30:58.644 INFO:teuthology.orchestra.run.trial057.stdout: "up" 2026-02-20T16:30:58.644 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-20T16:30:58.644 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-20T16:30:58.644 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-20T16:30:58.644 INFO:teuthology.orchestra.run.trial057.stdout: "osd": 1, 2026-02-20T16:30:58.644 INFO:teuthology.orchestra.run.trial057.stdout: "uuid": "00e7cb17-534c-4ac2-8486-585b3b8db0c3", 2026-02-20T16:30:58.644 INFO:teuthology.orchestra.run.trial057.stdout: "up": 1, 2026-02-20T16:30:58.644 INFO:teuthology.orchestra.run.trial057.stdout: "in": 1, 2026-02-20T16:30:58.644 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 1, 2026-02-20T16:30:58.644 INFO:teuthology.orchestra.run.trial057.stdout: "primary_affinity": 1, 2026-02-20T16:30:58.644 INFO:teuthology.orchestra.run.trial057.stdout: "last_clean_begin": 10, 2026-02-20T16:30:58.645 INFO:teuthology.orchestra.run.trial057.stdout: "last_clean_end": 21, 2026-02-20T16:30:58.645 INFO:teuthology.orchestra.run.trial057.stdout: "up_from": 24, 2026-02-20T16:30:58.645 INFO:teuthology.orchestra.run.trial057.stdout: "up_thru": 24, 2026-02-20T16:30:58.645 INFO:teuthology.orchestra.run.trial057.stdout: "down_at": 22, 2026-02-20T16:30:58.645 INFO:teuthology.orchestra.run.trial057.stdout: "lost_at": 0, 2026-02-20T16:30:58.645 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-20T16:30:58.645 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-20T16:30:58.645 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-20T16:30:58.645 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-20T16:30:58.645 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6805", 2026-02-20T16:30:58.645 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 3794545817 2026-02-20T16:30:58.645 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-20T16:30:58.646 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-20T16:30:58.646 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-20T16:30:58.646 INFO:teuthology.orchestra.run.trial057.stdout: "cluster_addrs": { 2026-02-20T16:30:58.646 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-20T16:30:58.646 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-20T16:30:58.646 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-20T16:30:58.646 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6806", 2026-02-20T16:30:58.646 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 3794545817 2026-02-20T16:30:58.646 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-20T16:30:58.646 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-20T16:30:58.646 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-20T16:30:58.646 INFO:teuthology.orchestra.run.trial057.stdout: "heartbeat_back_addrs": { 2026-02-20T16:30:58.647 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-20T16:30:58.647 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-20T16:30:58.647 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-20T16:30:58.647 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6808", 2026-02-20T16:30:58.647 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 3794545817 2026-02-20T16:30:58.647 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-20T16:30:58.647 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-20T16:30:58.647 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-20T16:30:58.647 INFO:teuthology.orchestra.run.trial057.stdout: "heartbeat_front_addrs": { 2026-02-20T16:30:58.647 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-20T16:30:58.647 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-20T16:30:58.647 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-20T16:30:58.647 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6807", 2026-02-20T16:30:58.648 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 3794545817 2026-02-20T16:30:58.648 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-20T16:30:58.648 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-20T16:30:58.648 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-20T16:30:58.648 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6805/3794545817", 2026-02-20T16:30:58.648 INFO:teuthology.orchestra.run.trial057.stdout: "cluster_addr": "10.20.193.57:6806/3794545817", 2026-02-20T16:30:58.648 INFO:teuthology.orchestra.run.trial057.stdout: "heartbeat_back_addr": "10.20.193.57:6808/3794545817", 2026-02-20T16:30:58.648 INFO:teuthology.orchestra.run.trial057.stdout: "heartbeat_front_addr": "10.20.193.57:6807/3794545817", 2026-02-20T16:30:58.648 INFO:teuthology.orchestra.run.trial057.stdout: "state": [ 2026-02-20T16:30:58.648 INFO:teuthology.orchestra.run.trial057.stdout: "exists", 2026-02-20T16:30:58.648 INFO:teuthology.orchestra.run.trial057.stdout: "up" 2026-02-20T16:30:58.648 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-20T16:30:58.648 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-20T16:30:58.649 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-20T16:30:58.649 INFO:teuthology.orchestra.run.trial057.stdout: "osd": 2, 2026-02-20T16:30:58.649 INFO:teuthology.orchestra.run.trial057.stdout: "uuid": "d0b55b31-45df-4c58-bf11-a72d44f21a00", 2026-02-20T16:30:58.649 INFO:teuthology.orchestra.run.trial057.stdout: "up": 1, 2026-02-20T16:30:58.649 INFO:teuthology.orchestra.run.trial057.stdout: "in": 1, 2026-02-20T16:30:58.649 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 1, 2026-02-20T16:30:58.649 INFO:teuthology.orchestra.run.trial057.stdout: "primary_affinity": 1, 2026-02-20T16:30:58.649 INFO:teuthology.orchestra.run.trial057.stdout: "last_clean_begin": 10, 2026-02-20T16:30:58.649 INFO:teuthology.orchestra.run.trial057.stdout: "last_clean_end": 22, 2026-02-20T16:30:58.649 INFO:teuthology.orchestra.run.trial057.stdout: "up_from": 25, 2026-02-20T16:30:58.649 INFO:teuthology.orchestra.run.trial057.stdout: "up_thru": 26, 2026-02-20T16:30:58.649 INFO:teuthology.orchestra.run.trial057.stdout: "down_at": 23, 2026-02-20T16:30:58.650 INFO:teuthology.orchestra.run.trial057.stdout: "lost_at": 0, 2026-02-20T16:30:58.650 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-20T16:30:58.650 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-20T16:30:58.650 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-20T16:30:58.650 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-20T16:30:58.650 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6809", 2026-02-20T16:30:58.650 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 3959776128 2026-02-20T16:30:58.650 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-20T16:30:58.650 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-20T16:30:58.650 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-20T16:30:58.651 INFO:teuthology.orchestra.run.trial057.stdout: "cluster_addrs": { 2026-02-20T16:30:58.651 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-20T16:30:58.651 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-20T16:30:58.651 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-20T16:30:58.651 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6810", 2026-02-20T16:30:58.651 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 3959776128 2026-02-20T16:30:58.651 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-20T16:30:58.651 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-20T16:30:58.651 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-20T16:30:58.651 INFO:teuthology.orchestra.run.trial057.stdout: "heartbeat_back_addrs": { 2026-02-20T16:30:58.651 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-20T16:30:58.651 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-20T16:30:58.652 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-20T16:30:58.652 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6812", 2026-02-20T16:30:58.652 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 3959776128 2026-02-20T16:30:58.652 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-20T16:30:58.652 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-20T16:30:58.652 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-20T16:30:58.652 INFO:teuthology.orchestra.run.trial057.stdout: "heartbeat_front_addrs": { 2026-02-20T16:30:58.652 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-20T16:30:58.652 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-20T16:30:58.652 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-20T16:30:58.652 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6811", 2026-02-20T16:30:58.653 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 3959776128 2026-02-20T16:30:58.653 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-20T16:30:58.653 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-20T16:30:58.653 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-20T16:30:58.653 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6809/3959776128", 2026-02-20T16:30:58.653 INFO:teuthology.orchestra.run.trial057.stdout: "cluster_addr": "10.20.193.57:6810/3959776128", 2026-02-20T16:30:58.653 INFO:teuthology.orchestra.run.trial057.stdout: "heartbeat_back_addr": "10.20.193.57:6812/3959776128", 2026-02-20T16:30:58.653 INFO:teuthology.orchestra.run.trial057.stdout: "heartbeat_front_addr": "10.20.193.57:6811/3959776128", 2026-02-20T16:30:58.653 INFO:teuthology.orchestra.run.trial057.stdout: "state": [ 2026-02-20T16:30:58.653 INFO:teuthology.orchestra.run.trial057.stdout: "exists", 2026-02-20T16:30:58.653 INFO:teuthology.orchestra.run.trial057.stdout: "up" 2026-02-20T16:30:58.653 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-20T16:30:58.654 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-20T16:30:58.654 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-20T16:30:58.654 INFO:teuthology.orchestra.run.trial057.stdout: "osd": 3, 2026-02-20T16:30:58.654 INFO:teuthology.orchestra.run.trial057.stdout: "uuid": "b3bfbbd8-cfaf-4360-9a5b-c52e89ac3f75", 2026-02-20T16:30:58.654 INFO:teuthology.orchestra.run.trial057.stdout: "up": 1, 2026-02-20T16:30:58.654 INFO:teuthology.orchestra.run.trial057.stdout: "in": 1, 2026-02-20T16:30:58.654 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 1, 2026-02-20T16:30:58.654 INFO:teuthology.orchestra.run.trial057.stdout: "primary_affinity": 1, 2026-02-20T16:30:58.654 INFO:teuthology.orchestra.run.trial057.stdout: "last_clean_begin": 10, 2026-02-20T16:30:58.654 INFO:teuthology.orchestra.run.trial057.stdout: "last_clean_end": 23, 2026-02-20T16:30:58.654 INFO:teuthology.orchestra.run.trial057.stdout: "up_from": 26, 2026-02-20T16:30:58.654 INFO:teuthology.orchestra.run.trial057.stdout: "up_thru": 26, 2026-02-20T16:30:58.655 INFO:teuthology.orchestra.run.trial057.stdout: "down_at": 24, 2026-02-20T16:30:58.655 INFO:teuthology.orchestra.run.trial057.stdout: "lost_at": 0, 2026-02-20T16:30:58.655 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-20T16:30:58.655 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-20T16:30:58.655 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-20T16:30:58.655 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-20T16:30:58.655 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6813", 2026-02-20T16:30:58.655 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 2476353628 2026-02-20T16:30:58.655 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-20T16:30:58.655 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-20T16:30:58.655 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-20T16:30:58.655 INFO:teuthology.orchestra.run.trial057.stdout: "cluster_addrs": { 2026-02-20T16:30:58.655 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-20T16:30:58.656 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-20T16:30:58.656 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-20T16:30:58.656 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6814", 2026-02-20T16:30:58.656 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 2476353628 2026-02-20T16:30:58.656 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-20T16:30:58.656 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-20T16:30:58.656 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-20T16:30:58.656 INFO:teuthology.orchestra.run.trial057.stdout: "heartbeat_back_addrs": { 2026-02-20T16:30:58.656 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-20T16:30:58.656 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-20T16:30:58.656 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-20T16:30:58.656 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6816", 2026-02-20T16:30:58.656 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 2476353628 2026-02-20T16:30:58.656 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-20T16:30:58.657 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-20T16:30:58.657 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-20T16:30:58.657 INFO:teuthology.orchestra.run.trial057.stdout: "heartbeat_front_addrs": { 2026-02-20T16:30:58.657 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-20T16:30:58.657 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-20T16:30:58.657 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-20T16:30:58.657 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6815", 2026-02-20T16:30:58.657 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 2476353628 2026-02-20T16:30:58.657 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-20T16:30:58.657 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-20T16:30:58.657 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-20T16:30:58.657 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6813/2476353628", 2026-02-20T16:30:58.657 INFO:teuthology.orchestra.run.trial057.stdout: "cluster_addr": "10.20.193.57:6814/2476353628", 2026-02-20T16:30:58.657 INFO:teuthology.orchestra.run.trial057.stdout: "heartbeat_back_addr": "10.20.193.57:6816/2476353628", 2026-02-20T16:30:58.658 INFO:teuthology.orchestra.run.trial057.stdout: "heartbeat_front_addr": "10.20.193.57:6815/2476353628", 2026-02-20T16:30:58.658 INFO:teuthology.orchestra.run.trial057.stdout: "state": [ 2026-02-20T16:30:58.658 INFO:teuthology.orchestra.run.trial057.stdout: "exists", 2026-02-20T16:30:58.658 INFO:teuthology.orchestra.run.trial057.stdout: "up" 2026-02-20T16:30:58.658 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-20T16:30:58.658 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-20T16:30:58.658 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-20T16:30:58.658 INFO:teuthology.orchestra.run.trial057.stdout: "osd_xinfo": [ 2026-02-20T16:30:58.658 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-20T16:30:58.658 INFO:teuthology.orchestra.run.trial057.stdout: "osd": 0, 2026-02-20T16:30:58.658 INFO:teuthology.orchestra.run.trial057.stdout: "down_stamp": "0.000000", 2026-02-20T16:30:58.658 INFO:teuthology.orchestra.run.trial057.stdout: "laggy_probability": 0, 2026-02-20T16:30:58.658 INFO:teuthology.orchestra.run.trial057.stdout: "laggy_interval": 0, 2026-02-20T16:30:58.658 INFO:teuthology.orchestra.run.trial057.stdout: "features": 4544132024016699391, 2026-02-20T16:30:58.658 INFO:teuthology.orchestra.run.trial057.stdout: "old_weight": 0, 2026-02-20T16:30:58.659 INFO:teuthology.orchestra.run.trial057.stdout: "last_purged_snaps_scrub": "2026-02-20T16:29:31.711310+0000", 2026-02-20T16:30:58.659 INFO:teuthology.orchestra.run.trial057.stdout: "dead_epoch": 21 2026-02-20T16:30:58.659 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-20T16:30:58.659 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-20T16:30:58.659 INFO:teuthology.orchestra.run.trial057.stdout: "osd": 1, 2026-02-20T16:30:58.659 INFO:teuthology.orchestra.run.trial057.stdout: "down_stamp": "0.000000", 2026-02-20T16:30:58.659 INFO:teuthology.orchestra.run.trial057.stdout: "laggy_probability": 0, 2026-02-20T16:30:58.659 INFO:teuthology.orchestra.run.trial057.stdout: "laggy_interval": 0, 2026-02-20T16:30:58.659 INFO:teuthology.orchestra.run.trial057.stdout: "features": 4544132024016699391, 2026-02-20T16:30:58.659 INFO:teuthology.orchestra.run.trial057.stdout: "old_weight": 0, 2026-02-20T16:30:58.659 INFO:teuthology.orchestra.run.trial057.stdout: "last_purged_snaps_scrub": "2026-02-20T16:29:31.724521+0000", 2026-02-20T16:30:58.659 INFO:teuthology.orchestra.run.trial057.stdout: "dead_epoch": 22 2026-02-20T16:30:58.659 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-20T16:30:58.659 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-20T16:30:58.659 INFO:teuthology.orchestra.run.trial057.stdout: "osd": 2, 2026-02-20T16:30:58.659 INFO:teuthology.orchestra.run.trial057.stdout: "down_stamp": "0.000000", 2026-02-20T16:30:58.660 INFO:teuthology.orchestra.run.trial057.stdout: "laggy_probability": 0, 2026-02-20T16:30:58.660 INFO:teuthology.orchestra.run.trial057.stdout: "laggy_interval": 0, 2026-02-20T16:30:58.660 INFO:teuthology.orchestra.run.trial057.stdout: "features": 4544132024016699391, 2026-02-20T16:30:58.660 INFO:teuthology.orchestra.run.trial057.stdout: "old_weight": 0, 2026-02-20T16:30:58.660 INFO:teuthology.orchestra.run.trial057.stdout: "last_purged_snaps_scrub": "2026-02-20T16:29:31.770683+0000", 2026-02-20T16:30:58.660 INFO:teuthology.orchestra.run.trial057.stdout: "dead_epoch": 23 2026-02-20T16:30:58.660 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-20T16:30:58.660 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-20T16:30:58.660 INFO:teuthology.orchestra.run.trial057.stdout: "osd": 3, 2026-02-20T16:30:58.660 INFO:teuthology.orchestra.run.trial057.stdout: "down_stamp": "0.000000", 2026-02-20T16:30:58.660 INFO:teuthology.orchestra.run.trial057.stdout: "laggy_probability": 0, 2026-02-20T16:30:58.660 INFO:teuthology.orchestra.run.trial057.stdout: "laggy_interval": 0, 2026-02-20T16:30:58.660 INFO:teuthology.orchestra.run.trial057.stdout: "features": 4544132024016699391, 2026-02-20T16:30:58.660 INFO:teuthology.orchestra.run.trial057.stdout: "old_weight": 0, 2026-02-20T16:30:58.660 INFO:teuthology.orchestra.run.trial057.stdout: "last_purged_snaps_scrub": "2026-02-20T16:29:31.821531+0000", 2026-02-20T16:30:58.660 INFO:teuthology.orchestra.run.trial057.stdout: "dead_epoch": 24 2026-02-20T16:30:58.661 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-20T16:30:58.661 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-20T16:30:58.661 INFO:teuthology.orchestra.run.trial057.stdout: "pg_upmap": [], 2026-02-20T16:30:58.661 INFO:teuthology.orchestra.run.trial057.stdout: "pg_upmap_items": [], 2026-02-20T16:30:58.661 INFO:teuthology.orchestra.run.trial057.stdout: "pg_upmap_primaries": [], 2026-02-20T16:30:58.661 INFO:teuthology.orchestra.run.trial057.stdout: "pg_temp": [], 2026-02-20T16:30:58.661 INFO:teuthology.orchestra.run.trial057.stdout: "primary_temp": [], 2026-02-20T16:30:58.661 INFO:teuthology.orchestra.run.trial057.stdout: "blocklist": { 2026-02-20T16:30:58.661 INFO:teuthology.orchestra.run.trial057.stdout: "10.20.193.57:0/4240799477": "2026-02-21T16:30:46.924862+0000", 2026-02-20T16:30:58.661 INFO:teuthology.orchestra.run.trial057.stdout: "10.20.193.57:0/1295824105": "2026-02-21T16:30:46.924862+0000", 2026-02-20T16:30:58.661 INFO:teuthology.orchestra.run.trial057.stdout: "10.20.193.57:0/2316661359": "2026-02-21T16:30:46.924862+0000", 2026-02-20T16:30:58.661 INFO:teuthology.orchestra.run.trial057.stdout: "10.20.193.57:0/3729051198": "2026-02-21T16:30:46.924862+0000", 2026-02-20T16:30:58.661 INFO:teuthology.orchestra.run.trial057.stdout: "10.20.193.57:6800/4138285113": "2026-02-21T16:30:46.924862+0000" 2026-02-20T16:30:58.661 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-20T16:30:58.661 INFO:teuthology.orchestra.run.trial057.stdout: "range_blocklist": {}, 2026-02-20T16:30:58.661 INFO:teuthology.orchestra.run.trial057.stdout: "erasure_code_profiles": { 2026-02-20T16:30:58.662 INFO:teuthology.orchestra.run.trial057.stdout: "default": { 2026-02-20T16:30:58.662 INFO:teuthology.orchestra.run.trial057.stdout: "crush-failure-domain": "osd", 2026-02-20T16:30:58.662 INFO:teuthology.orchestra.run.trial057.stdout: "k": "2", 2026-02-20T16:30:58.662 INFO:teuthology.orchestra.run.trial057.stdout: "m": "1", 2026-02-20T16:30:58.662 INFO:teuthology.orchestra.run.trial057.stdout: "plugin": "isa", 2026-02-20T16:30:58.662 INFO:teuthology.orchestra.run.trial057.stdout: "technique": "reed_sol_van" 2026-02-20T16:30:58.662 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-20T16:30:58.662 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-20T16:30:58.662 INFO:teuthology.orchestra.run.trial057.stdout: "removed_snaps_queue": [], 2026-02-20T16:30:58.662 INFO:teuthology.orchestra.run.trial057.stdout: "new_removed_snaps": [], 2026-02-20T16:30:58.662 INFO:teuthology.orchestra.run.trial057.stdout: "new_purged_snaps": [], 2026-02-20T16:30:58.662 INFO:teuthology.orchestra.run.trial057.stdout: "crush_node_flags": {}, 2026-02-20T16:30:58.662 INFO:teuthology.orchestra.run.trial057.stdout: "device_class_flags": {}, 2026-02-20T16:30:58.662 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": { 2026-02-20T16:30:58.662 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode_enabled": false, 2026-02-20T16:30:58.662 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_bucket_count": 0, 2026-02-20T16:30:58.663 INFO:teuthology.orchestra.run.trial057.stdout: "degraded_stretch_mode": 0, 2026-02-20T16:30:58.663 INFO:teuthology.orchestra.run.trial057.stdout: "recovering_stretch_mode": 0, 2026-02-20T16:30:58.663 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode_bucket": 0 2026-02-20T16:30:58.663 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-20T16:30:58.663 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-20T16:30:58.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.621+0000 7f8ac4b91640 1 -- 10.20.193.57:0/1674548280 >> v1:10.20.193.57:6800/2007744879 conn(0x7f8a8c04cae0 legacy=0x7f8a8c06cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:58.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.621+0000 7f8ac4b91640 1 -- 10.20.193.57:0/1674548280 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8ac0080670 msgr2=0x7f8ac0078e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:58.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.621+0000 7f8ac4b91640 1 --2- 10.20.193.57:0/1674548280 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8ac0080670 0x7f8ac0078e10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8ab400e940 tx=0x7f8ab400ee10 comp rx=0 tx=0).stop 2026-02-20T16:30:58.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.621+0000 7f8ac4b91640 1 -- 10.20.193.57:0/1674548280 shutdown_connections 2026-02-20T16:30:58.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.621+0000 7f8ac4b91640 1 --2- 10.20.193.57:0/1674548280 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8ac0082160 0x7f8ac01cba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:58.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.621+0000 7f8ac4b91640 1 --2- 10.20.193.57:0/1674548280 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f8ac0081810 0x7f8ac0079350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:58.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.621+0000 7f8ac4b91640 1 --2- 10.20.193.57:0/1674548280 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8ac0080670 0x7f8ac0078e10 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:58.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.621+0000 7f8ac4b91640 1 -- 10.20.193.57:0/1674548280 >> 10.20.193.57:0/1674548280 conn(0x7f8ac0084730 msgr2=0x7f8ac007dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:58.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.621+0000 7f8ac4b91640 1 -- 10.20.193.57:0/1674548280 shutdown_connections 2026-02-20T16:30:58.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.621+0000 7f8ac4b91640 1 -- 10.20.193.57:0/1674548280 wait complete. 2026-02-20T16:30:58.665 DEBUG:teuthology.orchestra.run.trial057:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs dump' 2026-02-20T16:30:58.732 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.728+0000 7f7e912d5640 1 -- 10.20.193.57:0/770187739 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f7e8c086dc0 msgr2=0x7f7e8c197ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:58.733 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.728+0000 7f7e912d5640 1 --2- 10.20.193.57:0/770187739 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f7e8c086dc0 0x7f7e8c197ee0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c004af0 tx=0x7f7e7c02f310 comp rx=0 tx=0).stop 2026-02-20T16:30:58.733 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.728+0000 7f7e912d5640 1 -- 10.20.193.57:0/770187739 shutdown_connections 2026-02-20T16:30:58.733 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.728+0000 7f7e912d5640 1 --2- 10.20.193.57:0/770187739 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f7e8c086dc0 0x7f7e8c197ee0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:58.733 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.728+0000 7f7e912d5640 1 --2- 10.20.193.57:0/770187739 >> v2:10.20.193.57:3300/0 conn(0x7f7e8c086940 0x7f7e8c177990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:58.733 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.728+0000 7f7e912d5640 1 -- 10.20.193.57:0/770187739 >> 10.20.193.57:0/770187739 conn(0x7f7e8c08ae50 msgr2=0x7f7e8c087320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:58.733 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.728+0000 7f7e912d5640 1 -- 10.20.193.57:0/770187739 shutdown_connections 2026-02-20T16:30:58.733 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.728+0000 7f7e912d5640 1 -- 10.20.193.57:0/770187739 wait complete. 2026-02-20T16:30:58.733 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.729+0000 7f7e912d5640 1 Processor -- start 2026-02-20T16:30:58.734 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.729+0000 7f7e912d5640 1 -- start start 2026-02-20T16:30:58.734 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.729+0000 7f7e912d5640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f7e8c086940 0x7f7e8c07aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:58.734 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.729+0000 7f7e912d5640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f7e8c086dc0 0x7f7e8c07af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:58.734 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.729+0000 7f7e912d5640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f7e8c087a30 0x7f7e8c07b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:58.734 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.729+0000 7f7e912d5640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8c198df0 con 0x7f7e8c086dc0 2026-02-20T16:30:58.734 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.729+0000 7f7e912d5640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f7e8c198c70 con 0x7f7e8c086940 2026-02-20T16:30:58.734 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.729+0000 7f7e912d5640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f7e8c198f70 con 0x7f7e8c087a30 2026-02-20T16:30:58.734 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.729+0000 7f7e8a7fc640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f7e8c086dc0 0x7f7e8c07af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:58.734 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.729+0000 7f7e8b7fe640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f7e8c087a30 0x7f7e8c07b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:58.734 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.729+0000 7f7e8b7fe640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f7e8c087a30 0x7f7e8c07b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3302/0 says I am v2:10.20.193.57:47894/0 (socket says 10.20.193.57:47894) 2026-02-20T16:30:58.734 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.729+0000 7f7e8affd640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f7e8c086940 0x7f7e8c07aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:58.734 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.729+0000 7f7e8b7fe640 1 -- 10.20.193.57:0/2505143872 learned_addr learned my addr 10.20.193.57:0/2505143872 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:30:58.735 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.729+0000 7f7e8b7fe640 1 -- 10.20.193.57:0/2505143872 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f7e8c086940 msgr2=0x7f7e8c07aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:58.735 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.729+0000 7f7e8b7fe640 1 --2- 10.20.193.57:0/2505143872 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f7e8c086940 0x7f7e8c07aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:58.735 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.729+0000 7f7e8b7fe640 1 -- 10.20.193.57:0/2505143872 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f7e8c086dc0 msgr2=0x7f7e8c07af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:58.735 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.729+0000 7f7e8b7fe640 1 --2- 10.20.193.57:0/2505143872 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f7e8c086dc0 0x7f7e8c07af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:58.735 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.730+0000 7f7e8b7fe640 1 -- 10.20.193.57:0/2505143872 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e8c07c390 con 0x7f7e8c087a30 2026-02-20T16:30:58.735 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.730+0000 7f7e8a7fc640 1 --2- 10.20.193.57:0/2505143872 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f7e8c086dc0 0x7f7e8c07af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:30:58.735 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.730+0000 7f7e8b7fe640 1 --2- 10.20.193.57:0/2505143872 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f7e8c087a30 0x7f7e8c07b480 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c009ee0 tx=0x7f7e7c009360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:30:58.735 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.730+0000 7f7e6b7fe640 1 -- 10.20.193.57:0/2505143872 <== mon.2 v2:10.20.193.57:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c0044f0 con 0x7f7e8c087a30 2026-02-20T16:30:58.735 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.730+0000 7f7e6b7fe640 1 -- 10.20.193.57:0/2505143872 <== mon.2 v2:10.20.193.57:3302/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e7c045070 con 0x7f7e8c087a30 2026-02-20T16:30:58.735 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.730+0000 7f7e912d5640 1 -- 10.20.193.57:0/2505143872 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e8c07d000 con 0x7f7e8c087a30 2026-02-20T16:30:58.735 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.730+0000 7f7e6b7fe640 1 -- 10.20.193.57:0/2505143872 <== mon.2 v2:10.20.193.57:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c007500 con 0x7f7e8c087a30 2026-02-20T16:30:58.735 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.730+0000 7f7e912d5640 1 -- 10.20.193.57:0/2505143872 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e8c1cdcc0 con 0x7f7e8c087a30 2026-02-20T16:30:58.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.730+0000 7f7e912d5640 1 -- 10.20.193.57:0/2505143872 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e8c086230 con 0x7f7e8c087a30 2026-02-20T16:30:58.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.730+0000 7f7e6b7fe640 1 -- 10.20.193.57:0/2505143872 <== mon.2 v2:10.20.193.57:3302/0 4 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7f7e7c0076a0 con 0x7f7e8c087a30 2026-02-20T16:30:58.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.731+0000 7f7e6b7fe640 1 -- 10.20.193.57:0/2505143872 <== mon.2 v2:10.20.193.57:3302/0 5 ==== osd_map(27..27 src has 1..27) ==== 3020+0+0 (secure 0 0 0) 0x7f7e7c088b50 con 0x7f7e8c087a30 2026-02-20T16:30:58.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.732+0000 7f7e6b7fe640 1 -- 10.20.193.57:0/2505143872 <== mon.2 v2:10.20.193.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7f7e7c087c30 con 0x7f7e8c087a30 2026-02-20T16:30:58.819 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.818+0000 7f7e912d5640 1 -- 10.20.193.57:0/2505143872 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f7e8c056b00 con 0x7f7e8c087a30 2026-02-20T16:30:58.820 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.818+0000 7f7e6b7fe640 1 -- 10.20.193.57:0/2505143872 <== mon.2 v2:10.20.193.57:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 1 v1) ==== 75+0+440 (secure 0 0 0) 0x7f7e7c0870d0 con 0x7f7e8c087a30 2026-02-20T16:30:58.820 INFO:teuthology.orchestra.run.trial057.stdout:e1 2026-02-20T16:30:58.820 INFO:teuthology.orchestra.run.trial057.stdout:btime 2026-02-20T16:29:22:501307+0000 2026-02-20T16:30:58.820 INFO:teuthology.orchestra.run.trial057.stdout:enable_multiple, ever_enabled_multiple: 1,1 2026-02-20T16:30:58.821 INFO:teuthology.orchestra.run.trial057.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-20T16:30:58.821 INFO:teuthology.orchestra.run.trial057.stdout:legacy client fscid: -1 2026-02-20T16:30:58.821 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:30:58.821 INFO:teuthology.orchestra.run.trial057.stdout:No filesystems configured 2026-02-20T16:30:58.822 INFO:teuthology.orchestra.run.trial057.stderr:dumped fsmap epoch 1 2026-02-20T16:30:58.822 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.818+0000 7f7e912d5640 1 -- 10.20.193.57:0/2505143872 >> v1:10.20.193.57:6800/2007744879 conn(0x7f7e5804cae0 legacy=0x7f7e5806cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:58.823 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.818+0000 7f7e912d5640 1 -- 10.20.193.57:0/2505143872 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f7e8c087a30 msgr2=0x7f7e8c07b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:58.823 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.818+0000 7f7e912d5640 1 --2- 10.20.193.57:0/2505143872 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f7e8c087a30 0x7f7e8c07b480 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c009ee0 tx=0x7f7e7c009360 comp rx=0 tx=0).stop 2026-02-20T16:30:58.823 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.819+0000 7f7e912d5640 1 -- 10.20.193.57:0/2505143872 shutdown_connections 2026-02-20T16:30:58.823 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.819+0000 7f7e912d5640 1 --2- 10.20.193.57:0/2505143872 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f7e8c087a30 0x7f7e8c07b480 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:58.823 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.819+0000 7f7e912d5640 1 --2- 10.20.193.57:0/2505143872 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f7e8c086dc0 0x7f7e8c07af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:58.823 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.819+0000 7f7e912d5640 1 --2- 10.20.193.57:0/2505143872 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f7e8c086940 0x7f7e8c07aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:58.823 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.819+0000 7f7e912d5640 1 -- 10.20.193.57:0/2505143872 >> 10.20.193.57:0/2505143872 conn(0x7f7e8c08ae50 msgr2=0x7f7e8c1a3680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:58.823 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.819+0000 7f7e912d5640 1 -- 10.20.193.57:0/2505143872 shutdown_connections 2026-02-20T16:30:58.824 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.819+0000 7f7e912d5640 1 -- 10.20.193.57:0/2505143872 wait complete. 2026-02-20T16:30:58.828 DEBUG:teuthology.orchestra.run.trial057:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd require-osd-release tentacle' 2026-02-20T16:30:58.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.891+0000 7f833c596640 1 -- 10.20.193.57:0/1384599231 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f83340811d0 msgr2=0x7f83340815a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:58.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.891+0000 7f833c596640 1 --2- 10.20.193.57:0/1384599231 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f83340811d0 0x7f83340815a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8324005ea0 tx=0x7f832402f1d0 comp rx=0 tx=0).stop 2026-02-20T16:30:58.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.891+0000 7f833c596640 1 -- 10.20.193.57:0/1384599231 shutdown_connections 2026-02-20T16:30:58.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.891+0000 7f833c596640 1 --2- 10.20.193.57:0/1384599231 >> v2:10.20.193.57:3300/0 conn(0x7f8334136ca0 0x7f83341987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:58.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.891+0000 7f833c596640 1 --2- 10.20.193.57:0/1384599231 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f83340811d0 0x7f83340815a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:58.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.891+0000 7f833c596640 1 -- 10.20.193.57:0/1384599231 >> 10.20.193.57:0/1384599231 conn(0x7f8334084730 msgr2=0x7f8334084b30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:58.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.891+0000 7f833c596640 1 -- 10.20.193.57:0/1384599231 shutdown_connections 2026-02-20T16:30:58.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.891+0000 7f833c596640 1 -- 10.20.193.57:0/1384599231 wait complete. 2026-02-20T16:30:58.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.892+0000 7f833c596640 1 Processor -- start 2026-02-20T16:30:58.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.892+0000 7f833c596640 1 -- start start 2026-02-20T16:30:58.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.892+0000 7f833c596640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f83340811d0 0x7f833410bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:58.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.892+0000 7f833c596640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8334081ae0 0x7f833410c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:58.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.892+0000 7f833c596640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f8334136ca0 0x7f8334125b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:30:58.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.892+0000 7f833c596640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f8334198f40 con 0x7f8334136ca0 2026-02-20T16:30:58.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.892+0000 7f833c596640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f83341373a0 con 0x7f83340811d0 2026-02-20T16:30:58.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.892+0000 7f833c596640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f83341990c0 con 0x7f8334081ae0 2026-02-20T16:30:58.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.892+0000 7f833a30b640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f83340811d0 0x7f833410bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:58.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.892+0000 7f8339b0a640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8334081ae0 0x7f833410c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:58.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.892+0000 7f833a30b640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f83340811d0 0x7f833410bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3301/0 says I am v2:10.20.193.57:33444/0 (socket says 10.20.193.57:33444) 2026-02-20T16:30:58.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.892+0000 7f833a30b640 1 -- 10.20.193.57:0/3830969688 learned_addr learned my addr 10.20.193.57:0/3830969688 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:30:58.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.892+0000 7f833ab0c640 1 --2- 10.20.193.57:0/3830969688 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f8334136ca0 0x7f8334125b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:30:58.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.892+0000 7f8339b0a640 1 -- 10.20.193.57:0/3830969688 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f83340811d0 msgr2=0x7f833410bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:58.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.892+0000 7f8339b0a640 1 --2- 10.20.193.57:0/3830969688 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f83340811d0 0x7f833410bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:58.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.892+0000 7f8339b0a640 1 -- 10.20.193.57:0/3830969688 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f8334136ca0 msgr2=0x7f8334125b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:58.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.892+0000 7f8339b0a640 1 --2- 10.20.193.57:0/3830969688 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f8334136ca0 0x7f8334125b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:58.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.892+0000 7f8339b0a640 1 -- 10.20.193.57:0/3830969688 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f833410d240 con 0x7f8334081ae0 2026-02-20T16:30:58.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.893+0000 7f8339b0a640 1 --2- 10.20.193.57:0/3830969688 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8334081ae0 0x7f833410c120 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f832800c450 tx=0x7f832800c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:30:58.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.893+0000 7f831affd640 1 -- 10.20.193.57:0/3830969688 <== mon.2 v2:10.20.193.57:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83280052d0 con 0x7f8334081ae0 2026-02-20T16:30:58.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.893+0000 7f831affd640 1 -- 10.20.193.57:0/3830969688 <== mon.2 v2:10.20.193.57:3302/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8328005470 con 0x7f8334081ae0 2026-02-20T16:30:58.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.893+0000 7f833c596640 1 -- 10.20.193.57:0/3830969688 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f833410db20 con 0x7f8334081ae0 2026-02-20T16:30:58.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.893+0000 7f831affd640 1 -- 10.20.193.57:0/3830969688 <== mon.2 v2:10.20.193.57:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8328003900 con 0x7f8334081ae0 2026-02-20T16:30:58.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.893+0000 7f833c596640 1 -- 10.20.193.57:0/3830969688 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f833410c840 con 0x7f8334081ae0 2026-02-20T16:30:58.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.893+0000 7f833c596640 1 -- 10.20.193.57:0/3830969688 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f833410eed0 con 0x7f8334081ae0 2026-02-20T16:30:58.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.893+0000 7f831affd640 1 -- 10.20.193.57:0/3830969688 <== mon.2 v2:10.20.193.57:3302/0 4 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7f8328003aa0 con 0x7f8334081ae0 2026-02-20T16:30:58.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.894+0000 7f831affd640 1 -- 10.20.193.57:0/3830969688 <== mon.2 v2:10.20.193.57:3302/0 5 ==== osd_map(27..27 src has 1..27) ==== 3020+0+0 (secure 0 0 0) 0x7f8328063310 con 0x7f8334081ae0 2026-02-20T16:30:58.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.895+0000 7f831affd640 1 -- 10.20.193.57:0/3830969688 <== mon.2 v2:10.20.193.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7f83280623b0 con 0x7f8334081ae0 2026-02-20T16:30:58.974 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:58.973+0000 7f833c596640 1 -- 10.20.193.57:0/3830969688 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_command({"prefix": "osd require-osd-release", "release": "tentacle"} v 0) -- 0x7f83340815a0 con 0x7f8334081ae0 2026-02-20T16:30:59.964 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:59.962+0000 7f831affd640 1 -- 10.20.193.57:0/3830969688 <== mon.2 v2:10.20.193.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd require-osd-release", "release": "tentacle"}]=0 v28) ==== 94+0+0 (secure 0 0 0) 0x7f8328003dc0 con 0x7f8334081ae0 2026-02-20T16:30:59.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:59.963+0000 7f833c596640 1 -- 10.20.193.57:0/3830969688 >> v1:10.20.193.57:6800/2007744879 conn(0x7f830404cae0 legacy=0x7f830406cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:59.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:59.963+0000 7f833c596640 1 -- 10.20.193.57:0/3830969688 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8334081ae0 msgr2=0x7f833410c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:30:59.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:59.963+0000 7f833c596640 1 --2- 10.20.193.57:0/3830969688 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8334081ae0 0x7f833410c120 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f832800c450 tx=0x7f832800c920 comp rx=0 tx=0).stop 2026-02-20T16:30:59.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:59.963+0000 7f833c596640 1 -- 10.20.193.57:0/3830969688 shutdown_connections 2026-02-20T16:30:59.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:59.963+0000 7f833c596640 1 --2- 10.20.193.57:0/3830969688 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f8334136ca0 0x7f8334125b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:59.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:59.963+0000 7f833c596640 1 --2- 10.20.193.57:0/3830969688 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8334081ae0 0x7f833410c120 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:59.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:59.963+0000 7f833c596640 1 --2- 10.20.193.57:0/3830969688 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f83340811d0 0x7f833410bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:30:59.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:59.964+0000 7f833c596640 1 -- 10.20.193.57:0/3830969688 >> 10.20.193.57:0/3830969688 conn(0x7f8334084730 msgr2=0x7f833407b190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:30:59.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:59.964+0000 7f833c596640 1 -- 10.20.193.57:0/3830969688 shutdown_connections 2026-02-20T16:30:59.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:30:59.964+0000 7f833c596640 1 -- 10.20.193.57:0/3830969688 wait complete. 2026-02-20T16:30:59.974 DEBUG:teuthology.orchestra.run.trial057:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done' 2026-02-20T16:31:00.044 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.039+0000 7f1db19f9640 1 -- 10.20.193.57:0/1397401415 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f1dac07b870 msgr2=0x7f1dac07a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:00.044 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.039+0000 7f1db19f9640 1 --2- 10.20.193.57:0/1397401415 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f1dac07b870 0x7f1dac07a9c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1d94005fd0 tx=0x7f1d9402f260 comp rx=0 tx=0).stop 2026-02-20T16:31:00.044 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.039+0000 7f1db19f9640 1 -- 10.20.193.57:0/1397401415 shutdown_connections 2026-02-20T16:31:00.044 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.039+0000 7f1db19f9640 1 --2- 10.20.193.57:0/1397401415 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f1dac07b870 0x7f1dac07a9c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:00.044 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.039+0000 7f1db19f9640 1 --2- 10.20.193.57:0/1397401415 >> v2:10.20.193.57:3300/0 conn(0x7f1dac07d060 0x7f1dac07a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:00.044 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.039+0000 7f1db19f9640 1 -- 10.20.193.57:0/1397401415 >> 10.20.193.57:0/1397401415 conn(0x7f1dac084730 msgr2=0x7f1dac084b30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:00.044 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.039+0000 7f1db19f9640 1 -- 10.20.193.57:0/1397401415 shutdown_connections 2026-02-20T16:31:00.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.039+0000 7f1db19f9640 1 -- 10.20.193.57:0/1397401415 wait complete. 2026-02-20T16:31:00.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.039+0000 7f1db19f9640 1 Processor -- start 2026-02-20T16:31:00.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.039+0000 7f1db19f9640 1 -- start start 2026-02-20T16:31:00.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.040+0000 7f1db19f9640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f1dac07af00 0x7f1dac057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:00.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.040+0000 7f1db19f9640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f1dac07b870 0x7f1dac057dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:00.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.040+0000 7f1db19f9640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f1dac07d060 0x7f1dac058310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:00.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.040+0000 7f1db19f9640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f1dac195850 con 0x7f1dac07af00 2026-02-20T16:31:00.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.040+0000 7f1db19f9640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f1dac1956d0 con 0x7f1dac07b870 2026-02-20T16:31:00.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.040+0000 7f1db19f9640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f1dac1959d0 con 0x7f1dac07d060 2026-02-20T16:31:00.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.040+0000 7f1daaffd640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f1dac07af00 0x7f1dac057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:00.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.040+0000 7f1daaffd640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f1dac07af00 0x7f1dac057890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:44980/0 (socket says 10.20.193.57:44980) 2026-02-20T16:31:00.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.040+0000 7f1dab7fe640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f1dac07d060 0x7f1dac058310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:00.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.040+0000 7f1daa7fc640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f1dac07b870 0x7f1dac057dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:00.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.040+0000 7f1daaffd640 1 -- 10.20.193.57:0/1896740037 learned_addr learned my addr 10.20.193.57:0/1896740037 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:31:00.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.040+0000 7f1daaffd640 1 -- 10.20.193.57:0/1896740037 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f1dac07d060 msgr2=0x7f1dac058310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:00.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.040+0000 7f1daaffd640 1 --2- 10.20.193.57:0/1896740037 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f1dac07d060 0x7f1dac058310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:00.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.040+0000 7f1daaffd640 1 -- 10.20.193.57:0/1896740037 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f1dac07b870 msgr2=0x7f1dac057dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:00.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.040+0000 7f1daaffd640 1 --2- 10.20.193.57:0/1896740037 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f1dac07b870 0x7f1dac057dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:00.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.040+0000 7f1daaffd640 1 -- 10.20.193.57:0/1896740037 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dac079970 con 0x7f1dac07af00 2026-02-20T16:31:00.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.040+0000 7f1daaffd640 1 --2- 10.20.193.57:0/1896740037 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f1dac07af00 0x7f1dac057890 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1da000e9c0 tx=0x7f1da000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:31:00.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.040+0000 7f1d83fff640 1 -- 10.20.193.57:0/1896740037 <== mon.0 v2:10.20.193.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da000cd50 con 0x7f1dac07af00 2026-02-20T16:31:00.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.040+0000 7f1d83fff640 1 -- 10.20.193.57:0/1896740037 <== mon.0 v2:10.20.193.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1da0004880 con 0x7f1dac07af00 2026-02-20T16:31:00.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.040+0000 7f1db19f9640 1 -- 10.20.193.57:0/1896740037 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dac058d70 con 0x7f1dac07af00 2026-02-20T16:31:00.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.040+0000 7f1d83fff640 1 -- 10.20.193.57:0/1896740037 <== mon.0 v2:10.20.193.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da0004cd0 con 0x7f1dac07af00 2026-02-20T16:31:00.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.040+0000 7f1db19f9640 1 -- 10.20.193.57:0/1896740037 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dac059820 con 0x7f1dac07af00 2026-02-20T16:31:00.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.041+0000 7f1db19f9640 1 -- 10.20.193.57:0/1896740037 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dac07a480 con 0x7f1dac07af00 2026-02-20T16:31:00.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.041+0000 7f1d83fff640 1 -- 10.20.193.57:0/1896740037 <== mon.0 v2:10.20.193.57:3300/0 4 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7f1da0004080 con 0x7f1dac07af00 2026-02-20T16:31:00.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.041+0000 7f1d83fff640 1 -- 10.20.193.57:0/1896740037 <== mon.0 v2:10.20.193.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 3026+0+0 (secure 0 0 0) 0x7f1da00641d0 con 0x7f1dac07af00 2026-02-20T16:31:00.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.043+0000 7f1d83fff640 1 -- 10.20.193.57:0/1896740037 <== mon.0 v2:10.20.193.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7f1da00632a0 con 0x7f1dac07af00 2026-02-20T16:31:00.119 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.117+0000 7f1db19f9640 1 -- 10.20.193.57:0/1896740037 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "osd pool ls"} v 0) -- 0x7f1dac19f100 con 0x7f1dac07af00 2026-02-20T16:31:00.119 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.117+0000 7f1d83fff640 1 -- 10.20.193.57:0/1896740037 <== mon.0 v2:10.20.193.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool ls"}]=0 v28) ==== 59+0+9 (secure 0 0 0) 0x7f1da0062a90 con 0x7f1dac07af00 2026-02-20T16:31:00.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.118+0000 7f1db19f9640 1 -- 10.20.193.57:0/1896740037 >> v1:10.20.193.57:6800/2007744879 conn(0x7f1d7c04cae0 legacy=0x7f1d7c06cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:00.121 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.118+0000 7f1db19f9640 1 -- 10.20.193.57:0/1896740037 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f1dac07af00 msgr2=0x7f1dac057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:00.121 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.118+0000 7f1db19f9640 1 --2- 10.20.193.57:0/1896740037 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f1dac07af00 0x7f1dac057890 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1da000e9c0 tx=0x7f1da000ee90 comp rx=0 tx=0).stop 2026-02-20T16:31:00.121 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.118+0000 7f1db19f9640 1 -- 10.20.193.57:0/1896740037 shutdown_connections 2026-02-20T16:31:00.121 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.118+0000 7f1db19f9640 1 --2- 10.20.193.57:0/1896740037 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f1dac07d060 0x7f1dac058310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:00.121 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.118+0000 7f1db19f9640 1 --2- 10.20.193.57:0/1896740037 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f1dac07b870 0x7f1dac057dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:00.121 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.118+0000 7f1db19f9640 1 --2- 10.20.193.57:0/1896740037 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f1dac07af00 0x7f1dac057890 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:00.121 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.118+0000 7f1db19f9640 1 -- 10.20.193.57:0/1896740037 >> 10.20.193.57:0/1896740037 conn(0x7f1dac084730 msgr2=0x7f1dac07f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:00.121 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.118+0000 7f1db19f9640 1 -- 10.20.193.57:0/1896740037 shutdown_connections 2026-02-20T16:31:00.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.118+0000 7f1db19f9640 1 -- 10.20.193.57:0/1896740037 wait complete. 2026-02-20T16:31:00.173 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.168+0000 7f585eacf640 1 -- 10.20.193.57:0/2016046271 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f5858132680 msgr2=0x7f58581955b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:00.174 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.168+0000 7f585eacf640 1 --2- 10.20.193.57:0/2016046271 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f5858132680 0x7f58581955b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5854004af0 tx=0x7f585402f3d0 comp rx=0 tx=0).stop 2026-02-20T16:31:00.174 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.168+0000 7f585eacf640 1 -- 10.20.193.57:0/2016046271 shutdown_connections 2026-02-20T16:31:00.174 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.168+0000 7f585eacf640 1 --2- 10.20.193.57:0/2016046271 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f5858132680 0x7f58581955b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:00.174 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.168+0000 7f585eacf640 1 --2- 10.20.193.57:0/2016046271 >> v2:10.20.193.57:3300/0 conn(0x7f5858132ff0 0x7f58581333c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:00.174 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.168+0000 7f585eacf640 1 -- 10.20.193.57:0/2016046271 >> 10.20.193.57:0/2016046271 conn(0x7f5858084fe0 msgr2=0x7f58580853e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:00.174 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.168+0000 7f585eacf640 1 -- 10.20.193.57:0/2016046271 shutdown_connections 2026-02-20T16:31:00.174 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.168+0000 7f585eacf640 1 -- 10.20.193.57:0/2016046271 wait complete. 2026-02-20T16:31:00.174 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.169+0000 7f585eacf640 1 Processor -- start 2026-02-20T16:31:00.174 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.169+0000 7f585eacf640 1 -- start start 2026-02-20T16:31:00.174 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.169+0000 7f585eacf640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f5858132680 0x7f5858102e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:00.175 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.169+0000 7f585eacf640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f5858132ff0 0x7f58581033b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:00.175 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.169+0000 7f585eacf640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f5858133900 0x7f58581038f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:00.175 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.169+0000 7f585eacf640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f5858195e80 con 0x7f5858132ff0 2026-02-20T16:31:00.175 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.169+0000 7f585eacf640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f5858195d00 con 0x7f5858132680 2026-02-20T16:31:00.175 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.169+0000 7f585eacf640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f5858196000 con 0x7f5858133900 2026-02-20T16:31:00.175 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.169+0000 7f585c844640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f5858132680 0x7f5858102e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:00.175 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.169+0000 7f584ffff640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f5858132ff0 0x7f58581033b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:00.175 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.169+0000 7f585c844640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f5858132680 0x7f5858102e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3301/0 says I am v2:10.20.193.57:53444/0 (socket says 10.20.193.57:53444) 2026-02-20T16:31:00.175 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.169+0000 7f585c844640 1 -- 10.20.193.57:0/1294926319 learned_addr learned my addr 10.20.193.57:0/1294926319 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:31:00.175 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.169+0000 7f585d045640 1 --2- 10.20.193.57:0/1294926319 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f5858133900 0x7f58581038f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:00.175 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.169+0000 7f585c844640 1 -- 10.20.193.57:0/1294926319 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f5858133900 msgr2=0x7f58581038f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:00.176 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.169+0000 7f585c844640 1 --2- 10.20.193.57:0/1294926319 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f5858133900 0x7f58581038f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:00.176 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.169+0000 7f585c844640 1 -- 10.20.193.57:0/1294926319 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f5858132ff0 msgr2=0x7f58581033b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:00.176 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.169+0000 7f585c844640 1 --2- 10.20.193.57:0/1294926319 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f5858132ff0 0x7f58581033b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:00.176 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.169+0000 7f585c844640 1 -- 10.20.193.57:0/1294926319 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5858105bc0 con 0x7f5858132680 2026-02-20T16:31:00.176 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.169+0000 7f585d045640 1 --2- 10.20.193.57:0/1294926319 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f5858133900 0x7f58581038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T16:31:00.176 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.169+0000 7f584ffff640 1 --2- 10.20.193.57:0/1294926319 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f5858132ff0 0x7f58581033b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:31:00.176 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.169+0000 7f585c844640 1 --2- 10.20.193.57:0/1294926319 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f5858132680 0x7f5858102e70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f58480094b0 tx=0x7f584800ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:31:00.176 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.169+0000 7f584d7fa640 1 -- 10.20.193.57:0/1294926319 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f584800cd20 con 0x7f5858132680 2026-02-20T16:31:00.176 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.169+0000 7f584d7fa640 1 -- 10.20.193.57:0/1294926319 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5848004880 con 0x7f5858132680 2026-02-20T16:31:00.176 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.169+0000 7f585eacf640 1 -- 10.20.193.57:0/1294926319 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58581061d0 con 0x7f5858132680 2026-02-20T16:31:00.176 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.169+0000 7f584d7fa640 1 -- 10.20.193.57:0/1294926319 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5848004cd0 con 0x7f5858132680 2026-02-20T16:31:00.176 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.169+0000 7f585eacf640 1 -- 10.20.193.57:0/1294926319 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5858122b40 con 0x7f5858132680 2026-02-20T16:31:00.177 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.170+0000 7f585eacf640 1 -- 10.20.193.57:0/1294926319 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f585805c9e0 con 0x7f5858132680 2026-02-20T16:31:00.177 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.170+0000 7f584d7fa640 1 -- 10.20.193.57:0/1294926319 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7f5848004080 con 0x7f5858132680 2026-02-20T16:31:00.177 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.170+0000 7f584d7fa640 1 -- 10.20.193.57:0/1294926319 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 3026+0+0 (secure 0 0 0) 0x7f5848064160 con 0x7f5858132680 2026-02-20T16:31:00.177 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.172+0000 7f584d7fa640 1 -- 10.20.193.57:0/1294926319 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7f585805c9e0 con 0x7f5858132680 2026-02-20T16:31:00.246 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.245+0000 7f585eacf640 1 -- 10.20.193.57:0/1294926319 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "osd pool set", "pool": ".mgr", "var": "pg_autoscale_mode", "val": "off"} v 0) -- 0x7f58581333c0 con 0x7f5858132680 2026-02-20T16:31:00.965 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.963+0000 7f584d7fa640 1 -- 10.20.193.57:0/1294926319 <== mon.1 v2:10.20.193.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": ".mgr", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 1 pg_autoscale_mode to off v29) ==== 153+0+0 (secure 0 0 0) 0x7f5858105bc0 con 0x7f5858132680 2026-02-20T16:31:00.965 INFO:teuthology.orchestra.run.trial057.stderr:set pool 1 pg_autoscale_mode to off 2026-02-20T16:31:00.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.965+0000 7f585eacf640 1 -- 10.20.193.57:0/1294926319 >> v1:10.20.193.57:6800/2007744879 conn(0x7f582804cae0 legacy=0x7f582806cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:00.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.965+0000 7f585eacf640 1 -- 10.20.193.57:0/1294926319 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f5858132680 msgr2=0x7f5858102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:00.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.965+0000 7f585eacf640 1 --2- 10.20.193.57:0/1294926319 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f5858132680 0x7f5858102e70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f58480094b0 tx=0x7f584800ee60 comp rx=0 tx=0).stop 2026-02-20T16:31:00.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.965+0000 7f585eacf640 1 -- 10.20.193.57:0/1294926319 shutdown_connections 2026-02-20T16:31:00.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.965+0000 7f585eacf640 1 --2- 10.20.193.57:0/1294926319 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f5858133900 0x7f58581038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:00.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.965+0000 7f585eacf640 1 --2- 10.20.193.57:0/1294926319 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f5858132ff0 0x7f58581033b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:00.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.965+0000 7f585eacf640 1 --2- 10.20.193.57:0/1294926319 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f5858132680 0x7f5858102e70 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:00.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.965+0000 7f585eacf640 1 -- 10.20.193.57:0/1294926319 >> 10.20.193.57:0/1294926319 conn(0x7f5858084fe0 msgr2=0x7f5858113d40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:00.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.965+0000 7f585eacf640 1 -- 10.20.193.57:0/1294926319 shutdown_connections 2026-02-20T16:31:00.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:00.965+0000 7f585eacf640 1 -- 10.20.193.57:0/1294926319 wait complete. 2026-02-20T16:31:01.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:01.018+0000 7f8082a4a640 1 -- 10.20.193.57:0/3638490185 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f807c058da0 msgr2=0x7f807c1368f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:01.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:01.018+0000 7f8082a4a640 1 --2- 10.20.193.57:0/3638490185 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f807c058da0 0x7f807c1368f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8070009f10 tx=0x7f807002f450 comp rx=0 tx=0).stop 2026-02-20T16:31:01.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:01.018+0000 7f8082a4a640 1 -- 10.20.193.57:0/3638490185 shutdown_connections 2026-02-20T16:31:01.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:01.018+0000 7f8082a4a640 1 --2- 10.20.193.57:0/3638490185 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f807c058da0 0x7f807c1368f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:01.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:01.018+0000 7f8082a4a640 1 --2- 10.20.193.57:0/3638490185 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f807c058490 0x7f807c058860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:01.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:01.018+0000 7f8082a4a640 1 -- 10.20.193.57:0/3638490185 >> 10.20.193.57:0/3638490185 conn(0x7f807c0891d0 msgr2=0x7f807c0895d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:01.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:01.018+0000 7f8082a4a640 1 -- 10.20.193.57:0/3638490185 shutdown_connections 2026-02-20T16:31:01.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:01.018+0000 7f8082a4a640 1 -- 10.20.193.57:0/3638490185 wait complete. 2026-02-20T16:31:01.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:01.019+0000 7f8082a4a640 1 Processor -- start 2026-02-20T16:31:01.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:01.019+0000 7f8082a4a640 1 -- start start 2026-02-20T16:31:01.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:01.019+0000 7f8082a4a640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f807c058490 0x7f807c107370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:01.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:01.019+0000 7f8082a4a640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f807c058da0 0x7f807c1078b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:01.024 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:01.019+0000 7f8082a4a640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f807c05a760 0x7f807c197640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:01.024 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:01.019+0000 7f8082a4a640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f807c199020 con 0x7f807c058490 2026-02-20T16:31:01.024 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:01.019+0000 7f8082a4a640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f807c198ea0 con 0x7f807c05a760 2026-02-20T16:31:01.024 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:01.019+0000 7f8082a4a640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f807c1991a0 con 0x7f807c058da0 2026-02-20T16:31:01.024 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:01.019+0000 7f8080fc0640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f807c05a760 0x7f807c197640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:01.024 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:01.019+0000 7f807bfff640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f807c058490 0x7f807c107370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:01.024 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:01.019+0000 7f8080fc0640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f807c05a760 0x7f807c197640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3301/0 says I am v2:10.20.193.57:53452/0 (socket says 10.20.193.57:53452) 2026-02-20T16:31:01.024 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:01.019+0000 7f807b7fe640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f807c058da0 0x7f807c1078b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:01.024 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:01.019+0000 7f8080fc0640 1 -- 10.20.193.57:0/3628102134 learned_addr learned my addr 10.20.193.57:0/3628102134 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:31:01.024 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:01.019+0000 7f8080fc0640 1 -- 10.20.193.57:0/3628102134 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f807c058da0 msgr2=0x7f807c1078b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:01.024 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:01.019+0000 7f8080fc0640 1 --2- 10.20.193.57:0/3628102134 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f807c058da0 0x7f807c1078b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:01.025 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:01.019+0000 7f8080fc0640 1 -- 10.20.193.57:0/3628102134 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f807c058490 msgr2=0x7f807c107370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:01.025 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:01.019+0000 7f8080fc0640 1 --2- 10.20.193.57:0/3628102134 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f807c058490 0x7f807c107370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:01.025 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:01.019+0000 7f8080fc0640 1 -- 10.20.193.57:0/3628102134 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f807c10a720 con 0x7f807c05a760 2026-02-20T16:31:01.025 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:01.019+0000 7f8080fc0640 1 --2- 10.20.193.57:0/3628102134 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f807c05a760 0x7f807c197640 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8070032040 tx=0x7f8070002d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:31:01.025 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:01.019+0000 7f8078ff9640 1 -- 10.20.193.57:0/3628102134 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8070004460 con 0x7f807c05a760 2026-02-20T16:31:01.025 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:01.019+0000 7f8078ff9640 1 -- 10.20.193.57:0/3628102134 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f80700046f0 con 0x7f807c05a760 2026-02-20T16:31:01.025 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:01.019+0000 7f8082a4a640 1 -- 10.20.193.57:0/3628102134 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f807c109690 con 0x7f807c05a760 2026-02-20T16:31:01.025 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:01.019+0000 7f8078ff9640 1 -- 10.20.193.57:0/3628102134 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8070007500 con 0x7f807c05a760 2026-02-20T16:31:01.025 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:01.019+0000 7f8082a4a640 1 -- 10.20.193.57:0/3628102134 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f807c197b80 con 0x7f807c05a760 2026-02-20T16:31:01.025 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:01.020+0000 7f8082a4a640 1 -- 10.20.193.57:0/3628102134 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f807c1084d0 con 0x7f807c05a760 2026-02-20T16:31:01.025 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:01.020+0000 7f8078ff9640 1 -- 10.20.193.57:0/3628102134 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7f80700076a0 con 0x7f807c05a760 2026-02-20T16:31:01.025 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:01.020+0000 7f8078ff9640 1 -- 10.20.193.57:0/3628102134 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 3026+0+0 (secure 0 0 0) 0x7f8070088460 con 0x7f807c05a760 2026-02-20T16:31:01.026 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:01.021+0000 7f8078ff9640 1 -- 10.20.193.57:0/3628102134 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7f80700874f0 con 0x7f807c05a760 2026-02-20T16:31:01.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:01.095+0000 7f8082a4a640 1 -- 10.20.193.57:0/3628102134 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "osd pool set", "pool": "rbd", "var": "pg_autoscale_mode", "val": "off"} v 0) -- 0x7f807c058860 con 0x7f807c05a760 2026-02-20T16:31:01.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:01.964+0000 7f8078ff9640 1 -- 10.20.193.57:0/3628102134 <== mon.1 v2:10.20.193.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "rbd", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 2 pg_autoscale_mode to off v30) ==== 152+0+0 (secure 0 0 0) 0x7f80700620b0 con 0x7f807c05a760 2026-02-20T16:31:01.966 INFO:teuthology.orchestra.run.trial057.stderr:set pool 2 pg_autoscale_mode to off 2026-02-20T16:31:01.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:01.965+0000 7f8082a4a640 1 -- 10.20.193.57:0/3628102134 >> v1:10.20.193.57:6800/2007744879 conn(0x7f804c04cae0 legacy=0x7f804c06cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:01.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:01.965+0000 7f8082a4a640 1 -- 10.20.193.57:0/3628102134 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f807c05a760 msgr2=0x7f807c197640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:01.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:01.965+0000 7f8082a4a640 1 --2- 10.20.193.57:0/3628102134 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f807c05a760 0x7f807c197640 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8070032040 tx=0x7f8070002d50 comp rx=0 tx=0).stop 2026-02-20T16:31:01.968 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:01.965+0000 7f8082a4a640 1 -- 10.20.193.57:0/3628102134 shutdown_connections 2026-02-20T16:31:01.968 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:01.965+0000 7f8082a4a640 1 --2- 10.20.193.57:0/3628102134 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f807c05a760 0x7f807c197640 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:01.968 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:01.965+0000 7f8082a4a640 1 --2- 10.20.193.57:0/3628102134 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f807c058da0 0x7f807c1078b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:01.968 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:01.965+0000 7f8082a4a640 1 --2- 10.20.193.57:0/3628102134 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f807c058490 0x7f807c107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:01.968 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:01.965+0000 7f8082a4a640 1 -- 10.20.193.57:0/3628102134 >> 10.20.193.57:0/3628102134 conn(0x7f807c0891d0 msgr2=0x7f807c117020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:01.968 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:01.965+0000 7f8082a4a640 1 -- 10.20.193.57:0/3628102134 shutdown_connections 2026-02-20T16:31:01.968 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:01.965+0000 7f8082a4a640 1 -- 10.20.193.57:0/3628102134 wait complete. 2026-02-20T16:31:01.975 INFO:teuthology.run_tasks:Running task ceph.healthy... 2026-02-20T16:31:01.994 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-20T16:31:01.994 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-20T16:31:01.995 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-20T16:31:02.066 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.062+0000 7f5048299640 1 -- 10.20.193.57:0/3966416936 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f504005c060 msgr2=0x7f504005c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.066 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.062+0000 7f5048299640 1 --2- 10.20.193.57:0/3966416936 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f504005c060 0x7f504005c430 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5030005ea0 tx=0x7f503002f1d0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.066 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.062+0000 7f5048299640 1 -- 10.20.193.57:0/3966416936 shutdown_connections 2026-02-20T16:31:02.066 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.062+0000 7f5048299640 1 --2- 10.20.193.57:0/3966416936 >> v2:10.20.193.57:3300/0 conn(0x7f5040176890 0x7f5040196c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.066 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.062+0000 7f5048299640 1 --2- 10.20.193.57:0/3966416936 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f504005c970 0x7f5040176350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.066 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.062+0000 7f5048299640 1 --2- 10.20.193.57:0/3966416936 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f504005c060 0x7f504005c430 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.066 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.062+0000 7f5048299640 1 -- 10.20.193.57:0/3966416936 >> 10.20.193.57:0/3966416936 conn(0x7f50400833e0 msgr2=0x7f50400840b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:02.066 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.062+0000 7f5048299640 1 -- 10.20.193.57:0/3966416936 shutdown_connections 2026-02-20T16:31:02.067 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.062+0000 7f5048299640 1 -- 10.20.193.57:0/3966416936 wait complete. 2026-02-20T16:31:02.067 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.062+0000 7f5048299640 1 Processor -- start 2026-02-20T16:31:02.067 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.062+0000 7f5048299640 1 -- start start 2026-02-20T16:31:02.067 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.063+0000 7f5048299640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f504005c060 0x7f504007a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:02.067 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.063+0000 7f5048299640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f504005c970 0x7f504007a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:02.067 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.063+0000 7f5048299640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f5040176890 0x7f504007adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:02.067 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.063+0000 7f5048299640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f5040197c30 con 0x7f504005c970 2026-02-20T16:31:02.067 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.063+0000 7f5048299640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f5040197ab0 con 0x7f504005c060 2026-02-20T16:31:02.067 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.063+0000 7f5048299640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f5040197db0 con 0x7f5040176890 2026-02-20T16:31:02.067 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.063+0000 7f504600e640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f504005c060 0x7f504007a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:02.068 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.063+0000 7f504580d640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f504005c970 0x7f504007a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:02.068 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.063+0000 7f504600e640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f504005c060 0x7f504007a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3301/0 says I am v2:10.20.193.57:53472/0 (socket says 10.20.193.57:53472) 2026-02-20T16:31:02.068 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.063+0000 7f504600e640 1 -- 10.20.193.57:0/3429272041 learned_addr learned my addr 10.20.193.57:0/3429272041 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:31:02.068 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.063+0000 7f504680f640 1 --2- 10.20.193.57:0/3429272041 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f5040176890 0x7f504007adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:02.068 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.063+0000 7f504600e640 1 -- 10.20.193.57:0/3429272041 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f5040176890 msgr2=0x7f504007adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.068 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.063+0000 7f504600e640 1 --2- 10.20.193.57:0/3429272041 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f5040176890 0x7f504007adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.068 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.063+0000 7f504600e640 1 -- 10.20.193.57:0/3429272041 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f504005c970 msgr2=0x7f504007a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.068 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.063+0000 7f504600e640 1 --2- 10.20.193.57:0/3429272041 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f504005c970 0x7f504007a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.068 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.063+0000 7f504600e640 1 -- 10.20.193.57:0/3429272041 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f504007bc90 con 0x7f504005c060 2026-02-20T16:31:02.068 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.063+0000 7f504600e640 1 --2- 10.20.193.57:0/3429272041 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f504005c060 0x7f504007a340 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f503002fe20 tx=0x7f5030002900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:31:02.069 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.063+0000 7f5026ffd640 1 -- 10.20.193.57:0/3429272041 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5030046070 con 0x7f504005c060 2026-02-20T16:31:02.069 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.063+0000 7f5026ffd640 1 -- 10.20.193.57:0/3429272041 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5030002d30 con 0x7f504005c060 2026-02-20T16:31:02.069 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.063+0000 7f5048299640 1 -- 10.20.193.57:0/3429272041 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5040177360 con 0x7f504005c060 2026-02-20T16:31:02.069 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.063+0000 7f5026ffd640 1 -- 10.20.193.57:0/3429272041 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50300386d0 con 0x7f504005c060 2026-02-20T16:31:02.069 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.063+0000 7f5048299640 1 -- 10.20.193.57:0/3429272041 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5040196eb0 con 0x7f504005c060 2026-02-20T16:31:02.069 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.063+0000 7f5048299640 1 -- 10.20.193.57:0/3429272041 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f504005c430 con 0x7f504005c060 2026-02-20T16:31:02.069 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.064+0000 7f5026ffd640 1 -- 10.20.193.57:0/3429272041 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7f5030038870 con 0x7f504005c060 2026-02-20T16:31:02.069 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.064+0000 7f5026ffd640 1 -- 10.20.193.57:0/3429272041 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(30..30 src has 1..30) ==== 3026+0+0 (secure 0 0 0) 0x7f5030087ea0 con 0x7f504005c060 2026-02-20T16:31:02.070 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.065+0000 7f5026ffd640 1 -- 10.20.193.57:0/3429272041 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7f5030086f70 con 0x7f504005c060 2026-02-20T16:31:02.157 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.155+0000 7f5048299640 1 -- 10.20.193.57:0/3429272041 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f5040080340 con 0x7f504005c060 2026-02-20T16:31:02.158 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.156+0000 7f5026ffd640 1 -- 10.20.193.57:0/3429272041 <== mon.1 v2:10.20.193.57:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v10) ==== 74+0+116766 (secure 0 0 0) 0x7f5030086760 con 0x7f504005c060 2026-02-20T16:31:02.159 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:31:02.160 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.157+0000 7f5048299640 1 -- 10.20.193.57:0/3429272041 >> v1:10.20.193.57:6800/2007744879 conn(0x7f501004cae0 legacy=0x7f501006cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.161 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.157+0000 7f5048299640 1 -- 10.20.193.57:0/3429272041 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f504005c060 msgr2=0x7f504007a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.161 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.157+0000 7f5048299640 1 --2- 10.20.193.57:0/3429272041 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f504005c060 0x7f504007a340 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f503002fe20 tx=0x7f5030002900 comp rx=0 tx=0).stop 2026-02-20T16:31:02.161 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.157+0000 7f5048299640 1 -- 10.20.193.57:0/3429272041 shutdown_connections 2026-02-20T16:31:02.161 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.157+0000 7f5048299640 1 --2- 10.20.193.57:0/3429272041 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f5040176890 0x7f504007adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.161 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.157+0000 7f5048299640 1 --2- 10.20.193.57:0/3429272041 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f504005c970 0x7f504007a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.161 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.157+0000 7f5048299640 1 --2- 10.20.193.57:0/3429272041 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f504005c060 0x7f504007a340 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.161 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.157+0000 7f5048299640 1 -- 10.20.193.57:0/3429272041 >> 10.20.193.57:0/3429272041 conn(0x7f50400833e0 msgr2=0x7f5040185dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:02.161 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.157+0000 7f5048299640 1 -- 10.20.193.57:0/3429272041 shutdown_connections 2026-02-20T16:31:02.161 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.157+0000 7f5048299640 1 -- 10.20.193.57:0/3429272041 wait complete. 2026-02-20T16:31:02.167 INFO:teuthology.orchestra.run.trial057.stdout:{"epoch":10,"flags":0,"active_gid":14109,"active_name":"y","active_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6800","nonce":2007744879}]},"active_addr":"10.20.193.57:6800/2007744879","active_change":"2026-02-20T16:30:46.925000+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[{"gid":14103,"name":"x","mgr_features":4544132024016699391,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":20,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.57:0","nonce":786270893}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.57:0","nonce":3280315434}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.57:0","nonce":1343740510}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.57:0","nonce":1311891796}]}]} 2026-02-20T16:31:02.172 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-20T16:31:02.172 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-20T16:31:02.172 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-20T16:31:02.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.239+0000 7f5f1956b640 1 -- 10.20.193.57:0/1242364058 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f5f14081690 msgr2=0x7f5f14175130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.239+0000 7f5f1956b640 1 --2- 10.20.193.57:0/1242364058 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f5f14081690 0x7f5f14175130 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5efc004770 tx=0x7f5efc02f0e0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.239+0000 7f5f1956b640 1 -- 10.20.193.57:0/1242364058 shutdown_connections 2026-02-20T16:31:02.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.239+0000 7f5f1956b640 1 --2- 10.20.193.57:0/1242364058 >> v2:10.20.193.57:3300/0 conn(0x7f5f14175670 0x7f5f14195a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.239+0000 7f5f1956b640 1 --2- 10.20.193.57:0/1242364058 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f5f14081690 0x7f5f14175130 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.244 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.239+0000 7f5f1956b640 1 -- 10.20.193.57:0/1242364058 >> 10.20.193.57:0/1242364058 conn(0x7f5f140833e0 msgr2=0x7f5f140840b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:02.244 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.239+0000 7f5f1956b640 1 -- 10.20.193.57:0/1242364058 shutdown_connections 2026-02-20T16:31:02.244 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.239+0000 7f5f1956b640 1 -- 10.20.193.57:0/1242364058 wait complete. 2026-02-20T16:31:02.244 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.239+0000 7f5f1956b640 1 Processor -- start 2026-02-20T16:31:02.244 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.240+0000 7f5f1956b640 1 -- start start 2026-02-20T16:31:02.244 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.240+0000 7f5f1956b640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f5f14080bb0 0x7f5f1411ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:02.244 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.240+0000 7f5f1956b640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f5f14081690 0x7f5f14175130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:02.244 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.240+0000 7f5f1956b640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f5f14175670 0x7f5f1411cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:02.244 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.240+0000 7f5f1956b640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f5f1405ddd0 con 0x7f5f14080bb0 2026-02-20T16:31:02.244 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.240+0000 7f5f1956b640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f5f14196a00 con 0x7f5f14175670 2026-02-20T16:31:02.244 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.240+0000 7f5f1956b640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f5f14196880 con 0x7f5f14081690 2026-02-20T16:31:02.245 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.240+0000 7f5f12ffd640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f5f14080bb0 0x7f5f1411ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:02.245 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.240+0000 7f5f137fe640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f5f14175670 0x7f5f1411cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:02.245 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.240+0000 7f5f137fe640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f5f14175670 0x7f5f1411cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3301/0 says I am v2:10.20.193.57:53488/0 (socket says 10.20.193.57:53488) 2026-02-20T16:31:02.245 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.240+0000 7f5f12ffd640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f5f14080bb0 0x7f5f1411ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:52614/0 (socket says 10.20.193.57:52614) 2026-02-20T16:31:02.245 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.240+0000 7f5f137fe640 1 -- 10.20.193.57:0/3854705276 learned_addr learned my addr 10.20.193.57:0/3854705276 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:31:02.245 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.240+0000 7f5f127fc640 1 --2- 10.20.193.57:0/3854705276 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f5f14081690 0x7f5f14175130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:02.245 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.240+0000 7f5f137fe640 1 -- 10.20.193.57:0/3854705276 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f5f14081690 msgr2=0x7f5f14175130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.245 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.240+0000 7f5f137fe640 1 --2- 10.20.193.57:0/3854705276 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f5f14081690 0x7f5f14175130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.245 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.240+0000 7f5f137fe640 1 -- 10.20.193.57:0/3854705276 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f5f14080bb0 msgr2=0x7f5f1411ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.245 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.240+0000 7f5f137fe640 1 --2- 10.20.193.57:0/3854705276 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f5f14080bb0 0x7f5f1411ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.245 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.240+0000 7f5f137fe640 1 -- 10.20.193.57:0/3854705276 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f1405d0a0 con 0x7f5f14175670 2026-02-20T16:31:02.246 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.240+0000 7f5f12ffd640 1 --2- 10.20.193.57:0/3854705276 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f5f14080bb0 0x7f5f1411ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:31:02.246 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.240+0000 7f5f137fe640 1 --2- 10.20.193.57:0/3854705276 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f5f14175670 0x7f5f1411cf40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5f04009e90 tx=0x7f5f04009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:31:02.246 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.240+0000 7f5ef37fe640 1 -- 10.20.193.57:0/3854705276 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f0400cdf0 con 0x7f5f14175670 2026-02-20T16:31:02.246 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.240+0000 7f5ef37fe640 1 -- 10.20.193.57:0/3854705276 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f040090d0 con 0x7f5f14175670 2026-02-20T16:31:02.246 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.240+0000 7f5ef37fe640 1 -- 10.20.193.57:0/3854705276 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f04003a80 con 0x7f5f14175670 2026-02-20T16:31:02.246 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.240+0000 7f5f1956b640 1 -- 10.20.193.57:0/3854705276 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f1405d6c0 con 0x7f5f14175670 2026-02-20T16:31:02.246 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.240+0000 7f5f1956b640 1 -- 10.20.193.57:0/3854705276 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f14076ec0 con 0x7f5f14175670 2026-02-20T16:31:02.246 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.241+0000 7f5f1956b640 1 -- 10.20.193.57:0/3854705276 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f14080f80 con 0x7f5f14175670 2026-02-20T16:31:02.246 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.241+0000 7f5ef37fe640 1 -- 10.20.193.57:0/3854705276 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7f5f04003c20 con 0x7f5f14175670 2026-02-20T16:31:02.246 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.241+0000 7f5ef37fe640 1 -- 10.20.193.57:0/3854705276 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(30..30 src has 1..30) ==== 3026+0+0 (secure 0 0 0) 0x7f5f04064180 con 0x7f5f14175670 2026-02-20T16:31:02.247 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.243+0000 7f5ef37fe640 1 -- 10.20.193.57:0/3854705276 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7f5f04022020 con 0x7f5f14175670 2026-02-20T16:31:02.319 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.317+0000 7f5f1956b640 1 -- 10.20.193.57:0/3854705276 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5f14053200 con 0x7f5f14175670 2026-02-20T16:31:02.319 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.317+0000 7f5ef37fe640 1 -- 10.20.193.57:0/3854705276 <== mon.1 v2:10.20.193.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+9205 (secure 0 0 0) 0x7f5f04010040 con 0x7f5f14175670 2026-02-20T16:31:02.319 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:31:02.319 INFO:teuthology.orchestra.run.trial057.stdout:{"epoch":30,"fsid":"3b3c5c1a-0a2b-40b9-ac1d-921ada466f9e","created":"2026-02-20T16:29:22.501479+0000","modified":"2026-02-20T16:31:01.963309+0000","last_up_change":"2026-02-20T16:30:56.950147+0000","last_in_change":"2026-02-20T16:29:24.294147+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":9,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"squid","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T16:29:34.029059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-20T16:29:38.191724+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a3139827-dc3c-46f9-b211-d376e3dc92f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":20,"up_from":23,"up_thru":24,"down_at":21,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6801","nonce":4246367706}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6802","nonce":4246367706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6804","nonce":4246367706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6803","nonce":4246367706}]},"public_addr":"10.20.193.57:6801/4246367706","cluster_addr":"10.20.193.57:6802/4246367706","heartbeat_back_addr":"10.20.193.57:6804/4246367706","heartbeat_front_addr":"10.20.193.57:6803/4246367706","state":["exists","up"]},{"osd":1,"uuid":"00e7cb17-534c-4ac2-8486-585b3b8db0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":21,"up_from":24,"up_thru":24,"down_at":22,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6805","nonce":3794545817}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6806","nonce":3794545817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6808","nonce":3794545817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6807","nonce":3794545817}]},"public_addr":"10.20.193.57:6805/3794545817","cluster_addr":"10.20.193.57:6806/3794545817","heartbeat_back_addr":"10.20.193.57:6808/3794545817","heartbeat_front_addr":"10.20.193.57:6807/3794545817","state":["exists","up"]},{"osd":2,"uuid":"d0b55b31-45df-4c58-bf11-a72d44f21a00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":22,"up_from":25,"up_thru":26,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6809","nonce":3959776128}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6810","nonce":3959776128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6812","nonce":3959776128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6811","nonce":3959776128}]},"public_addr":"10.20.193.57:6809/3959776128","cluster_addr":"10.20.193.57:6810/3959776128","heartbeat_back_addr":"10.20.193.57:6812/3959776128","heartbeat_front_addr":"10.20.193.57:6811/3959776128","state":["exists","up"]},{"osd":3,"uuid":"b3bfbbd8-cfaf-4360-9a5b-c52e89ac3f75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":23,"up_from":26,"up_thru":26,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6813","nonce":2476353628}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6814","nonce":2476353628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6816","nonce":2476353628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6815","nonce":2476353628}]},"public_addr":"10.20.193.57:6813/2476353628","cluster_addr":"10.20.193.57:6814/2476353628","heartbeat_back_addr":"10.20.193.57:6816/2476353628","heartbeat_front_addr":"10.20.193.57:6815/2476353628","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T16:29:31.711310+0000","dead_epoch":21},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T16:29:31.724521+0000","dead_epoch":22},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T16:29:31.770683+0000","dead_epoch":23},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T16:29:31.821531+0000","dead_epoch":24}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.57:0/4240799477":"2026-02-21T16:30:46.924862+0000","10.20.193.57:0/1295824105":"2026-02-21T16:30:46.924862+0000","10.20.193.57:0/2316661359":"2026-02-21T16:30:46.924862+0000","10.20.193.57:0/3729051198":"2026-02-21T16:30:46.924862+0000","10.20.193.57:6800/4138285113":"2026-02-21T16:30:46.924862+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T16:31:02.321 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.318+0000 7f5f1956b640 1 -- 10.20.193.57:0/3854705276 >> v1:10.20.193.57:6800/2007744879 conn(0x7f5ee004cae0 legacy=0x7f5ee006cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.321 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.318+0000 7f5f1956b640 1 -- 10.20.193.57:0/3854705276 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f5f14175670 msgr2=0x7f5f1411cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.321 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.318+0000 7f5f1956b640 1 --2- 10.20.193.57:0/3854705276 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f5f14175670 0x7f5f1411cf40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5f04009e90 tx=0x7f5f04009f90 comp rx=0 tx=0).stop 2026-02-20T16:31:02.321 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.318+0000 7f5f1956b640 1 -- 10.20.193.57:0/3854705276 shutdown_connections 2026-02-20T16:31:02.321 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.318+0000 7f5f1956b640 1 --2- 10.20.193.57:0/3854705276 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f5f14175670 0x7f5f1411cf40 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.321 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.318+0000 7f5f1956b640 1 --2- 10.20.193.57:0/3854705276 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f5f14081690 0x7f5f14175130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.321 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.318+0000 7f5f1956b640 1 --2- 10.20.193.57:0/3854705276 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f5f14080bb0 0x7f5f1411ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.321 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.318+0000 7f5f1956b640 1 -- 10.20.193.57:0/3854705276 >> 10.20.193.57:0/3854705276 conn(0x7f5f140833e0 msgr2=0x7f5f14132790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:02.321 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.318+0000 7f5f1956b640 1 -- 10.20.193.57:0/3854705276 shutdown_connections 2026-02-20T16:31:02.321 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.318+0000 7f5f1956b640 1 -- 10.20.193.57:0/3854705276 wait complete. 2026-02-20T16:31:02.327 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-20T16:31:02.327 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-20T16:31:02.399 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.395+0000 7f19586e6640 1 -- 10.20.193.57:0/2048867643 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f1950085b90 msgr2=0x7f195007d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.399 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.395+0000 7f19586e6640 1 --2- 10.20.193.57:0/2048867643 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f1950085b90 0x7f195007d720 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1940005ea0 tx=0x7f194002f220 comp rx=0 tx=0).stop 2026-02-20T16:31:02.399 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.395+0000 7f19586e6640 1 -- 10.20.193.57:0/2048867643 shutdown_connections 2026-02-20T16:31:02.399 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.395+0000 7f19586e6640 1 --2- 10.20.193.57:0/2048867643 >> v2:10.20.193.57:3300/0 conn(0x7f1950173320 0x7f1950193700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.399 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.395+0000 7f19586e6640 1 --2- 10.20.193.57:0/2048867643 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f195007dc60 0x7f195007e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.399 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.395+0000 7f19586e6640 1 --2- 10.20.193.57:0/2048867643 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f1950085b90 0x7f195007d720 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.400 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.395+0000 7f19586e6640 1 -- 10.20.193.57:0/2048867643 >> 10.20.193.57:0/2048867643 conn(0x7f19500833e0 msgr2=0x7f19500840b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:02.400 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.395+0000 7f19586e6640 1 -- 10.20.193.57:0/2048867643 shutdown_connections 2026-02-20T16:31:02.400 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.395+0000 7f19586e6640 1 -- 10.20.193.57:0/2048867643 wait complete. 2026-02-20T16:31:02.400 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.395+0000 7f19586e6640 1 Processor -- start 2026-02-20T16:31:02.400 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.395+0000 7f19586e6640 1 -- start start 2026-02-20T16:31:02.400 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.395+0000 7f19586e6640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f195007dc60 0x7f195007ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:02.400 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.395+0000 7f19586e6640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f1950085b90 0x7f195007b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:02.400 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.395+0000 7f19586e6640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f1950173320 0x7f195007b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:02.400 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.395+0000 7f19586e6640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f1950081f70 con 0x7f1950085b90 2026-02-20T16:31:02.400 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.395+0000 7f19586e6640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f1950081df0 con 0x7f195007dc60 2026-02-20T16:31:02.400 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.395+0000 7f19586e6640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f19500820f0 con 0x7f1950173320 2026-02-20T16:31:02.401 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.396+0000 7f1956c5c640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f1950173320 0x7f195007b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:02.401 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.396+0000 7f195645b640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f195007dc60 0x7f195007ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:02.401 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.396+0000 7f1955c5a640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f1950085b90 0x7f195007b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:02.401 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.396+0000 7f1956c5c640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f1950173320 0x7f195007b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3302/0 says I am v2:10.20.193.57:44774/0 (socket says 10.20.193.57:44774) 2026-02-20T16:31:02.401 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.396+0000 7f195645b640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f195007dc60 0x7f195007ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3301/0 says I am v2:10.20.193.57:53506/0 (socket says 10.20.193.57:53506) 2026-02-20T16:31:02.401 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.396+0000 7f1956c5c640 1 -- 10.20.193.57:0/2603469109 learned_addr learned my addr 10.20.193.57:0/2603469109 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:31:02.401 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.396+0000 7f195645b640 1 -- 10.20.193.57:0/2603469109 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f1950173320 msgr2=0x7f195007b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.401 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.396+0000 7f195645b640 1 --2- 10.20.193.57:0/2603469109 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f1950173320 0x7f195007b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.401 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.396+0000 7f195645b640 1 -- 10.20.193.57:0/2603469109 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f1950085b90 msgr2=0x7f195007b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.401 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.396+0000 7f195645b640 1 --2- 10.20.193.57:0/2603469109 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f1950085b90 0x7f195007b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.401 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.396+0000 7f195645b640 1 -- 10.20.193.57:0/2603469109 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f195007cea0 con 0x7f195007dc60 2026-02-20T16:31:02.401 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.396+0000 7f195645b640 1 --2- 10.20.193.57:0/2603469109 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f195007dc60 0x7f195007ab80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1940009a80 tx=0x7f1940002900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:31:02.402 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.396+0000 7f1936ffd640 1 -- 10.20.193.57:0/2603469109 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1940046070 con 0x7f195007dc60 2026-02-20T16:31:02.402 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.396+0000 7f1936ffd640 1 -- 10.20.193.57:0/2603469109 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f19400045b0 con 0x7f195007dc60 2026-02-20T16:31:02.402 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.396+0000 7f19586e6640 1 -- 10.20.193.57:0/2603469109 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f195007cbf0 con 0x7f195007dc60 2026-02-20T16:31:02.402 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.396+0000 7f1936ffd640 1 -- 10.20.193.57:0/2603469109 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1940038470 con 0x7f195007dc60 2026-02-20T16:31:02.402 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.396+0000 7f19586e6640 1 -- 10.20.193.57:0/2603469109 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1950177d40 con 0x7f195007dc60 2026-02-20T16:31:02.402 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.396+0000 7f1936ffd640 1 -- 10.20.193.57:0/2603469109 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7f1940038610 con 0x7f195007dc60 2026-02-20T16:31:02.402 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.397+0000 7f19586e6640 1 -- 10.20.193.57:0/2603469109 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f195005ace0 con 0x7f195007dc60 2026-02-20T16:31:02.402 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.397+0000 7f1936ffd640 1 -- 10.20.193.57:0/2603469109 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(30..30 src has 1..30) ==== 3026+0+0 (secure 0 0 0) 0x7f1940087d40 con 0x7f195007dc60 2026-02-20T16:31:02.403 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.398+0000 7f1936ffd640 1 -- 10.20.193.57:0/2603469109 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7f195005ace0 con 0x7f195007dc60 2026-02-20T16:31:02.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.477+0000 7f19586e6640 1 -- 10.20.193.57:0/2603469109 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f195007e030 con 0x7f195007dc60 2026-02-20T16:31:02.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.478+0000 7f1936ffd640 1 -- 10.20.193.57:0/2603469109 <== mon.1 v2:10.20.193.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+9205 (secure 0 0 0) 0x7f195007cea0 con 0x7f195007dc60 2026-02-20T16:31:02.480 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:31:02.481 INFO:teuthology.orchestra.run.trial057.stdout:{"epoch":30,"fsid":"3b3c5c1a-0a2b-40b9-ac1d-921ada466f9e","created":"2026-02-20T16:29:22.501479+0000","modified":"2026-02-20T16:31:01.963309+0000","last_up_change":"2026-02-20T16:30:56.950147+0000","last_in_change":"2026-02-20T16:29:24.294147+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":9,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"squid","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T16:29:34.029059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-20T16:29:38.191724+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a3139827-dc3c-46f9-b211-d376e3dc92f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":20,"up_from":23,"up_thru":24,"down_at":21,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6801","nonce":4246367706}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6802","nonce":4246367706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6804","nonce":4246367706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6803","nonce":4246367706}]},"public_addr":"10.20.193.57:6801/4246367706","cluster_addr":"10.20.193.57:6802/4246367706","heartbeat_back_addr":"10.20.193.57:6804/4246367706","heartbeat_front_addr":"10.20.193.57:6803/4246367706","state":["exists","up"]},{"osd":1,"uuid":"00e7cb17-534c-4ac2-8486-585b3b8db0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":21,"up_from":24,"up_thru":24,"down_at":22,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6805","nonce":3794545817}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6806","nonce":3794545817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6808","nonce":3794545817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6807","nonce":3794545817}]},"public_addr":"10.20.193.57:6805/3794545817","cluster_addr":"10.20.193.57:6806/3794545817","heartbeat_back_addr":"10.20.193.57:6808/3794545817","heartbeat_front_addr":"10.20.193.57:6807/3794545817","state":["exists","up"]},{"osd":2,"uuid":"d0b55b31-45df-4c58-bf11-a72d44f21a00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":22,"up_from":25,"up_thru":26,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6809","nonce":3959776128}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6810","nonce":3959776128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6812","nonce":3959776128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6811","nonce":3959776128}]},"public_addr":"10.20.193.57:6809/3959776128","cluster_addr":"10.20.193.57:6810/3959776128","heartbeat_back_addr":"10.20.193.57:6812/3959776128","heartbeat_front_addr":"10.20.193.57:6811/3959776128","state":["exists","up"]},{"osd":3,"uuid":"b3bfbbd8-cfaf-4360-9a5b-c52e89ac3f75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":23,"up_from":26,"up_thru":26,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6813","nonce":2476353628}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6814","nonce":2476353628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6816","nonce":2476353628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6815","nonce":2476353628}]},"public_addr":"10.20.193.57:6813/2476353628","cluster_addr":"10.20.193.57:6814/2476353628","heartbeat_back_addr":"10.20.193.57:6816/2476353628","heartbeat_front_addr":"10.20.193.57:6815/2476353628","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T16:29:31.711310+0000","dead_epoch":21},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T16:29:31.724521+0000","dead_epoch":22},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T16:29:31.770683+0000","dead_epoch":23},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T16:29:31.821531+0000","dead_epoch":24}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.57:0/4240799477":"2026-02-21T16:30:46.924862+0000","10.20.193.57:0/1295824105":"2026-02-21T16:30:46.924862+0000","10.20.193.57:0/2316661359":"2026-02-21T16:30:46.924862+0000","10.20.193.57:0/3729051198":"2026-02-21T16:30:46.924862+0000","10.20.193.57:6800/4138285113":"2026-02-21T16:30:46.924862+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T16:31:02.482 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.479+0000 7f19586e6640 1 -- 10.20.193.57:0/2603469109 >> v1:10.20.193.57:6800/2007744879 conn(0x7f192004cae0 legacy=0x7f192006cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.482 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.479+0000 7f19586e6640 1 -- 10.20.193.57:0/2603469109 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f195007dc60 msgr2=0x7f195007ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.482 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.479+0000 7f19586e6640 1 --2- 10.20.193.57:0/2603469109 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f195007dc60 0x7f195007ab80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1940009a80 tx=0x7f1940002900 comp rx=0 tx=0).stop 2026-02-20T16:31:02.482 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.479+0000 7f19586e6640 1 -- 10.20.193.57:0/2603469109 shutdown_connections 2026-02-20T16:31:02.482 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.479+0000 7f19586e6640 1 --2- 10.20.193.57:0/2603469109 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f1950173320 0x7f195007b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.479+0000 7f19586e6640 1 --2- 10.20.193.57:0/2603469109 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f1950085b90 0x7f195007b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.479+0000 7f19586e6640 1 --2- 10.20.193.57:0/2603469109 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f195007dc60 0x7f195007ab80 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.479+0000 7f19586e6640 1 -- 10.20.193.57:0/2603469109 >> 10.20.193.57:0/2603469109 conn(0x7f19500833e0 msgr2=0x7f195005b250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:02.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.479+0000 7f19586e6640 1 -- 10.20.193.57:0/2603469109 shutdown_connections 2026-02-20T16:31:02.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.479+0000 7f19586e6640 1 -- 10.20.193.57:0/2603469109 wait complete. 2026-02-20T16:31:02.489 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-20T16:31:02.489 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-20T16:31:02.490 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-20T16:31:02.490 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-20T16:31:02.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.559+0000 7fa232bed640 1 -- 10.20.193.57:0/2251454628 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fa22c136ac0 msgr2=0x7fa22c198280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.559+0000 7fa232bed640 1 --2- 10.20.193.57:0/2251454628 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fa22c136ac0 0x7fa22c198280 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa228009f10 tx=0x7fa22802f290 comp rx=0 tx=0).stop 2026-02-20T16:31:02.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.559+0000 7fa232bed640 1 -- 10.20.193.57:0/2251454628 shutdown_connections 2026-02-20T16:31:02.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.559+0000 7fa232bed640 1 --2- 10.20.193.57:0/2251454628 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fa22c136ac0 0x7fa22c198280 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.559+0000 7fa232bed640 1 --2- 10.20.193.57:0/2251454628 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fa22c130220 0x7fa22c086570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.559+0000 7fa232bed640 1 -- 10.20.193.57:0/2251454628 >> 10.20.193.57:0/2251454628 conn(0x7fa22c08aae0 msgr2=0x7fa22c08aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:02.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.559+0000 7fa232bed640 1 -- 10.20.193.57:0/2251454628 shutdown_connections 2026-02-20T16:31:02.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.559+0000 7fa232bed640 1 -- 10.20.193.57:0/2251454628 wait complete. 2026-02-20T16:31:02.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.559+0000 7fbafae92640 1 -- 10.20.193.57:0/1828228895 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fbaf4085b90 msgr2=0x7fbaf407d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.559+0000 7fbafae92640 1 --2- 10.20.193.57:0/1828228895 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fbaf4085b90 0x7fbaf407d720 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbae4005fd0 tx=0x7fbae402f260 comp rx=0 tx=0).stop 2026-02-20T16:31:02.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.559+0000 7fbafae92640 1 -- 10.20.193.57:0/1828228895 shutdown_connections 2026-02-20T16:31:02.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.559+0000 7fbafae92640 1 --2- 10.20.193.57:0/1828228895 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fbaf4174330 0x7fbaf4194710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.559+0000 7fbafae92640 1 --2- 10.20.193.57:0/1828228895 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fbaf4085b90 0x7fbaf407d720 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.559+0000 7fbafae92640 1 -- 10.20.193.57:0/1828228895 >> 10.20.193.57:0/1828228895 conn(0x7fbaf40833e0 msgr2=0x7fbaf40840b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:02.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.560+0000 7fbafae92640 1 -- 10.20.193.57:0/1828228895 shutdown_connections 2026-02-20T16:31:02.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.560+0000 7fbafae92640 1 -- 10.20.193.57:0/1828228895 wait complete. 2026-02-20T16:31:02.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.560+0000 7f0ecd4ca640 1 -- 10.20.193.57:0/3935867778 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f0eb4003b10 msgr2=0x7f0eb4003f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.560+0000 7f0ecd4ca640 1 --2- 10.20.193.57:0/3935867778 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f0eb4003b10 0x7f0eb4003f20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc006fa0 tx=0x7f0ebc02f8c0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.560+0000 7f0ec77fe640 1 -- 10.20.193.57:0/3935867778 reap_dead start 2026-02-20T16:31:02.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.560+0000 7f09f3f33640 1 -- 10.20.193.57:0/50591280 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f09ec174330 msgr2=0x7f09ec194710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.560+0000 7f09f3f33640 1 --2- 10.20.193.57:0/50591280 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f09ec174330 0x7f09ec194710 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f09e8009f10 tx=0x7f09e802f380 comp rx=0 tx=0).stop 2026-02-20T16:31:02.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.560+0000 7f0ecd4ca640 1 -- 10.20.193.57:0/3935867778 shutdown_connections 2026-02-20T16:31:02.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.560+0000 7f0ecd4ca640 1 -- 10.20.193.57:0/3935867778 >> 10.20.193.57:0/3935867778 conn(0x7f0ec80833e0 msgr2=0x7f0ec80840b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:02.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.560+0000 7f09f3f33640 1 -- 10.20.193.57:0/50591280 shutdown_connections 2026-02-20T16:31:02.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.560+0000 7f09f3f33640 1 --2- 10.20.193.57:0/50591280 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f09ec174330 0x7f09ec194710 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.560+0000 7f09f3f33640 1 --2- 10.20.193.57:0/50591280 >> v2:10.20.193.57:3300/0 conn(0x7f09ec07de30 0x7f09ec07e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.560+0000 7f09f3f33640 1 -- 10.20.193.57:0/50591280 >> 10.20.193.57:0/50591280 conn(0x7f09ec0833e0 msgr2=0x7f09ec0840b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:02.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.560+0000 7f0ecd4ca640 1 -- 10.20.193.57:0/3935867778 shutdown_connections 2026-02-20T16:31:02.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.560+0000 7f09f3f33640 1 -- 10.20.193.57:0/50591280 shutdown_connections 2026-02-20T16:31:02.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.560+0000 7f09f3f33640 1 -- 10.20.193.57:0/50591280 wait complete. 2026-02-20T16:31:02.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.560+0000 7f0ecd4ca640 1 -- 10.20.193.57:0/3935867778 wait complete. 2026-02-20T16:31:02.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.560+0000 7fa232bed640 1 Processor -- start 2026-02-20T16:31:02.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.560+0000 7fa232bed640 1 -- start start 2026-02-20T16:31:02.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.560+0000 7fa232bed640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fa22c130220 0x7fa22c112e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:02.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.560+0000 7fa232bed640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fa22c135f40 0x7fa22c113350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:02.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.560+0000 7fa232bed640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fa22c136ac0 0x7fa22c11ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:02.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.560+0000 7fa232bed640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7fa22c198da0 con 0x7fa22c135f40 2026-02-20T16:31:02.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.560+0000 7fa232bed640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7fa22c198c20 con 0x7fa22c130220 2026-02-20T16:31:02.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.560+0000 7fa232bed640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7fa22c198f20 con 0x7fa22c136ac0 2026-02-20T16:31:02.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.560+0000 7fa230962640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fa22c130220 0x7fa22c112e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:02.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.560+0000 7fa230962640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fa22c130220 0x7fa22c112e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3301/0 says I am v2:10.20.193.57:53540/0 (socket says 10.20.193.57:53540) 2026-02-20T16:31:02.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.560+0000 7fa230962640 1 -- 10.20.193.57:0/710006868 learned_addr learned my addr 10.20.193.57:0/710006868 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:31:02.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.560+0000 7fa223fff640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fa22c135f40 0x7fa22c113350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:02.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.560+0000 7fa231163640 1 --2- 10.20.193.57:0/710006868 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fa22c136ac0 0x7fa22c11ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:02.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.560+0000 7fbafae92640 1 Processor -- start 2026-02-20T16:31:02.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.560+0000 7f09f3f33640 1 Processor -- start 2026-02-20T16:31:02.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.560+0000 7f0ecd4ca640 1 Processor -- start 2026-02-20T16:31:02.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.560+0000 7fbafae92640 1 -- start start 2026-02-20T16:31:02.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.560+0000 7fa230962640 1 -- 10.20.193.57:0/710006868 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fa22c136ac0 msgr2=0x7fa22c11ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.560+0000 7fa230962640 1 --2- 10.20.193.57:0/710006868 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fa22c136ac0 0x7fa22c11ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.560+0000 7f09f3f33640 1 -- start start 2026-02-20T16:31:02.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.560+0000 7fa230962640 1 -- 10.20.193.57:0/710006868 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fa22c135f40 msgr2=0x7fa22c113350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.560+0000 7fa230962640 1 --2- 10.20.193.57:0/710006868 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fa22c135f40 0x7fa22c113350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.560+0000 7fa230962640 1 -- 10.20.193.57:0/710006868 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa22c1150c0 con 0x7fa22c130220 2026-02-20T16:31:02.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.560+0000 7fa223fff640 1 --2- 10.20.193.57:0/710006868 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fa22c135f40 0x7fa22c113350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:31:02.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.560+0000 7f0ecd4ca640 1 -- start start 2026-02-20T16:31:02.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.560+0000 7fa230962640 1 --2- 10.20.193.57:0/710006868 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fa22c130220 0x7fa22c112e10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa21c005970 tx=0x7fa21c00ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:31:02.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7fa2217fa640 1 -- 10.20.193.57:0/710006868 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21c00ccf0 con 0x7fa22c130220 2026-02-20T16:31:02.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7fa2217fa640 1 -- 10.20.193.57:0/710006868 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa21c004880 con 0x7fa22c130220 2026-02-20T16:31:02.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7fa232bed640 1 -- 10.20.193.57:0/710006868 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa22c058170 con 0x7fa22c130220 2026-02-20T16:31:02.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7f09f3f33640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f09ec07de30 0x7f09ec121fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:02.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7f09f3f33640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f09ec085b90 0x7f09ec122500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:02.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7fa2217fa640 1 -- 10.20.193.57:0/710006868 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21c004cd0 con 0x7fa22c130220 2026-02-20T16:31:02.577 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7f09f3f33640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f09ec174330 0x7f09ec125380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:02.577 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7f09f3f33640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f09ec195810 con 0x7f09ec085b90 2026-02-20T16:31:02.577 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7f09f3f33640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f09ec195690 con 0x7f09ec174330 2026-02-20T16:31:02.577 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7f09f3f33640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f09ec195990 con 0x7f09ec07de30 2026-02-20T16:31:02.578 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7fa232bed640 1 -- 10.20.193.57:0/710006868 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa22c113890 con 0x7fa22c130220 2026-02-20T16:31:02.578 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7fbafae92640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fbaf407dc60 0x7fbaf4125b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:02.578 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7fbafae92640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fbaf4085b90 0x7fbaf4126090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:02.579 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7f0ecd4ca640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f0ec81331f0 0x7f0ec8175130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:02.579 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7fbafae92640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fbaf4174330 0x7fbaf407b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:02.579 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7f09f1ca8640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f09ec07de30 0x7f09ec121fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:02.580 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7fbafae92640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf4195860 con 0x7fbaf4174330 2026-02-20T16:31:02.580 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7fbafae92640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7fbaf41956e0 con 0x7fbaf407dc60 2026-02-20T16:31:02.580 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7fbafae92640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7fbaf41959e0 con 0x7fbaf4085b90 2026-02-20T16:31:02.580 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7f0ecd4ca640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f0ec81335c0 0x7f0ec8133a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:02.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7f09f1ca8640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f09ec07de30 0x7f09ec121fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3302/0 says I am v2:10.20.193.57:44826/0 (socket says 10.20.193.57:44826) 2026-02-20T16:31:02.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7f09f1ca8640 1 -- 10.20.193.57:0/1292334096 learned_addr learned my addr 10.20.193.57:0/1292334096 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:31:02.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7f0ecd4ca640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f0ec811eed0 0x7f0ec811f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:02.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7f0ecd4ca640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec8176430 con 0x7f0ec811eed0 2026-02-20T16:31:02.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7f0ecd4ca640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f0ec81762b0 con 0x7f0ec81335c0 2026-02-20T16:31:02.582 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7f0ecd4ca640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f0ec81765b0 con 0x7f0ec81331f0 2026-02-20T16:31:02.582 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7f09f24a9640 1 --2- 10.20.193.57:0/1292334096 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f09ec174330 0x7f09ec125380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:02.582 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7f0ec6ffd640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f0ec81331f0 0x7f0ec8175130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:02.583 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7fbaebfff640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fbaf4085b90 0x7fbaf4126090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:02.583 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7fbaf9408640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fbaf4174330 0x7fbaf407b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:02.583 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7fbaebfff640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fbaf4085b90 0x7fbaf4126090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3302/0 says I am v2:10.20.193.57:44832/0 (socket says 10.20.193.57:44832) 2026-02-20T16:31:02.583 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7f0ec6ffd640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f0ec81331f0 0x7f0ec8175130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3302/0 says I am v2:10.20.193.57:44836/0 (socket says 10.20.193.57:44836) 2026-02-20T16:31:02.583 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7f09f14a7640 1 --2- 10.20.193.57:0/1292334096 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f09ec085b90 0x7f09ec122500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:02.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7fbaebfff640 1 -- 10.20.193.57:0/1544282638 learned_addr learned my addr 10.20.193.57:0/1544282638 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:31:02.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7fbaf8c07640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fbaf407dc60 0x7fbaf4125b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:02.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7f0ec6ffd640 1 -- 10.20.193.57:0/956651670 learned_addr learned my addr 10.20.193.57:0/956651670 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:31:02.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7f0ec77fe640 1 --2- 10.20.193.57:0/956651670 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f0ec811eed0 0x7f0ec811f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:02.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7f0ec67fc640 1 --2- 10.20.193.57:0/956651670 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f0ec81335c0 0x7f0ec8133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:02.585 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7f09f24a9640 1 -- 10.20.193.57:0/1292334096 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f09ec07de30 msgr2=0x7f09ec121fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.585 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7f09f24a9640 1 --2- 10.20.193.57:0/1292334096 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f09ec07de30 0x7f09ec121fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.585 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7f09f24a9640 1 -- 10.20.193.57:0/1292334096 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f09ec085b90 msgr2=0x7f09ec122500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.585 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7f09f24a9640 1 --2- 10.20.193.57:0/1292334096 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f09ec085b90 0x7f09ec122500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7f09f24a9640 1 -- 10.20.193.57:0/1292334096 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09ec10e760 con 0x7f09ec174330 2026-02-20T16:31:02.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7f09f1ca8640 1 --2- 10.20.193.57:0/1292334096 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f09ec07de30 0x7f09ec121fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:31:02.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7fbaf9408640 1 -- 10.20.193.57:0/1544282638 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fbaf4085b90 msgr2=0x7fbaf4126090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7fbaf9408640 1 --2- 10.20.193.57:0/1544282638 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fbaf4085b90 0x7fbaf4126090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7fbaf9408640 1 -- 10.20.193.57:0/1544282638 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fbaf407dc60 msgr2=0x7fbaf4125b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7fbaf9408640 1 --2- 10.20.193.57:0/1544282638 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fbaf407dc60 0x7fbaf4125b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7fbaf9408640 1 -- 10.20.193.57:0/1544282638 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaf407f8f0 con 0x7fbaf4174330 2026-02-20T16:31:02.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7f09f24a9640 1 --2- 10.20.193.57:0/1292334096 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f09ec174330 0x7f09ec125380 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f09e8009f10 tx=0x7f09e8002c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:31:02.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7fbaf9408640 1 --2- 10.20.193.57:0/1544282638 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fbaf4174330 0x7fbaf407b310 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbaf0004af0 tx=0x7fbaf000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:31:02.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7fa232bed640 1 -- 10.20.193.57:0/710006868 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa22c086570 con 0x7fa22c130220 2026-02-20T16:31:02.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7f0ec67fc640 1 -- 10.20.193.57:0/956651670 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f0ec81331f0 msgr2=0x7f0ec8175130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7f0ec67fc640 1 --2- 10.20.193.57:0/956651670 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f0ec81331f0 0x7f0ec8175130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7f0ec67fc640 1 -- 10.20.193.57:0/956651670 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f0ec811eed0 msgr2=0x7f0ec811f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7f0ec67fc640 1 --2- 10.20.193.57:0/956651670 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f0ec811eed0 0x7f0ec811f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7f0ec67fc640 1 -- 10.20.193.57:0/956651670 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ec810c910 con 0x7f0ec81335c0 2026-02-20T16:31:02.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7f0ec6ffd640 1 --2- 10.20.193.57:0/956651670 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f0ec81331f0 0x7f0ec8175130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:31:02.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7fbae97fa640 1 -- 10.20.193.57:0/1544282638 <== mon.0 v2:10.20.193.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf00092e0 con 0x7fbaf4174330 2026-02-20T16:31:02.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7fbae97fa640 1 -- 10.20.193.57:0/1544282638 <== mon.0 v2:10.20.193.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbaf000cb30 con 0x7fbaf4174330 2026-02-20T16:31:02.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7fbae97fa640 1 -- 10.20.193.57:0/1544282638 <== mon.0 v2:10.20.193.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf0003a80 con 0x7fbaf4174330 2026-02-20T16:31:02.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7fbafae92640 1 -- 10.20.193.57:0/1544282638 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaf41265d0 con 0x7fbaf4174330 2026-02-20T16:31:02.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7f0ec67fc640 1 --2- 10.20.193.57:0/956651670 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f0ec81335c0 0x7f0ec8133a30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0005fd0 tx=0x7f0eb0002aa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:31:02.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7fbafae92640 1 -- 10.20.193.57:0/1544282638 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaf4075e50 con 0x7fbaf4174330 2026-02-20T16:31:02.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7f0ea77fe640 1 -- 10.20.193.57:0/956651670 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb0011b90 con 0x7f0ec81335c0 2026-02-20T16:31:02.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7f0ea77fe640 1 -- 10.20.193.57:0/956651670 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0eb0011d30 con 0x7f0ec81335c0 2026-02-20T16:31:02.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7f0ecd4ca640 1 -- 10.20.193.57:0/956651670 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ec810b8f0 con 0x7f0ec81335c0 2026-02-20T16:31:02.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7f0ea77fe640 1 -- 10.20.193.57:0/956651670 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb0004ae0 con 0x7f0ec81335c0 2026-02-20T16:31:02.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7f0ecd4ca640 1 -- 10.20.193.57:0/956651670 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ec811f860 con 0x7f0ec81335c0 2026-02-20T16:31:02.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.561+0000 7fa2217fa640 1 -- 10.20.193.57:0/710006868 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7fa21c004080 con 0x7fa22c130220 2026-02-20T16:31:02.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.562+0000 7f09da7fc640 1 -- 10.20.193.57:0/1292334096 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e80040c0 con 0x7f09ec174330 2026-02-20T16:31:02.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.562+0000 7f09da7fc640 1 -- 10.20.193.57:0/1292334096 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f09e8004260 con 0x7f09ec174330 2026-02-20T16:31:02.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.562+0000 7f09f3f33640 1 -- 10.20.193.57:0/1292334096 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09ec07f8f0 con 0x7f09ec174330 2026-02-20T16:31:02.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.562+0000 7f09da7fc640 1 -- 10.20.193.57:0/1292334096 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e8004690 con 0x7f09ec174330 2026-02-20T16:31:02.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.562+0000 7f09f3f33640 1 -- 10.20.193.57:0/1292334096 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f09ec122c20 con 0x7f09ec174330 2026-02-20T16:31:02.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.562+0000 7fbafae92640 1 -- 10.20.193.57:0/1544282638 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbaf4076820 con 0x7fbaf4174330 2026-02-20T16:31:02.592 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.562+0000 7fa2217fa640 1 -- 10.20.193.57:0/710006868 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(30..30 src has 1..30) ==== 3026+0+0 (secure 0 0 0) 0x7fa21c064270 con 0x7fa22c130220 2026-02-20T16:31:02.592 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.562+0000 7f0ecd4ca640 1 -- 10.20.193.57:0/956651670 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0ec807f330 con 0x7f0ec81335c0 2026-02-20T16:31:02.592 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.562+0000 7fa2217fa640 1 -- 10.20.193.57:0/710006868 --> v1:10.20.193.57:6801/4246367706 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa21c010e50 con 0x7fa1fc071400 2026-02-20T16:31:02.592 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.562+0000 7fa2217fa640 1 -- 10.20.193.57:0/710006868 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa21c06b050 con 0x7fa22c130220 2026-02-20T16:31:02.592 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.562+0000 7f09f3f33640 1 -- 10.20.193.57:0/1292334096 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f09ec07e230 con 0x7f09ec174330 2026-02-20T16:31:02.592 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.562+0000 7fbae97fa640 1 -- 10.20.193.57:0/1544282638 <== mon.0 v2:10.20.193.57:3300/0 4 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7fbaf0007500 con 0x7fbaf4174330 2026-02-20T16:31:02.592 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.562+0000 7f0ea77fe640 1 -- 10.20.193.57:0/956651670 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7f0eb0018070 con 0x7f0ec81335c0 2026-02-20T16:31:02.592 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.562+0000 7f09da7fc640 1 -- 10.20.193.57:0/1292334096 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7f09e8007420 con 0x7f09ec174330 2026-02-20T16:31:02.593 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.562+0000 7fbae97fa640 1 -- 10.20.193.57:0/1544282638 <== mon.0 v2:10.20.193.57:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3026+0+0 (secure 0 0 0) 0x7fbaf0064d30 con 0x7fbaf4174330 2026-02-20T16:31:02.593 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.562+0000 7fbae97fa640 1 -- 10.20.193.57:0/1544282638 --> v1:10.20.193.57:6809/3959776128 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbaf0025e50 con 0x7fbac4071400 2026-02-20T16:31:02.593 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.562+0000 7fbae97fa640 1 -- 10.20.193.57:0/1544282638 <== mon.0 v2:10.20.193.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbaf0065190 con 0x7fbaf4174330 2026-02-20T16:31:02.593 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.562+0000 7f0ea77fe640 1 -- 10.20.193.57:0/956651670 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(30..30 src has 1..30) ==== 3026+0+0 (secure 0 0 0) 0x7f0eb0063f70 con 0x7f0ec81335c0 2026-02-20T16:31:02.593 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.562+0000 7f0ea77fe640 1 -- 10.20.193.57:0/956651670 --> v1:10.20.193.57:6813/2476353628 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0eb0018e50 con 0x7f0e94071390 2026-02-20T16:31:02.593 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.562+0000 7f0ea77fe640 1 -- 10.20.193.57:0/956651670 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0eb00665e0 con 0x7f0ec81335c0 2026-02-20T16:31:02.593 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.563+0000 7fa2217fa640 1 -- 10.20.193.57:0/710006868 <== osd.0 v1:10.20.193.57:6801/4246367706 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fa21c010e50 con 0x7fa1fc071400 2026-02-20T16:31:02.593 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.563+0000 7f09da7fc640 1 -- 10.20.193.57:0/1292334096 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(30..30 src has 1..30) ==== 3026+0+0 (secure 0 0 0) 0x7f09e80879a0 con 0x7f09ec174330 2026-02-20T16:31:02.593 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.563+0000 7f09da7fc640 1 -- 10.20.193.57:0/1292334096 --> v1:10.20.193.57:6805/3794545817 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f09e8043e70 con 0x7f09bc071450 2026-02-20T16:31:02.593 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.563+0000 7f09da7fc640 1 -- 10.20.193.57:0/1292334096 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f09e808c2c0 con 0x7f09ec174330 2026-02-20T16:31:02.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.563+0000 7fbae97fa640 1 -- 10.20.193.57:0/1544282638 <== osd.2 v1:10.20.193.57:6809/3959776128 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fbaf0025e50 con 0x7fbac4071400 2026-02-20T16:31:02.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.563+0000 7f0ea77fe640 1 -- 10.20.193.57:0/956651670 <== osd.3 v1:10.20.193.57:6813/2476353628 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f0eb0018e50 con 0x7f0e94071390 2026-02-20T16:31:02.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.563+0000 7f09da7fc640 1 -- 10.20.193.57:0/1292334096 <== osd.1 v1:10.20.193.57:6805/3794545817 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f09e8043e70 con 0x7f09bc071450 2026-02-20T16:31:02.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.570+0000 7fa232bed640 1 -- 10.20.193.57:0/710006868 --> v1:10.20.193.57:6801/4246367706 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa22c135040 con 0x7fa1fc071400 2026-02-20T16:31:02.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.570+0000 7fa2217fa640 1 -- 10.20.193.57:0/710006868 <== osd.0 v1:10.20.193.57:6801/4246367706 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1793987854) 0x7fa22c135040 con 0x7fa1fc071400 2026-02-20T16:31:02.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.570+0000 7fa232bed640 1 -- 10.20.193.57:0/710006868 >> v1:10.20.193.57:6801/4246367706 conn(0x7fa1fc071400 legacy=0x7fa1fc091830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.570+0000 7fa232bed640 1 -- 10.20.193.57:0/710006868 >> v1:10.20.193.57:6800/2007744879 conn(0x7fa1fc04cae0 legacy=0x7fa1fc06cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.570+0000 7fa232bed640 1 -- 10.20.193.57:0/710006868 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fa22c130220 msgr2=0x7fa22c112e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.570+0000 7fa232bed640 1 --2- 10.20.193.57:0/710006868 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fa22c130220 0x7fa22c112e10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa21c005970 tx=0x7fa21c00ee60 comp rx=0 tx=0).stop 2026-02-20T16:31:02.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.570+0000 7fa231163640 1 -- 10.20.193.57:0/710006868 reap_dead start 2026-02-20T16:31:02.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.570+0000 7fa232bed640 1 -- 10.20.193.57:0/710006868 shutdown_connections 2026-02-20T16:31:02.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.570+0000 7fa232bed640 1 -- 10.20.193.57:0/710006868 >> 10.20.193.57:0/710006868 conn(0x7fa22c08aae0 msgr2=0x7fa22c1346b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:02.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.570+0000 7fa232bed640 1 -- 10.20.193.57:0/710006868 shutdown_connections 2026-02-20T16:31:02.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.570+0000 7fbafae92640 1 -- 10.20.193.57:0/1544282638 --> v1:10.20.193.57:6809/3959776128 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbaf4081dc0 con 0x7fbac4071400 2026-02-20T16:31:02.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.570+0000 7fa232bed640 1 -- 10.20.193.57:0/710006868 wait complete. 2026-02-20T16:31:02.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.570+0000 7fbae97fa640 1 -- 10.20.193.57:0/1544282638 <== osd.2 v1:10.20.193.57:6809/3959776128 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (unknown 0 0 4081650579) 0x7fbaf4081dc0 con 0x7fbac4071400 2026-02-20T16:31:02.597 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.571+0000 7fbafae92640 1 -- 10.20.193.57:0/1544282638 >> v1:10.20.193.57:6809/3959776128 conn(0x7fbac4071400 legacy=0x7fbac4091830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.597 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.571+0000 7f0ecd4ca640 1 -- 10.20.193.57:0/956651670 --> v1:10.20.193.57:6813/2476353628 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0ec811fd70 con 0x7f0e94071390 2026-02-20T16:31:02.597 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.571+0000 7f09f3f33640 1 -- 10.20.193.57:0/1292334096 --> v1:10.20.193.57:6805/3794545817 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f09ec07c9c0 con 0x7f09bc071450 2026-02-20T16:31:02.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.571+0000 7fbafae92640 1 -- 10.20.193.57:0/1544282638 >> v1:10.20.193.57:6800/2007744879 conn(0x7fbac404cae0 legacy=0x7fbac406cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.571+0000 7fbafae92640 1 -- 10.20.193.57:0/1544282638 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fbaf4174330 msgr2=0x7fbaf407b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.571+0000 7fbafae92640 1 --2- 10.20.193.57:0/1544282638 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fbaf4174330 0x7fbaf407b310 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbaf0004af0 tx=0x7fbaf000c490 comp rx=0 tx=0).stop 2026-02-20T16:31:02.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.571+0000 7fbaf9408640 1 -- 10.20.193.57:0/1544282638 reap_dead start 2026-02-20T16:31:02.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.571+0000 7fbafae92640 1 -- 10.20.193.57:0/1544282638 shutdown_connections 2026-02-20T16:31:02.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.571+0000 7fbafae92640 1 -- 10.20.193.57:0/1544282638 >> 10.20.193.57:0/1544282638 conn(0x7fbaf40833e0 msgr2=0x7fbaf4081460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:02.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.571+0000 7fbafae92640 1 -- 10.20.193.57:0/1544282638 shutdown_connections 2026-02-20T16:31:02.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.571+0000 7fbafae92640 1 -- 10.20.193.57:0/1544282638 wait complete. 2026-02-20T16:31:02.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.571+0000 7f0ea77fe640 1 -- 10.20.193.57:0/956651670 <== osd.3 v1:10.20.193.57:6813/2476353628 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (unknown 0 0 795413372) 0x7f0ec811fd70 con 0x7f0e94071390 2026-02-20T16:31:02.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.571+0000 7f09da7fc640 1 -- 10.20.193.57:0/1292334096 <== osd.1 v1:10.20.193.57:6805/3794545817 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (unknown 0 0 1720373281) 0x7f09ec07c9c0 con 0x7f09bc071450 2026-02-20T16:31:02.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.571+0000 7f09f3f33640 1 -- 10.20.193.57:0/1292334096 >> v1:10.20.193.57:6805/3794545817 conn(0x7f09bc071450 legacy=0x7f09bc091880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.571+0000 7f0ecd4ca640 1 -- 10.20.193.57:0/956651670 >> v1:10.20.193.57:6813/2476353628 conn(0x7f0e94071390 legacy=0x7f0e940917c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.571+0000 7f09f3f33640 1 -- 10.20.193.57:0/1292334096 >> v1:10.20.193.57:6800/2007744879 conn(0x7f09bc04cb30 legacy=0x7f09bc06cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.571+0000 7f09f3f33640 1 -- 10.20.193.57:0/1292334096 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f09ec174330 msgr2=0x7f09ec125380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.600 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.571+0000 7f09f3f33640 1 --2- 10.20.193.57:0/1292334096 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f09ec174330 0x7f09ec125380 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f09e8009f10 tx=0x7f09e8002c80 comp rx=0 tx=0).stop 2026-02-20T16:31:02.600 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.571+0000 7f0ecd4ca640 1 -- 10.20.193.57:0/956651670 >> v1:10.20.193.57:6800/2007744879 conn(0x7f0e9404cae0 legacy=0x7f0e9406cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.600 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.571+0000 7f09f24a9640 1 -- 10.20.193.57:0/1292334096 reap_dead start 2026-02-20T16:31:02.600 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.571+0000 7f0ecd4ca640 1 -- 10.20.193.57:0/956651670 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f0ec81335c0 msgr2=0x7f0ec8133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.600 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.571+0000 7f0ecd4ca640 1 --2- 10.20.193.57:0/956651670 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f0ec81335c0 0x7f0ec8133a30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0005fd0 tx=0x7f0eb0002aa0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.600 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.571+0000 7f0ec77fe640 1 -- 10.20.193.57:0/956651670 reap_dead start 2026-02-20T16:31:02.600 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.571+0000 7f09f3f33640 1 -- 10.20.193.57:0/1292334096 shutdown_connections 2026-02-20T16:31:02.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.571+0000 7f09f3f33640 1 -- 10.20.193.57:0/1292334096 >> 10.20.193.57:0/1292334096 conn(0x7f09ec0833e0 msgr2=0x7f09ec0798a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:02.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.571+0000 7f0ecd4ca640 1 -- 10.20.193.57:0/956651670 shutdown_connections 2026-02-20T16:31:02.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.571+0000 7f0ecd4ca640 1 -- 10.20.193.57:0/956651670 >> 10.20.193.57:0/956651670 conn(0x7f0ec80833e0 msgr2=0x7f0ec8114640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:02.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.571+0000 7f09f3f33640 1 -- 10.20.193.57:0/1292334096 shutdown_connections 2026-02-20T16:31:02.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.571+0000 7f09f3f33640 1 -- 10.20.193.57:0/1292334096 wait complete. 2026-02-20T16:31:02.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.571+0000 7f0ecd4ca640 1 -- 10.20.193.57:0/956651670 shutdown_connections 2026-02-20T16:31:02.602 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.571+0000 7f0ecd4ca640 1 -- 10.20.193.57:0/956651670 wait complete. 2026-02-20T16:31:02.602 INFO:teuthology.orchestra.run.trial057.stdout:98784247811 2026-02-20T16:31:02.602 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-20T16:31:02.603 INFO:teuthology.orchestra.run.trial057.stdout:107374182403 2026-02-20T16:31:02.603 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-20T16:31:02.604 INFO:teuthology.orchestra.run.trial057.stdout:103079215107 2026-02-20T16:31:02.604 INFO:teuthology.orchestra.run.trial057.stdout:111669149699 2026-02-20T16:31:02.604 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-20T16:31:02.605 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-20T16:31:02.717 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.712+0000 7fefae440640 1 -- 10.20.193.57:0/3527631085 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fefa807dc60 msgr2=0x7fefa807e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.718 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.712+0000 7fefae440640 1 --2- 10.20.193.57:0/3527631085 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fefa807dc60 0x7fefa807e080 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fef98005ea0 tx=0x7fef9802f220 comp rx=0 tx=0).stop 2026-02-20T16:31:02.718 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.712+0000 7fefae440640 1 -- 10.20.193.57:0/3527631085 shutdown_connections 2026-02-20T16:31:02.718 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.712+0000 7fefae440640 1 --2- 10.20.193.57:0/3527631085 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fefa807dc60 0x7fefa807e080 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.718 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.712+0000 7fefae440640 1 --2- 10.20.193.57:0/3527631085 >> v2:10.20.193.57:3300/0 conn(0x7fefa8085b90 0x7fefa807d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.718 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.712+0000 7fefae440640 1 -- 10.20.193.57:0/3527631085 >> 10.20.193.57:0/3527631085 conn(0x7fefa80833e0 msgr2=0x7fefa80840b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:02.718 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.712+0000 7fefae440640 1 -- 10.20.193.57:0/3527631085 shutdown_connections 2026-02-20T16:31:02.718 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.713+0000 7fefae440640 1 -- 10.20.193.57:0/3527631085 wait complete. 2026-02-20T16:31:02.718 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.713+0000 7fefae440640 1 Processor -- start 2026-02-20T16:31:02.718 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.713+0000 7fefae440640 1 -- start start 2026-02-20T16:31:02.718 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.714+0000 7fefae440640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fefa807dc60 0x7fefa8194670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:02.718 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.714+0000 7fefae440640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fefa8085b90 0x7fefa807b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:02.719 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.714+0000 7fefae440640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fefa8173320 0x7fefa807be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:02.719 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.714+0000 7fefae440640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7fefa81958b0 con 0x7fefa8085b90 2026-02-20T16:31:02.719 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.714+0000 7fefae440640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7fefa8195730 con 0x7fefa8173320 2026-02-20T16:31:02.719 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.714+0000 7fefae440640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7fefa8195a30 con 0x7fefa807dc60 2026-02-20T16:31:02.719 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.714+0000 7fefa7fff640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fefa807dc60 0x7fefa8194670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:02.719 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.714+0000 7f8a117aa640 1 -- 10.20.193.57:0/2816629871 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8a0c0814c0 msgr2=0x7f8a0c07c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.720 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.714+0000 7f8a117aa640 1 --2- 10.20.193.57:0/2816629871 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8a0c0814c0 0x7f8a0c07c400 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f89f40098c0 tx=0x7f89f402f110 comp rx=0 tx=0).stop 2026-02-20T16:31:02.720 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.714+0000 7fefa7fff640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fefa807dc60 0x7fefa8194670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3302/0 says I am v2:10.20.193.57:44854/0 (socket says 10.20.193.57:44854) 2026-02-20T16:31:02.720 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.714+0000 7fefa7fff640 1 -- 10.20.193.57:0/499418399 learned_addr learned my addr 10.20.193.57:0/499418399 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:31:02.720 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.714+0000 7fefa77fe640 1 --2- 10.20.193.57:0/499418399 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fefa8085b90 0x7fefa807b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:02.721 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.714+0000 7fefac9b6640 1 --2- 10.20.193.57:0/499418399 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fefa8173320 0x7fefa807be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:02.721 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.714+0000 7f92b433f640 1 -- 10.20.193.57:0/3880014055 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f92ac05c060 msgr2=0x7f92ac05c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.721 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.714+0000 7f92b433f640 1 --2- 10.20.193.57:0/3880014055 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f92ac05c060 0x7f92ac05c430 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f929c005ea0 tx=0x7f929c02f1d0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.722 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.714+0000 7fefa7fff640 1 -- 10.20.193.57:0/499418399 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fefa8173320 msgr2=0x7fefa807be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.722 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.714+0000 7fefa7fff640 1 --2- 10.20.193.57:0/499418399 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fefa8173320 0x7fefa807be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.722 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.714+0000 7fefa7fff640 1 -- 10.20.193.57:0/499418399 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fefa8085b90 msgr2=0x7fefa807b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.722 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.714+0000 7fefa7fff640 1 --2- 10.20.193.57:0/499418399 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fefa8085b90 0x7fefa807b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.722 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.714+0000 7f8a117aa640 1 -- 10.20.193.57:0/2816629871 shutdown_connections 2026-02-20T16:31:02.723 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.714+0000 7f8a117aa640 1 --2- 10.20.193.57:0/2816629871 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8a0c0814c0 0x7f8a0c07c400 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.723 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.714+0000 7f8a117aa640 1 --2- 10.20.193.57:0/2816629871 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8a0c080bb0 0x7f8a0c080f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.723 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.714+0000 7f8a117aa640 1 -- 10.20.193.57:0/2816629871 >> 10.20.193.57:0/2816629871 conn(0x7f8a0c0833e0 msgr2=0x7f8a0c0840b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:02.723 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.714+0000 7fefa7fff640 1 -- 10.20.193.57:0/499418399 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefa807d230 con 0x7fefa807dc60 2026-02-20T16:31:02.723 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.714+0000 7fefa77fe640 1 --2- 10.20.193.57:0/499418399 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fefa8085b90 0x7fefa807b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:31:02.724 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.714+0000 7f8a117aa640 1 -- 10.20.193.57:0/2816629871 shutdown_connections 2026-02-20T16:31:02.724 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.714+0000 7f92b433f640 1 -- 10.20.193.57:0/3880014055 shutdown_connections 2026-02-20T16:31:02.724 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.714+0000 7f92b433f640 1 --2- 10.20.193.57:0/3880014055 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f92ac05c970 0x7f92ac176350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.724 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.714+0000 7f92b433f640 1 --2- 10.20.193.57:0/3880014055 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f92ac05c060 0x7f92ac05c430 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.724 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.714+0000 7f7dad1a7640 1 -- 10.20.193.57:0/217495800 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f7da8057500 msgr2=0x7f7da80578d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.725 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.714+0000 7f7dad1a7640 1 --2- 10.20.193.57:0/217495800 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f7da8057500 0x7f7da80578d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c0099b0 tx=0x7f7d9c02f240 comp rx=0 tx=0).stop 2026-02-20T16:31:02.725 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.714+0000 7f92b433f640 1 -- 10.20.193.57:0/3880014055 >> 10.20.193.57:0/3880014055 conn(0x7f92ac0833e0 msgr2=0x7f92ac0840b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:02.725 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.714+0000 7fefa7fff640 1 --2- 10.20.193.57:0/499418399 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fefa807dc60 0x7fefa8194670 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fef940094b0 tx=0x7fef9400ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:31:02.725 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.714+0000 7f8a117aa640 1 -- 10.20.193.57:0/2816629871 wait complete. 2026-02-20T16:31:02.726 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.714+0000 7f7dad1a7640 1 -- 10.20.193.57:0/217495800 shutdown_connections 2026-02-20T16:31:02.726 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.714+0000 7f92b433f640 1 -- 10.20.193.57:0/3880014055 shutdown_connections 2026-02-20T16:31:02.726 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.714+0000 7f92b433f640 1 -- 10.20.193.57:0/3880014055 wait complete. 2026-02-20T16:31:02.727 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.714+0000 7f7dad1a7640 1 --2- 10.20.193.57:0/217495800 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f7da81759c0 0x7f7da8195da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.727 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.714+0000 7f7dad1a7640 1 --2- 10.20.193.57:0/217495800 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f7da8057500 0x7f7da80578d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.727 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.714+0000 7f7dad1a7640 1 -- 10.20.193.57:0/217495800 >> 10.20.193.57:0/217495800 conn(0x7f7da8087550 msgr2=0x7f7da8087950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:02.727 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.714+0000 7f7dad1a7640 1 -- 10.20.193.57:0/217495800 shutdown_connections 2026-02-20T16:31:02.727 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.714+0000 7fefa4ff9640 1 -- 10.20.193.57:0/499418399 <== mon.2 v2:10.20.193.57:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef9400cd20 con 0x7fefa807dc60 2026-02-20T16:31:02.728 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.714+0000 7f7dad1a7640 1 -- 10.20.193.57:0/217495800 wait complete. 2026-02-20T16:31:02.729 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.714+0000 7fefa4ff9640 1 -- 10.20.193.57:0/499418399 <== mon.2 v2:10.20.193.57:3302/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fef94004880 con 0x7fefa807dc60 2026-02-20T16:31:02.729 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.714+0000 7fefa4ff9640 1 -- 10.20.193.57:0/499418399 <== mon.2 v2:10.20.193.57:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef94004cd0 con 0x7fefa807dc60 2026-02-20T16:31:02.729 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7fefae440640 1 -- 10.20.193.57:0/499418399 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefa8194bb0 con 0x7fefa807dc60 2026-02-20T16:31:02.729 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f8a117aa640 1 Processor -- start 2026-02-20T16:31:02.730 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7fefae440640 1 -- 10.20.193.57:0/499418399 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fefa8174800 con 0x7fefa807dc60 2026-02-20T16:31:02.730 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f7dad1a7640 1 Processor -- start 2026-02-20T16:31:02.730 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f7dad1a7640 1 -- start start 2026-02-20T16:31:02.730 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f92b433f640 1 Processor -- start 2026-02-20T16:31:02.731 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f92b433f640 1 -- start start 2026-02-20T16:31:02.731 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f8a117aa640 1 -- start start 2026-02-20T16:31:02.732 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f7dad1a7640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f7da8057500 0x7f7da807ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:02.732 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f7dad1a7640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f7da8057e10 0x7f7da807d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:02.732 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f7dad1a7640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f7da81759c0 0x7f7da807d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:02.732 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f7dad1a7640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f7da8196a30 con 0x7f7da81759c0 2026-02-20T16:31:02.732 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f7dad1a7640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f7da81968b0 con 0x7f7da8057e10 2026-02-20T16:31:02.732 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f7dad1a7640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f7da8196bb0 con 0x7f7da8057500 2026-02-20T16:31:02.733 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f92b433f640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f92ac05c060 0x7f92ac07b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:02.733 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f92b433f640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f92ac05c970 0x7f92ac07bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:02.733 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f92b433f640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f92ac176890 0x7f92ac07c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:02.733 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f92b433f640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f92ac082950 con 0x7f92ac05c060 2026-02-20T16:31:02.733 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f92b433f640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f92ac198dc0 con 0x7f92ac176890 2026-02-20T16:31:02.733 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f92b433f640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f92ac198c40 con 0x7f92ac05c970 2026-02-20T16:31:02.734 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f7da7577640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f7da81759c0 0x7f7da807d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:02.734 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f7da7577640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f7da81759c0 0x7f7da807d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:52724/0 (socket says 10.20.193.57:52724) 2026-02-20T16:31:02.734 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f8a117aa640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8a0c07c940 0x7f8a0c12cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:02.735 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f7da7577640 1 -- 10.20.193.57:0/3272455562 learned_addr learned my addr 10.20.193.57:0/3272455562 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:31:02.735 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f8a117aa640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f8a0c080bb0 0x7f8a0c12d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:02.735 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f7da6d76640 1 --2- 10.20.193.57:0/3272455562 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f7da8057500 0x7f7da807ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:02.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f92b20b4640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f92ac05c060 0x7f92ac07b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:02.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f92b18b3640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f92ac05c970 0x7f92ac07bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:02.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f92b18b3640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f92ac05c970 0x7f92ac07bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3302/0 says I am v2:10.20.193.57:44862/0 (socket says 10.20.193.57:44862) 2026-02-20T16:31:02.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f92b18b3640 1 -- 10.20.193.57:0/2324153921 learned_addr learned my addr 10.20.193.57:0/2324153921 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:31:02.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f92b20b4640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f92ac05c060 0x7f92ac07b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:52726/0 (socket says 10.20.193.57:52726) 2026-02-20T16:31:02.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f92b28b5640 1 --2- 10.20.193.57:0/2324153921 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f92ac176890 0x7f92ac07c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:02.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f8a117aa640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8a0c0814c0 0x7f8a0c146630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:02.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f8a0affd640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8a0c07c940 0x7f8a0c12cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:02.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f8a117aa640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0c196bf0 con 0x7f8a0c080bb0 2026-02-20T16:31:02.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f8a117aa640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f8a0c196a70 con 0x7f8a0c0814c0 2026-02-20T16:31:02.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f8a117aa640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f8a0c196d70 con 0x7f8a0c07c940 2026-02-20T16:31:02.738 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f7da6575640 1 --2- 10.20.193.57:0/3272455562 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f7da8057e10 0x7f7da807d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:02.738 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f8a0affd640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8a0c07c940 0x7f8a0c12cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3302/0 says I am v2:10.20.193.57:44870/0 (socket says 10.20.193.57:44870) 2026-02-20T16:31:02.738 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f8a0affd640 1 -- 10.20.193.57:0/1390448303 learned_addr learned my addr 10.20.193.57:0/1390448303 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:31:02.739 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f7da7577640 1 -- 10.20.193.57:0/3272455562 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f7da8057500 msgr2=0x7f7da807ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.739 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f7da7577640 1 --2- 10.20.193.57:0/3272455562 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f7da8057500 0x7f7da807ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.739 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f7da7577640 1 -- 10.20.193.57:0/3272455562 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f7da8057e10 msgr2=0x7f7da807d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.739 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f7da7577640 1 --2- 10.20.193.57:0/3272455562 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f7da8057e10 0x7f7da807d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.739 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f8a0b7fe640 1 --2- 10.20.193.57:0/1390448303 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8a0c0814c0 0x7f8a0c146630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:02.739 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f7da7577640 1 -- 10.20.193.57:0/3272455562 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7da81768d0 con 0x7f7da81759c0 2026-02-20T16:31:02.740 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f8a0a7fc640 1 --2- 10.20.193.57:0/1390448303 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f8a0c080bb0 0x7f8a0c12d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:02.740 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7fefae440640 1 -- 10.20.193.57:0/499418399 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefa807d720 con 0x7fefa807dc60 2026-02-20T16:31:02.741 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f92b28b5640 1 -- 10.20.193.57:0/2324153921 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f92ac05c970 msgr2=0x7f92ac07bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.741 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f92b28b5640 1 --2- 10.20.193.57:0/2324153921 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f92ac05c970 0x7f92ac07bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.741 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f92b28b5640 1 -- 10.20.193.57:0/2324153921 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f92ac05c060 msgr2=0x7f92ac07b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.741 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f92b28b5640 1 --2- 10.20.193.57:0/2324153921 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f92ac05c060 0x7f92ac07b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.741 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f92b28b5640 1 -- 10.20.193.57:0/2324153921 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92ac178aa0 con 0x7f92ac176890 2026-02-20T16:31:02.742 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f92b18b3640 1 --2- 10.20.193.57:0/2324153921 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f92ac05c970 0x7f92ac07bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:31:02.742 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f8a0a7fc640 1 -- 10.20.193.57:0/1390448303 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8a0c07c940 msgr2=0x7f8a0c12cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.742 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f8a0a7fc640 1 --2- 10.20.193.57:0/1390448303 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8a0c07c940 0x7f8a0c12cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f7da7577640 1 --2- 10.20.193.57:0/3272455562 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f7da81759c0 0x7f7da807d730 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7d98009e90 tx=0x7f7d98009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:31:02.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7fefa4ff9640 1 -- 10.20.193.57:0/499418399 <== mon.2 v2:10.20.193.57:3302/0 4 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7fef94004080 con 0x7fefa807dc60 2026-02-20T16:31:02.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f7d877fe640 1 -- 10.20.193.57:0/3272455562 <== mon.0 v2:10.20.193.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d9800cdf0 con 0x7f7da81759c0 2026-02-20T16:31:02.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f8a0a7fc640 1 -- 10.20.193.57:0/1390448303 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8a0c0814c0 msgr2=0x7f8a0c146630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.745 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f8a0a7fc640 1 --2- 10.20.193.57:0/1390448303 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8a0c0814c0 0x7f8a0c146630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.745 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.716+0000 7f92b28b5640 1 --2- 10.20.193.57:0/2324153921 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f92ac176890 0x7f92ac07c410 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f92ac080790 tx=0x7f92a800cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:31:02.746 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f8a0a7fc640 1 -- 10.20.193.57:0/1390448303 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a0c12e2d0 con 0x7f8a0c080bb0 2026-02-20T16:31:02.746 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.715+0000 7f8a0b7fe640 1 --2- 10.20.193.57:0/1390448303 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8a0c0814c0 0x7f8a0c146630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T16:31:02.746 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.716+0000 7f8a0a7fc640 1 --2- 10.20.193.57:0/1390448303 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f8a0c080bb0 0x7f8a0c12d060 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f89f4004770 tx=0x7f89f4002900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:31:02.747 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.716+0000 7f7d877fe640 1 -- 10.20.193.57:0/3272455562 <== mon.0 v2:10.20.193.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d980090d0 con 0x7f7da81759c0 2026-02-20T16:31:02.747 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.716+0000 7f7dad1a7640 1 -- 10.20.193.57:0/3272455562 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7da8181a20 con 0x7f7da81759c0 2026-02-20T16:31:02.747 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.716+0000 7f7d877fe640 1 -- 10.20.193.57:0/3272455562 <== mon.0 v2:10.20.193.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d98003a80 con 0x7f7da81759c0 2026-02-20T16:31:02.748 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.716+0000 7f7dad1a7640 1 -- 10.20.193.57:0/3272455562 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7da81771d0 con 0x7f7da81759c0 2026-02-20T16:31:02.748 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.716+0000 7f9292ffd640 1 -- 10.20.193.57:0/2324153921 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a8016020 con 0x7f92ac176890 2026-02-20T16:31:02.748 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.716+0000 7f9292ffd640 1 -- 10.20.193.57:0/2324153921 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f92a800ce50 con 0x7f92ac176890 2026-02-20T16:31:02.749 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.716+0000 7f89eb7fe640 1 -- 10.20.193.57:0/1390448303 <== mon.0 v2:10.20.193.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f4046070 con 0x7f8a0c080bb0 2026-02-20T16:31:02.749 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.716+0000 7f89eb7fe640 1 -- 10.20.193.57:0/1390448303 <== mon.0 v2:10.20.193.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f89f4002c80 con 0x7f8a0c080bb0 2026-02-20T16:31:02.750 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.716+0000 7f92b433f640 1 -- 10.20.193.57:0/2324153921 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92ac1776c0 con 0x7f92ac176890 2026-02-20T16:31:02.750 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.716+0000 7f89eb7fe640 1 -- 10.20.193.57:0/1390448303 <== mon.0 v2:10.20.193.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f4038690 con 0x7f8a0c080bb0 2026-02-20T16:31:02.750 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.716+0000 7f8a117aa640 1 -- 10.20.193.57:0/1390448303 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a0c075390 con 0x7f8a0c080bb0 2026-02-20T16:31:02.751 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.716+0000 7f9292ffd640 1 -- 10.20.193.57:0/2324153921 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a800ada0 con 0x7f92ac176890 2026-02-20T16:31:02.751 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.716+0000 7f92b433f640 1 -- 10.20.193.57:0/2324153921 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f92ac184940 con 0x7f92ac176890 2026-02-20T16:31:02.752 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.716+0000 7f8a117aa640 1 -- 10.20.193.57:0/1390448303 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a0c12d5a0 con 0x7f8a0c080bb0 2026-02-20T16:31:02.752 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.716+0000 7fefa4ff9640 1 -- 10.20.193.57:0/499418399 <== mon.2 v2:10.20.193.57:3302/0 5 ==== osd_map(30..30 src has 1..30) ==== 3026+0+0 (secure 0 0 0) 0x7fef940641a0 con 0x7fefa807dc60 2026-02-20T16:31:02.752 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.716+0000 7f7dad1a7640 1 -- 10.20.193.57:0/3272455562 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7da80578d0 con 0x7f7da81759c0 2026-02-20T16:31:02.753 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.716+0000 7f92b433f640 1 -- 10.20.193.57:0/2324153921 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92ac05c430 con 0x7f92ac176890 2026-02-20T16:31:02.753 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.716+0000 7f8a117aa640 1 -- 10.20.193.57:0/1390448303 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a0c12d7d0 con 0x7f8a0c080bb0 2026-02-20T16:31:02.754 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.716+0000 7f7d877fe640 1 -- 10.20.193.57:0/3272455562 <== mon.0 v2:10.20.193.57:3300/0 4 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7f7d98003c20 con 0x7f7da81759c0 2026-02-20T16:31:02.754 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.717+0000 7f9292ffd640 1 -- 10.20.193.57:0/2324153921 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7f92a801b400 con 0x7f92ac176890 2026-02-20T16:31:02.754 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.717+0000 7f7d877fe640 1 -- 10.20.193.57:0/3272455562 <== mon.0 v2:10.20.193.57:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3026+0+0 (secure 0 0 0) 0x7f7d98064140 con 0x7f7da81759c0 2026-02-20T16:31:02.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.717+0000 7f9292ffd640 1 -- 10.20.193.57:0/2324153921 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(30..30 src has 1..30) ==== 3026+0+0 (secure 0 0 0) 0x7f92a8063d00 con 0x7f92ac176890 2026-02-20T16:31:02.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.717+0000 7f89eb7fe640 1 -- 10.20.193.57:0/1390448303 <== mon.0 v2:10.20.193.57:3300/0 4 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7f89f4038830 con 0x7f8a0c080bb0 2026-02-20T16:31:02.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.718+0000 7fefa4ff9640 1 -- 10.20.193.57:0/499418399 <== mon.2 v2:10.20.193.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7fefa807d230 con 0x7fefa807dc60 2026-02-20T16:31:02.756 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.718+0000 7f7d877fe640 1 -- 10.20.193.57:0/3272455562 <== mon.0 v2:10.20.193.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7f7d98022020 con 0x7f7da81759c0 2026-02-20T16:31:02.756 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.718+0000 7f9292ffd640 1 -- 10.20.193.57:0/2324153921 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7f92a8020020 con 0x7f92ac176890 2026-02-20T16:31:02.757 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.719+0000 7f89eb7fe640 1 -- 10.20.193.57:0/1390448303 <== mon.0 v2:10.20.193.57:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3026+0+0 (secure 0 0 0) 0x7f89f40881b0 con 0x7f8a0c080bb0 2026-02-20T16:31:02.757 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.720+0000 7f89eb7fe640 1 -- 10.20.193.57:0/1390448303 <== mon.0 v2:10.20.193.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7f89f4009460 con 0x7f8a0c080bb0 2026-02-20T16:31:02.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.792+0000 7fefae440640 1 -- 10.20.193.57:0/499418399 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fefa8053200 con 0x7fefa807dc60 2026-02-20T16:31:02.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.793+0000 7fefa4ff9640 1 -- 10.20.193.57:0/499418399 <== mon.2 v2:10.20.193.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fef940631b0 con 0x7fefa807dc60 2026-02-20T16:31:02.794 INFO:teuthology.orchestra.run.trial057.stdout:98784247810 2026-02-20T16:31:02.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.794+0000 7fefae440640 1 -- 10.20.193.57:0/499418399 >> v1:10.20.193.57:6800/2007744879 conn(0x7fef7404cae0 legacy=0x7fef7406cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.794+0000 7fefae440640 1 -- 10.20.193.57:0/499418399 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fefa807dc60 msgr2=0x7fefa8194670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.794+0000 7fefae440640 1 --2- 10.20.193.57:0/499418399 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fefa807dc60 0x7fefa8194670 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fef940094b0 tx=0x7fef9400ee60 comp rx=0 tx=0).stop 2026-02-20T16:31:02.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.794+0000 7fefae440640 1 -- 10.20.193.57:0/499418399 shutdown_connections 2026-02-20T16:31:02.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.794+0000 7fefae440640 1 --2- 10.20.193.57:0/499418399 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fefa8173320 0x7fefa807be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.794+0000 7fefae440640 1 --2- 10.20.193.57:0/499418399 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fefa8085b90 0x7fefa807b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.794+0000 7fefae440640 1 --2- 10.20.193.57:0/499418399 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fefa807dc60 0x7fefa8194670 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.794+0000 7fefae440640 1 -- 10.20.193.57:0/499418399 >> 10.20.193.57:0/499418399 conn(0x7fefa80833e0 msgr2=0x7fefa805a060 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:02.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.794+0000 7fefae440640 1 -- 10.20.193.57:0/499418399 shutdown_connections 2026-02-20T16:31:02.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.794+0000 7fefae440640 1 -- 10.20.193.57:0/499418399 wait complete. 2026-02-20T16:31:02.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.794+0000 7f8a117aa640 1 -- 10.20.193.57:0/1390448303 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f8a0c080f80 con 0x7f8a0c080bb0 2026-02-20T16:31:02.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.795+0000 7f7dad1a7640 1 -- 10.20.193.57:0/3272455562 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f7da8177ba0 con 0x7f7da81759c0 2026-02-20T16:31:02.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.795+0000 7f89eb7fe640 1 -- 10.20.193.57:0/1390448303 <== mon.0 v2:10.20.193.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+2 (secure 0 0 0) 0x7f89f4087240 con 0x7f8a0c080bb0 2026-02-20T16:31:02.798 INFO:teuthology.orchestra.run.trial057.stdout:1 2026-02-20T16:31:02.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.795+0000 7f7d877fe640 1 -- 10.20.193.57:0/3272455562 <== mon.0 v2:10.20.193.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f7d98010040 con 0x7f7da81759c0 2026-02-20T16:31:02.798 INFO:teuthology.orchestra.run.trial057.stdout:103079215106 2026-02-20T16:31:02.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.795+0000 7f92b433f640 1 -- 10.20.193.57:0/2324153921 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f92ac053200 con 0x7f92ac176890 2026-02-20T16:31:02.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.795+0000 7f9292ffd640 1 -- 10.20.193.57:0/2324153921 <== mon.1 v2:10.20.193.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f92a8062dd0 con 0x7f92ac176890 2026-02-20T16:31:02.799 INFO:teuthology.orchestra.run.trial057.stdout:107374182402 2026-02-20T16:31:02.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.796+0000 7f8a117aa640 1 -- 10.20.193.57:0/1390448303 >> v1:10.20.193.57:6800/2007744879 conn(0x7f89d804cae0 legacy=0x7f89d806cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.796+0000 7f8a117aa640 1 -- 10.20.193.57:0/1390448303 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f8a0c080bb0 msgr2=0x7f8a0c12d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.796+0000 7f8a117aa640 1 --2- 10.20.193.57:0/1390448303 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f8a0c080bb0 0x7f8a0c12d060 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f89f4004770 tx=0x7f89f4002900 comp rx=0 tx=0).stop 2026-02-20T16:31:02.800 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.796+0000 7f8a117aa640 1 -- 10.20.193.57:0/1390448303 shutdown_connections 2026-02-20T16:31:02.800 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.796+0000 7f8a117aa640 1 --2- 10.20.193.57:0/1390448303 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8a0c0814c0 0x7f8a0c146630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.800 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.796+0000 7f8a117aa640 1 --2- 10.20.193.57:0/1390448303 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f8a0c080bb0 0x7f8a0c12d060 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.800 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.796+0000 7f8a117aa640 1 --2- 10.20.193.57:0/1390448303 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8a0c07c940 0x7f8a0c12cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.800 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.796+0000 7f8a117aa640 1 -- 10.20.193.57:0/1390448303 >> 10.20.193.57:0/1390448303 conn(0x7f8a0c0833e0 msgr2=0x7f8a0c05c060 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:02.800 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.796+0000 7f7dad1a7640 1 -- 10.20.193.57:0/3272455562 >> v1:10.20.193.57:6800/2007744879 conn(0x7f7d7c04cae0 legacy=0x7f7d7c06cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.800 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.796+0000 7f7dad1a7640 1 -- 10.20.193.57:0/3272455562 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f7da81759c0 msgr2=0x7f7da807d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.800 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.796+0000 7f7dad1a7640 1 --2- 10.20.193.57:0/3272455562 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f7da81759c0 0x7f7da807d730 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7d98009e90 tx=0x7f7d98009f90 comp rx=0 tx=0).stop 2026-02-20T16:31:02.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.796+0000 7f8a117aa640 1 -- 10.20.193.57:0/1390448303 shutdown_connections 2026-02-20T16:31:02.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.796+0000 7f8a117aa640 1 -- 10.20.193.57:0/1390448303 wait complete. 2026-02-20T16:31:02.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.796+0000 7f7dad1a7640 1 -- 10.20.193.57:0/3272455562 shutdown_connections 2026-02-20T16:31:02.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.796+0000 7f7dad1a7640 1 --2- 10.20.193.57:0/3272455562 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f7da81759c0 0x7f7da807d730 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.796+0000 7f7dad1a7640 1 --2- 10.20.193.57:0/3272455562 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f7da8057e10 0x7f7da807d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.796+0000 7f7dad1a7640 1 --2- 10.20.193.57:0/3272455562 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f7da8057500 0x7f7da807ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.796+0000 7f7dad1a7640 1 -- 10.20.193.57:0/3272455562 >> 10.20.193.57:0/3272455562 conn(0x7f7da8087550 msgr2=0x7f7da8059ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:02.802 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.796+0000 7f7dad1a7640 1 -- 10.20.193.57:0/3272455562 shutdown_connections 2026-02-20T16:31:02.802 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.796+0000 7f7dad1a7640 1 -- 10.20.193.57:0/3272455562 wait complete. 2026-02-20T16:31:02.803 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.797+0000 7f92b433f640 1 -- 10.20.193.57:0/2324153921 >> v1:10.20.193.57:6800/2007744879 conn(0x7f927c04cae0 legacy=0x7f927c06cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.803 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.797+0000 7f92b433f640 1 -- 10.20.193.57:0/2324153921 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f92ac176890 msgr2=0x7f92ac07c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:02.803 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.797+0000 7f92b433f640 1 --2- 10.20.193.57:0/2324153921 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f92ac176890 0x7f92ac07c410 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f92ac080790 tx=0x7f92a800cbf0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.803 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.797+0000 7f92b433f640 1 -- 10.20.193.57:0/2324153921 shutdown_connections 2026-02-20T16:31:02.803 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.797+0000 7f92b433f640 1 --2- 10.20.193.57:0/2324153921 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f92ac176890 0x7f92ac07c410 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.803 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.797+0000 7f92b433f640 1 --2- 10.20.193.57:0/2324153921 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f92ac05c970 0x7f92ac07bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.803 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.797+0000 7f92b433f640 1 --2- 10.20.193.57:0/2324153921 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f92ac05c060 0x7f92ac07b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:02.803 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.797+0000 7f92b433f640 1 -- 10.20.193.57:0/2324153921 >> 10.20.193.57:0/2324153921 conn(0x7f92ac0833e0 msgr2=0x7f92ac1861f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:02.803 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.797+0000 7f92b433f640 1 -- 10.20.193.57:0/2324153921 shutdown_connections 2026-02-20T16:31:02.804 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:02.797+0000 7f92b433f640 1 -- 10.20.193.57:0/2324153921 wait complete. 2026-02-20T16:31:02.805 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247811 got 98784247810 for osd.0 2026-02-20T16:31:02.806 INFO:tasks.ceph.ceph_manager.ceph:need seq 111669149699 got 1 for osd.3 2026-02-20T16:31:02.807 INFO:tasks.ceph.ceph_manager.ceph:need seq 107374182403 got 107374182402 for osd.2 2026-02-20T16:31:02.807 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215107 got 103079215106 for osd.1 2026-02-20T16:31:03.805 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-20T16:31:03.806 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-20T16:31:03.807 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-20T16:31:03.807 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-20T16:31:03.878 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.876+0000 7f499fa31640 1 -- 10.20.193.57:0/1554951976 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f4998085b90 msgr2=0x7f499807d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:03.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.876+0000 7f499fa31640 1 --2- 10.20.193.57:0/1554951976 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f4998085b90 0x7f499807d720 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4988005ea0 tx=0x7f498802f220 comp rx=0 tx=0).stop 2026-02-20T16:31:03.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.876+0000 7f499fa31640 1 -- 10.20.193.57:0/1554951976 shutdown_connections 2026-02-20T16:31:03.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.876+0000 7f499fa31640 1 --2- 10.20.193.57:0/1554951976 >> v2:10.20.193.57:3300/0 conn(0x7f4998174330 0x7f4998194710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:03.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.876+0000 7f499fa31640 1 --2- 10.20.193.57:0/1554951976 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f4998085b90 0x7f499807d720 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:03.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.876+0000 7f499fa31640 1 -- 10.20.193.57:0/1554951976 >> 10.20.193.57:0/1554951976 conn(0x7f49980833e0 msgr2=0x7f49980840b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:03.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.876+0000 7f499fa31640 1 -- 10.20.193.57:0/1554951976 shutdown_connections 2026-02-20T16:31:03.880 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.876+0000 7f82b5671640 1 -- 10.20.193.57:0/3221495978 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f82b0130220 msgr2=0x7f82b0086570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:03.880 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.876+0000 7f499fa31640 1 -- 10.20.193.57:0/1554951976 wait complete. 2026-02-20T16:31:03.880 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.876+0000 7f82b5671640 1 --2- 10.20.193.57:0/3221495978 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f82b0130220 0x7f82b0086570 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f82a4005fd0 tx=0x7f82a402f180 comp rx=0 tx=0).stop 2026-02-20T16:31:03.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.876+0000 7fcd239cb640 1 -- 10.20.193.57:0/3370326565 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fcd1c135f40 msgr2=0x7fcd1c1363b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:03.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.876+0000 7fcd239cb640 1 --2- 10.20.193.57:0/3370326565 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fcd1c135f40 0x7fcd1c1363b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcd10005fd0 tx=0x7fcd1002f180 comp rx=0 tx=0).stop 2026-02-20T16:31:03.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.876+0000 7f82b5671640 1 -- 10.20.193.57:0/3221495978 shutdown_connections 2026-02-20T16:31:03.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.876+0000 7f82b5671640 1 --2- 10.20.193.57:0/3221495978 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f82b01368f0 0x7f82b0197270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:03.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.876+0000 7f82b5671640 1 --2- 10.20.193.57:0/3221495978 >> v2:10.20.193.57:3300/0 conn(0x7f82b0135f40 0x7f82b01363b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:03.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.876+0000 7f82b5671640 1 --2- 10.20.193.57:0/3221495978 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f82b0130220 0x7f82b0086570 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:03.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.876+0000 7f82b5671640 1 -- 10.20.193.57:0/3221495978 >> 10.20.193.57:0/3221495978 conn(0x7f82b008aae0 msgr2=0x7f82b008aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:03.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.876+0000 7f82b5671640 1 -- 10.20.193.57:0/3221495978 shutdown_connections 2026-02-20T16:31:03.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.876+0000 7fcd239cb640 1 -- 10.20.193.57:0/3370326565 shutdown_connections 2026-02-20T16:31:03.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.876+0000 7fcd239cb640 1 --2- 10.20.193.57:0/3370326565 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fcd1c135f40 0x7fcd1c1363b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:03.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.876+0000 7fcd239cb640 1 --2- 10.20.193.57:0/3370326565 >> v2:10.20.193.57:3300/0 conn(0x7fcd1c130220 0x7fcd1c086570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:03.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.876+0000 7fcd239cb640 1 -- 10.20.193.57:0/3370326565 >> 10.20.193.57:0/3370326565 conn(0x7fcd1c08aae0 msgr2=0x7fcd1c08aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:03.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.876+0000 7f82b5671640 1 -- 10.20.193.57:0/3221495978 wait complete. 2026-02-20T16:31:03.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.876+0000 7fcd239cb640 1 -- 10.20.193.57:0/3370326565 shutdown_connections 2026-02-20T16:31:03.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.876+0000 7fcd239cb640 1 -- 10.20.193.57:0/3370326565 wait complete. 2026-02-20T16:31:03.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7f499fa31640 1 Processor -- start 2026-02-20T16:31:03.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7f499fa31640 1 -- start start 2026-02-20T16:31:03.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7fcd239cb640 1 Processor -- start 2026-02-20T16:31:03.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7f82b5671640 1 Processor -- start 2026-02-20T16:31:03.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7f82b5671640 1 -- start start 2026-02-20T16:31:03.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7fcd239cb640 1 -- start start 2026-02-20T16:31:03.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7f499fa31640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f499807dc60 0x7f499811fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:03.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7f499fa31640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f4998085b90 0x7f4998120350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:03.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7f499fa31640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f4998174330 0x7f4998123120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:03.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7f499fa31640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f4998195860 con 0x7f4998085b90 2026-02-20T16:31:03.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7f499fa31640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f49981956e0 con 0x7f4998174330 2026-02-20T16:31:03.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7f499fa31640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f49981959e0 con 0x7f499807dc60 2026-02-20T16:31:03.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7f499d7a6640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f499807dc60 0x7f499811fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:03.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7f499dfa7640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f4998174330 0x7f4998123120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:03.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7f499cfa5640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f4998085b90 0x7f4998120350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:03.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7f499dfa7640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f4998174330 0x7f4998123120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3301/0 says I am v2:10.20.193.57:53672/0 (socket says 10.20.193.57:53672) 2026-02-20T16:31:03.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7f499dfa7640 1 -- 10.20.193.57:0/2148373543 learned_addr learned my addr 10.20.193.57:0/2148373543 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:31:03.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7f82b5671640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f82b0130220 0x7f82b005b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:03.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7fcd239cb640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fcd1c130220 0x7fcd1c11f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:03.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7fcd239cb640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fcd1c135f40 0x7fcd1c05b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:03.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7f82b5671640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f82b0135f40 0x7f82b0196fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:03.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7f82b5671640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f82b01368f0 0x7f82b005bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:03.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7f82b5671640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f82b0197b40 con 0x7f82b01368f0 2026-02-20T16:31:03.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7f82b5671640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f82b01979c0 con 0x7f82b0135f40 2026-02-20T16:31:03.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7fcd239cb640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fcd1c1368f0 0x7fcd1c05b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:03.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7fcd239cb640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7fcd1c198d50 con 0x7fcd1c1368f0 2026-02-20T16:31:03.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7f82b5671640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f82b0197cc0 con 0x7f82b0130220 2026-02-20T16:31:03.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7fcd239cb640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7fcd1c198bd0 con 0x7fcd1c135f40 2026-02-20T16:31:03.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7fcd239cb640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7fcd1c198ed0 con 0x7fcd1c130220 2026-02-20T16:31:03.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7f82aeffd640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f82b0130220 0x7f82b005b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:03.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7f82af7fe640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f82b01368f0 0x7f82b005bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:03.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7fcd21740640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fcd1c130220 0x7fcd1c11f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:03.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7f82af7fe640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f82b01368f0 0x7f82b005bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:52788/0 (socket says 10.20.193.57:52788) 2026-02-20T16:31:03.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7f82af7fe640 1 -- 10.20.193.57:0/1778587110 learned_addr learned my addr 10.20.193.57:0/1778587110 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:31:03.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7f82aeffd640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f82b0130220 0x7f82b005b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3302/0 says I am v2:10.20.193.57:44906/0 (socket says 10.20.193.57:44906) 2026-02-20T16:31:03.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7fcd21740640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fcd1c130220 0x7fcd1c11f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3302/0 says I am v2:10.20.193.57:44912/0 (socket says 10.20.193.57:44912) 2026-02-20T16:31:03.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7fcd21740640 1 -- 10.20.193.57:0/1680381551 learned_addr learned my addr 10.20.193.57:0/1680381551 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:31:03.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7f499dfa7640 1 -- 10.20.193.57:0/2148373543 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f499807dc60 msgr2=0x7f499811fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:03.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7f499dfa7640 1 --2- 10.20.193.57:0/2148373543 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f499807dc60 0x7f499811fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:03.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7f499dfa7640 1 -- 10.20.193.57:0/2148373543 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f4998085b90 msgr2=0x7f4998120350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:03.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7f499dfa7640 1 --2- 10.20.193.57:0/2148373543 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f4998085b90 0x7f4998120350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:03.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7f499dfa7640 1 -- 10.20.193.57:0/2148373543 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f499810c490 con 0x7f4998174330 2026-02-20T16:31:03.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7f82ae7fc640 1 --2- 10.20.193.57:0/1778587110 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f82b0135f40 0x7f82b0196fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:03.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7fcd20f3f640 1 --2- 10.20.193.57:0/1680381551 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fcd1c135f40 0x7fcd1c05b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:03.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7fcd21f41640 1 --2- 10.20.193.57:0/1680381551 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fcd1c1368f0 0x7fcd1c05b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:03.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7f499dfa7640 1 --2- 10.20.193.57:0/2148373543 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f4998174330 0x7f4998123120 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4994004800 tx=0x7f499400d4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:31:03.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7f82af7fe640 1 -- 10.20.193.57:0/1778587110 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f82b0130220 msgr2=0x7f82b005b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:03.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7f82af7fe640 1 --2- 10.20.193.57:0/1778587110 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f82b0130220 0x7f82b005b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:03.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7f82af7fe640 1 -- 10.20.193.57:0/1778587110 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f82b0135f40 msgr2=0x7f82b0196fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:03.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7f82af7fe640 1 --2- 10.20.193.57:0/1778587110 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f82b0135f40 0x7f82b0196fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:03.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7fcd21740640 1 -- 10.20.193.57:0/1680381551 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fcd1c135f40 msgr2=0x7fcd1c05b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:03.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7fcd21740640 1 --2- 10.20.193.57:0/1680381551 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fcd1c135f40 0x7fcd1c05b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:03.898 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7f82af7fe640 1 -- 10.20.193.57:0/1778587110 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82b01307a0 con 0x7f82b01368f0 2026-02-20T16:31:03.898 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7f4985ffb640 1 -- 10.20.193.57:0/2148373543 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49940090d0 con 0x7f4998174330 2026-02-20T16:31:03.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7fcd21740640 1 -- 10.20.193.57:0/1680381551 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fcd1c1368f0 msgr2=0x7fcd1c05b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:03.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7fcd21740640 1 --2- 10.20.193.57:0/1680381551 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fcd1c1368f0 0x7fcd1c05b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:03.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7fcd21740640 1 -- 10.20.193.57:0/1680381551 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd1c05dcb0 con 0x7fcd1c130220 2026-02-20T16:31:03.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7fcd21f41640 1 --2- 10.20.193.57:0/1680381551 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fcd1c1368f0 0x7fcd1c05b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T16:31:03.900 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7f499fa31640 1 -- 10.20.193.57:0/2148373543 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f499807c990 con 0x7f4998174330 2026-02-20T16:31:03.900 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.877+0000 7f499fa31640 1 -- 10.20.193.57:0/2148373543 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f499810c180 con 0x7f4998174330 2026-02-20T16:31:03.900 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.878+0000 7f82af7fe640 1 --2- 10.20.193.57:0/1778587110 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f82b01368f0 0x7f82b005bb00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f82a0009de0 tx=0x7f82a000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:31:03.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.878+0000 7fcd21740640 1 --2- 10.20.193.57:0/1680381551 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fcd1c130220 0x7fcd1c11f530 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c009e90 tx=0x7fcd0c009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:31:03.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.878+0000 7f4985ffb640 1 -- 10.20.193.57:0/2148373543 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4994009270 con 0x7f4998174330 2026-02-20T16:31:03.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.878+0000 7f4985ffb640 1 -- 10.20.193.57:0/2148373543 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4994021060 con 0x7f4998174330 2026-02-20T16:31:03.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.878+0000 7f828f7fe640 1 -- 10.20.193.57:0/1778587110 <== mon.0 v2:10.20.193.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82a00092e0 con 0x7f82b01368f0 2026-02-20T16:31:03.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.878+0000 7f828f7fe640 1 -- 10.20.193.57:0/1778587110 <== mon.0 v2:10.20.193.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f82a000cb30 con 0x7f82b01368f0 2026-02-20T16:31:03.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.878+0000 7fcd09ffb640 1 -- 10.20.193.57:0/1680381551 <== mon.2 v2:10.20.193.57:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c0090d0 con 0x7fcd1c130220 2026-02-20T16:31:03.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.878+0000 7f828f7fe640 1 -- 10.20.193.57:0/1778587110 <== mon.0 v2:10.20.193.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82a0003a80 con 0x7f82b01368f0 2026-02-20T16:31:03.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.878+0000 7f82b5671640 1 -- 10.20.193.57:0/1778587110 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82b0197510 con 0x7f82b01368f0 2026-02-20T16:31:03.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.878+0000 7fcd09ffb640 1 -- 10.20.193.57:0/1680381551 <== mon.2 v2:10.20.193.57:3302/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd0c009270 con 0x7fcd1c130220 2026-02-20T16:31:03.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.878+0000 7fcd239cb640 1 -- 10.20.193.57:0/1680381551 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd1c05d4b0 con 0x7fcd1c130220 2026-02-20T16:31:03.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.878+0000 7fcd09ffb640 1 -- 10.20.193.57:0/1680381551 <== mon.2 v2:10.20.193.57:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c003ce0 con 0x7fcd1c130220 2026-02-20T16:31:03.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.878+0000 7f82b5671640 1 -- 10.20.193.57:0/1778587110 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82b010f960 con 0x7f82b01368f0 2026-02-20T16:31:03.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.878+0000 7fcd239cb640 1 -- 10.20.193.57:0/1680381551 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd1c11f070 con 0x7fcd1c130220 2026-02-20T16:31:03.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.878+0000 7f499fa31640 1 -- 10.20.193.57:0/2148373543 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f499807d720 con 0x7f4998174330 2026-02-20T16:31:03.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.878+0000 7f82b5671640 1 -- 10.20.193.57:0/1778587110 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82b0135240 con 0x7f82b01368f0 2026-02-20T16:31:03.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.878+0000 7f828f7fe640 1 -- 10.20.193.57:0/1778587110 <== mon.0 v2:10.20.193.57:3300/0 4 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7f82a0003c20 con 0x7f82b01368f0 2026-02-20T16:31:03.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.878+0000 7f4985ffb640 1 -- 10.20.193.57:0/2148373543 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7f4994012070 con 0x7f4998174330 2026-02-20T16:31:03.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.878+0000 7fcd09ffb640 1 -- 10.20.193.57:0/1680381551 <== mon.2 v2:10.20.193.57:3302/0 4 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7fcd0c004020 con 0x7fcd1c130220 2026-02-20T16:31:03.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.879+0000 7f828f7fe640 1 -- 10.20.193.57:0/1778587110 <== mon.0 v2:10.20.193.57:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3026+0+0 (secure 0 0 0) 0x7f82a0064050 con 0x7f82b01368f0 2026-02-20T16:31:03.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.878+0000 7fcd239cb640 1 -- 10.20.193.57:0/1680381551 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd1c086570 con 0x7fcd1c130220 2026-02-20T16:31:03.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.879+0000 7f4985ffb640 1 -- 10.20.193.57:0/2148373543 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(30..30 src has 1..30) ==== 3026+0+0 (secure 0 0 0) 0x7f4994063690 con 0x7f4998174330 2026-02-20T16:31:03.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.879+0000 7fcd09ffb640 1 -- 10.20.193.57:0/1680381551 <== mon.2 v2:10.20.193.57:3302/0 5 ==== osd_map(30..30 src has 1..30) ==== 3026+0+0 (secure 0 0 0) 0x7fcd0c064220 con 0x7fcd1c130220 2026-02-20T16:31:03.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.880+0000 7f4985ffb640 1 -- 10.20.193.57:0/2148373543 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7f4994010070 con 0x7f4998174330 2026-02-20T16:31:03.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.880+0000 7f828f7fe640 1 -- 10.20.193.57:0/1778587110 <== mon.0 v2:10.20.193.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7f82b0135240 con 0x7f82b01368f0 2026-02-20T16:31:03.909 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.880+0000 7fb27428d640 1 -- 10.20.193.57:0/2783884956 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fb26c136af0 msgr2=0x7fb26c198280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:03.909 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.880+0000 7fb27428d640 1 --2- 10.20.193.57:0/2783884956 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fb26c136af0 0x7fb26c198280 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb268004af0 tx=0x7fb26802f310 comp rx=0 tx=0).stop 2026-02-20T16:31:03.909 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.880+0000 7fb27428d640 1 -- 10.20.193.57:0/2783884956 shutdown_connections 2026-02-20T16:31:03.909 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.880+0000 7fb27428d640 1 --2- 10.20.193.57:0/2783884956 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fb26c136af0 0x7fb26c198280 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:03.909 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.880+0000 7fb27428d640 1 --2- 10.20.193.57:0/2783884956 >> v2:10.20.193.57:3300/0 conn(0x7fb26c130220 0x7fb26c086570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:03.909 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.880+0000 7fb27428d640 1 -- 10.20.193.57:0/2783884956 >> 10.20.193.57:0/2783884956 conn(0x7fb26c08aae0 msgr2=0x7fb26c08aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:03.909 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.880+0000 7fb27428d640 1 -- 10.20.193.57:0/2783884956 shutdown_connections 2026-02-20T16:31:03.909 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.880+0000 7fb27428d640 1 -- 10.20.193.57:0/2783884956 wait complete. 2026-02-20T16:31:03.910 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.880+0000 7fcd09ffb640 1 -- 10.20.193.57:0/1680381551 <== mon.2 v2:10.20.193.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7fcd0c022020 con 0x7fcd1c130220 2026-02-20T16:31:03.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.881+0000 7fb27428d640 1 Processor -- start 2026-02-20T16:31:03.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.881+0000 7fb27428d640 1 -- start start 2026-02-20T16:31:03.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.881+0000 7fb27428d640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fb26c130220 0x7fb26c112b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:03.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.881+0000 7fb27428d640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fb26c135f40 0x7fb26c113090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:03.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.881+0000 7fb27428d640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fb26c136af0 0x7fb26c1135d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:03.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.881+0000 7fb27428d640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7fb26c198d30 con 0x7fb26c135f40 2026-02-20T16:31:03.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.881+0000 7fb27428d640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7fb26c198bb0 con 0x7fb26c130220 2026-02-20T16:31:03.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.881+0000 7fb27428d640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7fb26c198eb0 con 0x7fb26c136af0 2026-02-20T16:31:03.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.881+0000 7fb272002640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fb26c130220 0x7fb26c112b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:03.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.881+0000 7fb272002640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fb26c130220 0x7fb26c112b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3301/0 says I am v2:10.20.193.57:53712/0 (socket says 10.20.193.57:53712) 2026-02-20T16:31:03.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.881+0000 7fb272002640 1 -- 10.20.193.57:0/2470356356 learned_addr learned my addr 10.20.193.57:0/2470356356 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:31:03.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.881+0000 7fb272803640 1 --2- 10.20.193.57:0/2470356356 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fb26c136af0 0x7fb26c1135d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:03.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.881+0000 7fb271801640 1 --2- 10.20.193.57:0/2470356356 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fb26c135f40 0x7fb26c113090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:03.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.881+0000 7fb272002640 1 -- 10.20.193.57:0/2470356356 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fb26c136af0 msgr2=0x7fb26c1135d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:03.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.881+0000 7fb272002640 1 --2- 10.20.193.57:0/2470356356 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fb26c136af0 0x7fb26c1135d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:03.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.881+0000 7fb272002640 1 -- 10.20.193.57:0/2470356356 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fb26c135f40 msgr2=0x7fb26c113090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:03.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.881+0000 7fb272002640 1 --2- 10.20.193.57:0/2470356356 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fb26c135f40 0x7fb26c113090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:03.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.881+0000 7fb272002640 1 -- 10.20.193.57:0/2470356356 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb26c0580d0 con 0x7fb26c130220 2026-02-20T16:31:03.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.881+0000 7fb272803640 1 --2- 10.20.193.57:0/2470356356 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fb26c136af0 0x7fb26c1135d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T16:31:03.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.881+0000 7fb272002640 1 --2- 10.20.193.57:0/2470356356 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fb26c130220 0x7fb26c112b50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb25c005970 tx=0x7fb25c00ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:31:03.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.882+0000 7fb25a7fc640 1 -- 10.20.193.57:0/2470356356 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb25c00ccf0 con 0x7fb26c130220 2026-02-20T16:31:03.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.882+0000 7fb25a7fc640 1 -- 10.20.193.57:0/2470356356 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb25c004880 con 0x7fb26c130220 2026-02-20T16:31:03.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.882+0000 7fb27428d640 1 -- 10.20.193.57:0/2470356356 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb26c05da70 con 0x7fb26c130220 2026-02-20T16:31:03.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.882+0000 7fb25a7fc640 1 -- 10.20.193.57:0/2470356356 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb25c004cd0 con 0x7fb26c130220 2026-02-20T16:31:03.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.882+0000 7fb27428d640 1 -- 10.20.193.57:0/2470356356 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb26c11ee20 con 0x7fb26c130220 2026-02-20T16:31:03.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.882+0000 7fb27428d640 1 -- 10.20.193.57:0/2470356356 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb26c086570 con 0x7fb26c130220 2026-02-20T16:31:03.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.882+0000 7fb25a7fc640 1 -- 10.20.193.57:0/2470356356 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7fb25c004080 con 0x7fb26c130220 2026-02-20T16:31:03.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.883+0000 7fb25a7fc640 1 -- 10.20.193.57:0/2470356356 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(30..30 src has 1..30) ==== 3026+0+0 (secure 0 0 0) 0x7fb25c064150 con 0x7fb26c130220 2026-02-20T16:31:03.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.884+0000 7fb25a7fc640 1 -- 10.20.193.57:0/2470356356 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7fb25c063220 con 0x7fb26c130220 2026-02-20T16:31:03.957 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.955+0000 7f499fa31640 1 -- 10.20.193.57:0/2148373543 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f49981208f0 con 0x7f4998174330 2026-02-20T16:31:03.957 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.956+0000 7f4985ffb640 1 -- 10.20.193.57:0/2148373543 <== mon.1 v2:10.20.193.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4994009420 con 0x7f4998174330 2026-02-20T16:31:03.958 INFO:teuthology.orchestra.run.trial057.stdout:98784247811 2026-02-20T16:31:03.959 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.957+0000 7f499fa31640 1 -- 10.20.193.57:0/2148373543 >> v1:10.20.193.57:6800/2007744879 conn(0x7f496804cae0 legacy=0x7f496806cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:03.959 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.957+0000 7f499fa31640 1 -- 10.20.193.57:0/2148373543 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f4998174330 msgr2=0x7f4998123120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:03.959 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.957+0000 7f499fa31640 1 --2- 10.20.193.57:0/2148373543 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f4998174330 0x7f4998123120 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4994004800 tx=0x7f499400d4a0 comp rx=0 tx=0).stop 2026-02-20T16:31:03.959 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.957+0000 7f499fa31640 1 -- 10.20.193.57:0/2148373543 shutdown_connections 2026-02-20T16:31:03.959 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.957+0000 7f499fa31640 1 --2- 10.20.193.57:0/2148373543 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f4998174330 0x7f4998123120 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:03.959 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.957+0000 7f499fa31640 1 --2- 10.20.193.57:0/2148373543 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f4998085b90 0x7f4998120350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:03.959 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.957+0000 7f499fa31640 1 --2- 10.20.193.57:0/2148373543 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f499807dc60 0x7f499811fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:03.960 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.957+0000 7f499fa31640 1 -- 10.20.193.57:0/2148373543 >> 10.20.193.57:0/2148373543 conn(0x7f49980833e0 msgr2=0x7f499805c080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:03.960 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.957+0000 7f499fa31640 1 -- 10.20.193.57:0/2148373543 shutdown_connections 2026-02-20T16:31:03.960 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.957+0000 7f499fa31640 1 -- 10.20.193.57:0/2148373543 wait complete. 2026-02-20T16:31:03.960 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.957+0000 7f82b5671640 1 -- 10.20.193.57:0/1778587110 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f82b0086570 con 0x7f82b01368f0 2026-02-20T16:31:03.960 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.957+0000 7f828f7fe640 1 -- 10.20.193.57:0/1778587110 <== mon.0 v2:10.20.193.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f82a0022020 con 0x7f82b01368f0 2026-02-20T16:31:03.961 INFO:teuthology.orchestra.run.trial057.stdout:111669149699 2026-02-20T16:31:03.961 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.958+0000 7fcd239cb640 1 -- 10.20.193.57:0/1680381551 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fcd1c1157d0 con 0x7fcd1c130220 2026-02-20T16:31:03.961 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.958+0000 7fcd09ffb640 1 -- 10.20.193.57:0/1680381551 <== mon.2 v2:10.20.193.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fcd1c05dcb0 con 0x7fcd1c130220 2026-02-20T16:31:03.961 INFO:teuthology.orchestra.run.trial057.stdout:103079215107 2026-02-20T16:31:03.962 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.959+0000 7f82b5671640 1 -- 10.20.193.57:0/1778587110 >> v1:10.20.193.57:6800/2007744879 conn(0x7f827c04cae0 legacy=0x7f827c06cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:03.962 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.959+0000 7f82b5671640 1 -- 10.20.193.57:0/1778587110 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f82b01368f0 msgr2=0x7f82b005bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:03.963 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.959+0000 7f82b5671640 1 --2- 10.20.193.57:0/1778587110 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f82b01368f0 0x7f82b005bb00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f82a0009de0 tx=0x7f82a000c490 comp rx=0 tx=0).stop 2026-02-20T16:31:03.963 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.959+0000 7f82b5671640 1 -- 10.20.193.57:0/1778587110 shutdown_connections 2026-02-20T16:31:03.963 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.959+0000 7f82b5671640 1 --2- 10.20.193.57:0/1778587110 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f82b01368f0 0x7f82b005bb00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:03.963 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.959+0000 7f82b5671640 1 --2- 10.20.193.57:0/1778587110 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f82b0135f40 0x7f82b0196fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:03.963 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.959+0000 7f82b5671640 1 --2- 10.20.193.57:0/1778587110 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f82b0130220 0x7f82b005b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:03.963 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.959+0000 7f82b5671640 1 -- 10.20.193.57:0/1778587110 >> 10.20.193.57:0/1778587110 conn(0x7f82b008aae0 msgr2=0x7f82b0082aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:03.963 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.959+0000 7f82b5671640 1 -- 10.20.193.57:0/1778587110 shutdown_connections 2026-02-20T16:31:03.963 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.959+0000 7f82b5671640 1 -- 10.20.193.57:0/1778587110 wait complete. 2026-02-20T16:31:03.964 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.960+0000 7fcd239cb640 1 -- 10.20.193.57:0/1680381551 >> v1:10.20.193.57:6800/2007744879 conn(0x7fccec04cae0 legacy=0x7fccec06cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:03.964 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.960+0000 7fcd239cb640 1 -- 10.20.193.57:0/1680381551 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fcd1c130220 msgr2=0x7fcd1c11f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:03.964 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.960+0000 7fcd239cb640 1 --2- 10.20.193.57:0/1680381551 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fcd1c130220 0x7fcd1c11f530 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c009e90 tx=0x7fcd0c009f90 comp rx=0 tx=0).stop 2026-02-20T16:31:03.964 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.960+0000 7fcd239cb640 1 -- 10.20.193.57:0/1680381551 shutdown_connections 2026-02-20T16:31:03.964 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.960+0000 7fcd239cb640 1 --2- 10.20.193.57:0/1680381551 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fcd1c1368f0 0x7fcd1c05b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:03.964 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.960+0000 7fcd239cb640 1 --2- 10.20.193.57:0/1680381551 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fcd1c135f40 0x7fcd1c05b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:03.964 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.960+0000 7fcd239cb640 1 --2- 10.20.193.57:0/1680381551 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fcd1c130220 0x7fcd1c11f530 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:03.965 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.960+0000 7fcd239cb640 1 -- 10.20.193.57:0/1680381551 >> 10.20.193.57:0/1680381551 conn(0x7fcd1c08aae0 msgr2=0x7fcd1c1347c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:03.965 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.960+0000 7fcd239cb640 1 -- 10.20.193.57:0/1680381551 shutdown_connections 2026-02-20T16:31:03.965 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.960+0000 7fcd239cb640 1 -- 10.20.193.57:0/1680381551 wait complete. 2026-02-20T16:31:03.965 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.961+0000 7fb27428d640 1 -- 10.20.193.57:0/2470356356 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fb26c0531d0 con 0x7fb26c130220 2026-02-20T16:31:03.965 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.961+0000 7fb25a7fc640 1 -- 10.20.193.57:0/2470356356 <== mon.1 v2:10.20.193.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb25c062a10 con 0x7fb26c130220 2026-02-20T16:31:03.965 INFO:teuthology.orchestra.run.trial057.stdout:107374182403 2026-02-20T16:31:03.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.963+0000 7fb27428d640 1 -- 10.20.193.57:0/2470356356 >> v1:10.20.193.57:6800/2007744879 conn(0x7fb23c04cae0 legacy=0x7fb23c06cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:03.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.963+0000 7fb27428d640 1 -- 10.20.193.57:0/2470356356 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fb26c130220 msgr2=0x7fb26c112b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:03.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.963+0000 7fb27428d640 1 --2- 10.20.193.57:0/2470356356 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fb26c130220 0x7fb26c112b50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb25c005970 tx=0x7fb25c00ee60 comp rx=0 tx=0).stop 2026-02-20T16:31:03.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.963+0000 7fb27428d640 1 -- 10.20.193.57:0/2470356356 shutdown_connections 2026-02-20T16:31:03.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.963+0000 7fb27428d640 1 --2- 10.20.193.57:0/2470356356 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fb26c136af0 0x7fb26c1135d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:03.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.963+0000 7fb27428d640 1 --2- 10.20.193.57:0/2470356356 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fb26c135f40 0x7fb26c113090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:03.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.963+0000 7fb27428d640 1 --2- 10.20.193.57:0/2470356356 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fb26c130220 0x7fb26c112b50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:03.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.963+0000 7fb27428d640 1 -- 10.20.193.57:0/2470356356 >> 10.20.193.57:0/2470356356 conn(0x7fb26c08aae0 msgr2=0x7fb26c134710 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:03.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.963+0000 7fb27428d640 1 -- 10.20.193.57:0/2470356356 shutdown_connections 2026-02-20T16:31:03.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:03.963+0000 7fb27428d640 1 -- 10.20.193.57:0/2470356356 wait complete. 2026-02-20T16:31:03.968 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247811 got 98784247811 for osd.0 2026-02-20T16:31:03.968 DEBUG:teuthology.parallel:result is None 2026-02-20T16:31:03.969 INFO:tasks.ceph.ceph_manager.ceph:need seq 111669149699 got 111669149699 for osd.3 2026-02-20T16:31:03.970 DEBUG:teuthology.parallel:result is None 2026-02-20T16:31:03.971 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215107 got 103079215107 for osd.1 2026-02-20T16:31:03.971 DEBUG:teuthology.parallel:result is None 2026-02-20T16:31:03.973 INFO:tasks.ceph.ceph_manager.ceph:need seq 107374182403 got 107374182403 for osd.2 2026-02-20T16:31:03.973 DEBUG:teuthology.parallel:result is None 2026-02-20T16:31:03.973 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-20T16:31:03.974 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T16:31:04.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.082+0000 7f3455a08640 1 -- 10.20.193.57:0/2842320660 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f3450176890 msgr2=0x7f3450196c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:04.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.082+0000 7f3455a08640 1 --2- 10.20.193.57:0/2842320660 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f3450176890 0x7f3450196c70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3440009750 tx=0x7f344002f400 comp rx=0 tx=0).stop 2026-02-20T16:31:04.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.082+0000 7f3455a08640 1 -- 10.20.193.57:0/2842320660 shutdown_connections 2026-02-20T16:31:04.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.082+0000 7f3455a08640 1 --2- 10.20.193.57:0/2842320660 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f3450176890 0x7f3450196c70 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:04.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.082+0000 7f3455a08640 1 --2- 10.20.193.57:0/2842320660 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f345005c970 0x7f3450176350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:04.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.082+0000 7f3455a08640 1 --2- 10.20.193.57:0/2842320660 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f345005c060 0x7f345005c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:04.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.082+0000 7f3455a08640 1 -- 10.20.193.57:0/2842320660 >> 10.20.193.57:0/2842320660 conn(0x7f34500833e0 msgr2=0x7f34500840b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:04.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.082+0000 7f3455a08640 1 -- 10.20.193.57:0/2842320660 shutdown_connections 2026-02-20T16:31:04.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.082+0000 7f3455a08640 1 -- 10.20.193.57:0/2842320660 wait complete. 2026-02-20T16:31:04.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.082+0000 7f3455a08640 1 Processor -- start 2026-02-20T16:31:04.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.082+0000 7f3455a08640 1 -- start start 2026-02-20T16:31:04.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.083+0000 7f3455a08640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f345005c060 0x7f3450176c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:04.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.083+0000 7f3455a08640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f345005c970 0x7f34501771a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:04.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.083+0000 7f3455a08640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f3450176890 0x7f34501776e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:04.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.083+0000 7f3455a08640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f3450197be0 con 0x7f3450176890 2026-02-20T16:31:04.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.083+0000 7f3455a08640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f3450197a60 con 0x7f345005c970 2026-02-20T16:31:04.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.083+0000 7f3455a08640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f3450197d60 con 0x7f345005c060 2026-02-20T16:31:04.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.083+0000 7f344e7fc640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f345005c970 0x7f34501771a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:04.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.083+0000 7f344effd640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f345005c060 0x7f3450176c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:04.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.083+0000 7f344e7fc640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f345005c970 0x7f34501771a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3301/0 says I am v2:10.20.193.57:53734/0 (socket says 10.20.193.57:53734) 2026-02-20T16:31:04.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.083+0000 7f344e7fc640 1 -- 10.20.193.57:0/3847565359 learned_addr learned my addr 10.20.193.57:0/3847565359 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:31:04.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.083+0000 7f344f7fe640 1 --2- 10.20.193.57:0/3847565359 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f3450176890 0x7f34501776e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:04.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.083+0000 7f344e7fc640 1 -- 10.20.193.57:0/3847565359 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f345005c060 msgr2=0x7f3450176c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:04.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.083+0000 7f344e7fc640 1 --2- 10.20.193.57:0/3847565359 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f345005c060 0x7f3450176c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:04.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.083+0000 7f344e7fc640 1 -- 10.20.193.57:0/3847565359 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f3450176890 msgr2=0x7f34501776e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:04.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.083+0000 7f344e7fc640 1 --2- 10.20.193.57:0/3847565359 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f3450176890 0x7f34501776e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:04.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.083+0000 7f344e7fc640 1 -- 10.20.193.57:0/3847565359 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34501799b0 con 0x7f345005c970 2026-02-20T16:31:04.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.083+0000 7f344effd640 1 --2- 10.20.193.57:0/3847565359 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f345005c060 0x7f3450176c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:31:04.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.083+0000 7f344e7fc640 1 --2- 10.20.193.57:0/3847565359 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f345005c970 0x7f34501771a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f343800e9f0 tx=0x7f343800eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:31:04.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.083+0000 7f3427fff640 1 -- 10.20.193.57:0/3847565359 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f343800cd00 con 0x7f345005c970 2026-02-20T16:31:04.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.083+0000 7f3427fff640 1 -- 10.20.193.57:0/3847565359 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3438004880 con 0x7f345005c970 2026-02-20T16:31:04.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.083+0000 7f3455a08640 1 -- 10.20.193.57:0/3847565359 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3450178ee0 con 0x7f345005c970 2026-02-20T16:31:04.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.083+0000 7f3427fff640 1 -- 10.20.193.57:0/3847565359 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f343800cea0 con 0x7f345005c970 2026-02-20T16:31:04.090 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.083+0000 7f3455a08640 1 -- 10.20.193.57:0/3847565359 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f345007c9e0 con 0x7f345005c970 2026-02-20T16:31:04.090 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.083+0000 7f3455a08640 1 -- 10.20.193.57:0/3847565359 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3450080130 con 0x7f345005c970 2026-02-20T16:31:04.090 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.084+0000 7f3427fff640 1 -- 10.20.193.57:0/3847565359 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7f3438004cd0 con 0x7f345005c970 2026-02-20T16:31:04.090 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.084+0000 7f3427fff640 1 -- 10.20.193.57:0/3847565359 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(30..30 src has 1..30) ==== 3026+0+0 (secure 0 0 0) 0x7f3438064060 con 0x7f345005c970 2026-02-20T16:31:04.090 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.085+0000 7f3427fff640 1 -- 10.20.193.57:0/3847565359 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7f3450080130 con 0x7f345005c970 2026-02-20T16:31:04.161 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.159+0000 7f3455a08640 1 -- 10.20.193.57:0/3847565359 --> v1:10.20.193.57:6800/2007744879 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3450081f00 con 0x7f342004cae0 2026-02-20T16:31:04.162 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.160+0000 7f3427fff640 1 -- 10.20.193.57:0/3847565359 <== mgr.14109 v1:10.20.193.57:6800/2007744879 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31972 (unknown 2965378022 0 808432974) 0x7f3450081f00 con 0x7f342004cae0 2026-02-20T16:31:04.162 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:31:04.163 INFO:teuthology.orchestra.run.trial057.stderr:dumped all 2026-02-20T16:31:04.164 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.160+0000 7f3455a08640 1 -- 10.20.193.57:0/3847565359 >> v1:10.20.193.57:6800/2007744879 conn(0x7f342004cae0 legacy=0x7f342006cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:04.164 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.160+0000 7f3455a08640 1 -- 10.20.193.57:0/3847565359 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f345005c970 msgr2=0x7f34501771a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:04.164 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.160+0000 7f3455a08640 1 --2- 10.20.193.57:0/3847565359 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f345005c970 0x7f34501771a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f343800e9f0 tx=0x7f343800eec0 comp rx=0 tx=0).stop 2026-02-20T16:31:04.164 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.160+0000 7f3455a08640 1 -- 10.20.193.57:0/3847565359 shutdown_connections 2026-02-20T16:31:04.164 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.160+0000 7f3455a08640 1 --2- 10.20.193.57:0/3847565359 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f3450176890 0x7f34501776e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:04.164 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.160+0000 7f3455a08640 1 --2- 10.20.193.57:0/3847565359 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f345005c970 0x7f34501771a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:04.165 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.160+0000 7f3455a08640 1 --2- 10.20.193.57:0/3847565359 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f345005c060 0x7f3450176c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:04.165 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.160+0000 7f3455a08640 1 -- 10.20.193.57:0/3847565359 >> 10.20.193.57:0/3847565359 conn(0x7f34500833e0 msgr2=0x7f345007ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:04.165 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.160+0000 7f3455a08640 1 -- 10.20.193.57:0/3847565359 shutdown_connections 2026-02-20T16:31:04.165 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.160+0000 7f3455a08640 1 -- 10.20.193.57:0/3847565359 wait complete. 2026-02-20T16:31:04.170 INFO:teuthology.orchestra.run.trial057.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2026-02-20T16:31:02.932184+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":115,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":111968,"kb_used_data":2144,"kb_used_omap":32,"kb_used_meta":109727,"kb_avail":377375392,"statfs":{"total":386547056640,"available":386432401408,"internally_reserved":0,"allocated":2195456,"data_stored":1526748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33367,"internal_metadata":112360873},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.980296"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.964839+0000","last_change":"2026-02-20T16:30:58.157966+0000","last_active":"2026-02-20T16:31:01.964839+0000","last_peered":"2026-02-20T16:31:01.964839+0000","last_clean":"2026-02-20T16:31:01.964839+0000","last_became_active":"2026-02-20T16:30:58.157789+0000","last_became_peered":"2026-02-20T16:30:58.157789+0000","last_unstale":"2026-02-20T16:31:01.964839+0000","last_undegraded":"2026-02-20T16:31:01.964839+0000","last_fullsized":"2026-02-20T16:31:01.964839+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:54:24.491175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001161203,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.964718+0000","last_change":"2026-02-20T16:30:55.953096+0000","last_active":"2026-02-20T16:31:01.964718+0000","last_peered":"2026-02-20T16:31:01.964718+0000","last_clean":"2026-02-20T16:31:01.964718+0000","last_became_active":"2026-02-20T16:30:55.952830+0000","last_became_peered":"2026-02-20T16:30:55.952830+0000","last_unstale":"2026-02-20T16:31:01.964718+0000","last_undegraded":"2026-02-20T16:31:01.964718+0000","last_fullsized":"2026-02-20T16:31:01.964718+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:40:28.084285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033720799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.964835+0000","last_change":"2026-02-20T16:30:58.158048+0000","last_active":"2026-02-20T16:31:01.964835+0000","last_peered":"2026-02-20T16:31:01.964835+0000","last_clean":"2026-02-20T16:31:01.964835+0000","last_became_active":"2026-02-20T16:30:58.157875+0000","last_became_peered":"2026-02-20T16:30:58.157875+0000","last_unstale":"2026-02-20T16:31:01.964835+0000","last_undegraded":"2026-02-20T16:31:01.964835+0000","last_fullsized":"2026-02-20T16:31:01.964835+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:21:38.884906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001207149,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.964710+0000","last_change":"2026-02-20T16:30:55.952911+0000","last_active":"2026-02-20T16:31:01.964710+0000","last_peered":"2026-02-20T16:31:01.964710+0000","last_clean":"2026-02-20T16:31:01.964710+0000","last_became_active":"2026-02-20T16:30:55.952715+0000","last_became_peered":"2026-02-20T16:30:55.952715+0000","last_unstale":"2026-02-20T16:31:01.964710+0000","last_undegraded":"2026-02-20T16:31:01.964710+0000","last_fullsized":"2026-02-20T16:31:01.964710+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T02:00:10.634783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000271997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.964821+0000","last_change":"2026-02-20T16:30:57.954902+0000","last_active":"2026-02-20T16:31:01.964821+0000","last_peered":"2026-02-20T16:31:01.964821+0000","last_clean":"2026-02-20T16:31:01.964821+0000","last_became_active":"2026-02-20T16:30:57.954650+0000","last_became_peered":"2026-02-20T16:30:57.954650+0000","last_unstale":"2026-02-20T16:31:01.964821+0000","last_undegraded":"2026-02-20T16:31:01.964821+0000","last_fullsized":"2026-02-20T16:31:01.964821+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:00:58.459896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092195700000000005,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.057625+0000","last_change":"2026-02-20T16:30:57.954352+0000","last_active":"2026-02-20T16:31:01.057625+0000","last_peered":"2026-02-20T16:31:01.057625+0000","last_clean":"2026-02-20T16:31:01.057625+0000","last_became_active":"2026-02-20T16:30:57.954061+0000","last_became_peered":"2026-02-20T16:30:57.954061+0000","last_unstale":"2026-02-20T16:31:01.057625+0000","last_undegraded":"2026-02-20T16:31:01.057625+0000","last_fullsized":"2026-02-20T16:31:01.057625+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:25:10.709903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025212999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.964783+0000","last_change":"2026-02-20T16:30:57.954552+0000","last_active":"2026-02-20T16:31:01.964783+0000","last_peered":"2026-02-20T16:31:01.964783+0000","last_clean":"2026-02-20T16:31:01.964783+0000","last_became_active":"2026-02-20T16:30:57.954099+0000","last_became_peered":"2026-02-20T16:30:57.954099+0000","last_unstale":"2026-02-20T16:31:01.964783+0000","last_undegraded":"2026-02-20T16:31:01.964783+0000","last_fullsized":"2026-02-20T16:31:01.964783+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:04:34.172539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010429829999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.964849+0000","last_change":"2026-02-20T16:30:57.954384+0000","last_active":"2026-02-20T16:31:01.964849+0000","last_peered":"2026-02-20T16:31:01.964849+0000","last_clean":"2026-02-20T16:31:01.964849+0000","last_became_active":"2026-02-20T16:30:57.953999+0000","last_became_peered":"2026-02-20T16:30:57.953999+0000","last_unstale":"2026-02-20T16:31:01.964849+0000","last_undegraded":"2026-02-20T16:31:01.964849+0000","last_fullsized":"2026-02-20T16:31:01.964849+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:18:53.326241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093713599999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"20'79","reported_seq":163,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.964727+0000","last_change":"2026-02-20T16:30:55.952986+0000","last_active":"2026-02-20T16:31:01.964727+0000","last_peered":"2026-02-20T16:31:01.964727+0000","last_clean":"2026-02-20T16:31:01.964727+0000","last_became_active":"2026-02-20T16:30:55.952756+0000","last_became_peered":"2026-02-20T16:30:55.952756+0000","last_unstale":"2026-02-20T16:31:01.964727+0000","last_undegraded":"2026-02-20T16:31:01.964727+0000","last_fullsized":"2026-02-20T16:31:01.964727+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:34.730052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:34.730052+0000","last_clean_scrub_stamp":"2026-02-20T16:29:34.730052+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:12:19.306906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":26,"seq":111669149699,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27716,"kb_used_data":244,"kb_used_omap":7,"kb_used_meta":27448,"kb_avail":94344124,"statfs":{"total":96636764160,"available":96608382976,"internally_reserved":0,"allocated":249856,"data_stored":84721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7688,"internal_metadata":28107256},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":25,"seq":107374182403,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27712,"kb_used_data":240,"kb_used_omap":8,"kb_used_meta":27447,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":245760,"data_stored":84710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8340,"internal_metadata":28106604},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":24,"seq":103079215107,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28304,"kb_used_data":832,"kb_used_omap":9,"kb_used_meta":27446,"kb_avail":94343536,"statfs":{"total":96636764160,"available":96607780864,"internally_reserved":0,"allocated":851968,"data_stored":678672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9646,"internal_metadata":28105298},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":23,"seq":98784247811,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28236,"kb_used_data":828,"kb_used_omap":7,"kb_used_meta":27384,"kb_avail":94343604,"statfs":{"total":96636764160,"available":96607850496,"internally_reserved":0,"allocated":847872,"data_stored":678645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7693,"internal_metadata":28041715},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T16:31:04.172 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T16:31:04.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.239+0000 7f266c22c640 1 -- 10.20.193.57:0/3583621391 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f26641778a0 msgr2=0x7f264c003b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:04.244 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.239+0000 7f266c22c640 1 --2- 10.20.193.57:0/3583621391 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f26641778a0 0x7f264c003b10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f265400c2e0 tx=0x7f265402f970 comp rx=0 tx=0).stop 2026-02-20T16:31:04.244 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.239+0000 7f266c22c640 1 -- 10.20.193.57:0/3583621391 shutdown_connections 2026-02-20T16:31:04.244 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.239+0000 7f266c22c640 1 --2- 10.20.193.57:0/3583621391 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f264c0048c0 0x7f264c004d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:04.244 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.239+0000 7f266c22c640 1 --2- 10.20.193.57:0/3583621391 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f266405cb40 0x7f264c0040f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:04.244 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.239+0000 7f266c22c640 1 --2- 10.20.193.57:0/3583621391 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f26641778a0 0x7f264c003b10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:04.244 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.239+0000 7f266c22c640 1 -- 10.20.193.57:0/3583621391 >> 10.20.193.57:0/3583621391 conn(0x7f26640833e0 msgr2=0x7f26640840b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:04.244 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.239+0000 7f266c22c640 1 -- 10.20.193.57:0/3583621391 shutdown_connections 2026-02-20T16:31:04.244 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.239+0000 7f266c22c640 1 -- 10.20.193.57:0/3583621391 wait complete. 2026-02-20T16:31:04.244 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.240+0000 7f266c22c640 1 Processor -- start 2026-02-20T16:31:04.245 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.240+0000 7f266c22c640 1 -- start start 2026-02-20T16:31:04.245 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.240+0000 7f266c22c640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f264c0048c0 0x7f266416e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:04.245 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.240+0000 7f266c22c640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f266405c060 0x7f266416e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:04.245 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.240+0000 7f266c22c640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f266405cb40 0x7f2664171300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:04.245 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.240+0000 7f266c22c640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f2664157c30 con 0x7f266405c060 2026-02-20T16:31:04.245 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.240+0000 7f266c22c640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f2664157ab0 con 0x7f266405cb40 2026-02-20T16:31:04.245 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.240+0000 7f266c22c640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f2664157db0 con 0x7f264c0048c0 2026-02-20T16:31:04.245 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.240+0000 7f2669fa1640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f264c0048c0 0x7f266416e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:04.245 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.240+0000 7f266a7a2640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f266405cb40 0x7f2664171300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:04.245 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.240+0000 7f2669fa1640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f264c0048c0 0x7f266416e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3302/0 says I am v2:10.20.193.57:44948/0 (socket says 10.20.193.57:44948) 2026-02-20T16:31:04.245 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.240+0000 7f2669fa1640 1 -- 10.20.193.57:0/1464332576 learned_addr learned my addr 10.20.193.57:0/1464332576 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:31:04.246 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.240+0000 7f26697a0640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f266405c060 0x7f266416e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:04.246 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.240+0000 7f266a7a2640 1 -- 10.20.193.57:0/1464332576 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f264c0048c0 msgr2=0x7f266416e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:04.246 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.240+0000 7f266a7a2640 1 --2- 10.20.193.57:0/1464332576 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f264c0048c0 0x7f266416e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:04.246 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.240+0000 7f266a7a2640 1 -- 10.20.193.57:0/1464332576 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f266405c060 msgr2=0x7f266416e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:04.246 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.240+0000 7f266a7a2640 1 --2- 10.20.193.57:0/1464332576 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f266405c060 0x7f266416e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:04.246 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.240+0000 7f266a7a2640 1 -- 10.20.193.57:0/1464332576 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f266415a310 con 0x7f266405cb40 2026-02-20T16:31:04.246 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.240+0000 7f26697a0640 1 --2- 10.20.193.57:0/1464332576 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f266405c060 0x7f266416e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:31:04.246 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.240+0000 7f266a7a2640 1 --2- 10.20.193.57:0/1464332576 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f266405cb40 0x7f2664171300 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f26600049b0 tx=0x7f2660011600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:31:04.246 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.240+0000 7f26527fc640 1 -- 10.20.193.57:0/1464332576 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2660019030 con 0x7f266405cb40 2026-02-20T16:31:04.246 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.240+0000 7f26527fc640 1 -- 10.20.193.57:0/1464332576 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2660011e50 con 0x7f266405cb40 2026-02-20T16:31:04.246 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.240+0000 7f266c22c640 1 -- 10.20.193.57:0/1464332576 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f266407bdf0 con 0x7f266405cb40 2026-02-20T16:31:04.246 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.240+0000 7f26527fc640 1 -- 10.20.193.57:0/1464332576 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2660009310 con 0x7f266405cb40 2026-02-20T16:31:04.247 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.240+0000 7f266c22c640 1 -- 10.20.193.57:0/1464332576 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2664159ce0 con 0x7f266405cb40 2026-02-20T16:31:04.247 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.241+0000 7f266c22c640 1 -- 10.20.193.57:0/1464332576 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f266405c430 con 0x7f266405cb40 2026-02-20T16:31:04.247 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.241+0000 7f26527fc640 1 -- 10.20.193.57:0/1464332576 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7f2660026060 con 0x7f266405cb40 2026-02-20T16:31:04.247 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.241+0000 7f26527fc640 1 -- 10.20.193.57:0/1464332576 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(30..30 src has 1..30) ==== 3026+0+0 (secure 0 0 0) 0x7f26600641d0 con 0x7f266405cb40 2026-02-20T16:31:04.247 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.243+0000 7f26527fc640 1 -- 10.20.193.57:0/1464332576 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7f266415a310 con 0x7f266405cb40 2026-02-20T16:31:04.317 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.315+0000 7f266c22c640 1 -- 10.20.193.57:0/1464332576 --> v1:10.20.193.57:6800/2007744879 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2664159a90 con 0x7f263404cae0 2026-02-20T16:31:04.318 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.316+0000 7f26527fc640 1 -- 10.20.193.57:0/1464332576 <== mgr.14109 v1:10.20.193.57:6800/2007744879 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31972 (unknown 2965378022 0 808432974) 0x7f265403d040 con 0x7f263404cae0 2026-02-20T16:31:04.318 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:31:04.319 INFO:teuthology.orchestra.run.trial057.stderr:dumped all 2026-02-20T16:31:04.320 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.316+0000 7f266c22c640 1 -- 10.20.193.57:0/1464332576 >> v1:10.20.193.57:6800/2007744879 conn(0x7f263404cae0 legacy=0x7f263406cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:04.320 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.316+0000 7f266c22c640 1 -- 10.20.193.57:0/1464332576 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f266405cb40 msgr2=0x7f2664171300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:04.320 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.316+0000 7f266c22c640 1 --2- 10.20.193.57:0/1464332576 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f266405cb40 0x7f2664171300 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f26600049b0 tx=0x7f2660011600 comp rx=0 tx=0).stop 2026-02-20T16:31:04.320 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.316+0000 7f266c22c640 1 -- 10.20.193.57:0/1464332576 shutdown_connections 2026-02-20T16:31:04.320 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.316+0000 7f266c22c640 1 --2- 10.20.193.57:0/1464332576 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f266405cb40 0x7f2664171300 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:04.320 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.316+0000 7f266c22c640 1 --2- 10.20.193.57:0/1464332576 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f266405c060 0x7f266416e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:04.320 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.316+0000 7f266c22c640 1 --2- 10.20.193.57:0/1464332576 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f264c0048c0 0x7f266416e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:04.320 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.316+0000 7f266c22c640 1 -- 10.20.193.57:0/1464332576 >> 10.20.193.57:0/1464332576 conn(0x7f26640833e0 msgr2=0x7f2664197c80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:04.320 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.316+0000 7f266c22c640 1 -- 10.20.193.57:0/1464332576 shutdown_connections 2026-02-20T16:31:04.320 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.317+0000 7f266c22c640 1 -- 10.20.193.57:0/1464332576 wait complete. 2026-02-20T16:31:04.326 INFO:teuthology.orchestra.run.trial057.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2026-02-20T16:31:02.932184+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":115,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":111968,"kb_used_data":2144,"kb_used_omap":32,"kb_used_meta":109727,"kb_avail":377375392,"statfs":{"total":386547056640,"available":386432401408,"internally_reserved":0,"allocated":2195456,"data_stored":1526748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33367,"internal_metadata":112360873},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.980296"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.964839+0000","last_change":"2026-02-20T16:30:58.157966+0000","last_active":"2026-02-20T16:31:01.964839+0000","last_peered":"2026-02-20T16:31:01.964839+0000","last_clean":"2026-02-20T16:31:01.964839+0000","last_became_active":"2026-02-20T16:30:58.157789+0000","last_became_peered":"2026-02-20T16:30:58.157789+0000","last_unstale":"2026-02-20T16:31:01.964839+0000","last_undegraded":"2026-02-20T16:31:01.964839+0000","last_fullsized":"2026-02-20T16:31:01.964839+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:54:24.491175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001161203,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.964718+0000","last_change":"2026-02-20T16:30:55.953096+0000","last_active":"2026-02-20T16:31:01.964718+0000","last_peered":"2026-02-20T16:31:01.964718+0000","last_clean":"2026-02-20T16:31:01.964718+0000","last_became_active":"2026-02-20T16:30:55.952830+0000","last_became_peered":"2026-02-20T16:30:55.952830+0000","last_unstale":"2026-02-20T16:31:01.964718+0000","last_undegraded":"2026-02-20T16:31:01.964718+0000","last_fullsized":"2026-02-20T16:31:01.964718+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:40:28.084285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033720799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.964835+0000","last_change":"2026-02-20T16:30:58.158048+0000","last_active":"2026-02-20T16:31:01.964835+0000","last_peered":"2026-02-20T16:31:01.964835+0000","last_clean":"2026-02-20T16:31:01.964835+0000","last_became_active":"2026-02-20T16:30:58.157875+0000","last_became_peered":"2026-02-20T16:30:58.157875+0000","last_unstale":"2026-02-20T16:31:01.964835+0000","last_undegraded":"2026-02-20T16:31:01.964835+0000","last_fullsized":"2026-02-20T16:31:01.964835+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:21:38.884906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001207149,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.964710+0000","last_change":"2026-02-20T16:30:55.952911+0000","last_active":"2026-02-20T16:31:01.964710+0000","last_peered":"2026-02-20T16:31:01.964710+0000","last_clean":"2026-02-20T16:31:01.964710+0000","last_became_active":"2026-02-20T16:30:55.952715+0000","last_became_peered":"2026-02-20T16:30:55.952715+0000","last_unstale":"2026-02-20T16:31:01.964710+0000","last_undegraded":"2026-02-20T16:31:01.964710+0000","last_fullsized":"2026-02-20T16:31:01.964710+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T02:00:10.634783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000271997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.964821+0000","last_change":"2026-02-20T16:30:57.954902+0000","last_active":"2026-02-20T16:31:01.964821+0000","last_peered":"2026-02-20T16:31:01.964821+0000","last_clean":"2026-02-20T16:31:01.964821+0000","last_became_active":"2026-02-20T16:30:57.954650+0000","last_became_peered":"2026-02-20T16:30:57.954650+0000","last_unstale":"2026-02-20T16:31:01.964821+0000","last_undegraded":"2026-02-20T16:31:01.964821+0000","last_fullsized":"2026-02-20T16:31:01.964821+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:00:58.459896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092195700000000005,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.057625+0000","last_change":"2026-02-20T16:30:57.954352+0000","last_active":"2026-02-20T16:31:01.057625+0000","last_peered":"2026-02-20T16:31:01.057625+0000","last_clean":"2026-02-20T16:31:01.057625+0000","last_became_active":"2026-02-20T16:30:57.954061+0000","last_became_peered":"2026-02-20T16:30:57.954061+0000","last_unstale":"2026-02-20T16:31:01.057625+0000","last_undegraded":"2026-02-20T16:31:01.057625+0000","last_fullsized":"2026-02-20T16:31:01.057625+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:25:10.709903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025212999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.964783+0000","last_change":"2026-02-20T16:30:57.954552+0000","last_active":"2026-02-20T16:31:01.964783+0000","last_peered":"2026-02-20T16:31:01.964783+0000","last_clean":"2026-02-20T16:31:01.964783+0000","last_became_active":"2026-02-20T16:30:57.954099+0000","last_became_peered":"2026-02-20T16:30:57.954099+0000","last_unstale":"2026-02-20T16:31:01.964783+0000","last_undegraded":"2026-02-20T16:31:01.964783+0000","last_fullsized":"2026-02-20T16:31:01.964783+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:04:34.172539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010429829999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.964849+0000","last_change":"2026-02-20T16:30:57.954384+0000","last_active":"2026-02-20T16:31:01.964849+0000","last_peered":"2026-02-20T16:31:01.964849+0000","last_clean":"2026-02-20T16:31:01.964849+0000","last_became_active":"2026-02-20T16:30:57.953999+0000","last_became_peered":"2026-02-20T16:30:57.953999+0000","last_unstale":"2026-02-20T16:31:01.964849+0000","last_undegraded":"2026-02-20T16:31:01.964849+0000","last_fullsized":"2026-02-20T16:31:01.964849+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:18:53.326241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093713599999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"20'79","reported_seq":163,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.964727+0000","last_change":"2026-02-20T16:30:55.952986+0000","last_active":"2026-02-20T16:31:01.964727+0000","last_peered":"2026-02-20T16:31:01.964727+0000","last_clean":"2026-02-20T16:31:01.964727+0000","last_became_active":"2026-02-20T16:30:55.952756+0000","last_became_peered":"2026-02-20T16:30:55.952756+0000","last_unstale":"2026-02-20T16:31:01.964727+0000","last_undegraded":"2026-02-20T16:31:01.964727+0000","last_fullsized":"2026-02-20T16:31:01.964727+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:34.730052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:34.730052+0000","last_clean_scrub_stamp":"2026-02-20T16:29:34.730052+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:12:19.306906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":26,"seq":111669149699,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27716,"kb_used_data":244,"kb_used_omap":7,"kb_used_meta":27448,"kb_avail":94344124,"statfs":{"total":96636764160,"available":96608382976,"internally_reserved":0,"allocated":249856,"data_stored":84721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7688,"internal_metadata":28107256},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":25,"seq":107374182403,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27712,"kb_used_data":240,"kb_used_omap":8,"kb_used_meta":27447,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":245760,"data_stored":84710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8340,"internal_metadata":28106604},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":24,"seq":103079215107,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28304,"kb_used_data":832,"kb_used_omap":9,"kb_used_meta":27446,"kb_avail":94343536,"statfs":{"total":96636764160,"available":96607780864,"internally_reserved":0,"allocated":851968,"data_stored":678672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9646,"internal_metadata":28105298},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":23,"seq":98784247811,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28236,"kb_used_data":828,"kb_used_omap":7,"kb_used_meta":27384,"kb_avail":94343604,"statfs":{"total":96636764160,"available":96607850496,"internally_reserved":0,"allocated":847872,"data_stored":678645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7693,"internal_metadata":28041715},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T16:31:04.327 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-20T16:31:04.327 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-20T16:31:04.328 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-20T16:31:04.328 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-20T16:31:04.399 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.394+0000 7f305dc92640 1 -- 10.20.193.57:0/2676754709 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f3058177a70 msgr2=0x7f3058197e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:04.399 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.394+0000 7f305dc92640 1 --2- 10.20.193.57:0/2676754709 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f3058177a70 0x7f3058197e50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f304c004af0 tx=0x7f304c02f310 comp rx=0 tx=0).stop 2026-02-20T16:31:04.399 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.395+0000 7f305dc92640 1 -- 10.20.193.57:0/2676754709 shutdown_connections 2026-02-20T16:31:04.399 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.395+0000 7f305dc92640 1 --2- 10.20.193.57:0/2676754709 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f3058177a70 0x7f3058197e50 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:04.399 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.395+0000 7f305dc92640 1 --2- 10.20.193.57:0/2676754709 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f305805c060 0x7f305805c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:04.400 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.395+0000 7f305dc92640 1 -- 10.20.193.57:0/2676754709 >> 10.20.193.57:0/2676754709 conn(0x7f30580833e0 msgr2=0x7f30580840b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:04.400 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.395+0000 7f305dc92640 1 -- 10.20.193.57:0/2676754709 shutdown_connections 2026-02-20T16:31:04.400 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.395+0000 7f305dc92640 1 -- 10.20.193.57:0/2676754709 wait complete. 2026-02-20T16:31:04.400 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.395+0000 7f305dc92640 1 Processor -- start 2026-02-20T16:31:04.400 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.395+0000 7f305dc92640 1 -- start start 2026-02-20T16:31:04.400 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.395+0000 7f305dc92640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f305805c060 0x7f30581979b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:04.400 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.395+0000 7f305dc92640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f305805c970 0x7f3058190710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:04.400 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.395+0000 7f305dc92640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f3058177a70 0x7f3058190c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:04.400 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.395+0000 7f305dc92640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f3058198d70 con 0x7f305805c970 2026-02-20T16:31:04.400 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.395+0000 7f305dc92640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f3058198bf0 con 0x7f305805c060 2026-02-20T16:31:04.401 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.395+0000 7f305dc92640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f3058198ef0 con 0x7f3058177a70 2026-02-20T16:31:04.401 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.395+0000 7f30577fe640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f305805c060 0x7f30581979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:04.401 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.395+0000 7f3056ffd640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f305805c970 0x7f3058190710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:04.401 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.395+0000 7f30577fe640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f305805c060 0x7f30581979b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3301/0 says I am v2:10.20.193.57:53786/0 (socket says 10.20.193.57:53786) 2026-02-20T16:31:04.401 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.395+0000 7f30577fe640 1 -- 10.20.193.57:0/2237205854 learned_addr learned my addr 10.20.193.57:0/2237205854 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:31:04.401 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.395+0000 7f3057fff640 1 --2- 10.20.193.57:0/2237205854 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f3058177a70 0x7f3058190c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:04.401 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.395+0000 7f3056ffd640 1 -- 10.20.193.57:0/2237205854 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f3058177a70 msgr2=0x7f3058190c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:04.401 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.395+0000 7f3056ffd640 1 --2- 10.20.193.57:0/2237205854 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f3058177a70 0x7f3058190c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:04.401 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.395+0000 7f3056ffd640 1 -- 10.20.193.57:0/2237205854 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f305805c060 msgr2=0x7f30581979b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:04.401 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.395+0000 7f3056ffd640 1 --2- 10.20.193.57:0/2237205854 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f305805c060 0x7f30581979b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:04.401 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.395+0000 7f3056ffd640 1 -- 10.20.193.57:0/2237205854 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f305817b900 con 0x7f305805c970 2026-02-20T16:31:04.402 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.396+0000 7f30577fe640 1 --2- 10.20.193.57:0/2237205854 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f305805c060 0x7f30581979b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:31:04.402 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.396+0000 7f3056ffd640 1 --2- 10.20.193.57:0/2237205854 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f305805c970 0x7f3058190710 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f304800c450 tx=0x7f304800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:31:04.402 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.396+0000 7f3033fff640 1 -- 10.20.193.57:0/2237205854 <== mon.0 v2:10.20.193.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3048017070 con 0x7f305805c970 2026-02-20T16:31:04.402 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.396+0000 7f3033fff640 1 -- 10.20.193.57:0/2237205854 <== mon.0 v2:10.20.193.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f30480053c0 con 0x7f305805c970 2026-02-20T16:31:04.402 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.396+0000 7f305dc92640 1 -- 10.20.193.57:0/2237205854 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3058179c70 con 0x7f305805c970 2026-02-20T16:31:04.402 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.396+0000 7f3033fff640 1 -- 10.20.193.57:0/2237205854 <== mon.0 v2:10.20.193.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3048003920 con 0x7f305805c970 2026-02-20T16:31:04.402 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.396+0000 7f305dc92640 1 -- 10.20.193.57:0/2237205854 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3058191190 con 0x7f305805c970 2026-02-20T16:31:04.402 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.396+0000 7f305dc92640 1 -- 10.20.193.57:0/2237205854 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f305805c430 con 0x7f305805c970 2026-02-20T16:31:04.402 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.396+0000 7f3033fff640 1 -- 10.20.193.57:0/2237205854 <== mon.0 v2:10.20.193.57:3300/0 4 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7f3048003ac0 con 0x7f305805c970 2026-02-20T16:31:04.402 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.397+0000 7f3033fff640 1 -- 10.20.193.57:0/2237205854 <== mon.0 v2:10.20.193.57:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3026+0+0 (secure 0 0 0) 0x7f3048062f10 con 0x7f305805c970 2026-02-20T16:31:04.403 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.398+0000 7f3033fff640 1 -- 10.20.193.57:0/2237205854 <== mon.0 v2:10.20.193.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7f3048061fe0 con 0x7f305805c970 2026-02-20T16:31:04.489 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.487+0000 7f305dc92640 1 -- 10.20.193.57:0/2237205854 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3058197ef0 con 0x7f305805c970 2026-02-20T16:31:04.489 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.487+0000 7f3033fff640 1 -- 10.20.193.57:0/2237205854 <== mon.0 v2:10.20.193.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f3048003de0 con 0x7f305805c970 2026-02-20T16:31:04.489 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:31:04.490 INFO:teuthology.orchestra.run.trial057.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-20T16:31:04.490 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.488+0000 7f305dc92640 1 -- 10.20.193.57:0/2237205854 >> v1:10.20.193.57:6800/2007744879 conn(0x7f302804cae0 legacy=0x7f302806cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:04.491 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.488+0000 7f305dc92640 1 -- 10.20.193.57:0/2237205854 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f305805c970 msgr2=0x7f3058190710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:04.491 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.488+0000 7f305dc92640 1 --2- 10.20.193.57:0/2237205854 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f305805c970 0x7f3058190710 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f304800c450 tx=0x7f304800c920 comp rx=0 tx=0).stop 2026-02-20T16:31:04.491 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.488+0000 7f305dc92640 1 -- 10.20.193.57:0/2237205854 shutdown_connections 2026-02-20T16:31:04.491 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.488+0000 7f305dc92640 1 --2- 10.20.193.57:0/2237205854 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f3058177a70 0x7f3058190c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:04.491 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.488+0000 7f305dc92640 1 --2- 10.20.193.57:0/2237205854 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f305805c970 0x7f3058190710 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:04.491 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.488+0000 7f305dc92640 1 --2- 10.20.193.57:0/2237205854 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f305805c060 0x7f30581979b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:04.491 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.488+0000 7f305dc92640 1 -- 10.20.193.57:0/2237205854 >> 10.20.193.57:0/2237205854 conn(0x7f30580833e0 msgr2=0x7f3058075cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:04.491 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.488+0000 7f305dc92640 1 -- 10.20.193.57:0/2237205854 shutdown_connections 2026-02-20T16:31:04.491 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.488+0000 7f305dc92640 1 -- 10.20.193.57:0/2237205854 wait complete. 2026-02-20T16:31:04.497 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-20T16:31:04.497 INFO:teuthology.run_tasks:Running task print... 2026-02-20T16:31:04.524 INFO:teuthology.task.print:**** done ceph.restart 2026-02-20T16:31:04.525 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2026-02-20T16:31:04.543 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2026-02-20T16:31:04.559 DEBUG:teuthology.run_tasks:Unwinding manager install.upgrade 2026-02-20T16:31:04.576 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-20T16:31:04.592 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-20T16:31:04.592 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T16:31:04.661 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.660+0000 7f7a37ded640 1 -- 10.20.193.57:0/3051828344 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f7a30081690 msgr2=0x7f7a30175130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:04.661 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.660+0000 7f7a37ded640 1 --2- 10.20.193.57:0/3051828344 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f7a30081690 0x7f7a30175130 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7a240098c0 tx=0x7f7a2402f110 comp rx=0 tx=0).stop 2026-02-20T16:31:04.661 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.660+0000 7f7a37ded640 1 -- 10.20.193.57:0/3051828344 shutdown_connections 2026-02-20T16:31:04.661 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.660+0000 7f7a37ded640 1 --2- 10.20.193.57:0/3051828344 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f7a30175670 0x7f7a30195a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:04.661 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.660+0000 7f7a37ded640 1 --2- 10.20.193.57:0/3051828344 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f7a30081690 0x7f7a30175130 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:04.661 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.660+0000 7f7a37ded640 1 -- 10.20.193.57:0/3051828344 >> 10.20.193.57:0/3051828344 conn(0x7f7a300833e0 msgr2=0x7f7a300840b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:04.661 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.660+0000 7f7a37ded640 1 -- 10.20.193.57:0/3051828344 shutdown_connections 2026-02-20T16:31:04.661 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.660+0000 7f7a37ded640 1 -- 10.20.193.57:0/3051828344 wait complete. 2026-02-20T16:31:04.662 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.660+0000 7f7a37ded640 1 Processor -- start 2026-02-20T16:31:04.662 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.660+0000 7f7a37ded640 1 -- start start 2026-02-20T16:31:04.662 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.660+0000 7f7a37ded640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f7a30080bb0 0x7f7a3005a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:04.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.660+0000 7f7a37ded640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f7a30081690 0x7f7a30175130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:04.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.660+0000 7f7a37ded640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f7a30175670 0x7f7a3005a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:04.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.660+0000 7f7a37ded640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f7a3005ddd0 con 0x7f7a30080bb0 2026-02-20T16:31:04.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.660+0000 7f7a37ded640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f7a30196b40 con 0x7f7a30081690 2026-02-20T16:31:04.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.660+0000 7f7a37ded640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f7a301969c0 con 0x7f7a30175670 2026-02-20T16:31:04.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.660+0000 7f7a35361640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f7a30081690 0x7f7a30175130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:04.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.660+0000 7f7a35b62640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f7a30080bb0 0x7f7a3005a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:04.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.660+0000 7f7a35361640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f7a30081690 0x7f7a30175130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3301/0 says I am v2:10.20.193.57:53816/0 (socket says 10.20.193.57:53816) 2026-02-20T16:31:04.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.660+0000 7f7a36363640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f7a30175670 0x7f7a3005a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:04.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.660+0000 7f7a35361640 1 -- 10.20.193.57:0/2490360719 learned_addr learned my addr 10.20.193.57:0/2490360719 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:31:04.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.661+0000 7f7a35361640 1 -- 10.20.193.57:0/2490360719 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f7a30175670 msgr2=0x7f7a3005a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:04.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.661+0000 7f7a35361640 1 --2- 10.20.193.57:0/2490360719 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f7a30175670 0x7f7a3005a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:04.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.661+0000 7f7a35361640 1 -- 10.20.193.57:0/2490360719 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f7a30080bb0 msgr2=0x7f7a3005a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:04.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.661+0000 7f7a35361640 1 --2- 10.20.193.57:0/2490360719 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f7a30080bb0 0x7f7a3005a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:04.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.661+0000 7f7a35361640 1 -- 10.20.193.57:0/2490360719 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a3005d690 con 0x7f7a30081690 2026-02-20T16:31:04.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.661+0000 7f7a36363640 1 --2- 10.20.193.57:0/2490360719 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f7a30175670 0x7f7a3005a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:31:04.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.661+0000 7f7a35361640 1 --2- 10.20.193.57:0/2490360719 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f7a30081690 0x7f7a30175130 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7a240099c0 tx=0x7f7a24002900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:31:04.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.661+0000 7f7a1e7fc640 1 -- 10.20.193.57:0/2490360719 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a24046070 con 0x7f7a30081690 2026-02-20T16:31:04.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.661+0000 7f7a1e7fc640 1 -- 10.20.193.57:0/2490360719 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7a24002c80 con 0x7f7a30081690 2026-02-20T16:31:04.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.661+0000 7f7a37ded640 1 -- 10.20.193.57:0/2490360719 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a3005c2e0 con 0x7f7a30081690 2026-02-20T16:31:04.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.661+0000 7f7a1e7fc640 1 -- 10.20.193.57:0/2490360719 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a240386b0 con 0x7f7a30081690 2026-02-20T16:31:04.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.661+0000 7f7a37ded640 1 -- 10.20.193.57:0/2490360719 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a3005cae0 con 0x7f7a30081690 2026-02-20T16:31:04.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.661+0000 7f7a37ded640 1 -- 10.20.193.57:0/2490360719 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a30080f80 con 0x7f7a30081690 2026-02-20T16:31:04.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.661+0000 7f7a1e7fc640 1 -- 10.20.193.57:0/2490360719 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7f7a24038850 con 0x7f7a30081690 2026-02-20T16:31:04.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.662+0000 7f7a1e7fc640 1 -- 10.20.193.57:0/2490360719 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(30..30 src has 1..30) ==== 3026+0+0 (secure 0 0 0) 0x7f7a240880e0 con 0x7f7a30081690 2026-02-20T16:31:04.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.663+0000 7f7a1e7fc640 1 -- 10.20.193.57:0/2490360719 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7f7a240871b0 con 0x7f7a30081690 2026-02-20T16:31:04.740 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.738+0000 7f7a37ded640 1 -- 10.20.193.57:0/2490360719 --> v1:10.20.193.57:6800/2007744879 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7a30053200 con 0x7f7a0004cae0 2026-02-20T16:31:04.741 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.739+0000 7f7a1e7fc640 1 -- 10.20.193.57:0/2490360719 <== mgr.14109 v1:10.20.193.57:6800/2007744879 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31972 (unknown 2965378022 0 808432974) 0x7f7a30053200 con 0x7f7a0004cae0 2026-02-20T16:31:04.741 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:31:04.742 INFO:teuthology.orchestra.run.trial057.stderr:dumped all 2026-02-20T16:31:04.742 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.739+0000 7f7a37ded640 1 -- 10.20.193.57:0/2490360719 >> v1:10.20.193.57:6800/2007744879 conn(0x7f7a0004cae0 legacy=0x7f7a0006cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:04.742 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.739+0000 7f7a37ded640 1 -- 10.20.193.57:0/2490360719 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f7a30081690 msgr2=0x7f7a30175130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:04.742 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.739+0000 7f7a37ded640 1 --2- 10.20.193.57:0/2490360719 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f7a30081690 0x7f7a30175130 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7a240099c0 tx=0x7f7a24002900 comp rx=0 tx=0).stop 2026-02-20T16:31:04.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.740+0000 7f7a37ded640 1 -- 10.20.193.57:0/2490360719 shutdown_connections 2026-02-20T16:31:04.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.740+0000 7f7a37ded640 1 --2- 10.20.193.57:0/2490360719 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f7a30175670 0x7f7a3005a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:04.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.740+0000 7f7a37ded640 1 --2- 10.20.193.57:0/2490360719 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f7a30081690 0x7f7a30175130 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:04.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.740+0000 7f7a37ded640 1 --2- 10.20.193.57:0/2490360719 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f7a30080bb0 0x7f7a3005a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:04.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.740+0000 7f7a37ded640 1 -- 10.20.193.57:0/2490360719 >> 10.20.193.57:0/2490360719 conn(0x7f7a300833e0 msgr2=0x7f7a30132470 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:04.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.740+0000 7f7a37ded640 1 -- 10.20.193.57:0/2490360719 shutdown_connections 2026-02-20T16:31:04.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.740+0000 7f7a37ded640 1 -- 10.20.193.57:0/2490360719 wait complete. 2026-02-20T16:31:04.749 INFO:teuthology.orchestra.run.trial057.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2026-02-20T16:31:02.932184+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":115,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":111968,"kb_used_data":2144,"kb_used_omap":32,"kb_used_meta":109727,"kb_avail":377375392,"statfs":{"total":386547056640,"available":386432401408,"internally_reserved":0,"allocated":2195456,"data_stored":1526748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33367,"internal_metadata":112360873},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.980296"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.964839+0000","last_change":"2026-02-20T16:30:58.157966+0000","last_active":"2026-02-20T16:31:01.964839+0000","last_peered":"2026-02-20T16:31:01.964839+0000","last_clean":"2026-02-20T16:31:01.964839+0000","last_became_active":"2026-02-20T16:30:58.157789+0000","last_became_peered":"2026-02-20T16:30:58.157789+0000","last_unstale":"2026-02-20T16:31:01.964839+0000","last_undegraded":"2026-02-20T16:31:01.964839+0000","last_fullsized":"2026-02-20T16:31:01.964839+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:54:24.491175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001161203,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.964718+0000","last_change":"2026-02-20T16:30:55.953096+0000","last_active":"2026-02-20T16:31:01.964718+0000","last_peered":"2026-02-20T16:31:01.964718+0000","last_clean":"2026-02-20T16:31:01.964718+0000","last_became_active":"2026-02-20T16:30:55.952830+0000","last_became_peered":"2026-02-20T16:30:55.952830+0000","last_unstale":"2026-02-20T16:31:01.964718+0000","last_undegraded":"2026-02-20T16:31:01.964718+0000","last_fullsized":"2026-02-20T16:31:01.964718+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:40:28.084285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033720799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.964835+0000","last_change":"2026-02-20T16:30:58.158048+0000","last_active":"2026-02-20T16:31:01.964835+0000","last_peered":"2026-02-20T16:31:01.964835+0000","last_clean":"2026-02-20T16:31:01.964835+0000","last_became_active":"2026-02-20T16:30:58.157875+0000","last_became_peered":"2026-02-20T16:30:58.157875+0000","last_unstale":"2026-02-20T16:31:01.964835+0000","last_undegraded":"2026-02-20T16:31:01.964835+0000","last_fullsized":"2026-02-20T16:31:01.964835+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:21:38.884906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001207149,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.964710+0000","last_change":"2026-02-20T16:30:55.952911+0000","last_active":"2026-02-20T16:31:01.964710+0000","last_peered":"2026-02-20T16:31:01.964710+0000","last_clean":"2026-02-20T16:31:01.964710+0000","last_became_active":"2026-02-20T16:30:55.952715+0000","last_became_peered":"2026-02-20T16:30:55.952715+0000","last_unstale":"2026-02-20T16:31:01.964710+0000","last_undegraded":"2026-02-20T16:31:01.964710+0000","last_fullsized":"2026-02-20T16:31:01.964710+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T02:00:10.634783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000271997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.964821+0000","last_change":"2026-02-20T16:30:57.954902+0000","last_active":"2026-02-20T16:31:01.964821+0000","last_peered":"2026-02-20T16:31:01.964821+0000","last_clean":"2026-02-20T16:31:01.964821+0000","last_became_active":"2026-02-20T16:30:57.954650+0000","last_became_peered":"2026-02-20T16:30:57.954650+0000","last_unstale":"2026-02-20T16:31:01.964821+0000","last_undegraded":"2026-02-20T16:31:01.964821+0000","last_fullsized":"2026-02-20T16:31:01.964821+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:00:58.459896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092195700000000005,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.057625+0000","last_change":"2026-02-20T16:30:57.954352+0000","last_active":"2026-02-20T16:31:01.057625+0000","last_peered":"2026-02-20T16:31:01.057625+0000","last_clean":"2026-02-20T16:31:01.057625+0000","last_became_active":"2026-02-20T16:30:57.954061+0000","last_became_peered":"2026-02-20T16:30:57.954061+0000","last_unstale":"2026-02-20T16:31:01.057625+0000","last_undegraded":"2026-02-20T16:31:01.057625+0000","last_fullsized":"2026-02-20T16:31:01.057625+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:25:10.709903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025212999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.964783+0000","last_change":"2026-02-20T16:30:57.954552+0000","last_active":"2026-02-20T16:31:01.964783+0000","last_peered":"2026-02-20T16:31:01.964783+0000","last_clean":"2026-02-20T16:31:01.964783+0000","last_became_active":"2026-02-20T16:30:57.954099+0000","last_became_peered":"2026-02-20T16:30:57.954099+0000","last_unstale":"2026-02-20T16:31:01.964783+0000","last_undegraded":"2026-02-20T16:31:01.964783+0000","last_fullsized":"2026-02-20T16:31:01.964783+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:04:34.172539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010429829999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.964849+0000","last_change":"2026-02-20T16:30:57.954384+0000","last_active":"2026-02-20T16:31:01.964849+0000","last_peered":"2026-02-20T16:31:01.964849+0000","last_clean":"2026-02-20T16:31:01.964849+0000","last_became_active":"2026-02-20T16:30:57.953999+0000","last_became_peered":"2026-02-20T16:30:57.953999+0000","last_unstale":"2026-02-20T16:31:01.964849+0000","last_undegraded":"2026-02-20T16:31:01.964849+0000","last_fullsized":"2026-02-20T16:31:01.964849+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:18:53.326241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093713599999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"20'79","reported_seq":163,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.964727+0000","last_change":"2026-02-20T16:30:55.952986+0000","last_active":"2026-02-20T16:31:01.964727+0000","last_peered":"2026-02-20T16:31:01.964727+0000","last_clean":"2026-02-20T16:31:01.964727+0000","last_became_active":"2026-02-20T16:30:55.952756+0000","last_became_peered":"2026-02-20T16:30:55.952756+0000","last_unstale":"2026-02-20T16:31:01.964727+0000","last_undegraded":"2026-02-20T16:31:01.964727+0000","last_fullsized":"2026-02-20T16:31:01.964727+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:34.730052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:34.730052+0000","last_clean_scrub_stamp":"2026-02-20T16:29:34.730052+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:12:19.306906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":26,"seq":111669149699,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27716,"kb_used_data":244,"kb_used_omap":7,"kb_used_meta":27448,"kb_avail":94344124,"statfs":{"total":96636764160,"available":96608382976,"internally_reserved":0,"allocated":249856,"data_stored":84721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7688,"internal_metadata":28107256},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":25,"seq":107374182403,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27712,"kb_used_data":240,"kb_used_omap":8,"kb_used_meta":27447,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":245760,"data_stored":84710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8340,"internal_metadata":28106604},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":24,"seq":103079215107,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28304,"kb_used_data":832,"kb_used_omap":9,"kb_used_meta":27446,"kb_avail":94343536,"statfs":{"total":96636764160,"available":96607780864,"internally_reserved":0,"allocated":851968,"data_stored":678672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9646,"internal_metadata":28105298},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":23,"seq":98784247811,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28236,"kb_used_data":828,"kb_used_omap":7,"kb_used_meta":27384,"kb_avail":94343604,"statfs":{"total":96636764160,"available":96607850496,"internally_reserved":0,"allocated":847872,"data_stored":678645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7693,"internal_metadata":28041715},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T16:31:04.751 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T16:31:04.820 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.816+0000 7fb15d764640 1 -- 10.20.193.57:0/3791793277 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fb158080bb0 msgr2=0x7fb158080f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:04.821 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.816+0000 7fb15d764640 1 --2- 10.20.193.57:0/3791793277 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fb158080bb0 0x7fb158080f80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb14c0098c0 tx=0x7fb14c02f110 comp rx=0 tx=0).stop 2026-02-20T16:31:04.821 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.816+0000 7fb15d764640 1 -- 10.20.193.57:0/3791793277 shutdown_connections 2026-02-20T16:31:04.821 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.816+0000 7fb15d764640 1 --2- 10.20.193.57:0/3791793277 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fb15807cb10 0x7fb158196150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:04.821 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.816+0000 7fb15d764640 1 --2- 10.20.193.57:0/3791793277 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fb158080bb0 0x7fb158080f80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:04.821 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.816+0000 7fb15d764640 1 -- 10.20.193.57:0/3791793277 >> 10.20.193.57:0/3791793277 conn(0x7fb1580833e0 msgr2=0x7fb1580840b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:04.821 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.816+0000 7fb15d764640 1 -- 10.20.193.57:0/3791793277 shutdown_connections 2026-02-20T16:31:04.821 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.816+0000 7fb15d764640 1 -- 10.20.193.57:0/3791793277 wait complete. 2026-02-20T16:31:04.821 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.817+0000 7fb15d764640 1 Processor -- start 2026-02-20T16:31:04.821 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.817+0000 7fb15d764640 1 -- start start 2026-02-20T16:31:04.822 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.817+0000 7fb15d764640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fb15807cb10 0x7fb15805d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:04.822 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.817+0000 7fb15d764640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fb158080bb0 0x7fb15807af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:04.822 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.817+0000 7fb15d764640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fb1580814c0 0x7fb15807b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:04.822 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.817+0000 7fb15d764640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7fb158196b70 con 0x7fb158080bb0 2026-02-20T16:31:04.822 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.817+0000 7fb15d764640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7fb1581969f0 con 0x7fb1580814c0 2026-02-20T16:31:04.822 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.817+0000 7fb15d764640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7fb158196cf0 con 0x7fb15807cb10 2026-02-20T16:31:04.822 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.817+0000 7fb156ffd640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fb15807cb10 0x7fb15805d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:04.822 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.817+0000 7fb156ffd640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fb15807cb10 0x7fb15805d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3302/0 says I am v2:10.20.193.57:44994/0 (socket says 10.20.193.57:44994) 2026-02-20T16:31:04.822 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.817+0000 7fb1577fe640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fb1580814c0 0x7fb15807b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:04.822 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.817+0000 7fb156ffd640 1 -- 10.20.193.57:0/1638934252 learned_addr learned my addr 10.20.193.57:0/1638934252 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:31:04.822 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.817+0000 7fb1567fc640 1 --2- 10.20.193.57:0/1638934252 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fb158080bb0 0x7fb15807af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:04.822 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.817+0000 7fb1577fe640 1 -- 10.20.193.57:0/1638934252 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fb15807cb10 msgr2=0x7fb15805d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:04.823 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.817+0000 7fb1577fe640 1 --2- 10.20.193.57:0/1638934252 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fb15807cb10 0x7fb15805d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:04.823 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.817+0000 7fb1577fe640 1 -- 10.20.193.57:0/1638934252 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fb158080bb0 msgr2=0x7fb15807af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:04.823 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.817+0000 7fb1577fe640 1 --2- 10.20.193.57:0/1638934252 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fb158080bb0 0x7fb15807af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:04.823 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.817+0000 7fb1577fe640 1 -- 10.20.193.57:0/1638934252 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb15807f0e0 con 0x7fb1580814c0 2026-02-20T16:31:04.823 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.817+0000 7fb156ffd640 1 --2- 10.20.193.57:0/1638934252 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fb15807cb10 0x7fb15805d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:31:04.823 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.817+0000 7fb1577fe640 1 --2- 10.20.193.57:0/1638934252 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fb1580814c0 0x7fb15807b4c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb148007ed0 tx=0x7fb14800e510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:31:04.823 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.817+0000 7fb1377fe640 1 -- 10.20.193.57:0/1638934252 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb148002c50 con 0x7fb1580814c0 2026-02-20T16:31:04.823 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.817+0000 7fb1377fe640 1 -- 10.20.193.57:0/1638934252 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb148018070 con 0x7fb1580814c0 2026-02-20T16:31:04.823 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.817+0000 7fb15d764640 1 -- 10.20.193.57:0/1638934252 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb15807a8f0 con 0x7fb1580814c0 2026-02-20T16:31:04.823 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.817+0000 7fb1377fe640 1 -- 10.20.193.57:0/1638934252 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb148004330 con 0x7fb1580814c0 2026-02-20T16:31:04.823 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.817+0000 7fb15d764640 1 -- 10.20.193.57:0/1638934252 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb15805d860 con 0x7fb1580814c0 2026-02-20T16:31:04.823 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.818+0000 7fb15d764640 1 -- 10.20.193.57:0/1638934252 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb158080f80 con 0x7fb1580814c0 2026-02-20T16:31:04.824 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.818+0000 7fb1377fe640 1 -- 10.20.193.57:0/1638934252 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7fb1480044d0 con 0x7fb1580814c0 2026-02-20T16:31:04.824 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.818+0000 7fb1377fe640 1 -- 10.20.193.57:0/1638934252 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(30..30 src has 1..30) ==== 3026+0+0 (secure 0 0 0) 0x7fb148063c60 con 0x7fb1580814c0 2026-02-20T16:31:04.824 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.820+0000 7fb1377fe640 1 -- 10.20.193.57:0/1638934252 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7fb148010040 con 0x7fb1580814c0 2026-02-20T16:31:04.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.894+0000 7fb15d764640 1 -- 10.20.193.57:0/1638934252 --> v1:10.20.193.57:6800/2007744879 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb158053200 con 0x7fb12404cad0 2026-02-20T16:31:04.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.894+0000 7fb1377fe640 1 -- 10.20.193.57:0/1638934252 <== mgr.14109 v1:10.20.193.57:6800/2007744879 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31972 (unknown 2965378022 0 808432974) 0x7fb158053200 con 0x7fb12404cad0 2026-02-20T16:31:04.897 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:31:04.898 INFO:teuthology.orchestra.run.trial057.stderr:dumped all 2026-02-20T16:31:04.898 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.895+0000 7fb15d764640 1 -- 10.20.193.57:0/1638934252 >> v1:10.20.193.57:6800/2007744879 conn(0x7fb12404cad0 legacy=0x7fb12406cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:04.898 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.895+0000 7fb15d764640 1 -- 10.20.193.57:0/1638934252 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fb1580814c0 msgr2=0x7fb15807b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:04.898 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.895+0000 7fb15d764640 1 --2- 10.20.193.57:0/1638934252 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fb1580814c0 0x7fb15807b4c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb148007ed0 tx=0x7fb14800e510 comp rx=0 tx=0).stop 2026-02-20T16:31:04.898 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.895+0000 7fb15d764640 1 -- 10.20.193.57:0/1638934252 shutdown_connections 2026-02-20T16:31:04.898 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.895+0000 7fb15d764640 1 --2- 10.20.193.57:0/1638934252 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fb1580814c0 0x7fb15807b4c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:04.898 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.895+0000 7fb15d764640 1 --2- 10.20.193.57:0/1638934252 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fb158080bb0 0x7fb15807af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:04.898 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.895+0000 7fb15d764640 1 --2- 10.20.193.57:0/1638934252 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fb15807cb10 0x7fb15805d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:04.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.895+0000 7fb15d764640 1 -- 10.20.193.57:0/1638934252 >> 10.20.193.57:0/1638934252 conn(0x7fb1580833e0 msgr2=0x7fb158132940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:04.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.895+0000 7fb15d764640 1 -- 10.20.193.57:0/1638934252 shutdown_connections 2026-02-20T16:31:04.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.895+0000 7fb15d764640 1 -- 10.20.193.57:0/1638934252 wait complete. 2026-02-20T16:31:04.904 INFO:teuthology.orchestra.run.trial057.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2026-02-20T16:31:02.932184+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":115,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":111968,"kb_used_data":2144,"kb_used_omap":32,"kb_used_meta":109727,"kb_avail":377375392,"statfs":{"total":386547056640,"available":386432401408,"internally_reserved":0,"allocated":2195456,"data_stored":1526748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33367,"internal_metadata":112360873},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.980296"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.964839+0000","last_change":"2026-02-20T16:30:58.157966+0000","last_active":"2026-02-20T16:31:01.964839+0000","last_peered":"2026-02-20T16:31:01.964839+0000","last_clean":"2026-02-20T16:31:01.964839+0000","last_became_active":"2026-02-20T16:30:58.157789+0000","last_became_peered":"2026-02-20T16:30:58.157789+0000","last_unstale":"2026-02-20T16:31:01.964839+0000","last_undegraded":"2026-02-20T16:31:01.964839+0000","last_fullsized":"2026-02-20T16:31:01.964839+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:54:24.491175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001161203,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.964718+0000","last_change":"2026-02-20T16:30:55.953096+0000","last_active":"2026-02-20T16:31:01.964718+0000","last_peered":"2026-02-20T16:31:01.964718+0000","last_clean":"2026-02-20T16:31:01.964718+0000","last_became_active":"2026-02-20T16:30:55.952830+0000","last_became_peered":"2026-02-20T16:30:55.952830+0000","last_unstale":"2026-02-20T16:31:01.964718+0000","last_undegraded":"2026-02-20T16:31:01.964718+0000","last_fullsized":"2026-02-20T16:31:01.964718+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:40:28.084285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033720799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.964835+0000","last_change":"2026-02-20T16:30:58.158048+0000","last_active":"2026-02-20T16:31:01.964835+0000","last_peered":"2026-02-20T16:31:01.964835+0000","last_clean":"2026-02-20T16:31:01.964835+0000","last_became_active":"2026-02-20T16:30:58.157875+0000","last_became_peered":"2026-02-20T16:30:58.157875+0000","last_unstale":"2026-02-20T16:31:01.964835+0000","last_undegraded":"2026-02-20T16:31:01.964835+0000","last_fullsized":"2026-02-20T16:31:01.964835+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:21:38.884906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001207149,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.964710+0000","last_change":"2026-02-20T16:30:55.952911+0000","last_active":"2026-02-20T16:31:01.964710+0000","last_peered":"2026-02-20T16:31:01.964710+0000","last_clean":"2026-02-20T16:31:01.964710+0000","last_became_active":"2026-02-20T16:30:55.952715+0000","last_became_peered":"2026-02-20T16:30:55.952715+0000","last_unstale":"2026-02-20T16:31:01.964710+0000","last_undegraded":"2026-02-20T16:31:01.964710+0000","last_fullsized":"2026-02-20T16:31:01.964710+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T02:00:10.634783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000271997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.964821+0000","last_change":"2026-02-20T16:30:57.954902+0000","last_active":"2026-02-20T16:31:01.964821+0000","last_peered":"2026-02-20T16:31:01.964821+0000","last_clean":"2026-02-20T16:31:01.964821+0000","last_became_active":"2026-02-20T16:30:57.954650+0000","last_became_peered":"2026-02-20T16:30:57.954650+0000","last_unstale":"2026-02-20T16:31:01.964821+0000","last_undegraded":"2026-02-20T16:31:01.964821+0000","last_fullsized":"2026-02-20T16:31:01.964821+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:00:58.459896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092195700000000005,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.057625+0000","last_change":"2026-02-20T16:30:57.954352+0000","last_active":"2026-02-20T16:31:01.057625+0000","last_peered":"2026-02-20T16:31:01.057625+0000","last_clean":"2026-02-20T16:31:01.057625+0000","last_became_active":"2026-02-20T16:30:57.954061+0000","last_became_peered":"2026-02-20T16:30:57.954061+0000","last_unstale":"2026-02-20T16:31:01.057625+0000","last_undegraded":"2026-02-20T16:31:01.057625+0000","last_fullsized":"2026-02-20T16:31:01.057625+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:25:10.709903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025212999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.964783+0000","last_change":"2026-02-20T16:30:57.954552+0000","last_active":"2026-02-20T16:31:01.964783+0000","last_peered":"2026-02-20T16:31:01.964783+0000","last_clean":"2026-02-20T16:31:01.964783+0000","last_became_active":"2026-02-20T16:30:57.954099+0000","last_became_peered":"2026-02-20T16:30:57.954099+0000","last_unstale":"2026-02-20T16:31:01.964783+0000","last_undegraded":"2026-02-20T16:31:01.964783+0000","last_fullsized":"2026-02-20T16:31:01.964783+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:04:34.172539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010429829999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.964849+0000","last_change":"2026-02-20T16:30:57.954384+0000","last_active":"2026-02-20T16:31:01.964849+0000","last_peered":"2026-02-20T16:31:01.964849+0000","last_clean":"2026-02-20T16:31:01.964849+0000","last_became_active":"2026-02-20T16:30:57.953999+0000","last_became_peered":"2026-02-20T16:30:57.953999+0000","last_unstale":"2026-02-20T16:31:01.964849+0000","last_undegraded":"2026-02-20T16:31:01.964849+0000","last_fullsized":"2026-02-20T16:31:01.964849+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:18:53.326241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093713599999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"20'79","reported_seq":163,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.964727+0000","last_change":"2026-02-20T16:30:55.952986+0000","last_active":"2026-02-20T16:31:01.964727+0000","last_peered":"2026-02-20T16:31:01.964727+0000","last_clean":"2026-02-20T16:31:01.964727+0000","last_became_active":"2026-02-20T16:30:55.952756+0000","last_became_peered":"2026-02-20T16:30:55.952756+0000","last_unstale":"2026-02-20T16:31:01.964727+0000","last_undegraded":"2026-02-20T16:31:01.964727+0000","last_fullsized":"2026-02-20T16:31:01.964727+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:34.730052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:34.730052+0000","last_clean_scrub_stamp":"2026-02-20T16:29:34.730052+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:12:19.306906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":26,"seq":111669149699,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27716,"kb_used_data":244,"kb_used_omap":7,"kb_used_meta":27448,"kb_avail":94344124,"statfs":{"total":96636764160,"available":96608382976,"internally_reserved":0,"allocated":249856,"data_stored":84721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7688,"internal_metadata":28107256},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":25,"seq":107374182403,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27712,"kb_used_data":240,"kb_used_omap":8,"kb_used_meta":27447,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":245760,"data_stored":84710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8340,"internal_metadata":28106604},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":24,"seq":103079215107,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28304,"kb_used_data":832,"kb_used_omap":9,"kb_used_meta":27446,"kb_avail":94343536,"statfs":{"total":96636764160,"available":96607780864,"internally_reserved":0,"allocated":851968,"data_stored":678672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9646,"internal_metadata":28105298},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":23,"seq":98784247811,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28236,"kb_used_data":828,"kb_used_omap":7,"kb_used_meta":27384,"kb_avail":94343604,"statfs":{"total":96636764160,"available":96607850496,"internally_reserved":0,"allocated":847872,"data_stored":678645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7693,"internal_metadata":28041715},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T16:31:04.906 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-20T16:31:04.906 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T16:31:04.977 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.973+0000 7ff97e216640 1 -- 10.20.193.57:0/2124678108 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7ff978130220 msgr2=0x7ff978086570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:04.978 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.973+0000 7ff97e216640 1 --2- 10.20.193.57:0/2124678108 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7ff978130220 0x7ff978086570 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff9640098f0 tx=0x7ff96402f0d0 comp rx=0 tx=0).stop 2026-02-20T16:31:04.978 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.973+0000 7ff97e216640 1 -- 10.20.193.57:0/2124678108 shutdown_connections 2026-02-20T16:31:04.978 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.973+0000 7ff97e216640 1 --2- 10.20.193.57:0/2124678108 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7ff978135f40 0x7ff9781363b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:04.978 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.973+0000 7ff97e216640 1 --2- 10.20.193.57:0/2124678108 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7ff978130220 0x7ff978086570 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:04.978 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.973+0000 7ff97e216640 1 -- 10.20.193.57:0/2124678108 >> 10.20.193.57:0/2124678108 conn(0x7ff97808aae0 msgr2=0x7ff97808aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:04.978 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.973+0000 7ff97e216640 1 -- 10.20.193.57:0/2124678108 shutdown_connections 2026-02-20T16:31:04.978 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.973+0000 7ff97e216640 1 -- 10.20.193.57:0/2124678108 wait complete. 2026-02-20T16:31:04.978 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.974+0000 7ff97e216640 1 Processor -- start 2026-02-20T16:31:04.979 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.974+0000 7ff97e216640 1 -- start start 2026-02-20T16:31:04.979 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.974+0000 7ff97e216640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7ff978130220 0x7ff97811ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:04.979 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.974+0000 7ff97e216640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7ff978135f40 0x7ff97811f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:04.979 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.974+0000 7ff97e216640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7ff9781368f0 0x7ff97811f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:04.979 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.974+0000 7ff97e216640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7ff978198da0 con 0x7ff978135f40 2026-02-20T16:31:04.979 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.974+0000 7ff97e216640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7ff978198c20 con 0x7ff9781368f0 2026-02-20T16:31:04.979 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.974+0000 7ff97e216640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7ff978198f20 con 0x7ff978130220 2026-02-20T16:31:04.979 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.974+0000 7ff976ffd640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7ff978135f40 0x7ff97811f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:04.979 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.974+0000 7ff977fff640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7ff9781368f0 0x7ff97811f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:04.979 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.974+0000 7ff976ffd640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7ff978135f40 0x7ff97811f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:52928/0 (socket says 10.20.193.57:52928) 2026-02-20T16:31:04.979 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.974+0000 7ff9777fe640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7ff978130220 0x7ff97811ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:04.979 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.974+0000 7ff976ffd640 1 -- 10.20.193.57:0/2339162970 learned_addr learned my addr 10.20.193.57:0/2339162970 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:31:04.980 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.974+0000 7ff976ffd640 1 -- 10.20.193.57:0/2339162970 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7ff978130220 msgr2=0x7ff97811ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:04.980 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.974+0000 7ff976ffd640 1 --2- 10.20.193.57:0/2339162970 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7ff978130220 0x7ff97811ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:04.980 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.974+0000 7ff976ffd640 1 -- 10.20.193.57:0/2339162970 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7ff9781368f0 msgr2=0x7ff97811f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:04.980 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.974+0000 7ff976ffd640 1 --2- 10.20.193.57:0/2339162970 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7ff9781368f0 0x7ff97811f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:04.980 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.974+0000 7ff976ffd640 1 -- 10.20.193.57:0/2339162970 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff978057e90 con 0x7ff978135f40 2026-02-20T16:31:04.980 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.974+0000 7ff977fff640 1 --2- 10.20.193.57:0/2339162970 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7ff9781368f0 0x7ff97811f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:31:04.980 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.974+0000 7ff976ffd640 1 --2- 10.20.193.57:0/2339162970 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7ff978135f40 0x7ff97811f360 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff968002750 tx=0x7ff968002c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:31:04.980 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.974+0000 7ff953fff640 1 -- 10.20.193.57:0/2339162970 <== mon.0 v2:10.20.193.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff96800ed40 con 0x7ff978135f40 2026-02-20T16:31:04.980 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.974+0000 7ff953fff640 1 -- 10.20.193.57:0/2339162970 <== mon.0 v2:10.20.193.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff968010430 con 0x7ff978135f40 2026-02-20T16:31:04.980 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.974+0000 7ff97e216640 1 -- 10.20.193.57:0/2339162970 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff978112db0 con 0x7ff978135f40 2026-02-20T16:31:04.980 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.974+0000 7ff953fff640 1 -- 10.20.193.57:0/2339162970 <== mon.0 v2:10.20.193.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff968010820 con 0x7ff978135f40 2026-02-20T16:31:04.980 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.974+0000 7ff97e216640 1 -- 10.20.193.57:0/2339162970 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff978113300 con 0x7ff978135f40 2026-02-20T16:31:04.981 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.975+0000 7ff97e216640 1 -- 10.20.193.57:0/2339162970 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff978086570 con 0x7ff978135f40 2026-02-20T16:31:04.981 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.975+0000 7ff953fff640 1 -- 10.20.193.57:0/2339162970 <== mon.0 v2:10.20.193.57:3300/0 4 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7ff968020030 con 0x7ff978135f40 2026-02-20T16:31:04.981 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.975+0000 7ff953fff640 1 -- 10.20.193.57:0/2339162970 <== mon.0 v2:10.20.193.57:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3026+0+0 (secure 0 0 0) 0x7ff968063dd0 con 0x7ff978135f40 2026-02-20T16:31:04.981 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:04.977+0000 7ff953fff640 1 -- 10.20.193.57:0/2339162970 <== mon.0 v2:10.20.193.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7ff968014030 con 0x7ff978135f40 2026-02-20T16:31:05.051 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.049+0000 7ff97e216640 1 -- 10.20.193.57:0/2339162970 --> v1:10.20.193.57:6800/2007744879 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff978114ce0 con 0x7ff94804cad0 2026-02-20T16:31:05.051 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.050+0000 7ff953fff640 1 -- 10.20.193.57:0/2339162970 <== mgr.14109 v1:10.20.193.57:6800/2007744879 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31972 (unknown 2965378022 0 2323981176) 0x7ff978114ce0 con 0x7ff94804cad0 2026-02-20T16:31:05.051 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:31:05.051 INFO:teuthology.orchestra.run.trial057.stderr:dumped all 2026-02-20T16:31:05.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.050+0000 7ff97e216640 1 -- 10.20.193.57:0/2339162970 >> v1:10.20.193.57:6800/2007744879 conn(0x7ff94804cad0 legacy=0x7ff94806cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:05.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.050+0000 7ff97e216640 1 -- 10.20.193.57:0/2339162970 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7ff978135f40 msgr2=0x7ff97811f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:05.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.050+0000 7ff97e216640 1 --2- 10.20.193.57:0/2339162970 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7ff978135f40 0x7ff97811f360 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff968002750 tx=0x7ff968002c20 comp rx=0 tx=0).stop 2026-02-20T16:31:05.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.051+0000 7ff97e216640 1 -- 10.20.193.57:0/2339162970 shutdown_connections 2026-02-20T16:31:05.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.051+0000 7ff97e216640 1 --2- 10.20.193.57:0/2339162970 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7ff9781368f0 0x7ff97811f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:05.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.051+0000 7ff97e216640 1 --2- 10.20.193.57:0/2339162970 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7ff978135f40 0x7ff97811f360 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:05.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.051+0000 7ff97e216640 1 --2- 10.20.193.57:0/2339162970 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7ff978130220 0x7ff97811ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:05.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.051+0000 7ff97e216640 1 -- 10.20.193.57:0/2339162970 >> 10.20.193.57:0/2339162970 conn(0x7ff97808aae0 msgr2=0x7ff978134730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:05.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.051+0000 7ff97e216640 1 -- 10.20.193.57:0/2339162970 shutdown_connections 2026-02-20T16:31:05.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.051+0000 7ff97e216640 1 -- 10.20.193.57:0/2339162970 wait complete. 2026-02-20T16:31:05.059 INFO:teuthology.orchestra.run.trial057.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2026-02-20T16:31:04.932401+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":115,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":111968,"kb_used_data":2144,"kb_used_omap":32,"kb_used_meta":109727,"kb_avail":377375392,"statfs":{"total":386547056640,"available":386432401408,"internally_reserved":0,"allocated":2195456,"data_stored":1526748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33367,"internal_metadata":112360873},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000602"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.964839+0000","last_change":"2026-02-20T16:30:58.157966+0000","last_active":"2026-02-20T16:31:01.964839+0000","last_peered":"2026-02-20T16:31:01.964839+0000","last_clean":"2026-02-20T16:31:01.964839+0000","last_became_active":"2026-02-20T16:30:58.157789+0000","last_became_peered":"2026-02-20T16:30:58.157789+0000","last_unstale":"2026-02-20T16:31:01.964839+0000","last_undegraded":"2026-02-20T16:31:01.964839+0000","last_fullsized":"2026-02-20T16:31:01.964839+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:54:24.491175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001161203,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.964718+0000","last_change":"2026-02-20T16:30:55.953096+0000","last_active":"2026-02-20T16:31:01.964718+0000","last_peered":"2026-02-20T16:31:01.964718+0000","last_clean":"2026-02-20T16:31:01.964718+0000","last_became_active":"2026-02-20T16:30:55.952830+0000","last_became_peered":"2026-02-20T16:30:55.952830+0000","last_unstale":"2026-02-20T16:31:01.964718+0000","last_undegraded":"2026-02-20T16:31:01.964718+0000","last_fullsized":"2026-02-20T16:31:01.964718+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:40:28.084285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033720799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.964835+0000","last_change":"2026-02-20T16:30:58.158048+0000","last_active":"2026-02-20T16:31:01.964835+0000","last_peered":"2026-02-20T16:31:01.964835+0000","last_clean":"2026-02-20T16:31:01.964835+0000","last_became_active":"2026-02-20T16:30:58.157875+0000","last_became_peered":"2026-02-20T16:30:58.157875+0000","last_unstale":"2026-02-20T16:31:01.964835+0000","last_undegraded":"2026-02-20T16:31:01.964835+0000","last_fullsized":"2026-02-20T16:31:01.964835+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:21:38.884906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001207149,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.964710+0000","last_change":"2026-02-20T16:30:55.952911+0000","last_active":"2026-02-20T16:31:01.964710+0000","last_peered":"2026-02-20T16:31:01.964710+0000","last_clean":"2026-02-20T16:31:01.964710+0000","last_became_active":"2026-02-20T16:30:55.952715+0000","last_became_peered":"2026-02-20T16:30:55.952715+0000","last_unstale":"2026-02-20T16:31:01.964710+0000","last_undegraded":"2026-02-20T16:31:01.964710+0000","last_fullsized":"2026-02-20T16:31:01.964710+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T02:00:10.634783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000271997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.964821+0000","last_change":"2026-02-20T16:30:57.954902+0000","last_active":"2026-02-20T16:31:01.964821+0000","last_peered":"2026-02-20T16:31:01.964821+0000","last_clean":"2026-02-20T16:31:01.964821+0000","last_became_active":"2026-02-20T16:30:57.954650+0000","last_became_peered":"2026-02-20T16:30:57.954650+0000","last_unstale":"2026-02-20T16:31:01.964821+0000","last_undegraded":"2026-02-20T16:31:01.964821+0000","last_fullsized":"2026-02-20T16:31:01.964821+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:00:58.459896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092195700000000005,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.057625+0000","last_change":"2026-02-20T16:30:57.954352+0000","last_active":"2026-02-20T16:31:01.057625+0000","last_peered":"2026-02-20T16:31:01.057625+0000","last_clean":"2026-02-20T16:31:01.057625+0000","last_became_active":"2026-02-20T16:30:57.954061+0000","last_became_peered":"2026-02-20T16:30:57.954061+0000","last_unstale":"2026-02-20T16:31:01.057625+0000","last_undegraded":"2026-02-20T16:31:01.057625+0000","last_fullsized":"2026-02-20T16:31:01.057625+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:25:10.709903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025212999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.964783+0000","last_change":"2026-02-20T16:30:57.954552+0000","last_active":"2026-02-20T16:31:01.964783+0000","last_peered":"2026-02-20T16:31:01.964783+0000","last_clean":"2026-02-20T16:31:01.964783+0000","last_became_active":"2026-02-20T16:30:57.954099+0000","last_became_peered":"2026-02-20T16:30:57.954099+0000","last_unstale":"2026-02-20T16:31:01.964783+0000","last_undegraded":"2026-02-20T16:31:01.964783+0000","last_fullsized":"2026-02-20T16:31:01.964783+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:04:34.172539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010429829999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.964849+0000","last_change":"2026-02-20T16:30:57.954384+0000","last_active":"2026-02-20T16:31:01.964849+0000","last_peered":"2026-02-20T16:31:01.964849+0000","last_clean":"2026-02-20T16:31:01.964849+0000","last_became_active":"2026-02-20T16:30:57.953999+0000","last_became_peered":"2026-02-20T16:30:57.953999+0000","last_unstale":"2026-02-20T16:31:01.964849+0000","last_undegraded":"2026-02-20T16:31:01.964849+0000","last_fullsized":"2026-02-20T16:31:01.964849+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:18:53.326241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093713599999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"20'79","reported_seq":163,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.964727+0000","last_change":"2026-02-20T16:30:55.952986+0000","last_active":"2026-02-20T16:31:01.964727+0000","last_peered":"2026-02-20T16:31:01.964727+0000","last_clean":"2026-02-20T16:31:01.964727+0000","last_became_active":"2026-02-20T16:30:55.952756+0000","last_became_peered":"2026-02-20T16:30:55.952756+0000","last_unstale":"2026-02-20T16:31:01.964727+0000","last_undegraded":"2026-02-20T16:31:01.964727+0000","last_fullsized":"2026-02-20T16:31:01.964727+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:34.730052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:34.730052+0000","last_clean_scrub_stamp":"2026-02-20T16:29:34.730052+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:12:19.306906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":26,"seq":111669149699,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27716,"kb_used_data":244,"kb_used_omap":7,"kb_used_meta":27448,"kb_avail":94344124,"statfs":{"total":96636764160,"available":96608382976,"internally_reserved":0,"allocated":249856,"data_stored":84721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7688,"internal_metadata":28107256},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":25,"seq":107374182403,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27712,"kb_used_data":240,"kb_used_omap":8,"kb_used_meta":27447,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":245760,"data_stored":84710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8340,"internal_metadata":28106604},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":24,"seq":103079215108,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28304,"kb_used_data":832,"kb_used_omap":9,"kb_used_meta":27446,"kb_avail":94343536,"statfs":{"total":96636764160,"available":96607780864,"internally_reserved":0,"allocated":851968,"data_stored":678672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9646,"internal_metadata":28105298},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":23,"seq":98784247812,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28236,"kb_used_data":828,"kb_used_omap":7,"kb_used_meta":27384,"kb_avail":94343604,"statfs":{"total":96636764160,"available":96607850496,"internally_reserved":0,"allocated":847872,"data_stored":678645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7693,"internal_metadata":28041715},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T16:31:05.060 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-20T16:31:05.130 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.126+0000 7f8e9244a640 1 -- 10.20.193.57:0/2698785903 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8e8c174330 msgr2=0x7f8e8c194710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:05.131 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.126+0000 7f8e9244a640 1 --2- 10.20.193.57:0/2698785903 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8e8c174330 0x7f8e8c194710 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8e80009f10 tx=0x7f8e8002f390 comp rx=0 tx=0).stop 2026-02-20T16:31:05.131 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.126+0000 7f8e9244a640 1 -- 10.20.193.57:0/2698785903 shutdown_connections 2026-02-20T16:31:05.131 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.126+0000 7f8e9244a640 1 --2- 10.20.193.57:0/2698785903 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8e8c174330 0x7f8e8c194710 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:05.131 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.126+0000 7f8e9244a640 1 --2- 10.20.193.57:0/2698785903 >> v2:10.20.193.57:3300/0 conn(0x7f8e8c085b90 0x7f8e8c07d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:05.131 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.126+0000 7f8e9244a640 1 -- 10.20.193.57:0/2698785903 >> 10.20.193.57:0/2698785903 conn(0x7f8e8c0833e0 msgr2=0x7f8e8c0840b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:05.131 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.126+0000 7f8e9244a640 1 -- 10.20.193.57:0/2698785903 shutdown_connections 2026-02-20T16:31:05.131 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.126+0000 7f8e9244a640 1 -- 10.20.193.57:0/2698785903 wait complete. 2026-02-20T16:31:05.131 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.127+0000 7f8e9244a640 1 Processor -- start 2026-02-20T16:31:05.131 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.127+0000 7f8e9244a640 1 -- start start 2026-02-20T16:31:05.131 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.127+0000 7f8e9244a640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8e8c07dc60 0x7f8e8c121e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:05.132 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.127+0000 7f8e9244a640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f8e8c085b90 0x7f8e8c122380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:05.132 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.127+0000 7f8e9244a640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8e8c174330 0x7f8e8c125170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:05.132 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.127+0000 7f8e9244a640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f8e8c195810 con 0x7f8e8c085b90 2026-02-20T16:31:05.132 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.127+0000 7f8e9244a640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f8e8c195690 con 0x7f8e8c174330 2026-02-20T16:31:05.132 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.127+0000 7f8e9244a640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f8e8c195990 con 0x7f8e8c07dc60 2026-02-20T16:31:05.132 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.127+0000 7f8e8bfff640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8e8c07dc60 0x7f8e8c121e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:05.132 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.127+0000 7f8e8b7fe640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f8e8c085b90 0x7f8e8c122380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:05.132 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.127+0000 7f8e8bfff640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8e8c07dc60 0x7f8e8c121e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3302/0 says I am v2:10.20.193.57:45026/0 (socket says 10.20.193.57:45026) 2026-02-20T16:31:05.132 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.127+0000 7f8e8bfff640 1 -- 10.20.193.57:0/4116098956 learned_addr learned my addr 10.20.193.57:0/4116098956 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:31:05.132 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.127+0000 7f8e909c0640 1 --2- 10.20.193.57:0/4116098956 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8e8c174330 0x7f8e8c125170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:05.132 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.127+0000 7f8e8bfff640 1 -- 10.20.193.57:0/4116098956 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8e8c174330 msgr2=0x7f8e8c125170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:05.133 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.127+0000 7f8e8bfff640 1 --2- 10.20.193.57:0/4116098956 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8e8c174330 0x7f8e8c125170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:05.133 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.127+0000 7f8e8bfff640 1 -- 10.20.193.57:0/4116098956 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f8e8c085b90 msgr2=0x7f8e8c122380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:05.133 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.127+0000 7f8e8bfff640 1 --2- 10.20.193.57:0/4116098956 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f8e8c085b90 0x7f8e8c122380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:05.133 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.127+0000 7f8e8bfff640 1 -- 10.20.193.57:0/4116098956 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e8c10d170 con 0x7f8e8c07dc60 2026-02-20T16:31:05.133 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.127+0000 7f8e8bfff640 1 --2- 10.20.193.57:0/4116098956 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8e8c07dc60 0x7f8e8c121e40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8e78004770 tx=0x7f8e78002b70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:31:05.133 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.127+0000 7f8e88ff9640 1 -- 10.20.193.57:0/4116098956 <== mon.2 v2:10.20.193.57:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e7800eb30 con 0x7f8e8c07dc60 2026-02-20T16:31:05.133 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.128+0000 7f8e88ff9640 1 -- 10.20.193.57:0/4116098956 <== mon.2 v2:10.20.193.57:3302/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8e7800ecd0 con 0x7f8e8c07dc60 2026-02-20T16:31:05.133 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.128+0000 7f8e9244a640 1 -- 10.20.193.57:0/4116098956 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e8c10e110 con 0x7f8e8c07dc60 2026-02-20T16:31:05.133 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.128+0000 7f8e88ff9640 1 -- 10.20.193.57:0/4116098956 <== mon.2 v2:10.20.193.57:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e78010690 con 0x7f8e8c07dc60 2026-02-20T16:31:05.133 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.128+0000 7f8e9244a640 1 -- 10.20.193.57:0/4116098956 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e8c1228c0 con 0x7f8e8c07dc60 2026-02-20T16:31:05.133 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.128+0000 7f8e9244a640 1 -- 10.20.193.57:0/4116098956 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e8c07d720 con 0x7f8e8c07dc60 2026-02-20T16:31:05.133 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.128+0000 7f8e88ff9640 1 -- 10.20.193.57:0/4116098956 <== mon.2 v2:10.20.193.57:3302/0 4 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7f8e78010830 con 0x7f8e8c07dc60 2026-02-20T16:31:05.134 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.129+0000 7f8e88ff9640 1 -- 10.20.193.57:0/4116098956 <== mon.2 v2:10.20.193.57:3302/0 5 ==== osd_map(30..30 src has 1..30) ==== 3026+0+0 (secure 0 0 0) 0x7f8e78064290 con 0x7f8e8c07dc60 2026-02-20T16:31:05.134 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.130+0000 7f8e88ff9640 1 -- 10.20.193.57:0/4116098956 <== mon.2 v2:10.20.193.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7f8e78014070 con 0x7f8e8c07dc60 2026-02-20T16:31:05.207 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.206+0000 7f8e9244a640 1 -- 10.20.193.57:0/4116098956 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8e8c053200 con 0x7f8e8c07dc60 2026-02-20T16:31:05.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.206+0000 7f8e88ff9640 1 -- 10.20.193.57:0/4116098956 <== mon.2 v2:10.20.193.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+9205 (secure 0 0 0) 0x7f8e78009550 con 0x7f8e8c07dc60 2026-02-20T16:31:05.208 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:31:05.209 INFO:teuthology.orchestra.run.trial057.stdout:{"epoch":30,"fsid":"3b3c5c1a-0a2b-40b9-ac1d-921ada466f9e","created":"2026-02-20T16:29:22.501479+0000","modified":"2026-02-20T16:31:01.963309+0000","last_up_change":"2026-02-20T16:30:56.950147+0000","last_in_change":"2026-02-20T16:29:24.294147+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":9,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"squid","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T16:29:34.029059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-20T16:29:38.191724+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a3139827-dc3c-46f9-b211-d376e3dc92f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":20,"up_from":23,"up_thru":24,"down_at":21,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6801","nonce":4246367706}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6802","nonce":4246367706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6804","nonce":4246367706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6803","nonce":4246367706}]},"public_addr":"10.20.193.57:6801/4246367706","cluster_addr":"10.20.193.57:6802/4246367706","heartbeat_back_addr":"10.20.193.57:6804/4246367706","heartbeat_front_addr":"10.20.193.57:6803/4246367706","state":["exists","up"]},{"osd":1,"uuid":"00e7cb17-534c-4ac2-8486-585b3b8db0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":21,"up_from":24,"up_thru":24,"down_at":22,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6805","nonce":3794545817}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6806","nonce":3794545817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6808","nonce":3794545817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6807","nonce":3794545817}]},"public_addr":"10.20.193.57:6805/3794545817","cluster_addr":"10.20.193.57:6806/3794545817","heartbeat_back_addr":"10.20.193.57:6808/3794545817","heartbeat_front_addr":"10.20.193.57:6807/3794545817","state":["exists","up"]},{"osd":2,"uuid":"d0b55b31-45df-4c58-bf11-a72d44f21a00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":22,"up_from":25,"up_thru":26,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6809","nonce":3959776128}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6810","nonce":3959776128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6812","nonce":3959776128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6811","nonce":3959776128}]},"public_addr":"10.20.193.57:6809/3959776128","cluster_addr":"10.20.193.57:6810/3959776128","heartbeat_back_addr":"10.20.193.57:6812/3959776128","heartbeat_front_addr":"10.20.193.57:6811/3959776128","state":["exists","up"]},{"osd":3,"uuid":"b3bfbbd8-cfaf-4360-9a5b-c52e89ac3f75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":23,"up_from":26,"up_thru":26,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6813","nonce":2476353628}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6814","nonce":2476353628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6816","nonce":2476353628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6815","nonce":2476353628}]},"public_addr":"10.20.193.57:6813/2476353628","cluster_addr":"10.20.193.57:6814/2476353628","heartbeat_back_addr":"10.20.193.57:6816/2476353628","heartbeat_front_addr":"10.20.193.57:6815/2476353628","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T16:29:31.711310+0000","dead_epoch":21},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T16:29:31.724521+0000","dead_epoch":22},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T16:29:31.770683+0000","dead_epoch":23},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T16:29:31.821531+0000","dead_epoch":24}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.57:0/4240799477":"2026-02-21T16:30:46.924862+0000","10.20.193.57:0/1295824105":"2026-02-21T16:30:46.924862+0000","10.20.193.57:0/2316661359":"2026-02-21T16:30:46.924862+0000","10.20.193.57:0/3729051198":"2026-02-21T16:30:46.924862+0000","10.20.193.57:6800/4138285113":"2026-02-21T16:30:46.924862+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T16:31:05.210 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.207+0000 7f8e9244a640 1 -- 10.20.193.57:0/4116098956 >> v1:10.20.193.57:6800/2007744879 conn(0x7f8e5c04cae0 legacy=0x7f8e5c06cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:05.210 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.207+0000 7f8e9244a640 1 -- 10.20.193.57:0/4116098956 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8e8c07dc60 msgr2=0x7f8e8c121e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:05.210 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.207+0000 7f8e9244a640 1 --2- 10.20.193.57:0/4116098956 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8e8c07dc60 0x7f8e8c121e40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8e78004770 tx=0x7f8e78002b70 comp rx=0 tx=0).stop 2026-02-20T16:31:05.210 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.207+0000 7f8e9244a640 1 -- 10.20.193.57:0/4116098956 shutdown_connections 2026-02-20T16:31:05.210 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.207+0000 7f8e9244a640 1 --2- 10.20.193.57:0/4116098956 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f8e8c174330 0x7f8e8c125170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:05.210 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.207+0000 7f8e9244a640 1 --2- 10.20.193.57:0/4116098956 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f8e8c085b90 0x7f8e8c122380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:05.210 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.207+0000 7f8e9244a640 1 --2- 10.20.193.57:0/4116098956 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f8e8c07dc60 0x7f8e8c121e40 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:05.210 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.207+0000 7f8e9244a640 1 -- 10.20.193.57:0/4116098956 >> 10.20.193.57:0/4116098956 conn(0x7f8e8c0833e0 msgr2=0x7f8e8c05bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:05.210 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.207+0000 7f8e9244a640 1 -- 10.20.193.57:0/4116098956 shutdown_connections 2026-02-20T16:31:05.210 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:05.207+0000 7f8e9244a640 1 -- 10.20.193.57:0/4116098956 wait complete. 2026-02-20T16:31:06.218 INFO:tasks.ceph:Scrubbing osd.0 2026-02-20T16:31:06.219 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-20T16:31:06.294 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.289+0000 7f559563d640 1 -- 10.20.193.57:0/1639181394 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f5590136770 msgr2=0x7f5590136bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:06.294 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.289+0000 7f559563d640 1 --2- 10.20.193.57:0/1639181394 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f5590136770 0x7f5590136bf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5580004af0 tx=0x7f558002f310 comp rx=0 tx=0).stop 2026-02-20T16:31:06.294 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.289+0000 7f559563d640 1 -- 10.20.193.57:0/1639181394 shutdown_connections 2026-02-20T16:31:06.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.289+0000 7f559563d640 1 --2- 10.20.193.57:0/1639181394 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f5590136770 0x7f5590136bf0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:06.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.289+0000 7f559563d640 1 --2- 10.20.193.57:0/1639181394 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f5590081780 0x7f5590136230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:06.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.289+0000 7f559563d640 1 --2- 10.20.193.57:0/1639181394 >> v2:10.20.193.57:3300/0 conn(0x7f5590080e70 0x7f5590081240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:06.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.289+0000 7f559563d640 1 -- 10.20.193.57:0/1639181394 >> 10.20.193.57:0/1639181394 conn(0x7f55900843d0 msgr2=0x7f55900847d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:06.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.289+0000 7f559563d640 1 -- 10.20.193.57:0/1639181394 shutdown_connections 2026-02-20T16:31:06.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.289+0000 7f559563d640 1 -- 10.20.193.57:0/1639181394 wait complete. 2026-02-20T16:31:06.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.289+0000 7f559563d640 1 Processor -- start 2026-02-20T16:31:06.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.289+0000 7f559563d640 1 -- start start 2026-02-20T16:31:06.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.290+0000 7f559563d640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f5590080e70 0x7f55901467b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:06.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.290+0000 7f559563d640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f5590081780 0x7f5590146cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:06.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.290+0000 7f559563d640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f5590136770 0x7f559012b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:06.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.290+0000 7f559563d640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f55901979d0 con 0x7f5590080e70 2026-02-20T16:31:06.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.290+0000 7f559563d640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f5590197850 con 0x7f5590136770 2026-02-20T16:31:06.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.290+0000 7f559563d640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f5590197b50 con 0x7f5590081780 2026-02-20T16:31:06.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.290+0000 7f558e7fc640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f5590081780 0x7f5590146cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:06.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.290+0000 7f558effd640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f5590080e70 0x7f55901467b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:06.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.290+0000 7f558e7fc640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f5590081780 0x7f5590146cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3302/0 says I am v2:10.20.193.57:45046/0 (socket says 10.20.193.57:45046) 2026-02-20T16:31:06.298 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.290+0000 7f558e7fc640 1 -- 10.20.193.57:0/1752006866 learned_addr learned my addr 10.20.193.57:0/1752006866 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:31:06.298 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.290+0000 7f558f7fe640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f5590136770 0x7f559012b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:06.298 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.290+0000 7f558e7fc640 1 -- 10.20.193.57:0/1752006866 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f5590136770 msgr2=0x7f559012b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:06.298 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.290+0000 7f558e7fc640 1 --2- 10.20.193.57:0/1752006866 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f5590136770 0x7f559012b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:06.298 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.290+0000 7f558e7fc640 1 -- 10.20.193.57:0/1752006866 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f5590080e70 msgr2=0x7f55901467b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:06.298 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.290+0000 7f558e7fc640 1 --2- 10.20.193.57:0/1752006866 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f5590080e70 0x7f55901467b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:06.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.290+0000 7f558e7fc640 1 -- 10.20.193.57:0/1752006866 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f559012dcc0 con 0x7f5590081780 2026-02-20T16:31:06.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.290+0000 7f558f7fe640 1 --2- 10.20.193.57:0/1752006866 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f5590136770 0x7f559012b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:31:06.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.290+0000 7f558e7fc640 1 --2- 10.20.193.57:0/1752006866 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f5590081780 0x7f5590146cf0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f55780094b0 tx=0x7f557800ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:31:06.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.290+0000 7f556f7fe640 1 -- 10.20.193.57:0/1752006866 <== mon.2 v2:10.20.193.57:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f557800cd20 con 0x7f5590081780 2026-02-20T16:31:06.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.290+0000 7f556f7fe640 1 -- 10.20.193.57:0/1752006866 <== mon.2 v2:10.20.193.57:3302/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5578004880 con 0x7f5590081780 2026-02-20T16:31:06.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.290+0000 7f559563d640 1 -- 10.20.193.57:0/1752006866 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f559005cea0 con 0x7f5590081780 2026-02-20T16:31:06.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.290+0000 7f556f7fe640 1 -- 10.20.193.57:0/1752006866 <== mon.2 v2:10.20.193.57:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5578004cd0 con 0x7f5590081780 2026-02-20T16:31:06.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.290+0000 7f559563d640 1 -- 10.20.193.57:0/1752006866 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f5590147230 con 0x7f5590081780 2026-02-20T16:31:06.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.290+0000 7f559563d640 1 -- 10.20.193.57:0/1752006866 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5590081240 con 0x7f5590081780 2026-02-20T16:31:06.300 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.291+0000 7f556f7fe640 1 -- 10.20.193.57:0/1752006866 <== mon.2 v2:10.20.193.57:3302/0 4 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7f5578004080 con 0x7f5590081780 2026-02-20T16:31:06.300 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.291+0000 7f556f7fe640 1 -- 10.20.193.57:0/1752006866 <== mon.2 v2:10.20.193.57:3302/0 5 ==== osd_map(30..30 src has 1..30) ==== 3026+0+0 (secure 0 0 0) 0x7f55780640e0 con 0x7f5590081780 2026-02-20T16:31:06.300 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.291+0000 7f556f7fe640 1 -- 10.20.193.57:0/1752006866 --> v1:10.20.193.57:6801/4246367706 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5578017e50 con 0x7f555c071400 2026-02-20T16:31:06.300 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.291+0000 7f556f7fe640 1 -- 10.20.193.57:0/1752006866 <== mon.2 v2:10.20.193.57:3302/0 6 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f557806b050 con 0x7f5590081780 2026-02-20T16:31:06.300 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.291+0000 7f556f7fe640 1 -- 10.20.193.57:0/1752006866 <== osd.0 v1:10.20.193.57:6801/4246367706 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f5578017e50 con 0x7f555c071400 2026-02-20T16:31:06.301 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.299+0000 7f559563d640 1 -- 10.20.193.57:0/1752006866 --> v1:10.20.193.57:6801/4246367706 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f559012bbd0 con 0x7f555c071400 2026-02-20T16:31:06.301 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.299+0000 7f556f7fe640 1 -- 10.20.193.57:0/1752006866 <== osd.0 v1:10.20.193.57:6801/4246367706 2 ==== command_reply(tid 2: 0 ) ==== 8+0+712 (unknown 0 0 714369635) 0x7f559012bbd0 con 0x7f555c071400 2026-02-20T16:31:06.301 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-20T16:31:06.301 INFO:teuthology.orchestra.run.trial057.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-20T16:31:06.302 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-20T16:31:06.303 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.299+0000 7f559563d640 1 -- 10.20.193.57:0/1752006866 >> v1:10.20.193.57:6801/4246367706 conn(0x7f555c071400 legacy=0x7f555c091830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:06.303 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.299+0000 7f559563d640 1 -- 10.20.193.57:0/1752006866 >> v1:10.20.193.57:6800/2007744879 conn(0x7f555c04cae0 legacy=0x7f555c06cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:06.303 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.300+0000 7f559563d640 1 -- 10.20.193.57:0/1752006866 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f5590081780 msgr2=0x7f5590146cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:06.303 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.300+0000 7f559563d640 1 --2- 10.20.193.57:0/1752006866 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f5590081780 0x7f5590146cf0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f55780094b0 tx=0x7f557800ee60 comp rx=0 tx=0).stop 2026-02-20T16:31:06.303 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.300+0000 7f558f7fe640 1 -- 10.20.193.57:0/1752006866 reap_dead start 2026-02-20T16:31:06.303 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.300+0000 7f559563d640 1 -- 10.20.193.57:0/1752006866 shutdown_connections 2026-02-20T16:31:06.303 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.300+0000 7f559563d640 1 -- 10.20.193.57:0/1752006866 >> 10.20.193.57:0/1752006866 conn(0x7f55900843d0 msgr2=0x7f55900757b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:06.303 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.300+0000 7f559563d640 1 -- 10.20.193.57:0/1752006866 shutdown_connections 2026-02-20T16:31:06.304 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.300+0000 7f559563d640 1 -- 10.20.193.57:0/1752006866 wait complete. 2026-02-20T16:31:06.307 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-20T16:31:06.380 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.375+0000 7f56cb261640 1 -- 10.20.193.57:0/2787355265 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f56c4086560 msgr2=0x7f56c4086930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:06.380 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.375+0000 7f56cb261640 1 --2- 10.20.193.57:0/2787355265 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f56c4086560 0x7f56c4086930 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f56b4005ea0 tx=0x7f56b402f1d0 comp rx=0 tx=0).stop 2026-02-20T16:31:06.380 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.375+0000 7f56cb261640 1 -- 10.20.193.57:0/2787355265 shutdown_connections 2026-02-20T16:31:06.380 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.375+0000 7f56cb261640 1 --2- 10.20.193.57:0/2787355265 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f56c4087260 0x7f56c4134220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:06.380 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.375+0000 7f56cb261640 1 --2- 10.20.193.57:0/2787355265 >> v2:10.20.193.57:3300/0 conn(0x7f56c4086e70 0x7f56c4133ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:06.380 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.375+0000 7f56cb261640 1 --2- 10.20.193.57:0/2787355265 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f56c4086560 0x7f56c4086930 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:06.381 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.375+0000 7f56cb261640 1 -- 10.20.193.57:0/2787355265 >> 10.20.193.57:0/2787355265 conn(0x7f56c4089230 msgr2=0x7f56c405a910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:06.381 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.375+0000 7f56cb261640 1 -- 10.20.193.57:0/2787355265 shutdown_connections 2026-02-20T16:31:06.381 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.375+0000 7f56cb261640 1 -- 10.20.193.57:0/2787355265 wait complete. 2026-02-20T16:31:06.381 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.376+0000 7f56cb261640 1 Processor -- start 2026-02-20T16:31:06.381 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.376+0000 7f56cb261640 1 -- start start 2026-02-20T16:31:06.381 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.376+0000 7f56cb261640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f56c4086560 0x7f56c4058680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:06.381 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.376+0000 7f56cb261640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f56c4086e70 0x7f56c4058bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:06.381 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.376+0000 7f56cb261640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f56c4087260 0x7f56c4059100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:06.381 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.376+0000 7f56cb261640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f56c4195910 con 0x7f56c4087260 2026-02-20T16:31:06.382 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.376+0000 7f56cb261640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f56c4195790 con 0x7f56c4086560 2026-02-20T16:31:06.382 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.376+0000 7f56cb261640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f56c4195a90 con 0x7f56c4086e70 2026-02-20T16:31:06.382 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.376+0000 7f56c8fd6640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f56c4086560 0x7f56c4058680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:06.382 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.376+0000 7f56bbfff640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f56c4086e70 0x7f56c4058bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:06.382 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.376+0000 7f56c8fd6640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f56c4086560 0x7f56c4058680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3301/0 says I am v2:10.20.193.57:53914/0 (socket says 10.20.193.57:53914) 2026-02-20T16:31:06.382 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.376+0000 7f56c8fd6640 1 -- 10.20.193.57:0/1178357116 learned_addr learned my addr 10.20.193.57:0/1178357116 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:31:06.382 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.376+0000 7f56c97d7640 1 --2- 10.20.193.57:0/1178357116 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f56c4087260 0x7f56c4059100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:06.382 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.376+0000 7f56c8fd6640 1 -- 10.20.193.57:0/1178357116 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f56c4086e70 msgr2=0x7f56c4058bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:06.382 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.376+0000 7f56c8fd6640 1 --2- 10.20.193.57:0/1178357116 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f56c4086e70 0x7f56c4058bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:06.382 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.376+0000 7f56c8fd6640 1 -- 10.20.193.57:0/1178357116 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f56c4087260 msgr2=0x7f56c4059100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:06.382 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.376+0000 7f56c8fd6640 1 --2- 10.20.193.57:0/1178357116 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f56c4087260 0x7f56c4059100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:06.383 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.376+0000 7f56c8fd6640 1 -- 10.20.193.57:0/1178357116 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56c4109450 con 0x7f56c4086560 2026-02-20T16:31:06.383 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.376+0000 7f56c8fd6640 1 --2- 10.20.193.57:0/1178357116 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f56c4086560 0x7f56c4058680 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f56b402fe20 tx=0x7f56b4002900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:31:06.383 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.376+0000 7f56b97fa640 1 -- 10.20.193.57:0/1178357116 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b4046070 con 0x7f56c4086560 2026-02-20T16:31:06.383 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.376+0000 7f56b97fa640 1 -- 10.20.193.57:0/1178357116 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f56b40045b0 con 0x7f56c4086560 2026-02-20T16:31:06.383 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.376+0000 7f56cb261640 1 -- 10.20.193.57:0/1178357116 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56c4108a90 con 0x7f56c4086560 2026-02-20T16:31:06.383 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.376+0000 7f56b97fa640 1 -- 10.20.193.57:0/1178357116 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b4038470 con 0x7f56c4086560 2026-02-20T16:31:06.383 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.376+0000 7f56cb261640 1 -- 10.20.193.57:0/1178357116 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f56c4114690 con 0x7f56c4086560 2026-02-20T16:31:06.383 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.377+0000 7f56cb261640 1 -- 10.20.193.57:0/1178357116 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56c4100300 con 0x7f56c4086560 2026-02-20T16:31:06.383 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.377+0000 7f56b97fa640 1 -- 10.20.193.57:0/1178357116 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7f56b4038610 con 0x7f56c4086560 2026-02-20T16:31:06.383 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.377+0000 7f56b97fa640 1 -- 10.20.193.57:0/1178357116 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(30..30 src has 1..30) ==== 3026+0+0 (secure 0 0 0) 0x7f56b4087d90 con 0x7f56c4086560 2026-02-20T16:31:06.384 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.379+0000 7f56b97fa640 1 -- 10.20.193.57:0/1178357116 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7f56c4100300 con 0x7f56c4086560 2026-02-20T16:31:06.456 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.454+0000 7f56cb261640 1 -- 10.20.193.57:0/1178357116 --> v1:10.20.193.57:6800/2007744879 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f56c4053100 con 0x7f569404cae0 2026-02-20T16:31:06.457 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.455+0000 7f56b97fa640 1 -- 10.20.193.57:0/1178357116 <== mgr.14109 v1:10.20.193.57:6800/2007744879 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (unknown 2057319476 0 0) 0x7f56c4053100 con 0x7f569404cae0 2026-02-20T16:31:06.457 INFO:teuthology.orchestra.run.trial057.stderr:instructed osd(s) 0 to deep-scrub 2026-02-20T16:31:06.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.455+0000 7f56cb261640 1 -- 10.20.193.57:0/1178357116 >> v1:10.20.193.57:6800/2007744879 conn(0x7f569404cae0 legacy=0x7f569406cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:06.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.455+0000 7f56cb261640 1 -- 10.20.193.57:0/1178357116 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f56c4086560 msgr2=0x7f56c4058680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:06.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.455+0000 7f56cb261640 1 --2- 10.20.193.57:0/1178357116 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f56c4086560 0x7f56c4058680 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f56b402fe20 tx=0x7f56b4002900 comp rx=0 tx=0).stop 2026-02-20T16:31:06.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.455+0000 7f56cb261640 1 -- 10.20.193.57:0/1178357116 shutdown_connections 2026-02-20T16:31:06.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.455+0000 7f56cb261640 1 --2- 10.20.193.57:0/1178357116 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f56c4087260 0x7f56c4059100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:06.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.455+0000 7f56cb261640 1 --2- 10.20.193.57:0/1178357116 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f56c4086e70 0x7f56c4058bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:06.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.455+0000 7f56cb261640 1 --2- 10.20.193.57:0/1178357116 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f56c4086560 0x7f56c4058680 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:06.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.455+0000 7f56cb261640 1 -- 10.20.193.57:0/1178357116 >> 10.20.193.57:0/1178357116 conn(0x7f56c4089230 msgr2=0x7f56c4114b10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:06.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.456+0000 7f56cb261640 1 -- 10.20.193.57:0/1178357116 shutdown_connections 2026-02-20T16:31:06.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.456+0000 7f56cb261640 1 -- 10.20.193.57:0/1178357116 wait complete. 2026-02-20T16:31:06.465 INFO:tasks.ceph:Scrubbing osd.1 2026-02-20T16:31:06.466 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-20T16:31:06.542 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.536+0000 7fc362222640 1 -- 10.20.193.57:0/3489374547 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fc35c081780 msgr2=0x7fc35c136230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:06.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.536+0000 7fc362222640 1 --2- 10.20.193.57:0/3489374547 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fc35c081780 0x7fc35c136230 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc34c0098c0 tx=0x7fc34c02f110 comp rx=0 tx=0).stop 2026-02-20T16:31:06.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.536+0000 7fc362222640 1 -- 10.20.193.57:0/3489374547 shutdown_connections 2026-02-20T16:31:06.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.536+0000 7fc362222640 1 --2- 10.20.193.57:0/3489374547 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fc35c081780 0x7fc35c136230 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:06.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.536+0000 7fc362222640 1 --2- 10.20.193.57:0/3489374547 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fc35c080e70 0x7fc35c081240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:06.544 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.536+0000 7fc362222640 1 -- 10.20.193.57:0/3489374547 >> 10.20.193.57:0/3489374547 conn(0x7fc35c0843d0 msgr2=0x7fc35c0847d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:06.544 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.536+0000 7fc362222640 1 -- 10.20.193.57:0/3489374547 shutdown_connections 2026-02-20T16:31:06.544 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.536+0000 7fc362222640 1 -- 10.20.193.57:0/3489374547 wait complete. 2026-02-20T16:31:06.544 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.536+0000 7fc362222640 1 Processor -- start 2026-02-20T16:31:06.544 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.536+0000 7fc362222640 1 -- start start 2026-02-20T16:31:06.544 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.536+0000 7fc362222640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fc35c080e70 0x7fc35c10b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:06.545 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.536+0000 7fc362222640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fc35c081780 0x7fc35c10bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:06.545 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.536+0000 7fc362222640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fc35c136770 0x7fc35c1258f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:06.545 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.536+0000 7fc362222640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7fc35c198d20 con 0x7fc35c081780 2026-02-20T16:31:06.545 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.536+0000 7fc362222640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7fc35c198ba0 con 0x7fc35c136770 2026-02-20T16:31:06.545 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.536+0000 7fc362222640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7fc35c198ea0 con 0x7fc35c080e70 2026-02-20T16:31:06.545 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.536+0000 7fc35b7fe640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fc35c080e70 0x7fc35c10b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:06.545 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.536+0000 7fc35affd640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fc35c081780 0x7fc35c10bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:06.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.536+0000 7fc35b7fe640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fc35c080e70 0x7fc35c10b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3302/0 says I am v2:10.20.193.57:45062/0 (socket says 10.20.193.57:45062) 2026-02-20T16:31:06.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.536+0000 7fc35bfff640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fc35c136770 0x7fc35c1258f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:06.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.536+0000 7fc35b7fe640 1 -- 10.20.193.57:0/3341153546 learned_addr learned my addr 10.20.193.57:0/3341153546 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:31:06.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.537+0000 7fc35bfff640 1 -- 10.20.193.57:0/3341153546 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fc35c080e70 msgr2=0x7fc35c10b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:06.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.537+0000 7fc35bfff640 1 --2- 10.20.193.57:0/3341153546 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fc35c080e70 0x7fc35c10b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:06.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.537+0000 7fc35bfff640 1 -- 10.20.193.57:0/3341153546 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fc35c081780 msgr2=0x7fc35c10bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:06.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.537+0000 7fc35bfff640 1 --2- 10.20.193.57:0/3341153546 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fc35c081780 0x7fc35c10bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:06.547 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.537+0000 7fc35bfff640 1 -- 10.20.193.57:0/3341153546 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc35c10cf30 con 0x7fc35c136770 2026-02-20T16:31:06.547 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.537+0000 7fc35b7fe640 1 --2- 10.20.193.57:0/3341153546 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fc35c080e70 0x7fc35c10b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:31:06.547 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.537+0000 7fc35affd640 1 --2- 10.20.193.57:0/3341153546 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fc35c081780 0x7fc35c10bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:31:06.547 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.537+0000 7fc35bfff640 1 --2- 10.20.193.57:0/3341153546 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fc35c136770 0x7fc35c1258f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc350002bb0 tx=0x7fc35000cc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:31:06.547 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.537+0000 7fc337fff640 1 -- 10.20.193.57:0/3341153546 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc350017070 con 0x7fc35c136770 2026-02-20T16:31:06.547 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.537+0000 7fc337fff640 1 -- 10.20.193.57:0/3341153546 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc35000a640 con 0x7fc35c136770 2026-02-20T16:31:06.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.537+0000 7fc362222640 1 -- 10.20.193.57:0/3341153546 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc35c05cea0 con 0x7fc35c136770 2026-02-20T16:31:06.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.537+0000 7fc337fff640 1 -- 10.20.193.57:0/3341153546 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc35000aa70 con 0x7fc35c136770 2026-02-20T16:31:06.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.537+0000 7fc362222640 1 -- 10.20.193.57:0/3341153546 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc35c10c250 con 0x7fc35c136770 2026-02-20T16:31:06.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.537+0000 7fc362222640 1 -- 10.20.193.57:0/3341153546 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc35c081240 con 0x7fc35c136770 2026-02-20T16:31:06.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.538+0000 7fc337fff640 1 -- 10.20.193.57:0/3341153546 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7fc35000ac10 con 0x7fc35c136770 2026-02-20T16:31:06.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.538+0000 7fc337fff640 1 -- 10.20.193.57:0/3341153546 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(30..30 src has 1..30) ==== 3026+0+0 (secure 0 0 0) 0x7fc350063260 con 0x7fc35c136770 2026-02-20T16:31:06.549 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.538+0000 7fc337fff640 1 -- 10.20.193.57:0/3341153546 --> v1:10.20.193.57:6805/3794545817 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc35001ce50 con 0x7fc32c071400 2026-02-20T16:31:06.549 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.538+0000 7fc337fff640 1 -- 10.20.193.57:0/3341153546 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc35006a050 con 0x7fc35c136770 2026-02-20T16:31:06.549 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.539+0000 7fc337fff640 1 -- 10.20.193.57:0/3341153546 <== osd.1 v1:10.20.193.57:6805/3794545817 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fc35001ce50 con 0x7fc32c071400 2026-02-20T16:31:06.550 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.546+0000 7fc362222640 1 -- 10.20.193.57:0/3341153546 --> v1:10.20.193.57:6805/3794545817 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc35c126080 con 0x7fc32c071400 2026-02-20T16:31:06.550 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.547+0000 7fc337fff640 1 -- 10.20.193.57:0/3341153546 <== osd.1 v1:10.20.193.57:6805/3794545817 2 ==== command_reply(tid 2: 0 ) ==== 8+0+712 (unknown 0 0 714369635) 0x7fc34c0332d0 con 0x7fc32c071400 2026-02-20T16:31:06.551 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-20T16:31:06.551 INFO:teuthology.orchestra.run.trial057.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-20T16:31:06.551 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-20T16:31:06.553 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.547+0000 7fc362222640 1 -- 10.20.193.57:0/3341153546 >> v1:10.20.193.57:6805/3794545817 conn(0x7fc32c071400 legacy=0x7fc32c091830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:06.553 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.547+0000 7fc362222640 1 -- 10.20.193.57:0/3341153546 >> v1:10.20.193.57:6800/2007744879 conn(0x7fc32c04cae0 legacy=0x7fc32c06cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:06.554 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.547+0000 7fc362222640 1 -- 10.20.193.57:0/3341153546 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fc35c136770 msgr2=0x7fc35c1258f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:06.554 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.547+0000 7fc362222640 1 --2- 10.20.193.57:0/3341153546 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fc35c136770 0x7fc35c1258f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc350002bb0 tx=0x7fc35000cc80 comp rx=0 tx=0).stop 2026-02-20T16:31:06.554 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.547+0000 7fc35bfff640 1 -- 10.20.193.57:0/3341153546 reap_dead start 2026-02-20T16:31:06.554 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.547+0000 7fc362222640 1 -- 10.20.193.57:0/3341153546 shutdown_connections 2026-02-20T16:31:06.554 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.547+0000 7fc362222640 1 -- 10.20.193.57:0/3341153546 >> 10.20.193.57:0/3341153546 conn(0x7fc35c0843d0 msgr2=0x7fc35c075cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:06.554 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.547+0000 7fc362222640 1 -- 10.20.193.57:0/3341153546 shutdown_connections 2026-02-20T16:31:06.555 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.547+0000 7fc362222640 1 -- 10.20.193.57:0/3341153546 wait complete. 2026-02-20T16:31:06.557 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-20T16:31:06.628 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.624+0000 7f392f64a640 1 -- 10.20.193.57:0/1101117703 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f3928174330 msgr2=0x7f3928194710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:06.628 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.624+0000 7f392f64a640 1 --2- 10.20.193.57:0/1101117703 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f3928174330 0x7f3928194710 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3924009f10 tx=0x7f392402f410 comp rx=0 tx=0).stop 2026-02-20T16:31:06.628 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.624+0000 7f392f64a640 1 -- 10.20.193.57:0/1101117703 shutdown_connections 2026-02-20T16:31:06.628 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.624+0000 7f392f64a640 1 --2- 10.20.193.57:0/1101117703 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f3928174330 0x7f3928194710 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:06.628 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.624+0000 7f392f64a640 1 --2- 10.20.193.57:0/1101117703 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f3928085b90 0x7f392807d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:06.628 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.624+0000 7f392f64a640 1 -- 10.20.193.57:0/1101117703 >> 10.20.193.57:0/1101117703 conn(0x7f39280833e0 msgr2=0x7f39280840b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:06.629 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.624+0000 7f392f64a640 1 -- 10.20.193.57:0/1101117703 shutdown_connections 2026-02-20T16:31:06.629 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.624+0000 7f392f64a640 1 -- 10.20.193.57:0/1101117703 wait complete. 2026-02-20T16:31:06.629 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.625+0000 7f392f64a640 1 Processor -- start 2026-02-20T16:31:06.629 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.625+0000 7f392f64a640 1 -- start start 2026-02-20T16:31:06.629 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.625+0000 7f392f64a640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f392807dc60 0x7f392811fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:06.629 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.625+0000 7f392f64a640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f3928085b90 0x7f39281203c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:06.629 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.625+0000 7f392f64a640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f3928174330 0x7f3928123240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:06.629 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.625+0000 7f392f64a640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f39281957c0 con 0x7f3928085b90 2026-02-20T16:31:06.629 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.625+0000 7f392f64a640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f3928195640 con 0x7f3928174330 2026-02-20T16:31:06.629 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.625+0000 7f392f64a640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f3928195940 con 0x7f392807dc60 2026-02-20T16:31:06.629 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.625+0000 7f392dbc0640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f3928174330 0x7f3928123240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:06.629 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.625+0000 7f392d3bf640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f392807dc60 0x7f392811fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:06.629 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.625+0000 7f392cbbe640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f3928085b90 0x7f39281203c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:06.629 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.625+0000 7f392dbc0640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f3928174330 0x7f3928123240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3301/0 says I am v2:10.20.193.57:53952/0 (socket says 10.20.193.57:53952) 2026-02-20T16:31:06.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.625+0000 7f392dbc0640 1 -- 10.20.193.57:0/62507352 learned_addr learned my addr 10.20.193.57:0/62507352 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:31:06.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.625+0000 7f392dbc0640 1 -- 10.20.193.57:0/62507352 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f392807dc60 msgr2=0x7f392811fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:06.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.625+0000 7f392dbc0640 1 --2- 10.20.193.57:0/62507352 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f392807dc60 0x7f392811fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:06.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.625+0000 7f392dbc0640 1 -- 10.20.193.57:0/62507352 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f3928085b90 msgr2=0x7f39281203c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:06.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.625+0000 7f392dbc0640 1 --2- 10.20.193.57:0/62507352 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f3928085b90 0x7f39281203c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:06.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.625+0000 7f392dbc0640 1 -- 10.20.193.57:0/62507352 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f392810c620 con 0x7f3928174330 2026-02-20T16:31:06.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.625+0000 7f392dbc0640 1 --2- 10.20.193.57:0/62507352 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f3928174330 0x7f3928123240 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f392400c090 tx=0x7f3924002c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:31:06.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.626+0000 7f3915ffb640 1 -- 10.20.193.57:0/62507352 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39240040c0 con 0x7f3928174330 2026-02-20T16:31:06.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.626+0000 7f3915ffb640 1 -- 10.20.193.57:0/62507352 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3924004280 con 0x7f3928174330 2026-02-20T16:31:06.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.626+0000 7f392f64a640 1 -- 10.20.193.57:0/62507352 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f392810c1e0 con 0x7f3928174330 2026-02-20T16:31:06.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.626+0000 7f3915ffb640 1 -- 10.20.193.57:0/62507352 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39240046d0 con 0x7f3928174330 2026-02-20T16:31:06.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.626+0000 7f392f64a640 1 -- 10.20.193.57:0/62507352 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3928120ae0 con 0x7f3928174330 2026-02-20T16:31:06.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.626+0000 7f392f64a640 1 -- 10.20.193.57:0/62507352 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f392807e130 con 0x7f3928174330 2026-02-20T16:31:06.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.626+0000 7f3915ffb640 1 -- 10.20.193.57:0/62507352 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7f3924007420 con 0x7f3928174330 2026-02-20T16:31:06.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.626+0000 7f3915ffb640 1 -- 10.20.193.57:0/62507352 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(30..30 src has 1..30) ==== 3026+0+0 (secure 0 0 0) 0x7f3924087a60 con 0x7f3928174330 2026-02-20T16:31:06.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.628+0000 7f3915ffb640 1 -- 10.20.193.57:0/62507352 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7f392807e130 con 0x7f3928174330 2026-02-20T16:31:06.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.705+0000 7f392f64a640 1 -- 10.20.193.57:0/62507352 --> v1:10.20.193.57:6800/2007744879 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f392807d720 con 0x7f38f804cae0 2026-02-20T16:31:06.708 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.706+0000 7f3915ffb640 1 -- 10.20.193.57:0/62507352 <== mgr.14109 v1:10.20.193.57:6800/2007744879 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (unknown 489605429 0 0) 0x7f392807d720 con 0x7f38f804cae0 2026-02-20T16:31:06.708 INFO:teuthology.orchestra.run.trial057.stderr:instructed osd(s) 1 to deep-scrub 2026-02-20T16:31:06.709 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.707+0000 7f392f64a640 1 -- 10.20.193.57:0/62507352 >> v1:10.20.193.57:6800/2007744879 conn(0x7f38f804cae0 legacy=0x7f38f806cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:06.709 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.707+0000 7f392f64a640 1 -- 10.20.193.57:0/62507352 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f3928174330 msgr2=0x7f3928123240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:06.709 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.707+0000 7f392f64a640 1 --2- 10.20.193.57:0/62507352 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f3928174330 0x7f3928123240 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f392400c090 tx=0x7f3924002c80 comp rx=0 tx=0).stop 2026-02-20T16:31:06.710 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.707+0000 7f392f64a640 1 -- 10.20.193.57:0/62507352 shutdown_connections 2026-02-20T16:31:06.710 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.707+0000 7f392f64a640 1 --2- 10.20.193.57:0/62507352 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f3928174330 0x7f3928123240 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:06.710 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.707+0000 7f392f64a640 1 --2- 10.20.193.57:0/62507352 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f3928085b90 0x7f39281203c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:06.710 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.707+0000 7f392f64a640 1 --2- 10.20.193.57:0/62507352 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f392807dc60 0x7f392811fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:06.710 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.707+0000 7f392f64a640 1 -- 10.20.193.57:0/62507352 >> 10.20.193.57:0/62507352 conn(0x7f39280833e0 msgr2=0x7f392805c080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:06.710 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.707+0000 7f392f64a640 1 -- 10.20.193.57:0/62507352 shutdown_connections 2026-02-20T16:31:06.710 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.707+0000 7f392f64a640 1 -- 10.20.193.57:0/62507352 wait complete. 2026-02-20T16:31:06.717 INFO:tasks.ceph:Scrubbing osd.2 2026-02-20T16:31:06.717 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-20T16:31:06.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.787+0000 7fc622486640 1 -- 10.20.193.57:0/1524603650 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fc61c1346f0 msgr2=0x7fc61c195f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:06.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.787+0000 7fc622486640 1 --2- 10.20.193.57:0/1524603650 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fc61c1346f0 0x7fc61c195f20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc610009750 tx=0x7fc61002f450 comp rx=0 tx=0).stop 2026-02-20T16:31:06.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.787+0000 7fc622486640 1 -- 10.20.193.57:0/1524603650 shutdown_connections 2026-02-20T16:31:06.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.787+0000 7fc622486640 1 --2- 10.20.193.57:0/1524603650 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fc61c1346f0 0x7fc61c195f20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:06.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.787+0000 7fc622486640 1 --2- 10.20.193.57:0/1524603650 >> v2:10.20.193.57:3300/0 conn(0x7fc61c130cc0 0x7fc61c131090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:06.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.787+0000 7fc622486640 1 -- 10.20.193.57:0/1524603650 >> 10.20.193.57:0/1524603650 conn(0x7fc61c0843d0 msgr2=0x7fc61c0847d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:06.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.787+0000 7fc622486640 1 -- 10.20.193.57:0/1524603650 shutdown_connections 2026-02-20T16:31:06.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.787+0000 7fc622486640 1 -- 10.20.193.57:0/1524603650 wait complete. 2026-02-20T16:31:06.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.787+0000 7fc622486640 1 Processor -- start 2026-02-20T16:31:06.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.788+0000 7fc622486640 1 -- start start 2026-02-20T16:31:06.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.788+0000 7fc622486640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fc61c130cc0 0x7fc61c07e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:06.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.788+0000 7fc622486640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fc61c133b80 0x7fc61c05c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:06.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.788+0000 7fc622486640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fc61c1346f0 0x7fc61c05c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:06.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.788+0000 7fc622486640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7fc61c196c60 con 0x7fc61c133b80 2026-02-20T16:31:06.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.788+0000 7fc622486640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7fc61c196ae0 con 0x7fc61c1346f0 2026-02-20T16:31:06.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.788+0000 7fc622486640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7fc61c196de0 con 0x7fc61c130cc0 2026-02-20T16:31:06.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.788+0000 7fc61b7fe640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fc61c133b80 0x7fc61c05c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:06.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.788+0000 7fc6209fc640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fc61c1346f0 0x7fc61c05c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:06.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.788+0000 7fc61b7fe640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fc61c133b80 0x7fc61c05c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:52996/0 (socket says 10.20.193.57:52996) 2026-02-20T16:31:06.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.788+0000 7fc6209fc640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fc61c1346f0 0x7fc61c05c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3301/0 says I am v2:10.20.193.57:53960/0 (socket says 10.20.193.57:53960) 2026-02-20T16:31:06.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.788+0000 7fc61bfff640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fc61c130cc0 0x7fc61c07e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:06.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.788+0000 7fc61b7fe640 1 -- 10.20.193.57:0/810730431 learned_addr learned my addr 10.20.193.57:0/810730431 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:31:06.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.788+0000 7fc61b7fe640 1 -- 10.20.193.57:0/810730431 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fc61c130cc0 msgr2=0x7fc61c07e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:06.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.788+0000 7fc61b7fe640 1 --2- 10.20.193.57:0/810730431 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fc61c130cc0 0x7fc61c07e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:06.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.788+0000 7fc61b7fe640 1 -- 10.20.193.57:0/810730431 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fc61c1346f0 msgr2=0x7fc61c05c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:06.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.788+0000 7fc61b7fe640 1 --2- 10.20.193.57:0/810730431 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fc61c1346f0 0x7fc61c05c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:06.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.788+0000 7fc61b7fe640 1 -- 10.20.193.57:0/810730431 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc61c12e370 con 0x7fc61c133b80 2026-02-20T16:31:06.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.788+0000 7fc61b7fe640 1 --2- 10.20.193.57:0/810730431 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fc61c133b80 0x7fc61c05c340 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc60c007fd0 tx=0x7fc60c00cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:31:06.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.788+0000 7fc618ff9640 1 -- 10.20.193.57:0/810730431 <== mon.0 v2:10.20.193.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc60c0052d0 con 0x7fc61c133b80 2026-02-20T16:31:06.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.788+0000 7fc618ff9640 1 -- 10.20.193.57:0/810730431 <== mon.0 v2:10.20.193.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc60c005470 con 0x7fc61c133b80 2026-02-20T16:31:06.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.788+0000 7fc622486640 1 -- 10.20.193.57:0/810730431 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc61c07cf00 con 0x7fc61c133b80 2026-02-20T16:31:06.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.788+0000 7fc618ff9640 1 -- 10.20.193.57:0/810730431 <== mon.0 v2:10.20.193.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc60c003940 con 0x7fc61c133b80 2026-02-20T16:31:06.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.788+0000 7fc622486640 1 -- 10.20.193.57:0/810730431 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc61c05b790 con 0x7fc61c133b80 2026-02-20T16:31:06.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.789+0000 7fc622486640 1 -- 10.20.193.57:0/810730431 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc61c05c130 con 0x7fc61c133b80 2026-02-20T16:31:06.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.789+0000 7fc618ff9640 1 -- 10.20.193.57:0/810730431 <== mon.0 v2:10.20.193.57:3300/0 4 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7fc60c003ae0 con 0x7fc61c133b80 2026-02-20T16:31:06.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.789+0000 7fc618ff9640 1 -- 10.20.193.57:0/810730431 <== mon.0 v2:10.20.193.57:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3026+0+0 (secure 0 0 0) 0x7fc60c063370 con 0x7fc61c133b80 2026-02-20T16:31:06.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.789+0000 7fc618ff9640 1 -- 10.20.193.57:0/810730431 --> v1:10.20.193.57:6809/3959776128 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc5ec0930a0 con 0x7fc5ec071400 2026-02-20T16:31:06.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.789+0000 7fc618ff9640 1 -- 10.20.193.57:0/810730431 <== mon.0 v2:10.20.193.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc60c06a050 con 0x7fc61c133b80 2026-02-20T16:31:06.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.790+0000 7fc618ff9640 1 -- 10.20.193.57:0/810730431 <== osd.2 v1:10.20.193.57:6809/3959776128 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fc5ec0930a0 con 0x7fc5ec071400 2026-02-20T16:31:06.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.797+0000 7fc622486640 1 -- 10.20.193.57:0/810730431 --> v1:10.20.193.57:6809/3959776128 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc61c05d010 con 0x7fc5ec071400 2026-02-20T16:31:06.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.797+0000 7fc618ff9640 1 -- 10.20.193.57:0/810730431 <== osd.2 v1:10.20.193.57:6809/3959776128 2 ==== command_reply(tid 2: 0 ) ==== 8+0+712 (unknown 0 0 714369635) 0x7fc6100332d0 con 0x7fc5ec071400 2026-02-20T16:31:06.799 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-20T16:31:06.799 INFO:teuthology.orchestra.run.trial057.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-20T16:31:06.799 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-20T16:31:06.800 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.797+0000 7fc622486640 1 -- 10.20.193.57:0/810730431 >> v1:10.20.193.57:6809/3959776128 conn(0x7fc5ec071400 legacy=0x7fc5ec091830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:06.800 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.797+0000 7fc622486640 1 -- 10.20.193.57:0/810730431 >> v1:10.20.193.57:6800/2007744879 conn(0x7fc5ec04cae0 legacy=0x7fc5ec06cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:06.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.797+0000 7fc622486640 1 -- 10.20.193.57:0/810730431 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fc61c133b80 msgr2=0x7fc61c05c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:06.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.797+0000 7fc622486640 1 --2- 10.20.193.57:0/810730431 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fc61c133b80 0x7fc61c05c340 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc60c007fd0 tx=0x7fc60c00cba0 comp rx=0 tx=0).stop 2026-02-20T16:31:06.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.797+0000 7fc6209fc640 1 -- 10.20.193.57:0/810730431 reap_dead start 2026-02-20T16:31:06.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.797+0000 7fc622486640 1 -- 10.20.193.57:0/810730431 shutdown_connections 2026-02-20T16:31:06.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.798+0000 7fc622486640 1 -- 10.20.193.57:0/810730431 >> 10.20.193.57:0/810730431 conn(0x7fc61c0843d0 msgr2=0x7fc61c12e580 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:06.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.798+0000 7fc622486640 1 -- 10.20.193.57:0/810730431 shutdown_connections 2026-02-20T16:31:06.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.798+0000 7fc622486640 1 -- 10.20.193.57:0/810730431 wait complete. 2026-02-20T16:31:06.805 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-20T16:31:06.876 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.872+0000 7f947ab3a640 1 -- 10.20.193.57:0/3287899070 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f947405c060 msgr2=0x7f947405c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:06.876 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.872+0000 7f947ab3a640 1 --2- 10.20.193.57:0/3287899070 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f947405c060 0x7f947405c430 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9464004770 tx=0x7f946402f0e0 comp rx=0 tx=0).stop 2026-02-20T16:31:06.877 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.872+0000 7f947ab3a640 1 -- 10.20.193.57:0/3287899070 shutdown_connections 2026-02-20T16:31:06.877 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.872+0000 7f947ab3a640 1 --2- 10.20.193.57:0/3287899070 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f9474177a70 0x7f9474197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:06.877 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.872+0000 7f947ab3a640 1 --2- 10.20.193.57:0/3287899070 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f947405c060 0x7f947405c430 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:06.877 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.872+0000 7f947ab3a640 1 -- 10.20.193.57:0/3287899070 >> 10.20.193.57:0/3287899070 conn(0x7f94740833e0 msgr2=0x7f94740840b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:06.877 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.872+0000 7f947ab3a640 1 -- 10.20.193.57:0/3287899070 shutdown_connections 2026-02-20T16:31:06.877 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.872+0000 7f947ab3a640 1 -- 10.20.193.57:0/3287899070 wait complete. 2026-02-20T16:31:06.877 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.872+0000 7f947ab3a640 1 Processor -- start 2026-02-20T16:31:06.877 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.872+0000 7f947ab3a640 1 -- start start 2026-02-20T16:31:06.877 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.872+0000 7f947ab3a640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f947405c060 0x7f947418f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:06.878 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.872+0000 7f947ab3a640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f947405c970 0x7f947418f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:06.878 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.872+0000 7f947ab3a640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f9474177a70 0x7f947418fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:06.878 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.872+0000 7f947ab3a640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f9474198e10 con 0x7f947405c970 2026-02-20T16:31:06.878 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.872+0000 7f947ab3a640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f9474198c90 con 0x7f9474177a70 2026-02-20T16:31:06.878 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.873+0000 7f947ab3a640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f9474198f90 con 0x7f947405c060 2026-02-20T16:31:06.878 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.873+0000 7f94788af640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f947405c060 0x7f947418f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:06.878 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.873+0000 7f946bfff640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f947405c970 0x7f947418f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:06.878 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.873+0000 7f94788af640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f947405c060 0x7f947418f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3302/0 says I am v2:10.20.193.57:45114/0 (socket says 10.20.193.57:45114) 2026-02-20T16:31:06.878 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.873+0000 7f94788af640 1 -- 10.20.193.57:0/1713735502 learned_addr learned my addr 10.20.193.57:0/1713735502 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:31:06.878 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.873+0000 7f94790b0640 1 --2- 10.20.193.57:0/1713735502 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f9474177a70 0x7f947418fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:06.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.873+0000 7f94788af640 1 -- 10.20.193.57:0/1713735502 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f9474177a70 msgr2=0x7f947418fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:06.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.873+0000 7f94788af640 1 --2- 10.20.193.57:0/1713735502 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f9474177a70 0x7f947418fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:06.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.873+0000 7f94788af640 1 -- 10.20.193.57:0/1713735502 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f947405c970 msgr2=0x7f947418f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:06.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.873+0000 7f94788af640 1 --2- 10.20.193.57:0/1713735502 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f947405c970 0x7f947418f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:06.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.873+0000 7f94788af640 1 -- 10.20.193.57:0/1713735502 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f947417b630 con 0x7f947405c060 2026-02-20T16:31:06.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.873+0000 7f94788af640 1 --2- 10.20.193.57:0/1713735502 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f947405c060 0x7f947418f0b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9464009230 tx=0x7f9464002900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:31:06.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.873+0000 7f94697fa640 1 -- 10.20.193.57:0/1713735502 <== mon.2 v2:10.20.193.57:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9464046070 con 0x7f947405c060 2026-02-20T16:31:06.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.873+0000 7f94697fa640 1 -- 10.20.193.57:0/1713735502 <== mon.2 v2:10.20.193.57:3302/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9464002cb0 con 0x7f947405c060 2026-02-20T16:31:06.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.873+0000 7f947ab3a640 1 -- 10.20.193.57:0/1713735502 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f947417a560 con 0x7f947405c060 2026-02-20T16:31:06.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.873+0000 7f94697fa640 1 -- 10.20.193.57:0/1713735502 <== mon.2 v2:10.20.193.57:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94640386d0 con 0x7f947405c060 2026-02-20T16:31:06.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.873+0000 7f947ab3a640 1 -- 10.20.193.57:0/1713735502 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f9474197e70 con 0x7f947405c060 2026-02-20T16:31:06.880 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.874+0000 7f947ab3a640 1 -- 10.20.193.57:0/1713735502 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f947405c430 con 0x7f947405c060 2026-02-20T16:31:06.880 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.874+0000 7f94697fa640 1 -- 10.20.193.57:0/1713735502 <== mon.2 v2:10.20.193.57:3302/0 4 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7f9464038870 con 0x7f947405c060 2026-02-20T16:31:06.880 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.874+0000 7f94697fa640 1 -- 10.20.193.57:0/1713735502 <== mon.2 v2:10.20.193.57:3302/0 5 ==== osd_map(30..30 src has 1..30) ==== 3026+0+0 (secure 0 0 0) 0x7f9464088020 con 0x7f947405c060 2026-02-20T16:31:06.880 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.875+0000 7f94697fa640 1 -- 10.20.193.57:0/1713735502 <== mon.2 v2:10.20.193.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7f94640870f0 con 0x7f947405c060 2026-02-20T16:31:06.954 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.952+0000 7f947ab3a640 1 -- 10.20.193.57:0/1713735502 --> v1:10.20.193.57:6800/2007744879 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f9474179d10 con 0x7f944404cae0 2026-02-20T16:31:06.955 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.952+0000 7f94697fa640 1 -- 10.20.193.57:0/1713735502 <== mgr.14109 v1:10.20.193.57:6800/2007744879 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (unknown 3049115190 0 0) 0x7f945c003ab0 con 0x7f944404cae0 2026-02-20T16:31:06.955 INFO:teuthology.orchestra.run.trial057.stderr:instructed osd(s) 2 to deep-scrub 2026-02-20T16:31:06.957 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.953+0000 7f947ab3a640 1 -- 10.20.193.57:0/1713735502 >> v1:10.20.193.57:6800/2007744879 conn(0x7f944404cae0 legacy=0x7f944406cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:06.957 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.953+0000 7f947ab3a640 1 -- 10.20.193.57:0/1713735502 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f947405c060 msgr2=0x7f947418f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:06.957 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.953+0000 7f947ab3a640 1 --2- 10.20.193.57:0/1713735502 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f947405c060 0x7f947418f0b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9464009230 tx=0x7f9464002900 comp rx=0 tx=0).stop 2026-02-20T16:31:06.957 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.953+0000 7f947ab3a640 1 -- 10.20.193.57:0/1713735502 shutdown_connections 2026-02-20T16:31:06.958 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.953+0000 7f947ab3a640 1 --2- 10.20.193.57:0/1713735502 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f9474177a70 0x7f947418fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:06.958 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.953+0000 7f947ab3a640 1 --2- 10.20.193.57:0/1713735502 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f947405c970 0x7f947418f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:06.958 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.953+0000 7f947ab3a640 1 --2- 10.20.193.57:0/1713735502 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f947405c060 0x7f947418f0b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:06.958 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.953+0000 7f947ab3a640 1 -- 10.20.193.57:0/1713735502 >> 10.20.193.57:0/1713735502 conn(0x7f94740833e0 msgr2=0x7f9474075d40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:06.958 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.953+0000 7f947ab3a640 1 -- 10.20.193.57:0/1713735502 shutdown_connections 2026-02-20T16:31:06.958 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:06.953+0000 7f947ab3a640 1 -- 10.20.193.57:0/1713735502 wait complete. 2026-02-20T16:31:06.964 INFO:tasks.ceph:Scrubbing osd.3 2026-02-20T16:31:06.964 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2026-02-20T16:31:07.040 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.035+0000 7f446adae640 1 -- 10.20.193.57:0/811812532 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f4464081780 msgr2=0x7f4464136230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:07.040 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.035+0000 7f446adae640 1 --2- 10.20.193.57:0/811812532 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f4464081780 0x7f4464136230 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f444c004770 tx=0x7f444c02f0e0 comp rx=0 tx=0).stop 2026-02-20T16:31:07.040 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.035+0000 7f446adae640 1 -- 10.20.193.57:0/811812532 shutdown_connections 2026-02-20T16:31:07.040 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.035+0000 7f446adae640 1 --2- 10.20.193.57:0/811812532 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f4464081780 0x7f4464136230 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:07.040 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.035+0000 7f446adae640 1 --2- 10.20.193.57:0/811812532 >> v2:10.20.193.57:3300/0 conn(0x7f4464080e70 0x7f4464081240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:07.040 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.035+0000 7f446adae640 1 -- 10.20.193.57:0/811812532 >> 10.20.193.57:0/811812532 conn(0x7f44640843d0 msgr2=0x7f44640847d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:07.040 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.035+0000 7f446adae640 1 -- 10.20.193.57:0/811812532 shutdown_connections 2026-02-20T16:31:07.040 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.035+0000 7f446adae640 1 -- 10.20.193.57:0/811812532 wait complete. 2026-02-20T16:31:07.041 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.036+0000 7f446adae640 1 Processor -- start 2026-02-20T16:31:07.041 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.036+0000 7f446adae640 1 -- start start 2026-02-20T16:31:07.041 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.036+0000 7f446adae640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f4464080e70 0x7f4464125fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:07.041 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.036+0000 7f446adae640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f4464081780 0x7f446410b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:07.041 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.036+0000 7f446adae640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f4464136770 0x7f446410bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:07.041 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.036+0000 7f446adae640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f4464198d20 con 0x7f4464136770 2026-02-20T16:31:07.041 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.036+0000 7f446adae640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f4464198ba0 con 0x7f4464080e70 2026-02-20T16:31:07.041 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.036+0000 7f446adae640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f4464198ea0 con 0x7f4464081780 2026-02-20T16:31:07.041 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.036+0000 7f4468b23640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f4464080e70 0x7f4464125fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:07.041 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.036+0000 7f4469324640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f4464136770 0x7f446410bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:07.041 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.036+0000 7f445bfff640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f4464081780 0x7f446410b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:07.042 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.036+0000 7f4468b23640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f4464080e70 0x7f4464125fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3301/0 says I am v2:10.20.193.57:53984/0 (socket says 10.20.193.57:53984) 2026-02-20T16:31:07.042 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.036+0000 7f4468b23640 1 -- 10.20.193.57:0/3527340360 learned_addr learned my addr 10.20.193.57:0/3527340360 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:31:07.042 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.036+0000 7f4469324640 1 -- 10.20.193.57:0/3527340360 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f4464081780 msgr2=0x7f446410b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:07.042 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.036+0000 7f4469324640 1 --2- 10.20.193.57:0/3527340360 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f4464081780 0x7f446410b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:07.042 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.036+0000 7f4469324640 1 -- 10.20.193.57:0/3527340360 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f4464080e70 msgr2=0x7f4464125fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:07.042 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.036+0000 7f4469324640 1 --2- 10.20.193.57:0/3527340360 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f4464080e70 0x7f4464125fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:07.042 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.036+0000 7f4469324640 1 -- 10.20.193.57:0/3527340360 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4464125ba0 con 0x7f4464136770 2026-02-20T16:31:07.042 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.036+0000 7f4468b23640 1 --2- 10.20.193.57:0/3527340360 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f4464080e70 0x7f4464125fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:31:07.042 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.036+0000 7f4469324640 1 --2- 10.20.193.57:0/3527340360 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f4464136770 0x7f446410bc40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4460002d50 tx=0x7f446000cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:31:07.042 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.036+0000 7f44597fa640 1 -- 10.20.193.57:0/3527340360 <== mon.0 v2:10.20.193.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4460016020 con 0x7f4464136770 2026-02-20T16:31:07.042 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.036+0000 7f44597fa640 1 -- 10.20.193.57:0/3527340360 <== mon.0 v2:10.20.193.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f446000acf0 con 0x7f4464136770 2026-02-20T16:31:07.043 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.036+0000 7f446adae640 1 -- 10.20.193.57:0/3527340360 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f446410eb20 con 0x7f4464136770 2026-02-20T16:31:07.043 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.036+0000 7f44597fa640 1 -- 10.20.193.57:0/3527340360 <== mon.0 v2:10.20.193.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4460012680 con 0x7f4464136770 2026-02-20T16:31:07.043 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.036+0000 7f446adae640 1 -- 10.20.193.57:0/3527340360 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f446410df70 con 0x7f4464136770 2026-02-20T16:31:07.043 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.037+0000 7f446adae640 1 -- 10.20.193.57:0/3527340360 --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4464081240 con 0x7f4464136770 2026-02-20T16:31:07.043 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.037+0000 7f44597fa640 1 -- 10.20.193.57:0/3527340360 <== mon.0 v2:10.20.193.57:3300/0 4 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7f4460012820 con 0x7f4464136770 2026-02-20T16:31:07.043 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.037+0000 7f44597fa640 1 -- 10.20.193.57:0/3527340360 <== mon.0 v2:10.20.193.57:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3026+0+0 (secure 0 0 0) 0x7f4460063fd0 con 0x7f4464136770 2026-02-20T16:31:07.043 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.037+0000 7f44597fa640 1 -- 10.20.193.57:0/3527340360 --> v1:10.20.193.57:6813/2476353628 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4460016e50 con 0x7f4434071400 2026-02-20T16:31:07.043 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.037+0000 7f44597fa640 1 -- 10.20.193.57:0/3527340360 <== mon.0 v2:10.20.193.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f446006b050 con 0x7f4464136770 2026-02-20T16:31:07.043 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.038+0000 7f44597fa640 1 -- 10.20.193.57:0/3527340360 <== osd.3 v1:10.20.193.57:6813/2476353628 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f4460016e50 con 0x7f4434071400 2026-02-20T16:31:07.048 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.046+0000 7f446adae640 1 -- 10.20.193.57:0/3527340360 --> v1:10.20.193.57:6813/2476353628 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f4464126510 con 0x7f4434071400 2026-02-20T16:31:07.048 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.046+0000 7f44597fa640 1 -- 10.20.193.57:0/3527340360 <== osd.3 v1:10.20.193.57:6813/2476353628 2 ==== command_reply(tid 2: 0 ) ==== 8+0+712 (unknown 0 0 714369635) 0x7f444c0332d0 con 0x7f4434071400 2026-02-20T16:31:07.048 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-20T16:31:07.048 INFO:teuthology.orchestra.run.trial057.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-20T16:31:07.049 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-20T16:31:07.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.046+0000 7f446adae640 1 -- 10.20.193.57:0/3527340360 >> v1:10.20.193.57:6813/2476353628 conn(0x7f4434071400 legacy=0x7f4434091830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:07.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.046+0000 7f446adae640 1 -- 10.20.193.57:0/3527340360 >> v1:10.20.193.57:6800/2007744879 conn(0x7f443404cae0 legacy=0x7f443406cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:07.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.046+0000 7f446adae640 1 -- 10.20.193.57:0/3527340360 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f4464136770 msgr2=0x7f446410bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:07.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.046+0000 7f446adae640 1 --2- 10.20.193.57:0/3527340360 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f4464136770 0x7f446410bc40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4460002d50 tx=0x7f446000cef0 comp rx=0 tx=0).stop 2026-02-20T16:31:07.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.047+0000 7f4469324640 1 -- 10.20.193.57:0/3527340360 reap_dead start 2026-02-20T16:31:07.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.047+0000 7f446adae640 1 -- 10.20.193.57:0/3527340360 shutdown_connections 2026-02-20T16:31:07.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.047+0000 7f446adae640 1 -- 10.20.193.57:0/3527340360 >> 10.20.193.57:0/3527340360 conn(0x7f44640843d0 msgr2=0x7f4464075c20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:07.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.047+0000 7f446adae640 1 -- 10.20.193.57:0/3527340360 shutdown_connections 2026-02-20T16:31:07.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.047+0000 7f446adae640 1 -- 10.20.193.57:0/3527340360 wait complete. 2026-02-20T16:31:07.055 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2026-02-20T16:31:07.125 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.124+0000 7fdbe75d8640 1 -- 10.20.193.57:0/2186188220 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fdbe005cb40 msgr2=0x7fdbe0177360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:07.125 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.124+0000 7fdbe75d8640 1 --2- 10.20.193.57:0/2186188220 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fdbe005cb40 0x7fdbe0177360 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4004770 tx=0x7fdbd402f0e0 comp rx=0 tx=0).stop 2026-02-20T16:31:07.125 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.124+0000 7fdbe75d8640 1 -- 10.20.193.57:0/2186188220 shutdown_connections 2026-02-20T16:31:07.126 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.124+0000 7fdbe75d8640 1 --2- 10.20.193.57:0/2186188220 >> v2:10.20.193.57:3300/0 conn(0x7fdbe01778a0 0x7fdbe0197c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:07.126 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.124+0000 7fdbe75d8640 1 --2- 10.20.193.57:0/2186188220 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fdbe005cb40 0x7fdbe0177360 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:07.126 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.124+0000 7fdbe75d8640 1 -- 10.20.193.57:0/2186188220 >> 10.20.193.57:0/2186188220 conn(0x7fdbe00833e0 msgr2=0x7fdbe00840b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:07.126 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.124+0000 7fdbe75d8640 1 -- 10.20.193.57:0/2186188220 shutdown_connections 2026-02-20T16:31:07.126 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.124+0000 7fdbe75d8640 1 -- 10.20.193.57:0/2186188220 wait complete. 2026-02-20T16:31:07.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.124+0000 7fdbe75d8640 1 Processor -- start 2026-02-20T16:31:07.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.124+0000 7fdbe75d8640 1 -- start start 2026-02-20T16:31:07.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.125+0000 7fdbe75d8640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fdbe005c060 0x7fdbe0121f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:07.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.125+0000 7fdbe75d8640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fdbe005cb40 0x7fdbe01224d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:07.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.125+0000 7fdbe75d8640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fdbe01778a0 0x7fdbe01252c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:07.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.125+0000 7fdbe75d8640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe0198ba0 con 0x7fdbe005c060 2026-02-20T16:31:07.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.125+0000 7fdbe75d8640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7fdbe0198a20 con 0x7fdbe01778a0 2026-02-20T16:31:07.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.125+0000 7fdbe75d8640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7fdbe0198d20 con 0x7fdbe005cb40 2026-02-20T16:31:07.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.125+0000 7fdbe534d640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fdbe005c060 0x7fdbe0121f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:07.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.125+0000 7fdbe5b4e640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fdbe01778a0 0x7fdbe01252c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:07.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.125+0000 7fdbe534d640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fdbe005c060 0x7fdbe0121f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:53050/0 (socket says 10.20.193.57:53050) 2026-02-20T16:31:07.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.125+0000 7fdbe534d640 1 -- 10.20.193.57:0/86817704 learned_addr learned my addr 10.20.193.57:0/86817704 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:31:07.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.125+0000 7fdbe4b4c640 1 --2- 10.20.193.57:0/86817704 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fdbe005cb40 0x7fdbe01224d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:07.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.125+0000 7fdbe5b4e640 1 -- 10.20.193.57:0/86817704 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fdbe005cb40 msgr2=0x7fdbe01224d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:07.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.125+0000 7fdbe5b4e640 1 --2- 10.20.193.57:0/86817704 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fdbe005cb40 0x7fdbe01224d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:07.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.125+0000 7fdbe5b4e640 1 -- 10.20.193.57:0/86817704 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fdbe005c060 msgr2=0x7fdbe0121f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:07.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.125+0000 7fdbe5b4e640 1 --2- 10.20.193.57:0/86817704 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fdbe005c060 0x7fdbe0121f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:07.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.125+0000 7fdbe5b4e640 1 -- 10.20.193.57:0/86817704 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbe010d2c0 con 0x7fdbe01778a0 2026-02-20T16:31:07.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.125+0000 7fdbe5b4e640 1 --2- 10.20.193.57:0/86817704 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fdbe01778a0 0x7fdbe01252c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0080790 tx=0x7fdbdc00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:31:07.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.125+0000 7fdbcdffb640 1 -- 10.20.193.57:0/86817704 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc0092e0 con 0x7fdbe01778a0 2026-02-20T16:31:07.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.125+0000 7fdbcdffb640 1 -- 10.20.193.57:0/86817704 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdbdc00cb00 con 0x7fdbe01778a0 2026-02-20T16:31:07.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.125+0000 7fdbe75d8640 1 -- 10.20.193.57:0/86817704 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbe010e260 con 0x7fdbe01778a0 2026-02-20T16:31:07.128 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.125+0000 7fdbcdffb640 1 -- 10.20.193.57:0/86817704 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc003a80 con 0x7fdbe01778a0 2026-02-20T16:31:07.128 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.125+0000 7fdbe75d8640 1 -- 10.20.193.57:0/86817704 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbe0122a10 con 0x7fdbe01778a0 2026-02-20T16:31:07.128 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.126+0000 7fdbe75d8640 1 -- 10.20.193.57:0/86817704 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbe005c430 con 0x7fdbe01778a0 2026-02-20T16:31:07.128 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.126+0000 7fdbcdffb640 1 -- 10.20.193.57:0/86817704 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7fdbdc007500 con 0x7fdbe01778a0 2026-02-20T16:31:07.128 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.126+0000 7fdbcdffb640 1 -- 10.20.193.57:0/86817704 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(30..30 src has 1..30) ==== 3026+0+0 (secure 0 0 0) 0x7fdbdc063ff0 con 0x7fdbe01778a0 2026-02-20T16:31:07.129 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.128+0000 7fdbcdffb640 1 -- 10.20.193.57:0/86817704 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7fdbdc022020 con 0x7fdbe01778a0 2026-02-20T16:31:07.206 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.204+0000 7fdbe75d8640 1 -- 10.20.193.57:0/86817704 --> v1:10.20.193.57:6800/2007744879 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fdbe0053200 con 0x7fdbb004cae0 2026-02-20T16:31:07.206 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.204+0000 7fdbcdffb640 1 -- 10.20.193.57:0/86817704 <== mgr.14109 v1:10.20.193.57:6800/2007744879 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (unknown 3526570807 0 0) 0x7fdbe0053200 con 0x7fdbb004cae0 2026-02-20T16:31:07.206 INFO:teuthology.orchestra.run.trial057.stderr:instructed osd(s) 3 to deep-scrub 2026-02-20T16:31:07.207 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.205+0000 7fdbe75d8640 1 -- 10.20.193.57:0/86817704 >> v1:10.20.193.57:6800/2007744879 conn(0x7fdbb004cae0 legacy=0x7fdbb006cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:07.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.205+0000 7fdbe75d8640 1 -- 10.20.193.57:0/86817704 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fdbe01778a0 msgr2=0x7fdbe01252c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:07.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.205+0000 7fdbe75d8640 1 --2- 10.20.193.57:0/86817704 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fdbe01778a0 0x7fdbe01252c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0080790 tx=0x7fdbdc00c490 comp rx=0 tx=0).stop 2026-02-20T16:31:07.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.205+0000 7fdbe75d8640 1 -- 10.20.193.57:0/86817704 shutdown_connections 2026-02-20T16:31:07.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.205+0000 7fdbe75d8640 1 --2- 10.20.193.57:0/86817704 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fdbe01778a0 0x7fdbe01252c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:07.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.205+0000 7fdbe75d8640 1 --2- 10.20.193.57:0/86817704 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fdbe005cb40 0x7fdbe01224d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:07.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.205+0000 7fdbe75d8640 1 --2- 10.20.193.57:0/86817704 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fdbe005c060 0x7fdbe0121f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:07.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.205+0000 7fdbe75d8640 1 -- 10.20.193.57:0/86817704 >> 10.20.193.57:0/86817704 conn(0x7fdbe00833e0 msgr2=0x7fdbe0075bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:07.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.205+0000 7fdbe75d8640 1 -- 10.20.193.57:0/86817704 shutdown_connections 2026-02-20T16:31:07.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.205+0000 7fdbe75d8640 1 -- 10.20.193.57:0/86817704 wait complete. 2026-02-20T16:31:07.215 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T16:31:07.288 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.283+0000 7fe6dca8d640 1 -- 10.20.193.57:0/3138742749 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fe6d8176890 msgr2=0x7fe6d8196c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:07.288 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.283+0000 7fe6dca8d640 1 --2- 10.20.193.57:0/3138742749 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fe6d8176890 0x7fe6d8196c70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe6c8009750 tx=0x7fe6c802f400 comp rx=0 tx=0).stop 2026-02-20T16:31:07.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.283+0000 7fe6dca8d640 1 -- 10.20.193.57:0/3138742749 shutdown_connections 2026-02-20T16:31:07.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.283+0000 7fe6dca8d640 1 --2- 10.20.193.57:0/3138742749 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fe6d8176890 0x7fe6d8196c70 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:07.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.283+0000 7fe6dca8d640 1 --2- 10.20.193.57:0/3138742749 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fe6d805c970 0x7fe6d8176350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:07.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.283+0000 7fe6dca8d640 1 --2- 10.20.193.57:0/3138742749 >> v2:10.20.193.57:3300/0 conn(0x7fe6d805c060 0x7fe6d805c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:07.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.283+0000 7fe6dca8d640 1 -- 10.20.193.57:0/3138742749 >> 10.20.193.57:0/3138742749 conn(0x7fe6d80833e0 msgr2=0x7fe6d80840b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:07.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.283+0000 7fe6dca8d640 1 -- 10.20.193.57:0/3138742749 shutdown_connections 2026-02-20T16:31:07.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.283+0000 7fe6dca8d640 1 -- 10.20.193.57:0/3138742749 wait complete. 2026-02-20T16:31:07.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.284+0000 7fe6dca8d640 1 Processor -- start 2026-02-20T16:31:07.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.284+0000 7fe6dca8d640 1 -- start start 2026-02-20T16:31:07.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.284+0000 7fe6dca8d640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fe6d805c060 0x7fe6d807b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:07.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.284+0000 7fe6dca8d640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fe6d805c970 0x7fe6d807b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:07.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.284+0000 7fe6dca8d640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fe6d8176890 0x7fe6d807bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:07.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.284+0000 7fe6dca8d640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7fe6d8197bd0 con 0x7fe6d805c970 2026-02-20T16:31:07.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.284+0000 7fe6dca8d640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7fe6d8197a50 con 0x7fe6d805c060 2026-02-20T16:31:07.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.284+0000 7fe6dca8d640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7fe6d8197d50 con 0x7fe6d8176890 2026-02-20T16:31:07.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.284+0000 7fe6d5d74640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fe6d805c970 0x7fe6d807b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:07.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.284+0000 7fe6d6575640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fe6d805c060 0x7fe6d807b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:07.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.284+0000 7fe6d6d76640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fe6d8176890 0x7fe6d807bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:07.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.284+0000 7fe6d5d74640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fe6d805c970 0x7fe6d807b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:53064/0 (socket says 10.20.193.57:53064) 2026-02-20T16:31:07.291 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.284+0000 7fe6d6575640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fe6d805c060 0x7fe6d807b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3301/0 says I am v2:10.20.193.57:54016/0 (socket says 10.20.193.57:54016) 2026-02-20T16:31:07.291 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.284+0000 7fe6d5d74640 1 -- 10.20.193.57:0/3889929275 learned_addr learned my addr 10.20.193.57:0/3889929275 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:31:07.291 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.284+0000 7fe6d6d76640 1 -- 10.20.193.57:0/3889929275 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fe6d805c060 msgr2=0x7fe6d807b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:07.291 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.284+0000 7fe6d6d76640 1 --2- 10.20.193.57:0/3889929275 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fe6d805c060 0x7fe6d807b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:07.291 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.284+0000 7fe6d6d76640 1 -- 10.20.193.57:0/3889929275 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fe6d805c970 msgr2=0x7fe6d807b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:07.291 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.284+0000 7fe6d6d76640 1 --2- 10.20.193.57:0/3889929275 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fe6d805c970 0x7fe6d807b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:07.291 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.284+0000 7fe6d6d76640 1 -- 10.20.193.57:0/3889929275 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6d8189800 con 0x7fe6d8176890 2026-02-20T16:31:07.291 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.284+0000 7fe6d5d74640 1 --2- 10.20.193.57:0/3889929275 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fe6d805c970 0x7fe6d807b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:31:07.291 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.284+0000 7fe6d6d76640 1 --2- 10.20.193.57:0/3889929275 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fe6d8176890 0x7fe6d807bde0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe6c8009fa0 tx=0x7fe6c8009300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:31:07.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.285+0000 7fe6beffd640 1 -- 10.20.193.57:0/3889929275 <== mon.2 v2:10.20.193.57:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c8031ec0 con 0x7fe6d8176890 2026-02-20T16:31:07.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.285+0000 7fe6beffd640 1 -- 10.20.193.57:0/3889929275 <== mon.2 v2:10.20.193.57:3302/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe6c80042d0 con 0x7fe6d8176890 2026-02-20T16:31:07.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.285+0000 7fe6dca8d640 1 -- 10.20.193.57:0/3889929275 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6d807cb70 con 0x7fe6d8176890 2026-02-20T16:31:07.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.285+0000 7fe6beffd640 1 -- 10.20.193.57:0/3889929275 <== mon.2 v2:10.20.193.57:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c8004740 con 0x7fe6d8176890 2026-02-20T16:31:07.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.285+0000 7fe6dca8d640 1 -- 10.20.193.57:0/3889929275 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6d8188660 con 0x7fe6d8176890 2026-02-20T16:31:07.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.285+0000 7fe6dca8d640 1 -- 10.20.193.57:0/3889929275 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6d805c430 con 0x7fe6d8176890 2026-02-20T16:31:07.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.285+0000 7fe6beffd640 1 -- 10.20.193.57:0/3889929275 <== mon.2 v2:10.20.193.57:3302/0 4 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7fe6c8007470 con 0x7fe6d8176890 2026-02-20T16:31:07.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.286+0000 7fe6beffd640 1 -- 10.20.193.57:0/3889929275 <== mon.2 v2:10.20.193.57:3302/0 5 ==== osd_map(30..30 src has 1..30) ==== 3026+0+0 (secure 0 0 0) 0x7fe6c8087c70 con 0x7fe6d8176890 2026-02-20T16:31:07.293 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.287+0000 7fe6beffd640 1 -- 10.20.193.57:0/3889929275 <== mon.2 v2:10.20.193.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7fe6c8086d40 con 0x7fe6d8176890 2026-02-20T16:31:07.364 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.362+0000 7fe6dca8d640 1 -- 10.20.193.57:0/3889929275 --> v1:10.20.193.57:6800/2007744879 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe6d8053200 con 0x7fe6a404cc80 2026-02-20T16:31:07.365 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.363+0000 7fe6beffd640 1 -- 10.20.193.57:0/3889929275 <== mgr.14109 v1:10.20.193.57:6800/2007744879 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31972 (unknown 2965378022 0 1672772940) 0x7fe6d8053200 con 0x7fe6a404cc80 2026-02-20T16:31:07.365 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:31:07.366 INFO:teuthology.orchestra.run.trial057.stderr:dumped all 2026-02-20T16:31:07.367 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.364+0000 7fe6dca8d640 1 -- 10.20.193.57:0/3889929275 >> v1:10.20.193.57:6800/2007744879 conn(0x7fe6a404cc80 legacy=0x7fe6a406d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:07.367 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.364+0000 7fe6dca8d640 1 -- 10.20.193.57:0/3889929275 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fe6d8176890 msgr2=0x7fe6d807bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:07.367 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.364+0000 7fe6dca8d640 1 --2- 10.20.193.57:0/3889929275 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fe6d8176890 0x7fe6d807bde0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe6c8009fa0 tx=0x7fe6c8009300 comp rx=0 tx=0).stop 2026-02-20T16:31:07.367 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.364+0000 7fe6dca8d640 1 -- 10.20.193.57:0/3889929275 shutdown_connections 2026-02-20T16:31:07.367 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.364+0000 7fe6dca8d640 1 --2- 10.20.193.57:0/3889929275 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7fe6d8176890 0x7fe6d807bde0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:07.367 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.364+0000 7fe6dca8d640 1 --2- 10.20.193.57:0/3889929275 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7fe6d805c970 0x7fe6d807b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:07.367 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.364+0000 7fe6dca8d640 1 --2- 10.20.193.57:0/3889929275 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7fe6d805c060 0x7fe6d807b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:07.367 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.364+0000 7fe6dca8d640 1 -- 10.20.193.57:0/3889929275 >> 10.20.193.57:0/3889929275 conn(0x7fe6d80833e0 msgr2=0x7fe6d807dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:07.367 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.364+0000 7fe6dca8d640 1 -- 10.20.193.57:0/3889929275 shutdown_connections 2026-02-20T16:31:07.368 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:07.364+0000 7fe6dca8d640 1 -- 10.20.193.57:0/3889929275 wait complete. 2026-02-20T16:31:07.374 INFO:teuthology.orchestra.run.trial057.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2026-02-20T16:31:06.932622+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":115,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":111984,"kb_used_data":2160,"kb_used_omap":33,"kb_used_meta":109726,"kb_avail":377375376,"statfs":{"total":386547056640,"available":386432385024,"internally_reserved":0,"allocated":2211840,"data_stored":1533882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34671,"internal_metadata":112359569},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.970685"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.964839+0000","last_change":"2026-02-20T16:30:58.157966+0000","last_active":"2026-02-20T16:31:01.964839+0000","last_peered":"2026-02-20T16:31:01.964839+0000","last_clean":"2026-02-20T16:31:01.964839+0000","last_became_active":"2026-02-20T16:30:58.157789+0000","last_became_peered":"2026-02-20T16:30:58.157789+0000","last_unstale":"2026-02-20T16:31:01.964839+0000","last_undegraded":"2026-02-20T16:31:01.964839+0000","last_fullsized":"2026-02-20T16:31:01.964839+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:54:24.491175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001161203,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.964718+0000","last_change":"2026-02-20T16:30:55.953096+0000","last_active":"2026-02-20T16:31:01.964718+0000","last_peered":"2026-02-20T16:31:01.964718+0000","last_clean":"2026-02-20T16:31:01.964718+0000","last_became_active":"2026-02-20T16:30:55.952830+0000","last_became_peered":"2026-02-20T16:30:55.952830+0000","last_unstale":"2026-02-20T16:31:01.964718+0000","last_undegraded":"2026-02-20T16:31:01.964718+0000","last_fullsized":"2026-02-20T16:31:01.964718+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:40:28.084285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033720799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.964835+0000","last_change":"2026-02-20T16:30:58.158048+0000","last_active":"2026-02-20T16:31:01.964835+0000","last_peered":"2026-02-20T16:31:01.964835+0000","last_clean":"2026-02-20T16:31:01.964835+0000","last_became_active":"2026-02-20T16:30:58.157875+0000","last_became_peered":"2026-02-20T16:30:58.157875+0000","last_unstale":"2026-02-20T16:31:01.964835+0000","last_undegraded":"2026-02-20T16:31:01.964835+0000","last_fullsized":"2026-02-20T16:31:01.964835+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:21:38.884906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001207149,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.964710+0000","last_change":"2026-02-20T16:30:55.952911+0000","last_active":"2026-02-20T16:31:01.964710+0000","last_peered":"2026-02-20T16:31:01.964710+0000","last_clean":"2026-02-20T16:31:01.964710+0000","last_became_active":"2026-02-20T16:30:55.952715+0000","last_became_peered":"2026-02-20T16:30:55.952715+0000","last_unstale":"2026-02-20T16:31:01.964710+0000","last_undegraded":"2026-02-20T16:31:01.964710+0000","last_fullsized":"2026-02-20T16:31:01.964710+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T02:00:10.634783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000271997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.964821+0000","last_change":"2026-02-20T16:30:57.954902+0000","last_active":"2026-02-20T16:31:01.964821+0000","last_peered":"2026-02-20T16:31:01.964821+0000","last_clean":"2026-02-20T16:31:01.964821+0000","last_became_active":"2026-02-20T16:30:57.954650+0000","last_became_peered":"2026-02-20T16:30:57.954650+0000","last_unstale":"2026-02-20T16:31:01.964821+0000","last_undegraded":"2026-02-20T16:31:01.964821+0000","last_fullsized":"2026-02-20T16:31:01.964821+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T17:00:58.459896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092195700000000005,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:03.957781+0000","last_change":"2026-02-20T16:30:57.954352+0000","last_active":"2026-02-20T16:31:03.957781+0000","last_peered":"2026-02-20T16:31:03.957781+0000","last_clean":"2026-02-20T16:31:03.957781+0000","last_became_active":"2026-02-20T16:30:57.954061+0000","last_became_peered":"2026-02-20T16:30:57.954061+0000","last_unstale":"2026-02-20T16:31:03.957781+0000","last_undegraded":"2026-02-20T16:31:03.957781+0000","last_fullsized":"2026-02-20T16:31:03.957781+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:19:49.576783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025212999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.964783+0000","last_change":"2026-02-20T16:30:57.954552+0000","last_active":"2026-02-20T16:31:01.964783+0000","last_peered":"2026-02-20T16:31:01.964783+0000","last_clean":"2026-02-20T16:31:01.964783+0000","last_became_active":"2026-02-20T16:30:57.954099+0000","last_became_peered":"2026-02-20T16:30:57.954099+0000","last_unstale":"2026-02-20T16:31:01.964783+0000","last_undegraded":"2026-02-20T16:31:01.964783+0000","last_fullsized":"2026-02-20T16:31:01.964783+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:04:34.172539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010429829999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.964849+0000","last_change":"2026-02-20T16:30:57.954384+0000","last_active":"2026-02-20T16:31:01.964849+0000","last_peered":"2026-02-20T16:31:01.964849+0000","last_clean":"2026-02-20T16:31:01.964849+0000","last_became_active":"2026-02-20T16:30:57.953999+0000","last_became_peered":"2026-02-20T16:30:57.953999+0000","last_unstale":"2026-02-20T16:31:01.964849+0000","last_undegraded":"2026-02-20T16:31:01.964849+0000","last_fullsized":"2026-02-20T16:31:01.964849+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:38.739171+0000","last_clean_scrub_stamp":"2026-02-20T16:29:38.739171+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:18:53.326241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093713599999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"20'79","reported_seq":163,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:01.964727+0000","last_change":"2026-02-20T16:30:55.952986+0000","last_active":"2026-02-20T16:31:01.964727+0000","last_peered":"2026-02-20T16:31:01.964727+0000","last_clean":"2026-02-20T16:31:01.964727+0000","last_became_active":"2026-02-20T16:30:55.952756+0000","last_became_peered":"2026-02-20T16:30:55.952756+0000","last_unstale":"2026-02-20T16:31:01.964727+0000","last_undegraded":"2026-02-20T16:31:01.964727+0000","last_fullsized":"2026-02-20T16:31:01.964727+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:29:34.730052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:29:34.730052+0000","last_clean_scrub_stamp":"2026-02-20T16:29:34.730052+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:12:19.306906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":26,"seq":111669149700,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":252,"kb_used_omap":8,"kb_used_meta":27447,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":258048,"data_stored":88288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8340,"internal_metadata":28106604},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":25,"seq":107374182404,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":248,"kb_used_omap":8,"kb_used_meta":27447,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":253952,"data_stored":88277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8992,"internal_metadata":28105952},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":24,"seq":103079215108,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28304,"kb_used_data":832,"kb_used_omap":9,"kb_used_meta":27446,"kb_avail":94343536,"statfs":{"total":96636764160,"available":96607780864,"internally_reserved":0,"allocated":851968,"data_stored":678672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9646,"internal_metadata":28105298},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":23,"seq":98784247812,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28236,"kb_used_data":828,"kb_used_omap":7,"kb_used_meta":27384,"kb_avail":94343604,"statfs":{"total":96636764160,"available":96607850496,"internally_reserved":0,"allocated":847872,"data_stored":678645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7693,"internal_metadata":28041715},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T16:31:07.379 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2026-02-20T16:29:38.739171+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=16, tm_min=29, tm_sec=38, tm_wday=4, tm_yday=51, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=16, tm_min=31, tm_sec=5, tm_wday=4, tm_yday=51, tm_isdst=0) 2026-02-20T16:31:07.379 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2026-02-20T16:29:38.739171+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=16, tm_min=29, tm_sec=38, tm_wday=4, tm_yday=51, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=16, tm_min=31, tm_sec=5, tm_wday=4, tm_yday=51, tm_isdst=0) 2026-02-20T16:31:07.379 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2026-02-20T16:29:38.739171+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=16, tm_min=29, tm_sec=38, tm_wday=4, tm_yday=51, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=16, tm_min=31, tm_sec=5, tm_wday=4, tm_yday=51, tm_isdst=0) 2026-02-20T16:31:07.379 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2026-02-20T16:29:38.739171+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=16, tm_min=29, tm_sec=38, tm_wday=4, tm_yday=51, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=16, tm_min=31, tm_sec=5, tm_wday=4, tm_yday=51, tm_isdst=0) 2026-02-20T16:31:07.380 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2026-02-20T16:29:38.739171+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=16, tm_min=29, tm_sec=38, tm_wday=4, tm_yday=51, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=16, tm_min=31, tm_sec=5, tm_wday=4, tm_yday=51, tm_isdst=0) 2026-02-20T16:31:07.380 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2026-02-20T16:29:38.739171+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=16, tm_min=29, tm_sec=38, tm_wday=4, tm_yday=51, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=16, tm_min=31, tm_sec=5, tm_wday=4, tm_yday=51, tm_isdst=0) 2026-02-20T16:31:07.380 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2026-02-20T16:29:38.739171+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=16, tm_min=29, tm_sec=38, tm_wday=4, tm_yday=51, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=16, tm_min=31, tm_sec=5, tm_wday=4, tm_yday=51, tm_isdst=0) 2026-02-20T16:31:07.380 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2026-02-20T16:29:38.739171+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=16, tm_min=29, tm_sec=38, tm_wday=4, tm_yday=51, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=16, tm_min=31, tm_sec=5, tm_wday=4, tm_yday=51, tm_isdst=0) 2026-02-20T16:31:07.380 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2026-02-20T16:29:34.730052+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=16, tm_min=29, tm_sec=34, tm_wday=4, tm_yday=51, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=16, tm_min=31, tm_sec=5, tm_wday=4, tm_yday=51, tm_isdst=0) 2026-02-20T16:31:07.381 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-20T16:31:27.382 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T16:31:27.457 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.451+0000 7f76bf5fe640 1 -- 10.20.193.57:0/1768826602 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f76b807cb10 msgr2=0x7f76b8196150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:27.457 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.451+0000 7f76bf5fe640 1 --2- 10.20.193.57:0/1768826602 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f76b807cb10 0x7f76b8196150 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f76b4009fd0 tx=0x7f76b402f400 comp rx=0 tx=0).stop 2026-02-20T16:31:27.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.451+0000 7f76bf5fe640 1 -- 10.20.193.57:0/1768826602 shutdown_connections 2026-02-20T16:31:27.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.451+0000 7f76bf5fe640 1 --2- 10.20.193.57:0/1768826602 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f76b807cb10 0x7f76b8196150 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:27.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.451+0000 7f76bf5fe640 1 --2- 10.20.193.57:0/1768826602 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f76b8080bb0 0x7f76b8080f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:27.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.451+0000 7f76bf5fe640 1 -- 10.20.193.57:0/1768826602 >> 10.20.193.57:0/1768826602 conn(0x7f76b80833e0 msgr2=0x7f76b80840b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:27.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.451+0000 7f76bf5fe640 1 -- 10.20.193.57:0/1768826602 shutdown_connections 2026-02-20T16:31:27.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.451+0000 7f76bf5fe640 1 -- 10.20.193.57:0/1768826602 wait complete. 2026-02-20T16:31:27.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.451+0000 7f76bf5fe640 1 Processor -- start 2026-02-20T16:31:27.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.451+0000 7f76bf5fe640 1 -- start start 2026-02-20T16:31:27.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.452+0000 7f76bf5fe640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f76b807cb10 0x7f76b8133010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:27.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.452+0000 7f76bf5fe640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f76b8080bb0 0x7f76b8133550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:27.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.452+0000 7f76bf5fe640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f76b80814c0 0x7f76b8133a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:27.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.452+0000 7f76bf5fe640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f76b8196ab0 con 0x7f76b8080bb0 2026-02-20T16:31:27.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.452+0000 7f76bf5fe640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f76b8196930 con 0x7f76b80814c0 2026-02-20T16:31:27.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.452+0000 7f76bf5fe640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f76b8196c30 con 0x7f76b807cb10 2026-02-20T16:31:27.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.452+0000 7f76bcb72640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f76b8080bb0 0x7f76b8133550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:27.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.452+0000 7f76bd373640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f76b807cb10 0x7f76b8133010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:27.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.452+0000 7f76bdb74640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f76b80814c0 0x7f76b8133a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:27.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.452+0000 7f76bcb72640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f76b8080bb0 0x7f76b8133550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3300/0 says I am v2:10.20.193.57:57272/0 (socket says 10.20.193.57:57272) 2026-02-20T16:31:27.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.452+0000 7f76bcb72640 1 -- 10.20.193.57:0/2051496677 learned_addr learned my addr 10.20.193.57:0/2051496677 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:31:27.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.452+0000 7f76bd373640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f76b807cb10 0x7f76b8133010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3302/0 says I am v2:10.20.193.57:60016/0 (socket says 10.20.193.57:60016) 2026-02-20T16:31:27.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.452+0000 7f76bd373640 1 -- 10.20.193.57:0/2051496677 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f76b80814c0 msgr2=0x7f76b8133a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:27.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.452+0000 7f76bd373640 1 --2- 10.20.193.57:0/2051496677 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f76b80814c0 0x7f76b8133a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:27.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.452+0000 7f76bd373640 1 -- 10.20.193.57:0/2051496677 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f76b8080bb0 msgr2=0x7f76b8133550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:27.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.452+0000 7f76bd373640 1 --2- 10.20.193.57:0/2051496677 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f76b8080bb0 0x7f76b8133550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:27.461 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.452+0000 7f76bd373640 1 -- 10.20.193.57:0/2051496677 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76b8075c80 con 0x7f76b807cb10 2026-02-20T16:31:27.461 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.452+0000 7f76bcb72640 1 --2- 10.20.193.57:0/2051496677 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f76b8080bb0 0x7f76b8133550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T16:31:27.461 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.452+0000 7f76bd373640 1 --2- 10.20.193.57:0/2051496677 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f76b807cb10 0x7f76b8133010 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f76a800e9c0 tx=0x7f76a800ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:31:27.461 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.452+0000 7f76a5ffb640 1 -- 10.20.193.57:0/2051496677 <== mon.2 v2:10.20.193.57:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a800cc90 con 0x7f76b807cb10 2026-02-20T16:31:27.461 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.452+0000 7f76a5ffb640 1 -- 10.20.193.57:0/2051496677 <== mon.2 v2:10.20.193.57:3302/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f76a800ce30 con 0x7f76b807cb10 2026-02-20T16:31:27.461 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.452+0000 7f76bf5fe640 1 -- 10.20.193.57:0/2051496677 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76b8076160 con 0x7f76b807cb10 2026-02-20T16:31:27.461 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.452+0000 7f76a5ffb640 1 -- 10.20.193.57:0/2051496677 <== mon.2 v2:10.20.193.57:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a8004ae0 con 0x7f76b807cb10 2026-02-20T16:31:27.462 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.452+0000 7f76bf5fe640 1 -- 10.20.193.57:0/2051496677 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f76b81466e0 con 0x7f76b807cb10 2026-02-20T16:31:27.462 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.453+0000 7f76bf5fe640 1 -- 10.20.193.57:0/2051496677 --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76b8080f80 con 0x7f76b807cb10 2026-02-20T16:31:27.462 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.453+0000 7f76a5ffb640 1 -- 10.20.193.57:0/2051496677 <== mon.2 v2:10.20.193.57:3302/0 4 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7f76a8004c80 con 0x7f76b807cb10 2026-02-20T16:31:27.462 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.453+0000 7f76a5ffb640 1 -- 10.20.193.57:0/2051496677 <== mon.2 v2:10.20.193.57:3302/0 5 ==== osd_map(30..30 src has 1..30) ==== 3026+0+0 (secure 0 0 0) 0x7f76a80640b0 con 0x7f76b807cb10 2026-02-20T16:31:27.462 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.455+0000 7f76a5ffb640 1 -- 10.20.193.57:0/2051496677 <== mon.2 v2:10.20.193.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7f76a8063180 con 0x7f76b807cb10 2026-02-20T16:31:27.529 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.527+0000 7f76bf5fe640 1 -- 10.20.193.57:0/2051496677 --> v1:10.20.193.57:6800/2007744879 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f76b80008d0 con 0x7f768804cae0 2026-02-20T16:31:27.529 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.527+0000 7f76a5ffb640 1 -- 10.20.193.57:0/2051496677 <== mgr.14109 v1:10.20.193.57:6800/2007744879 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31981 (unknown 2965378022 0 844748492) 0x7f76b80008d0 con 0x7f768804cae0 2026-02-20T16:31:27.530 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-20T16:31:27.531 INFO:teuthology.orchestra.run.trial057.stderr:dumped all 2026-02-20T16:31:27.531 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.528+0000 7f76bf5fe640 1 -- 10.20.193.57:0/2051496677 >> v1:10.20.193.57:6800/2007744879 conn(0x7f768804cae0 legacy=0x7f768806cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:27.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.528+0000 7f76bf5fe640 1 -- 10.20.193.57:0/2051496677 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f76b807cb10 msgr2=0x7f76b8133010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:27.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.528+0000 7f76bf5fe640 1 --2- 10.20.193.57:0/2051496677 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f76b807cb10 0x7f76b8133010 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f76a800e9c0 tx=0x7f76a800ee90 comp rx=0 tx=0).stop 2026-02-20T16:31:27.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.528+0000 7f76bf5fe640 1 -- 10.20.193.57:0/2051496677 shutdown_connections 2026-02-20T16:31:27.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.528+0000 7f76bf5fe640 1 --2- 10.20.193.57:0/2051496677 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f76b80814c0 0x7f76b8133a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:27.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.528+0000 7f76bf5fe640 1 --2- 10.20.193.57:0/2051496677 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f76b8080bb0 0x7f76b8133550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:27.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.528+0000 7f76bf5fe640 1 --2- 10.20.193.57:0/2051496677 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f76b807cb10 0x7f76b8133010 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:27.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.528+0000 7f76bf5fe640 1 -- 10.20.193.57:0/2051496677 >> 10.20.193.57:0/2051496677 conn(0x7f76b80833e0 msgr2=0x7f76b805c850 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:27.533 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.528+0000 7f76bf5fe640 1 -- 10.20.193.57:0/2051496677 shutdown_connections 2026-02-20T16:31:27.533 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.528+0000 7f76bf5fe640 1 -- 10.20.193.57:0/2051496677 wait complete. 2026-02-20T16:31:27.537 INFO:teuthology.orchestra.run.trial057.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2026-02-20T16:31:26.934328+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":115,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":85,"ondisk_log_size":85,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":111984,"kb_used_data":2160,"kb_used_omap":33,"kb_used_meta":109726,"kb_avail":377375376,"statfs":{"total":386547056640,"available":386432385024,"internally_reserved":0,"allocated":2211840,"data_stored":1533882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34671,"internal_metadata":112359569},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.000907"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:09.585769+0000","last_change":"2026-02-20T16:31:09.585769+0000","last_active":"2026-02-20T16:31:09.585769+0000","last_peered":"2026-02-20T16:31:09.585769+0000","last_clean":"2026-02-20T16:31:09.585769+0000","last_became_active":"2026-02-20T16:30:58.157789+0000","last_became_peered":"2026-02-20T16:30:58.157789+0000","last_unstale":"2026-02-20T16:31:09.585769+0000","last_undegraded":"2026-02-20T16:31:09.585769+0000","last_fullsized":"2026-02-20T16:31:09.585769+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:31:09.585700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:31:09.585700+0000","last_clean_scrub_stamp":"2026-02-20T16:31:09.585700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:20:47.726144+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.001161203,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:09.281554+0000","last_change":"2026-02-20T16:31:09.281554+0000","last_active":"2026-02-20T16:31:09.281554+0000","last_peered":"2026-02-20T16:31:09.281554+0000","last_clean":"2026-02-20T16:31:09.281554+0000","last_became_active":"2026-02-20T16:30:55.952830+0000","last_became_peered":"2026-02-20T16:30:55.952830+0000","last_unstale":"2026-02-20T16:31:09.281554+0000","last_undegraded":"2026-02-20T16:31:09.281554+0000","last_fullsized":"2026-02-20T16:31:09.281554+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:31:09.281466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:31:09.281466+0000","last_clean_scrub_stamp":"2026-02-20T16:31:09.281466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:30:54.661037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033720799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:10.560679+0000","last_change":"2026-02-20T16:31:10.560679+0000","last_active":"2026-02-20T16:31:10.560679+0000","last_peered":"2026-02-20T16:31:10.560679+0000","last_clean":"2026-02-20T16:31:10.560679+0000","last_became_active":"2026-02-20T16:30:58.157875+0000","last_became_peered":"2026-02-20T16:30:58.157875+0000","last_unstale":"2026-02-20T16:31:10.560679+0000","last_undegraded":"2026-02-20T16:31:10.560679+0000","last_fullsized":"2026-02-20T16:31:10.560679+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:31:10.560629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:31:10.560629+0000","last_clean_scrub_stamp":"2026-02-20T16:31:10.560629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T16:59:51.750631+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.001207149,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:08.322082+0000","last_change":"2026-02-20T16:31:08.322082+0000","last_active":"2026-02-20T16:31:08.322082+0000","last_peered":"2026-02-20T16:31:08.322082+0000","last_clean":"2026-02-20T16:31:08.322082+0000","last_became_active":"2026-02-20T16:30:55.952715+0000","last_became_peered":"2026-02-20T16:30:55.952715+0000","last_unstale":"2026-02-20T16:31:08.322082+0000","last_undegraded":"2026-02-20T16:31:08.322082+0000","last_fullsized":"2026-02-20T16:31:08.322082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:31:08.322032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:31:08.322032+0000","last_clean_scrub_stamp":"2026-02-20T16:31:08.322032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T22:25:37.682456+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.000271997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"30'3","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:08.579975+0000","last_change":"2026-02-20T16:31:08.579975+0000","last_active":"2026-02-20T16:31:08.579975+0000","last_peered":"2026-02-20T16:31:08.579975+0000","last_clean":"2026-02-20T16:31:08.579975+0000","last_became_active":"2026-02-20T16:30:57.954650+0000","last_became_peered":"2026-02-20T16:30:57.954650+0000","last_unstale":"2026-02-20T16:31:08.579975+0000","last_undegraded":"2026-02-20T16:31:08.579975+0000","last_fullsized":"2026-02-20T16:31:08.579975+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2026-02-20T16:31:08.579934+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2026-02-20T16:31:08.579934+0000","last_clean_scrub_stamp":"2026-02-20T16:31:08.579934+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:10:09.095064+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00092195700000000005,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:07.496719+0000","last_change":"2026-02-20T16:31:07.496719+0000","last_active":"2026-02-20T16:31:07.496719+0000","last_peered":"2026-02-20T16:31:07.496719+0000","last_clean":"2026-02-20T16:31:07.496719+0000","last_became_active":"2026-02-20T16:30:57.954061+0000","last_became_peered":"2026-02-20T16:30:57.954061+0000","last_unstale":"2026-02-20T16:31:07.496719+0000","last_undegraded":"2026-02-20T16:31:07.496719+0000","last_fullsized":"2026-02-20T16:31:07.496719+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:31:07.496658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:31:07.496658+0000","last_clean_scrub_stamp":"2026-02-20T16:31:07.496658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T18:07:05.097557+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00025212999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:07.611206+0000","last_change":"2026-02-20T16:31:07.611206+0000","last_active":"2026-02-20T16:31:07.611206+0000","last_peered":"2026-02-20T16:31:07.611206+0000","last_clean":"2026-02-20T16:31:07.611206+0000","last_became_active":"2026-02-20T16:30:57.954099+0000","last_became_peered":"2026-02-20T16:30:57.954099+0000","last_unstale":"2026-02-20T16:31:07.611206+0000","last_undegraded":"2026-02-20T16:31:07.611206+0000","last_fullsized":"2026-02-20T16:31:07.611206+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T16:31:07.611173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T16:31:07.611173+0000","last_clean_scrub_stamp":"2026-02-20T16:31:07.611173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T04:05:57.283637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010429829999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"30'2","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:11.558739+0000","last_change":"2026-02-20T16:31:11.558739+0000","last_active":"2026-02-20T16:31:11.558739+0000","last_peered":"2026-02-20T16:31:11.558739+0000","last_clean":"2026-02-20T16:31:11.558739+0000","last_became_active":"2026-02-20T16:30:57.953999+0000","last_became_peered":"2026-02-20T16:30:57.953999+0000","last_unstale":"2026-02-20T16:31:11.558739+0000","last_undegraded":"2026-02-20T16:31:11.558739+0000","last_fullsized":"2026-02-20T16:31:11.558739+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2026-02-20T16:31:11.558698+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2026-02-20T16:31:11.558698+0000","last_clean_scrub_stamp":"2026-02-20T16:31:11.558698+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:45:41.948955+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00093713599999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"30'80","reported_seq":172,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-20T16:31:07.338483+0000","last_change":"2026-02-20T16:31:07.338483+0000","last_active":"2026-02-20T16:31:07.338483+0000","last_peered":"2026-02-20T16:31:07.338483+0000","last_clean":"2026-02-20T16:31:07.338483+0000","last_became_active":"2026-02-20T16:30:55.952756+0000","last_became_peered":"2026-02-20T16:30:55.952756+0000","last_unstale":"2026-02-20T16:31:07.338483+0000","last_undegraded":"2026-02-20T16:31:07.338483+0000","last_fullsized":"2026-02-20T16:31:07.338483+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'80","last_scrub_stamp":"2026-02-20T16:31:07.338450+0000","last_deep_scrub":"30'80","last_deep_scrub_stamp":"2026-02-20T16:31:07.338450+0000","last_clean_scrub_stamp":"2026-02-20T16:31:07.338450+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:19:39.921188+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":26,"seq":111669149704,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":252,"kb_used_omap":8,"kb_used_meta":27447,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":258048,"data_stored":88288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8340,"internal_metadata":28106604},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":25,"seq":107374182408,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":248,"kb_used_omap":8,"kb_used_meta":27447,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":253952,"data_stored":88277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8992,"internal_metadata":28105952},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":24,"seq":103079215112,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28304,"kb_used_data":832,"kb_used_omap":9,"kb_used_meta":27446,"kb_avail":94343536,"statfs":{"total":96636764160,"available":96607780864,"internally_reserved":0,"allocated":851968,"data_stored":678672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9646,"internal_metadata":28105298},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":23,"seq":98784247816,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28236,"kb_used_data":828,"kb_used_omap":7,"kb_used_meta":27384,"kb_avail":94343604,"statfs":{"total":96636764160,"available":96607850496,"internally_reserved":0,"allocated":847872,"data_stored":678645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7693,"internal_metadata":28041715},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T16:31:27.540 DEBUG:teuthology.orchestra.run.trial057:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-20T16:31:27.612 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.607+0000 7f98616ee640 1 -- 10.20.193.57:0/1411265364 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f985c081ec0 msgr2=0x7f985c134710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:27.613 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.607+0000 7f98616ee640 1 --2- 10.20.193.57:0/1411265364 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f985c081ec0 0x7f985c134710 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9844004770 tx=0x7f984402f0e0 comp rx=0 tx=0).stop 2026-02-20T16:31:27.613 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.607+0000 7f98616ee640 1 -- 10.20.193.57:0/1411265364 shutdown_connections 2026-02-20T16:31:27.613 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.607+0000 7f98616ee640 1 --2- 10.20.193.57:0/1411265364 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f985c081ec0 0x7f985c134710 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:27.613 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.607+0000 7f98616ee640 1 --2- 10.20.193.57:0/1411265364 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f985c133e00 0x7f985c1341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:27.613 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.607+0000 7f98616ee640 1 -- 10.20.193.57:0/1411265364 >> 10.20.193.57:0/1411265364 conn(0x7f985c084020 msgr2=0x7f985c084420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:27.613 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.607+0000 7f98616ee640 1 -- 10.20.193.57:0/1411265364 shutdown_connections 2026-02-20T16:31:27.613 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.607+0000 7f98616ee640 1 -- 10.20.193.57:0/1411265364 wait complete. 2026-02-20T16:31:27.614 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.608+0000 7f98616ee640 1 Processor -- start 2026-02-20T16:31:27.614 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.608+0000 7f98616ee640 1 -- start start 2026-02-20T16:31:27.614 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.608+0000 7f98616ee640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f985c080b20 0x7f985c07e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:27.614 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.608+0000 7f98616ee640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f985c081ec0 0x7f985c05c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:27.614 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.608+0000 7f98616ee640 1 --2- >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f985c133e00 0x7f985c05c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T16:31:27.614 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.608+0000 7f98616ee640 1 -- --> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] -- mon_getmap magic: 0 -- 0x7f985c196b40 con 0x7f985c080b20 2026-02-20T16:31:27.615 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.608+0000 7f98616ee640 1 -- --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_getmap magic: 0 -- 0x7f985c1969c0 con 0x7f985c081ec0 2026-02-20T16:31:27.615 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.608+0000 7f98616ee640 1 -- --> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] -- mon_getmap magic: 0 -- 0x7f985c196cc0 con 0x7f985c133e00 2026-02-20T16:31:27.615 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.608+0000 7f985affd640 1 --2- >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f985c080b20 0x7f985c07e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:27.615 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.608+0000 7f985a7fc640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f985c081ec0 0x7f985c05c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:27.615 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.608+0000 7f985a7fc640 1 --2- >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f985c081ec0 0x7f985c05c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.57:3301/0 says I am v2:10.20.193.57:36478/0 (socket says 10.20.193.57:36478) 2026-02-20T16:31:27.615 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.608+0000 7f985a7fc640 1 -- 10.20.193.57:0/2770005306 learned_addr learned my addr 10.20.193.57:0/2770005306 (peer_addr_for_me v2:10.20.193.57:0/0) 2026-02-20T16:31:27.616 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.608+0000 7f985b7fe640 1 --2- 10.20.193.57:0/2770005306 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f985c133e00 0x7f985c05c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T16:31:27.616 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.608+0000 7f985a7fc640 1 -- 10.20.193.57:0/2770005306 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f985c133e00 msgr2=0x7f985c05c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:27.616 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.608+0000 7f985a7fc640 1 --2- 10.20.193.57:0/2770005306 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f985c133e00 0x7f985c05c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:27.616 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.608+0000 7f985a7fc640 1 -- 10.20.193.57:0/2770005306 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f985c080b20 msgr2=0x7f985c07e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:27.616 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.608+0000 7f985a7fc640 1 --2- 10.20.193.57:0/2770005306 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f985c080b20 0x7f985c07e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:27.616 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.608+0000 7f985a7fc640 1 -- 10.20.193.57:0/2770005306 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f985c05bca0 con 0x7f985c081ec0 2026-02-20T16:31:27.617 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.608+0000 7f985a7fc640 1 --2- 10.20.193.57:0/2770005306 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f985c081ec0 0x7f985c05c1d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9844009230 tx=0x7f9844002900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T16:31:27.617 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.609+0000 7f983b7fe640 1 -- 10.20.193.57:0/2770005306 <== mon.1 v2:10.20.193.57:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9844046070 con 0x7f985c081ec0 2026-02-20T16:31:27.617 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.609+0000 7f983b7fe640 1 -- 10.20.193.57:0/2770005306 <== mon.1 v2:10.20.193.57:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9844002c80 con 0x7f985c081ec0 2026-02-20T16:31:27.617 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.609+0000 7f98616ee640 1 -- 10.20.193.57:0/2770005306 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f985c12e290 con 0x7f985c081ec0 2026-02-20T16:31:27.617 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.609+0000 7f983b7fe640 1 -- 10.20.193.57:0/2770005306 <== mon.1 v2:10.20.193.57:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9844038690 con 0x7f985c081ec0 2026-02-20T16:31:27.617 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.609+0000 7f98616ee640 1 -- 10.20.193.57:0/2770005306 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f985c07cae0 con 0x7f985c081ec0 2026-02-20T16:31:27.617 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.609+0000 7f98616ee640 1 -- 10.20.193.57:0/2770005306 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f985c080fa0 con 0x7f985c081ec0 2026-02-20T16:31:27.618 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.609+0000 7f983b7fe640 1 -- 10.20.193.57:0/2770005306 <== mon.1 v2:10.20.193.57:3301/0 4 ==== mgrmap(e 10) ==== 60040+0+0 (secure 0 0 0) 0x7f9844038830 con 0x7f985c081ec0 2026-02-20T16:31:27.618 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.610+0000 7f983b7fe640 1 -- 10.20.193.57:0/2770005306 <== mon.1 v2:10.20.193.57:3301/0 5 ==== osd_map(30..30 src has 1..30) ==== 3026+0+0 (secure 0 0 0) 0x7f9844088070 con 0x7f985c081ec0 2026-02-20T16:31:27.618 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.611+0000 7f983b7fe640 1 -- 10.20.193.57:0/2770005306 <== mon.1 v2:10.20.193.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+167186 (secure 0 0 0) 0x7f9844087140 con 0x7f985c081ec0 2026-02-20T16:31:27.689 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.687+0000 7f98616ee640 1 -- 10.20.193.57:0/2770005306 --> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f985c0531f0 con 0x7f985c081ec0 2026-02-20T16:31:27.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.690+0000 7f983b7fe640 1 -- 10.20.193.57:0/2770005306 <== mon.1 v2:10.20.193.57:3301/0 7 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f9844009400 con 0x7f985c081ec0 2026-02-20T16:31:27.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.690+0000 7f983b7fe640 1 -- 10.20.193.57:0/2770005306 <== mon.1 v2:10.20.193.57:3301/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v24)=0 v24) ==== 123+0+0 (secure 0 0 0) 0x7f9844086930 con 0x7f985c081ec0 2026-02-20T16:31:27.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.691+0000 7f98616ee640 1 -- 10.20.193.57:0/2770005306 >> v1:10.20.193.57:6800/2007744879 conn(0x7f982804cae0 legacy=0x7f982806cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:27.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.691+0000 7f98616ee640 1 -- 10.20.193.57:0/2770005306 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f985c081ec0 msgr2=0x7f985c05c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T16:31:27.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.691+0000 7f98616ee640 1 --2- 10.20.193.57:0/2770005306 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f985c081ec0 0x7f985c05c1d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9844009230 tx=0x7f9844002900 comp rx=0 tx=0).stop 2026-02-20T16:31:27.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.691+0000 7f98616ee640 1 -- 10.20.193.57:0/2770005306 shutdown_connections 2026-02-20T16:31:27.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.691+0000 7f98616ee640 1 --2- 10.20.193.57:0/2770005306 >> [v2:10.20.193.57:3302/0,v1:10.20.193.57:6791/0] conn(0x7f985c133e00 0x7f985c05c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:27.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.691+0000 7f98616ee640 1 --2- 10.20.193.57:0/2770005306 >> [v2:10.20.193.57:3301/0,v1:10.20.193.57:6790/0] conn(0x7f985c081ec0 0x7f985c05c1d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:27.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.691+0000 7f98616ee640 1 --2- 10.20.193.57:0/2770005306 >> [v2:10.20.193.57:3300/0,v1:10.20.193.57:6789/0] conn(0x7f985c080b20 0x7f985c07e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T16:31:27.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.691+0000 7f98616ee640 1 -- 10.20.193.57:0/2770005306 >> 10.20.193.57:0/2770005306 conn(0x7f985c084020 msgr2=0x7f985c131a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T16:31:27.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.691+0000 7f98616ee640 1 -- 10.20.193.57:0/2770005306 shutdown_connections 2026-02-20T16:31:27.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-20T16:31:27.691+0000 7f98616ee640 1 -- 10.20.193.57:0/2770005306 wait complete. 2026-02-20T16:31:27.701 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-20T16:31:27.701 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-20T16:31:27.702 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-20T16:31:27.702 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T16:31:27.747 INFO:tasks.ceph.osd.0:Stopped 2026-02-20T16:31:27.747 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-20T16:31:27.748 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T16:31:27.780 INFO:tasks.ceph.osd.1:Stopped 2026-02-20T16:31:27.781 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-20T16:31:27.781 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T16:31:27.855 INFO:tasks.ceph.osd.2:Stopped 2026-02-20T16:31:27.856 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-20T16:31:27.856 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T16:31:27.925 INFO:tasks.ceph.osd.3:Stopped 2026-02-20T16:31:27.926 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-20T16:31:27.927 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-20T16:31:27.927 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T16:31:27.987 INFO:tasks.ceph.mgr.x:Stopped 2026-02-20T16:31:27.987 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2026-02-20T16:31:27.987 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T16:31:28.048 INFO:tasks.ceph.mgr.y:Stopped 2026-02-20T16:31:28.048 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-20T16:31:28.049 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-20T16:31:28.049 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T16:31:28.097 INFO:tasks.ceph.mon.a:Stopped 2026-02-20T16:31:28.097 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-20T16:31:28.097 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T16:31:28.147 INFO:tasks.ceph.mon.b:Stopped 2026-02-20T16:31:28.147 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-20T16:31:28.147 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T16:31:28.196 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2026-02-20T16:31:28.196 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2026-02-20T16:31:28.196 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2026-02-20T16:31:28.197 INFO:tasks.ceph.mon.c:Stopped 2026-02-20T16:31:28.197 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-20T16:31:28.197 DEBUG:teuthology.orchestra.run.trial057:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'overall HEALTH_' | egrep -v '\(FS_' | egrep -v '\(MDS_' | egrep -v '\(OSD_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(CACHE_POOL_' | egrep -v '\(POOL_' | egrep -v '\(MGR_DOWN\)' | egrep -v '\(PG_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v 'Monitor daemon marked osd' | egrep -v 'Behind on trimming' | egrep -v 'Manager daemon' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v 'is offline because no MDS' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v BLUESTORE_SLOW_OP_ALERT | egrep -v 'slow operation indications in BlueStore' | egrep -v 'experiencing slow operations in BlueStore' | egrep -v MGR_MODULE_ERROR | egrep -v OSD_DOWN | egrep -v 'osd.* is down' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'osds down' | egrep -v 'osd.* is down' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'pg .* is stuck inactive' | egrep -v 'pg .* is .*degraded' | egrep -v 'pg .* is stuck peering' | egrep -v 'scrub mismatch' | egrep -v ScrubResult | egrep -v 'wrongly marked' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'overall HEALTH_' | egrep -v '\(MON_MSGR2_NOT_ENABLED\)' | egrep -v 'slow request' | head -n 1 2026-02-20T16:31:28.265 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial057.front.sepia.ceph.com 2026-02-20T16:31:28.266 DEBUG:teuthology.orchestra.run.trial057:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-20T16:31:28.343 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial057.front.sepia.ceph.com 2026-02-20T16:31:28.343 DEBUG:teuthology.orchestra.run.trial057:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-20T16:31:28.413 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial057.front.sepia.ceph.com 2026-02-20T16:31:28.413 DEBUG:teuthology.orchestra.run.trial057:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-20T16:31:28.479 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@trial057.front.sepia.ceph.com 2026-02-20T16:31:28.480 DEBUG:teuthology.orchestra.run.trial057:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2026-02-20T16:31:28.547 INFO:tasks.ceph:Archiving mon data... 2026-02-20T16:31:28.549 DEBUG:teuthology.misc:Transferring archived files from trial057:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/yuriw-2026-02-20_16:06:46-upgrade-wip-pdonnell-testing-20260219.182737-tentacle-distro-default-trial/60844/data/mon.a.tgz 2026-02-20T16:31:28.549 DEBUG:teuthology.orchestra.run.trial057:> mktemp 2026-02-20T16:31:28.604 INFO:teuthology.orchestra.run.trial057.stdout:/tmp/tmp.rOnIYhi3tl 2026-02-20T16:31:28.604 DEBUG:teuthology.orchestra.run.trial057:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.rOnIYhi3tl 2026-02-20T16:31:28.697 DEBUG:teuthology.orchestra.run.trial057:> sudo chmod 0666 /tmp/tmp.rOnIYhi3tl 2026-02-20T16:31:28.778 DEBUG:teuthology.orchestra.remote:trial057:/tmp/tmp.rOnIYhi3tl is 234KB 2026-02-20T16:31:28.839 DEBUG:teuthology.orchestra.run.trial057:> rm -fr /tmp/tmp.rOnIYhi3tl 2026-02-20T16:31:28.856 DEBUG:teuthology.misc:Transferring archived files from trial057:/var/lib/ceph/mon/ceph-b to /home/teuthworker/mnt/teuthology/yuriw-2026-02-20_16:06:46-upgrade-wip-pdonnell-testing-20260219.182737-tentacle-distro-default-trial/60844/data/mon.b.tgz 2026-02-20T16:31:28.856 DEBUG:teuthology.orchestra.run.trial057:> mktemp 2026-02-20T16:31:28.912 INFO:teuthology.orchestra.run.trial057.stdout:/tmp/tmp.6s2Zr4ipkD 2026-02-20T16:31:28.912 DEBUG:teuthology.orchestra.run.trial057:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.6s2Zr4ipkD 2026-02-20T16:31:29.009 DEBUG:teuthology.orchestra.run.trial057:> sudo chmod 0666 /tmp/tmp.6s2Zr4ipkD 2026-02-20T16:31:29.090 DEBUG:teuthology.orchestra.remote:trial057:/tmp/tmp.6s2Zr4ipkD is 276KB 2026-02-20T16:31:29.183 DEBUG:teuthology.orchestra.run.trial057:> rm -fr /tmp/tmp.6s2Zr4ipkD 2026-02-20T16:31:29.201 DEBUG:teuthology.misc:Transferring archived files from trial057:/var/lib/ceph/mon/ceph-c to /home/teuthworker/mnt/teuthology/yuriw-2026-02-20_16:06:46-upgrade-wip-pdonnell-testing-20260219.182737-tentacle-distro-default-trial/60844/data/mon.c.tgz 2026-02-20T16:31:29.201 DEBUG:teuthology.orchestra.run.trial057:> mktemp 2026-02-20T16:31:29.258 INFO:teuthology.orchestra.run.trial057.stdout:/tmp/tmp.R10t1gdWGo 2026-02-20T16:31:29.258 DEBUG:teuthology.orchestra.run.trial057:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.R10t1gdWGo 2026-02-20T16:31:29.355 DEBUG:teuthology.orchestra.run.trial057:> sudo chmod 0666 /tmp/tmp.R10t1gdWGo 2026-02-20T16:31:29.438 DEBUG:teuthology.orchestra.remote:trial057:/tmp/tmp.R10t1gdWGo is 274KB 2026-02-20T16:31:29.532 DEBUG:teuthology.orchestra.run.trial057:> rm -fr /tmp/tmp.R10t1gdWGo 2026-02-20T16:31:29.549 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-20T16:31:29.550 DEBUG:teuthology.orchestra.run.trial057:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-20T16:31:29.672 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-20T16:31:29.672 INFO:tasks.ceph:Archiving crash dumps... 2026-02-20T16:31:29.675 DEBUG:teuthology.misc:Transferring archived files from trial057:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-20_16:06:46-upgrade-wip-pdonnell-testing-20260219.182737-tentacle-distro-default-trial/60844/remote/trial057/crash 2026-02-20T16:31:29.676 DEBUG:teuthology.orchestra.run.trial057:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-20T16:31:29.737 INFO:tasks.ceph:Compressing logs... 2026-02-20T16:31:29.738 DEBUG:teuthology.orchestra.run.trial057:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-20T16:31:29.802 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43811.log 2026-02-20T16:31:29.844 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-20T16:31:29.844 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.43811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51159.log 2026-02-20T16:31:29.844 INFO:teuthology.orchestra.run.trial057.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.43811.log.gz 2026-02-20T16:31:29.844 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51192.log 2026-02-20T16:31:29.844 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.51159.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-20T16:31:29.844 INFO:teuthology.orchestra.run.trial057.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.51159.log.gz 2026-02-20T16:31:29.844 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.51192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49011.log 2026-02-20T16:31:29.844 INFO:teuthology.orchestra.run.trial057.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.51192.log.gz 2026-02-20T16:31:29.844 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48817.log 2026-02-20T16:31:29.845 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.49011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56351.log 2026-02-20T16:31:29.845 INFO:teuthology.orchestra.run.trial057.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.49011.log.gz 2026-02-20T16:31:29.845 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.48817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56516.log 2026-02-20T16:31:29.845 INFO:teuthology.orchestra.run.trial057.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.48817.log.gz 2026-02-20T16:31:29.845 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.56351.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-20T16:31:29.845 INFO:teuthology.orchestra.run.trial057.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.56351.log.gz 2026-02-20T16:31:29.845 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.56516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48406.log 2026-02-20T16:31:29.845 INFO:teuthology.orchestra.run.trial057.stderr: 85.9%/var/log/ceph/ceph-osd.0.log: -- replaced with /var/log/ceph/ceph-client.admin.56516.log.gz 2026-02-20T16:31:29.845 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2026-02-20T16:31:29.845 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57251.log 2026-02-20T16:31:29.845 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.48406.log: /var/log/ceph/ceph-mgr.y.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.48406.log.gz 2026-02-20T16:31:29.845 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56153.log 2026-02-20T16:31:29.845 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48913.log 2026-02-20T16:31:29.845 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.57251.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.57251.log.gz 2026-02-20T16:31:29.845 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.56153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48403.log 2026-02-20T16:31:29.845 INFO:teuthology.orchestra.run.trial057.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.56153.log.gz 2026-02-20T16:31:29.846 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2026-02-20T16:31:29.846 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.48913.log: /var/log/ceph/ceph-client.admin.48403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51158.log 2026-02-20T16:31:29.846 INFO:teuthology.orchestra.run.trial057.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.48913.log.gz 2026-02-20T16:31:29.846 INFO:teuthology.orchestra.run.trial057.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48403.log.gz 2026-02-20T16:31:29.846 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51355.log 2026-02-20T16:31:29.846 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.51158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48080.log 2026-02-20T16:31:29.846 INFO:teuthology.orchestra.run.trial057.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.51158.log.gz 2026-02-20T16:31:29.846 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.51355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56565.log 2026-02-20T16:31:29.846 INFO:teuthology.orchestra.run.trial057.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.51355.log.gz 2026-02-20T16:31:29.846 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.48080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47773.log 2026-02-20T16:31:29.846 INFO:teuthology.orchestra.run.trial057.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.48080.log.gz 2026-02-20T16:31:29.846 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.56565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43985.log 2026-02-20T16:31:29.846 INFO:teuthology.orchestra.run.trial057.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.56565.log.gz 2026-02-20T16:31:29.846 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.47773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42423.log 2026-02-20T16:31:29.846 INFO:teuthology.orchestra.run.trial057.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.47773.log.gz 2026-02-20T16:31:29.846 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.43985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56350.log 2026-02-20T16:31:29.846 INFO:teuthology.orchestra.run.trial057.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.43985.log.gz 2026-02-20T16:31:29.847 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.42423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48031.log 2026-02-20T16:31:29.847 INFO:teuthology.orchestra.run.trial057.stderr: 75.9% -- replaced with /var/log/ceph/ceph-client.admin.42423.log.gz 2026-02-20T16:31:29.847 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.56350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56761.log 2026-02-20T16:31:29.847 INFO:teuthology.orchestra.run.trial057.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.56350.log.gz 2026-02-20T16:31:29.847 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.48031.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2026-02-20T16:31:29.847 INFO:teuthology.orchestra.run.trial057.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.48031.log.gz 2026-02-20T16:31:29.847 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.56761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48210.log 2026-02-20T16:31:29.847 INFO:teuthology.orchestra.run.trial057.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.56761.log.gz 2026-02-20T16:31:29.847 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55683.log 2026-02-20T16:31:29.847 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.48210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55960.log 2026-02-20T16:31:29.847 INFO:teuthology.orchestra.run.trial057.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.48210.log.gz 2026-02-20T16:31:29.847 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.55683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48962.log 2026-02-20T16:31:29.847 INFO:teuthology.orchestra.run.trial057.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.55683.log.gz 2026-02-20T16:31:29.847 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43013.log 2026-02-20T16:31:29.847 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.55960.log: /var/log/ceph/ceph-client.admin.48962.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.55960.log.gz 2026-02-20T16:31:29.847 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56859.log 2026-02-20T16:31:29.847 INFO:teuthology.orchestra.run.trial057.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.48962.log.gz 2026-02-20T16:31:29.847 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.43013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50781.log 2026-02-20T16:31:29.847 INFO:teuthology.orchestra.run.trial057.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.43013.log.gz 2026-02-20T16:31:29.848 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.36110.log 2026-02-20T16:31:29.848 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.56859.log: /var/log/ceph/ceph-client.admin.50781.log: gzip -5 --verbose 86.1% -- -- replaced with /var/log/ceph/ceph-client.admin.56859.log.gz /var/log/ceph/ceph-client.admin.55732.log 2026-02-20T16:31:29.848 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-20T16:31:29.848 INFO:teuthology.orchestra.run.trial057.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.50781.log.gz 2026-02-20T16:31:29.848 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph.tmp-client.admin.36110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43293.log 0.0% 2026-02-20T16:31:29.848 INFO:teuthology.orchestra.run.trial057.stderr: -- replaced with /var/log/ceph/ceph.tmp-client.admin.36110.log.gz 2026-02-20T16:31:29.848 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.55732.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.55732.log.gz 2026-02-20T16:31:29.848 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55448.log 2026-02-20T16:31:29.848 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.43293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48405.log 2026-02-20T16:31:29.848 INFO:teuthology.orchestra.run.trial057.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.43293.log.gz 2026-02-20T16:31:29.848 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.55448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42657.log 2026-02-20T16:31:29.848 INFO:teuthology.orchestra.run.trial057.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.55448.log.gz 2026-02-20T16:31:29.848 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.48405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55959.log 2026-02-20T16:31:29.848 INFO:teuthology.orchestra.run.trial057.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.48405.log.gz 2026-02-20T16:31:29.848 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.42657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48575.log 2026-02-20T16:31:29.848 INFO:teuthology.orchestra.run.trial057.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42657.log.gz 2026-02-20T16:31:29.848 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.55959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42802.log 2026-02-20T16:31:29.848 INFO:teuthology.orchestra.run.trial057.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.55959.log.gz 2026-02-20T16:31:29.848 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.48575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56349.log 2026-02-20T16:31:29.849 INFO:teuthology.orchestra.run.trial057.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.48575.log.gz 2026-02-20T16:31:29.849 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.42802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48626.log 2026-02-20T16:31:29.849 INFO:teuthology.orchestra.run.trial057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42802.log.gz 2026-02-20T16:31:29.849 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.56349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47843.log 2026-02-20T16:31:29.849 INFO:teuthology.orchestra.run.trial057.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.56349.log.gz 2026-02-20T16:31:29.849 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.48626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57298.log 2026-02-20T16:31:29.849 INFO:teuthology.orchestra.run.trial057.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.48626.log.gz 2026-02-20T16:31:29.849 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43223.log 2026-02-20T16:31:29.849 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.47843.log: /var/log/ceph/ceph-client.admin.57298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53586.log 2026-02-20T16:31:29.849 INFO:teuthology.orchestra.run.trial057.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.47843.log.gz 2026-02-20T16:31:29.849 INFO:teuthology.orchestra.run.trial057.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.57298.log.gz 2026-02-20T16:31:29.849 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.43223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51354.log 2026-02-20T16:31:29.849 INFO:teuthology.orchestra.run.trial057.stderr: 77.1% -- replaced with /var/log/ceph/ceph-client.admin.43223.log.gz 2026-02-20T16:31:29.849 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.53586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42838.log 2026-02-20T16:31:29.849 INFO:teuthology.orchestra.run.trial057.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.53586.log.gz 2026-02-20T16:31:29.849 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.51354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57202.log 2026-02-20T16:31:29.849 INFO:teuthology.orchestra.run.trial057.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.51354.log.gz 2026-02-20T16:31:29.849 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.42838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57006.log 2026-02-20T16:31:29.850 INFO:teuthology.orchestra.run.trial057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42838.log.gz 2026-02-20T16:31:29.850 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.57202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47868.log 2026-02-20T16:31:29.850 INFO:teuthology.orchestra.run.trial057.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.57202.log.gz 2026-02-20T16:31:29.850 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.57006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42698.log 2026-02-20T16:31:29.850 INFO:teuthology.orchestra.run.trial057.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.57006.log.gz 2026-02-20T16:31:29.850 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.47868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49058.log 2026-02-20T16:31:29.850 INFO:teuthology.orchestra.run.trial057.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.47868.log.gz 2026-02-20T16:31:29.850 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.42698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48818.log 2026-02-20T16:31:29.850 INFO:teuthology.orchestra.run.trial057.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.42698.log.gz 2026-02-20T16:31:29.850 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.49058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57153.log 2026-02-20T16:31:29.850 INFO:teuthology.orchestra.run.trial057.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.49058.log.gz 2026-02-20T16:31:29.850 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.48818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55401.log 2026-02-20T16:31:29.850 INFO:teuthology.orchestra.run.trial057.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.48818.log.gz 2026-02-20T16:31:29.850 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.57153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51497.log 2026-02-20T16:31:29.850 INFO:teuthology.orchestra.run.trial057.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.57153.log.gz 2026-02-20T16:31:29.850 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.55401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50783.log 2026-02-20T16:31:29.850 INFO:teuthology.orchestra.run.trial057.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.55401.log.gz 2026-02-20T16:31:29.850 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.51497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50604.log 2026-02-20T16:31:29.850 INFO:teuthology.orchestra.run.trial057.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.51497.log.gz 2026-02-20T16:31:29.850 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.50783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56810.log 2026-02-20T16:31:29.851 INFO:teuthology.orchestra.run.trial057.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.50783.log.gz 2026-02-20T16:31:29.851 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.50604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51546.log 2026-02-20T16:31:29.851 INFO:teuthology.orchestra.run.trial057.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.50604.log.gz 2026-02-20T16:31:29.851 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.56810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47982.log 2026-02-20T16:31:29.851 INFO:teuthology.orchestra.run.trial057.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.56810.log.gz 2026-02-20T16:31:29.851 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.51546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56352.log 2026-02-20T16:31:29.851 INFO:teuthology.orchestra.run.trial057.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.51546.log.gz 2026-02-20T16:31:29.851 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42908.log 2026-02-20T16:31:29.851 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.47982.log: /var/log/ceph/ceph-client.admin.56352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56712.log 2026-02-20T16:31:29.851 INFO:teuthology.orchestra.run.trial057.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.47982.log.gz 2026-02-20T16:31:29.851 INFO:teuthology.orchestra.run.trial057.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.56352.log.gz 2026-02-20T16:31:29.851 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.42908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42943.log 2026-02-20T16:31:29.851 INFO:teuthology.orchestra.run.trial057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42908.log.gz 2026-02-20T16:31:29.851 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.56712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56467.log 2026-02-20T16:31:29.851 INFO:teuthology.orchestra.run.trial057.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.56712.log.gz 2026-02-20T16:31:29.851 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.42943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51157.log 2026-02-20T16:31:29.851 INFO:teuthology.orchestra.run.trial057.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.42943.log.gz 2026-02-20T16:31:29.851 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.56467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56155.log 2026-02-20T16:31:29.851 INFO:teuthology.orchestra.run.trial057.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.56467.log.gz 2026-02-20T16:31:29.851 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.51157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43048.log 2026-02-20T16:31:29.851 INFO:teuthology.orchestra.run.trial057.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.51157.log.gz 2026-02-20T16:31:29.851 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.56155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42725.log 2026-02-20T16:31:29.852 INFO:teuthology.orchestra.run.trial057.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.56155.log.gz 2026-02-20T16:31:29.852 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.43048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48208.log 2026-02-20T16:31:29.852 INFO:teuthology.orchestra.run.trial057.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.43048.log.gz 2026-02-20T16:31:29.852 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.42725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42867.log 2026-02-20T16:31:29.852 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.48208.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.42725.log.gz 2026-02-20T16:31:29.852 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56663.log 2026-02-20T16:31:29.852 INFO:teuthology.orchestra.run.trial057.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.48208.log.gz 2026-02-20T16:31:29.852 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.42867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50779.log 2026-02-20T16:31:29.852 INFO:teuthology.orchestra.run.trial057.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.42867.log.gz 2026-02-20T16:31:29.852 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.56663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43858.log 2026-02-20T16:31:29.852 INFO:teuthology.orchestra.run.trial057.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.56663.log.gz 2026-02-20T16:31:29.852 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.50779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44032.log 2026-02-20T16:31:29.852 INFO:teuthology.orchestra.run.trial057.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.50779.log.gz 2026-02-20T16:31:29.852 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.43858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47658.log 2026-02-20T16:31:29.852 INFO:teuthology.orchestra.run.trial057.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.43858.log.gz 2026-02-20T16:31:29.852 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.44032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57055.log 2026-02-20T16:31:29.852 INFO:teuthology.orchestra.run.trial057.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44032.log.gz 2026-02-20T16:31:29.852 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.47658.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-20T16:31:29.852 INFO:teuthology.orchestra.run.trial057.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.47658.log.gz 2026-02-20T16:31:29.852 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.57055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51595.log 2026-02-20T16:31:29.853 INFO:teuthology.orchestra.run.trial057.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.57055.log.gz 2026-02-20T16:31:29.853 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48209.log 2026-02-20T16:31:29.853 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.51595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50445.log 2026-02-20T16:31:29.853 INFO:teuthology.orchestra.run.trial057.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.51595.log.gz 2026-02-20T16:31:29.853 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.48209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55589.log 2026-02-20T16:31:29.853 INFO:teuthology.orchestra.run.trial057.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2026-02-20T16:31:29.853 INFO:teuthology.orchestra.run.trial057.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.48209.log.gz 2026-02-20T16:31:29.853 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2026-02-20T16:31:29.853 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.50445.log: 95.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-20T16:31:29.853 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.55589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55637.log 2026-02-20T16:31:29.853 INFO:teuthology.orchestra.run.trial057.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.50445.log.gz 2026-02-20T16:31:29.853 INFO:teuthology.orchestra.run.trial057.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.55589.log.gz 2026-02-20T16:31:29.853 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44200.log 2026-02-20T16:31:29.853 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.55637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43663.log 2026-02-20T16:31:29.853 INFO:teuthology.orchestra.run.trial057.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.55637.log.gz 2026-02-20T16:31:29.853 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.44200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48741.log 2026-02-20T16:31:29.853 INFO:teuthology.orchestra.run.trial057.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44200.log.gz 2026-02-20T16:31:29.853 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.43663.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-20T16:31:29.853 INFO:teuthology.orchestra.run.trial057.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.43663.log.gz 2026-02-20T16:31:29.853 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.48741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48744.log 2026-02-20T16:31:29.853 INFO:teuthology.orchestra.run.trial057.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.48741.log.gz 2026-02-20T16:31:29.853 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44268.log 2026-02-20T16:31:29.853 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.48744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55542.log 2026-02-20T16:31:29.854 INFO:teuthology.orchestra.run.trial057.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.48744.log.gz 2026-02-20T16:31:29.854 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.44268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50782.log 2026-02-20T16:31:29.854 INFO:teuthology.orchestra.run.trial057.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.44268.log.gz 2026-02-20T16:31:29.854 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.55542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43083.log 2026-02-20T16:31:29.854 INFO:teuthology.orchestra.run.trial057.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.55542.log.gz 2026-02-20T16:31:29.854 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.50782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57104.log 2026-02-20T16:31:29.854 INFO:teuthology.orchestra.run.trial057.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-20T16:31:29.854 INFO:teuthology.orchestra.run.trial057.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.50782.log.gz 2026-02-20T16:31:29.854 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.43083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42975.log 2026-02-20T16:31:29.854 INFO:teuthology.orchestra.run.trial057.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.43083.log.gz 2026-02-20T16:31:29.854 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.57104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43153.log 2026-02-20T16:31:29.854 INFO:teuthology.orchestra.run.trial057.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.57104.log.gz 2026-02-20T16:31:29.854 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.42975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42768.log 2026-02-20T16:31:29.854 INFO:teuthology.orchestra.run.trial057.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42975.log.gz 2026-02-20T16:31:29.854 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.43153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56614.log 2026-02-20T16:31:29.854 INFO:teuthology.orchestra.run.trial057.stderr: 74.8% -- replaced with /var/log/ceph/ceph-client.admin.43153.log.gz 2026-02-20T16:31:29.854 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.42768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47933.log 2026-02-20T16:31:29.854 INFO:teuthology.orchestra.run.trial057.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.42768.log.gz 2026-02-20T16:31:29.854 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.56614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42585.log 2026-02-20T16:31:29.854 INFO:teuthology.orchestra.run.trial057.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.56614.log.gz 2026-02-20T16:31:29.854 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.47933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50653.log 2026-02-20T16:31:29.854 INFO:teuthology.orchestra.run.trial057.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.47933.log.gz 2026-02-20T16:31:29.855 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.42585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50978.log 2026-02-20T16:31:29.855 INFO:teuthology.orchestra.run.trial057.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.42585.log.gz 2026-02-20T16:31:29.855 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.50653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55830.log 2026-02-20T16:31:29.855 INFO:teuthology.orchestra.run.trial057.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.50653.log.gz 2026-02-20T16:31:29.855 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.50978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56957.log 2026-02-20T16:31:29.855 INFO:teuthology.orchestra.run.trial057.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.50978.log.gz 2026-02-20T16:31:29.855 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.55830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43112.log 2026-02-20T16:31:29.855 INFO:teuthology.orchestra.run.trial057.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.55830.log.gz 2026-02-20T16:31:29.855 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.56957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48207.log 2026-02-20T16:31:29.855 INFO:teuthology.orchestra.run.trial057.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.56957.log.gz 2026-02-20T16:31:29.855 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.43112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51353.log 2026-02-20T16:31:29.855 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.48207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55957.log 2026-02-20T16:31:29.855 INFO:teuthology.orchestra.run.trial057.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.48207.log.gz 2026-02-20T16:31:29.855 INFO:teuthology.orchestra.run.trial057.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43112.log.gz 2026-02-20T16:31:29.855 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.51353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51644.log 2026-02-20T16:31:29.855 INFO:teuthology.orchestra.run.trial057.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.51353.log.gz 2026-02-20T16:31:29.855 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.55957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49105.log 2026-02-20T16:31:29.855 INFO:teuthology.orchestra.run.trial057.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.55957.log.gz 2026-02-20T16:31:29.855 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.51644.log: gzip 86.7% -- replaced with /var/log/ceph/ceph-client.admin.51644.log.gz -5 2026-02-20T16:31:29.855 INFO:teuthology.orchestra.run.trial057.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48573.log 2026-02-20T16:31:29.855 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51734.log 2026-02-20T16:31:29.855 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.49105.log: /var/log/ceph/ceph-client.admin.48573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55958.log 2026-02-20T16:31:29.855 INFO:teuthology.orchestra.run.trial057.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.49105.log.gz 2026-02-20T16:31:29.856 INFO:teuthology.orchestra.run.trial057.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.48573.log.gz 2026-02-20T16:31:29.856 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.51734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56156.log 2026-02-20T16:31:29.856 INFO:teuthology.orchestra.run.trial057.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.51734.log.gz 2026-02-20T16:31:29.856 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.55958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50976.log 2026-02-20T16:31:29.856 INFO:teuthology.orchestra.run.trial057.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.55958.log.gz 2026-02-20T16:31:29.856 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.56156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56154.log 2026-02-20T16:31:29.856 INFO:teuthology.orchestra.run.trial057.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.56156.log.gz 2026-02-20T16:31:29.856 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51387.log 2026-02-20T16:31:29.856 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.50976.log: 86.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.50976.log.gz 2026-02-20T16:31:29.856 INFO:teuthology.orchestra.run.trial057.stderr: -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-20T16:31:29.856 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.56154.log: /var/log/ceph/ceph-client.admin.51387.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.56154.log.gzgzip 2026-02-20T16:31:29.856 INFO:teuthology.orchestra.run.trial057.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50977.log 2026-02-20T16:31:29.856 INFO:teuthology.orchestra.run.trial057.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51387.log.gz 2026-02-20T16:31:29.856 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56908.log 2026-02-20T16:31:29.856 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50979.log 2026-02-20T16:31:29.856 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.50977.log: /var/log/ceph/ceph-client.admin.56908.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.50977.log.gz 2026-02-20T16:31:29.856 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-20T16:31:29.856 INFO:teuthology.orchestra.run.trial057.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.56908.log.gz 2026-02-20T16:31:29.856 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.50979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52659.log 2026-02-20T16:31:29.856 INFO:teuthology.orchestra.run.trial057.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.50979.log.gz 2026-02-20T16:31:29.856 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42627.log 2026-02-20T16:31:29.856 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph.log: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-20T16:31:29.857 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.52659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55495.log 2026-02-20T16:31:29.857 INFO:teuthology.orchestra.run.trial057.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.52659.log.gz 2026-02-20T16:31:29.857 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.42627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43616.log 2026-02-20T16:31:29.857 INFO:teuthology.orchestra.run.trial057.stderr: 75.1% -- replaced with /var/log/ceph/ceph-client.admin.42627.log.gz 2026-02-20T16:31:29.857 INFO:teuthology.orchestra.run.trial057.stderr: 93.8% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-20T16:31:29.857 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.55495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48404.log 2026-02-20T16:31:29.857 INFO:teuthology.orchestra.run.trial057.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.55495.log.gz 2026-02-20T16:31:29.857 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.43616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43188.log 2026-02-20T16:31:29.857 INFO:teuthology.orchestra.run.trial057.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43616.log.gz 2026-02-20T16:31:29.857 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.48404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48574.log 2026-02-20T16:31:29.857 INFO:teuthology.orchestra.run.trial057.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.48404.log.gz 2026-02-20T16:31:29.857 INFO:teuthology.orchestra.run.trial057.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-20T16:31:29.857 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.43188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55781.log 2026-02-20T16:31:29.857 INFO:teuthology.orchestra.run.trial057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43188.log.gz 2026-02-20T16:31:29.857 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.48574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54500.log 2026-02-20T16:31:29.857 INFO:teuthology.orchestra.run.trial057.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.48574.log.gz 2026-02-20T16:31:29.857 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.55781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43250.log 2026-02-20T16:31:29.857 INFO:teuthology.orchestra.run.trial057.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.55781.log.gz 2026-02-20T16:31:29.857 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.54500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55660.log 2026-02-20T16:31:29.857 INFO:teuthology.orchestra.run.trial057.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.54500.log.gz 2026-02-20T16:31:29.857 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.43250.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43250.log.gz 2026-02-20T16:31:29.857 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.55660.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.55660.log.gz 2026-02-20T16:31:29.857 INFO:teuthology.orchestra.run.trial057.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2026-02-20T16:31:29.858 INFO:teuthology.orchestra.run.trial057.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2026-02-20T16:31:29.858 INFO:teuthology.orchestra.run.trial057.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2026-02-20T16:31:29.863 INFO:teuthology.orchestra.run.trial057.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-20T16:31:29.870 INFO:teuthology.orchestra.run.trial057.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-20T16:31:29.871 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-20T16:31:29.871 INFO:teuthology.orchestra.run.trial057.stderr:real 0m0.077s 2026-02-20T16:31:29.871 INFO:teuthology.orchestra.run.trial057.stderr:user 0m0.304s 2026-02-20T16:31:29.871 INFO:teuthology.orchestra.run.trial057.stderr:sys 0m0.077s 2026-02-20T16:31:29.871 INFO:tasks.ceph:Archiving logs... 2026-02-20T16:31:29.871 DEBUG:teuthology.misc:Transferring archived files from trial057:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-20_16:06:46-upgrade-wip-pdonnell-testing-20260219.182737-tentacle-distro-default-trial/60844/remote/trial057/log 2026-02-20T16:31:29.873 DEBUG:teuthology.orchestra.run.trial057:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-20T16:31:30.072 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-20T16:31:30.090 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-20T16:31:30.090 DEBUG:teuthology.orchestra.run.trial057:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-20T16:31:30.348 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-20T16:31:30.360 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-20T16:31:30.360 DEBUG:teuthology.orchestra.run.trial057:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-20T16:31:30.376 INFO:teuthology.orchestra.run.trial057.stderr:bash: line 1: ntpq: command not found 2026-02-20T16:31:30.426 INFO:teuthology.orchestra.run.trial057.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-20T16:31:30.426 INFO:teuthology.orchestra.run.trial057.stdout:=============================================================================== 2026-02-20T16:31:30.426 INFO:teuthology.orchestra.run.trial057.stdout:^+ s2-b.time.mci1.us.rozint> 2 6 177 96 +434us[ +621us] +/- 23ms 2026-02-20T16:31:30.426 INFO:teuthology.orchestra.run.trial057.stdout:^* ntp4.glypnod.com 2 6 177 31 -75us[ -151us] +/- 14ms 2026-02-20T16:31:30.427 INFO:teuthology.orchestra.run.trial057.stdout:^+ 172-238-164-57.ip.linode> 4 6 177 30 -3752us[-3752us] +/- 33ms 2026-02-20T16:31:30.427 INFO:teuthology.orchestra.run.trial057.stdout:^+ 149.28.61.105.vultruserc> 3 6 177 32 +467us[ +391us] +/- 33ms 2026-02-20T16:31:30.427 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-20T16:31:30.451 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-20T16:31:30.451 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-20T16:31:30.468 DEBUG:teuthology.orchestra.run.trial057:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-20T16:31:30.524 DEBUG:teuthology.orchestra.run.trial057:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2026-02-20T16:31:30.551 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T16:31:30.552 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-20T16:31:30.570 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-20T16:31:30.582 INFO:teuthology.task.internal:Duration was 394.625918 seconds 2026-02-20T16:31:30.582 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-20T16:31:30.595 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-20T16:31:30.595 DEBUG:teuthology.orchestra.run.trial057:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-20T16:31:30.631 INFO:teuthology.orchestra.run.trial057.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-20T16:31:30.966 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-20T16:31:30.966 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial057.front.sepia.ceph.com 2026-02-20T16:31:30.967 DEBUG:teuthology.orchestra.run.trial057:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-20T16:31:31.024 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-20T16:31:31.024 DEBUG:teuthology.orchestra.run.trial057:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-20T16:31:31.126 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-20T16:31:31.127 DEBUG:teuthology.orchestra.run.trial057:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-20T16:31:31.150 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T16:31:31.151 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T16:31:31.151 INFO:teuthology.orchestra.run.trial057.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-20T16:31:31.151 INFO:teuthology.orchestra.run.trial057.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-20T16:31:31.151 INFO:teuthology.orchestra.run.trial057.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-20T16:31:31.161 INFO:teuthology.orchestra.run.trial057.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 82.2% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-20T16:31:31.163 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-20T16:31:31.179 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-20T16:31:31.179 DEBUG:teuthology.orchestra.run.trial057:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-20T16:31:31.228 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-20T16:31:31.247 DEBUG:teuthology.orchestra.run.trial057:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-20T16:31:31.291 INFO:teuthology.orchestra.run.trial057.stdout:kernel.core_pattern = core 2026-02-20T16:31:31.305 DEBUG:teuthology.orchestra.run.trial057:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-20T16:31:31.360 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T16:31:31.361 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-20T16:31:31.381 INFO:teuthology.task.internal:Transferring archived files... 2026-02-20T16:31:31.382 DEBUG:teuthology.misc:Transferring archived files from trial057:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-20_16:06:46-upgrade-wip-pdonnell-testing-20260219.182737-tentacle-distro-default-trial/60844/remote/trial057 2026-02-20T16:31:31.382 DEBUG:teuthology.orchestra.run.trial057:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-20T16:31:31.442 INFO:teuthology.task.internal:Removing archive directory... 2026-02-20T16:31:31.443 DEBUG:teuthology.orchestra.run.trial057:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-20T16:31:31.488 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-20T16:31:31.509 INFO:teuthology.task.internal:Not uploading archives. 2026-02-20T16:31:31.509 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-20T16:31:31.529 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-20T16:31:31.529 DEBUG:teuthology.orchestra.run.trial057:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-20T16:31:31.546 INFO:teuthology.orchestra.run.trial057.stdout: 917576 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 20 16:31 /home/ubuntu/cephtest 2026-02-20T16:31:31.548 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-20T16:31:31.568 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-20T16:31:31.612 INFO:teuthology.run:Summary data: description: upgrade/cephfs/nofs/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} kernel no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn pg_health} tasks/{0-from/squid 1-upgrade}} duration: 394.62591767311096 flavor: default owner: scheduled_yuriw@soko04.front.sepia.ceph.com success: true 2026-02-20T16:31:31.612 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-20T16:31:31.726 INFO:teuthology.run:pass