2026-02-22T23:18:32.377 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-22T23:18:32.393 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-22T23:18:32.473 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64383 branch: wip-yuri6-testing-2026-02-22-1629-squid description: rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} tasks/libcephsqlite} email: yweinste@redhat.com first_in_suite: false flavor: default job_id: '64383' kernel: branch: distro kdb: true sha1: distro last_in_suite: false machine_type: trial name: yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 10 - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-yuri6-testing-2026-02-22-1629-squid ceph: conf: client: debug cephsqlite: 20 debug client: 20 debug ms: 1 global: mon client directed command retry: 5 mon election default strategy: 1 ms bind msgr2: false ms inject socket failures: 1500 ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub interval: 300 paxos service trim min: 10 osd: bdev async discard: true bdev enable discard: true bluestore allocator: stupid bluestore block size: 96636764160 bluestore fsck on mount: true bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd mclock skip benchmark: true osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - POOL_APP_NOT_ENABLED - do not have an application enabled mon_bind_msgr2: false sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri6-testing-2026-02-22-1629-squid sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 owner: scheduled_yuriw@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 5907 sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-yuri6-testing-2026-02-22-1629-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 targets: trial093.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMrpK6O9hi0YPkGzlrwOiunQhIXZQYy5DJiKIAvhUNP0GcrB/u6tqGlRpVhAjaqmgjaoXcjy1mpcE7084f178PA= trial155.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE4hf29MP+OplcqrNbhRhyoWqarvAYUR/Y+p2tDRAfm29sBTt4XuVIq4Ml6LJUFIa5eiJrNNqtTwDLkTRSHkgz4= tasks: - install: extra_system_packages: deb: - sqlite3 rpm: - sqlite-devel - ceph: null - exec: client.0: - ceph osd pool create cephsqlite - ceph auth get-or-create client.libcephsqlite mon 'profile simple-rados-client-with-blocklist' osd 'allow rwx pool=cephsqlite' >> /etc/ceph/ceph.keyring - exec: client.0: - ceph_test_libcephsqlite --id libcephsqlite --no-log-to-stderr - workunit: clients: client.0: - rados/test_libcephsqlite.sh cephsqlite env: CEPH_ARGS: --id libcephsqlite --no-log-to-stderr teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-22_19:35:40 tube: trial user: yuriw verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3318653 2026-02-22T23:18:32.474 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa; will attempt to use it 2026-02-22T23:18:32.474 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa/tasks 2026-02-22T23:18:32.474 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-22T23:18:32.476 INFO:teuthology.task.internal:Checking packages... 2026-02-22T23:18:32.476 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'f90f4eaebb28b619cf76e80cbbe997656da69579' 2026-02-22T23:18:32.476 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-22T23:18:32.476 INFO:teuthology.packaging:ref: None 2026-02-22T23:18:32.476 INFO:teuthology.packaging:tag: None 2026-02-22T23:18:32.476 INFO:teuthology.packaging:branch: wip-yuri6-testing-2026-02-22-1629-squid 2026-02-22T23:18:32.476 INFO:teuthology.packaging:sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-22T23:18:32.476 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-yuri6-testing-2026-02-22-1629-squid 2026-02-22T23:18:32.593 INFO:teuthology.task.internal:Found packages for ceph version 19.2.3-689.gf90f4eae 2026-02-22T23:18:32.594 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-22T23:18:32.606 INFO:teuthology.task.internal:no buildpackages task found 2026-02-22T23:18:32.606 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-22T23:18:32.619 INFO:teuthology.task.internal:Saving configuration 2026-02-22T23:18:32.631 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-22T23:18:32.643 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-22T23:18:32.719 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial093.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64383', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-22 23:15:02.436933', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMrpK6O9hi0YPkGzlrwOiunQhIXZQYy5DJiKIAvhUNP0GcrB/u6tqGlRpVhAjaqmgjaoXcjy1mpcE7084f178PA='} 2026-02-22T23:18:32.777 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial155.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64383', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-22 23:15:02.437574', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE4hf29MP+OplcqrNbhRhyoWqarvAYUR/Y+p2tDRAfm29sBTt4XuVIq4Ml6LJUFIa5eiJrNNqtTwDLkTRSHkgz4='} 2026-02-22T23:18:32.777 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-22T23:18:32.788 INFO:teuthology.task.internal:roles: ubuntu@trial093.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2026-02-22T23:18:32.788 INFO:teuthology.task.internal:roles: ubuntu@trial155.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2026-02-22T23:18:32.788 INFO:teuthology.run_tasks:Running task console_log... 2026-02-22T23:18:32.923 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7b32208f1a80>, signals=[15]) 2026-02-22T23:18:32.923 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-22T23:18:32.934 INFO:teuthology.task.internal:Opening connections... 2026-02-22T23:18:32.934 DEBUG:teuthology.task.internal:connecting to ubuntu@trial093.front.sepia.ceph.com 2026-02-22T23:18:32.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-22T23:18:32.995 DEBUG:teuthology.task.internal:connecting to ubuntu@trial155.front.sepia.ceph.com 2026-02-22T23:18:32.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-22T23:18:33.055 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-22T23:18:33.066 DEBUG:teuthology.orchestra.run.trial093:> uname -m 2026-02-22T23:18:33.081 INFO:teuthology.orchestra.run.trial093.stdout:x86_64 2026-02-22T23:18:33.081 DEBUG:teuthology.orchestra.run.trial093:> cat /etc/os-release 2026-02-22T23:18:33.137 INFO:teuthology.orchestra.run.trial093.stdout:NAME="CentOS Stream" 2026-02-22T23:18:33.137 INFO:teuthology.orchestra.run.trial093.stdout:VERSION="9" 2026-02-22T23:18:33.137 INFO:teuthology.orchestra.run.trial093.stdout:ID="centos" 2026-02-22T23:18:33.137 INFO:teuthology.orchestra.run.trial093.stdout:ID_LIKE="rhel fedora" 2026-02-22T23:18:33.137 INFO:teuthology.orchestra.run.trial093.stdout:VERSION_ID="9" 2026-02-22T23:18:33.137 INFO:teuthology.orchestra.run.trial093.stdout:PLATFORM_ID="platform:el9" 2026-02-22T23:18:33.137 INFO:teuthology.orchestra.run.trial093.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-22T23:18:33.138 INFO:teuthology.orchestra.run.trial093.stdout:ANSI_COLOR="0;31" 2026-02-22T23:18:33.138 INFO:teuthology.orchestra.run.trial093.stdout:LOGO="fedora-logo-icon" 2026-02-22T23:18:33.138 INFO:teuthology.orchestra.run.trial093.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-22T23:18:33.138 INFO:teuthology.orchestra.run.trial093.stdout:HOME_URL="https://centos.org/" 2026-02-22T23:18:33.138 INFO:teuthology.orchestra.run.trial093.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-22T23:18:33.138 INFO:teuthology.orchestra.run.trial093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-22T23:18:33.138 INFO:teuthology.orchestra.run.trial093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-22T23:18:33.138 INFO:teuthology.lock.ops:Updating trial093.front.sepia.ceph.com on lock server 2026-02-22T23:18:33.214 DEBUG:teuthology.orchestra.run.trial155:> uname -m 2026-02-22T23:18:33.229 INFO:teuthology.orchestra.run.trial155.stdout:x86_64 2026-02-22T23:18:33.229 DEBUG:teuthology.orchestra.run.trial155:> cat /etc/os-release 2026-02-22T23:18:33.285 INFO:teuthology.orchestra.run.trial155.stdout:NAME="CentOS Stream" 2026-02-22T23:18:33.285 INFO:teuthology.orchestra.run.trial155.stdout:VERSION="9" 2026-02-22T23:18:33.286 INFO:teuthology.orchestra.run.trial155.stdout:ID="centos" 2026-02-22T23:18:33.286 INFO:teuthology.orchestra.run.trial155.stdout:ID_LIKE="rhel fedora" 2026-02-22T23:18:33.286 INFO:teuthology.orchestra.run.trial155.stdout:VERSION_ID="9" 2026-02-22T23:18:33.286 INFO:teuthology.orchestra.run.trial155.stdout:PLATFORM_ID="platform:el9" 2026-02-22T23:18:33.286 INFO:teuthology.orchestra.run.trial155.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-22T23:18:33.286 INFO:teuthology.orchestra.run.trial155.stdout:ANSI_COLOR="0;31" 2026-02-22T23:18:33.286 INFO:teuthology.orchestra.run.trial155.stdout:LOGO="fedora-logo-icon" 2026-02-22T23:18:33.286 INFO:teuthology.orchestra.run.trial155.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-22T23:18:33.286 INFO:teuthology.orchestra.run.trial155.stdout:HOME_URL="https://centos.org/" 2026-02-22T23:18:33.286 INFO:teuthology.orchestra.run.trial155.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-22T23:18:33.287 INFO:teuthology.orchestra.run.trial155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-22T23:18:33.287 INFO:teuthology.orchestra.run.trial155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-22T23:18:33.287 INFO:teuthology.lock.ops:Updating trial155.front.sepia.ceph.com on lock server 2026-02-22T23:18:33.360 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-22T23:18:33.371 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-22T23:18:33.383 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-22T23:18:33.384 DEBUG:teuthology.orchestra.run.trial093:> test '!' -e /home/ubuntu/cephtest 2026-02-22T23:18:33.385 DEBUG:teuthology.orchestra.run.trial155:> test '!' -e /home/ubuntu/cephtest 2026-02-22T23:18:33.400 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-22T23:18:33.410 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-22T23:18:33.410 DEBUG:teuthology.orchestra.run.trial093:> test -z $(ls -A /var/lib/ceph) 2026-02-22T23:18:33.441 DEBUG:teuthology.orchestra.run.trial155:> test -z $(ls -A /var/lib/ceph) 2026-02-22T23:18:33.458 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-22T23:18:33.612 INFO:teuthology.run_tasks:Running task kernel... 2026-02-22T23:18:33.631 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': True, 'sha1': 'distro'} 2026-02-22T23:18:33.632 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'mon.b': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, timeout 300 2026-02-22T23:18:33.632 DEBUG:teuthology.orchestra.run.trial093:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-22T23:18:33.632 DEBUG:teuthology.orchestra.run.trial155:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-22T23:18:33.646 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T23:18:33.647 DEBUG:teuthology.orchestra.run.trial155:> uname -r 2026-02-22T23:18:33.647 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T23:18:33.647 DEBUG:teuthology.orchestra.run.trial093:> uname -r 2026-02-22T23:18:33.702 INFO:teuthology.orchestra.run.trial155.stdout:5.14.0-681.el9.x86_64 2026-02-22T23:18:33.702 INFO:teuthology.task.kernel:Running kernel on trial155: 5.14.0-681.el9.x86_64 2026-02-22T23:18:33.702 DEBUG:teuthology.orchestra.run.trial155:> sudo yum install -y kernel 2026-02-22T23:18:33.703 INFO:teuthology.orchestra.run.trial093.stdout:5.14.0-681.el9.x86_64 2026-02-22T23:18:33.703 INFO:teuthology.task.kernel:Running kernel on trial093: 5.14.0-681.el9.x86_64 2026-02-22T23:18:33.703 DEBUG:teuthology.orchestra.run.trial093:> sudo yum install -y kernel 2026-02-22T23:18:35.167 INFO:teuthology.orchestra.run.trial155.stdout:CentOS Stream 9 - BaseOS 8.2 MB/s | 8.9 MB 00:01 2026-02-22T23:18:36.170 INFO:teuthology.orchestra.run.trial093.stdout:CentOS Stream 9 - BaseOS 4.3 MB/s | 8.9 MB 00:02 2026-02-22T23:19:02.533 INFO:teuthology.orchestra.run.trial155.stdout:CentOS Stream 9 - AppStream 1.0 MB/s | 27 MB 00:26 2026-02-22T23:19:03.562 INFO:teuthology.orchestra.run.trial093.stdout:CentOS Stream 9 - AppStream 1.0 MB/s | 27 MB 00:26 2026-02-22T23:19:06.123 INFO:teuthology.orchestra.run.trial155.stdout:CentOS Stream 9 - CRB 6.3 MB/s | 7.8 MB 00:01 2026-02-22T23:19:06.921 INFO:teuthology.orchestra.run.trial093.stdout:CentOS Stream 9 - CRB 7.6 MB/s | 7.8 MB 00:01 2026-02-22T23:19:07.337 INFO:teuthology.orchestra.run.trial155.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 20 kB 00:00 2026-02-22T23:19:07.722 INFO:teuthology.orchestra.run.trial093.stdout:CentOS Stream 9 - Extras packages 255 kB/s | 20 kB 00:00 2026-02-22T23:19:08.042 INFO:teuthology.orchestra.run.trial155.stdout:Extra Packages for Enterprise Linux 32 MB/s | 20 MB 00:00 2026-02-22T23:19:10.452 INFO:teuthology.orchestra.run.trial093.stdout:Extra Packages for Enterprise Linux 7.6 MB/s | 20 MB 00:02 2026-02-22T23:19:11.211 INFO:teuthology.orchestra.run.trial155.stdout:lab-extras 1.6 MB/s | 50 kB 00:00 2026-02-22T23:19:12.215 INFO:teuthology.orchestra.run.trial155.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-22T23:19:12.215 INFO:teuthology.orchestra.run.trial155.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-22T23:19:12.234 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T23:19:12.234 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-22T23:19:12.235 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T23:19:12.258 DEBUG:teuthology.orchestra.run.trial155:> echo no | sudo yum reinstall kernel || true 2026-02-22T23:19:12.556 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:01 ago on Sun 22 Feb 2026 11:19:11 PM UTC. 2026-02-22T23:19:12.636 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T23:19:12.637 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T23:19:12.637 INFO:teuthology.orchestra.run.trial155.stdout: Package Architecture Version Repository Size 2026-02-22T23:19:12.637 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T23:19:12.637 INFO:teuthology.orchestra.run.trial155.stdout:Reinstalling: 2026-02-22T23:19:12.637 INFO:teuthology.orchestra.run.trial155.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-22T23:19:12.637 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:19:12.637 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-22T23:19:12.637 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T23:19:12.638 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:19:12.638 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 803 k 2026-02-22T23:19:12.638 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 0 2026-02-22T23:19:12.638 INFO:teuthology.orchestra.run.trial155.stderr:Operation aborted. 2026-02-22T23:19:12.657 INFO:teuthology.orchestra.run.trial155.stdout:Is this ok [y/N]: 2026-02-22T23:19:12.657 DEBUG:teuthology.orchestra.run.trial155:> sudo yum reinstall -y kernel || true 2026-02-22T23:19:12.961 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:01 ago on Sun 22 Feb 2026 11:19:11 PM UTC. 2026-02-22T23:19:13.041 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T23:19:13.042 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T23:19:13.042 INFO:teuthology.orchestra.run.trial155.stdout: Package Architecture Version Repository Size 2026-02-22T23:19:13.042 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T23:19:13.042 INFO:teuthology.orchestra.run.trial155.stdout:Reinstalling: 2026-02-22T23:19:13.042 INFO:teuthology.orchestra.run.trial155.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-22T23:19:13.042 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:19:13.042 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-22T23:19:13.042 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T23:19:13.042 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:19:13.042 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 803 k 2026-02-22T23:19:13.043 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 0 2026-02-22T23:19:13.043 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-22T23:19:13.604 INFO:teuthology.orchestra.run.trial093.stdout:lab-extras 2.5 MB/s | 50 kB 00:00 2026-02-22T23:19:14.610 INFO:teuthology.orchestra.run.trial093.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-22T23:19:14.611 INFO:teuthology.orchestra.run.trial093.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-22T23:19:14.629 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-22T23:19:14.630 INFO:teuthology.orchestra.run.trial093.stdout:Nothing to do. 2026-02-22T23:19:14.630 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-22T23:19:14.654 DEBUG:teuthology.orchestra.run.trial093:> echo no | sudo yum reinstall kernel || true 2026-02-22T23:19:14.954 INFO:teuthology.orchestra.run.trial093.stdout:Last metadata expiration check: 0:00:01 ago on Sun 22 Feb 2026 11:19:13 PM UTC. 2026-02-22T23:19:15.036 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-22T23:19:15.037 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-22T23:19:15.037 INFO:teuthology.orchestra.run.trial093.stdout: Package Architecture Version Repository Size 2026-02-22T23:19:15.037 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-22T23:19:15.037 INFO:teuthology.orchestra.run.trial093.stdout:Reinstalling: 2026-02-22T23:19:15.037 INFO:teuthology.orchestra.run.trial093.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-22T23:19:15.037 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:19:15.037 INFO:teuthology.orchestra.run.trial093.stdout:Transaction Summary 2026-02-22T23:19:15.037 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-22T23:19:15.037 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:19:15.038 INFO:teuthology.orchestra.run.trial093.stdout:Total download size: 803 k 2026-02-22T23:19:15.038 INFO:teuthology.orchestra.run.trial093.stdout:Installed size: 0 2026-02-22T23:19:15.038 INFO:teuthology.orchestra.run.trial093.stderr:Operation aborted. 2026-02-22T23:19:15.056 INFO:teuthology.orchestra.run.trial093.stdout:Is this ok [y/N]: 2026-02-22T23:19:15.057 DEBUG:teuthology.orchestra.run.trial093:> sudo yum reinstall -y kernel || true 2026-02-22T23:19:15.353 INFO:teuthology.orchestra.run.trial093.stdout:Last metadata expiration check: 0:00:02 ago on Sun 22 Feb 2026 11:19:13 PM UTC. 2026-02-22T23:19:15.433 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-22T23:19:15.433 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-22T23:19:15.433 INFO:teuthology.orchestra.run.trial093.stdout: Package Architecture Version Repository Size 2026-02-22T23:19:15.433 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-22T23:19:15.434 INFO:teuthology.orchestra.run.trial093.stdout:Reinstalling: 2026-02-22T23:19:15.434 INFO:teuthology.orchestra.run.trial093.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-22T23:19:15.434 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:19:15.434 INFO:teuthology.orchestra.run.trial093.stdout:Transaction Summary 2026-02-22T23:19:15.434 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-22T23:19:15.434 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:19:15.434 INFO:teuthology.orchestra.run.trial093.stdout:Total download size: 803 k 2026-02-22T23:19:15.434 INFO:teuthology.orchestra.run.trial093.stdout:Installed size: 0 2026-02-22T23:19:15.434 INFO:teuthology.orchestra.run.trial093.stdout:Downloading Packages: 2026-02-22T23:19:15.793 INFO:teuthology.orchestra.run.trial155.stdout:kernel-5.14.0-681.el9.x86_64.rpm 328 kB/s | 803 kB 00:02 2026-02-22T23:19:15.794 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-22T23:19:15.794 INFO:teuthology.orchestra.run.trial155.stdout:Total 292 kB/s | 803 kB 00:02 2026-02-22T23:19:15.806 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-22T23:19:15.841 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-22T23:19:15.841 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-22T23:19:15.846 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-22T23:19:15.846 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-22T23:19:15.870 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-22T23:19:15.874 INFO:teuthology.orchestra.run.trial155.stdout: Reinstalling : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-22T23:19:15.874 INFO:teuthology.orchestra.run.trial155.stdout: Cleanup : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-22T23:19:15.979 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 2/2 2026-02-22T23:19:15.980 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-22T23:19:16.035 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-22T23:19:16.035 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:19:16.035 INFO:teuthology.orchestra.run.trial155.stdout:Reinstalled: 2026-02-22T23:19:16.036 INFO:teuthology.orchestra.run.trial155.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-22T23:19:16.036 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:19:16.036 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T23:19:16.062 DEBUG:teuthology.orchestra.run.trial155:> rpm -q kernel | sort -rV | head -n 1 2026-02-22T23:19:16.126 INFO:teuthology.orchestra.run.trial155.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-22T23:19:16.127 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-22T23:19:16.127 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2026-02-22T23:19:16.127 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2026-02-22T23:19:16.127 DEBUG:teuthology.orchestra.run.trial155:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-22T23:19:16.192 INFO:teuthology.orchestra.run.trial155.stdout:ttyS1 2026-02-22T23:19:16.213 DEBUG:teuthology.parallel:result is None 2026-02-22T23:19:16.898 INFO:teuthology.orchestra.run.trial093.stdout:kernel-5.14.0-681.el9.x86_64.rpm 585 kB/s | 803 kB 00:01 2026-02-22T23:19:16.898 INFO:teuthology.orchestra.run.trial093.stdout:-------------------------------------------------------------------------------- 2026-02-22T23:19:16.899 INFO:teuthology.orchestra.run.trial093.stdout:Total 548 kB/s | 803 kB 00:01 2026-02-22T23:19:16.910 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction check 2026-02-22T23:19:16.946 INFO:teuthology.orchestra.run.trial093.stdout:Transaction check succeeded. 2026-02-22T23:19:16.947 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction test 2026-02-22T23:19:16.951 INFO:teuthology.orchestra.run.trial093.stdout:Transaction test succeeded. 2026-02-22T23:19:16.951 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction 2026-02-22T23:19:16.977 INFO:teuthology.orchestra.run.trial093.stdout: Preparing : 1/1 2026-02-22T23:19:16.981 INFO:teuthology.orchestra.run.trial093.stdout: Reinstalling : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-22T23:19:16.981 INFO:teuthology.orchestra.run.trial093.stdout: Cleanup : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-22T23:19:17.092 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 2/2 2026-02-22T23:19:17.092 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-22T23:19:17.148 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-22T23:19:17.148 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:19:17.148 INFO:teuthology.orchestra.run.trial093.stdout:Reinstalled: 2026-02-22T23:19:17.149 INFO:teuthology.orchestra.run.trial093.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-22T23:19:17.149 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:19:17.149 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-22T23:19:17.174 DEBUG:teuthology.orchestra.run.trial093:> rpm -q kernel | sort -rV | head -n 1 2026-02-22T23:19:17.197 INFO:teuthology.orchestra.run.trial093.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-22T23:19:17.198 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-22T23:19:17.198 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2026-02-22T23:19:17.198 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-22T23:19:17.198 DEBUG:teuthology.orchestra.run.trial093:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-22T23:19:17.261 INFO:teuthology.orchestra.run.trial093.stdout:ttyS1 2026-02-22T23:19:17.283 DEBUG:teuthology.parallel:result is None 2026-02-22T23:19:17.283 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-22T23:19:17.294 INFO:teuthology.task.internal:Creating test directory... 2026-02-22T23:19:17.294 DEBUG:teuthology.orchestra.run.trial093:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-22T23:19:17.324 DEBUG:teuthology.orchestra.run.trial155:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-22T23:19:17.343 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-22T23:19:17.354 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-22T23:19:17.368 INFO:teuthology.task.internal:Creating archive directory... 2026-02-22T23:19:17.368 DEBUG:teuthology.orchestra.run.trial093:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-22T23:19:17.382 DEBUG:teuthology.orchestra.run.trial155:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-22T23:19:17.409 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-22T23:19:17.421 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-22T23:19:17.421 DEBUG:teuthology.orchestra.run.trial093:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-22T23:19:17.439 DEBUG:teuthology.orchestra.run.trial155:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-22T23:19:17.460 INFO:teuthology.orchestra.run.trial093.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-22T23:19:17.465 INFO:teuthology.orchestra.run.trial155.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-22T23:19:17.468 INFO:teuthology.orchestra.run.trial093.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-22T23:19:17.473 INFO:teuthology.orchestra.run.trial155.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-22T23:19:17.475 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-22T23:19:17.488 INFO:teuthology.task.internal:Configuring sudo... 2026-02-22T23:19:17.488 DEBUG:teuthology.orchestra.run.trial093:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-22T23:19:17.513 DEBUG:teuthology.orchestra.run.trial155:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-22T23:19:17.538 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-22T23:19:17.555 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-22T23:19:17.555 DEBUG:teuthology.orchestra.run.trial093:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-22T23:19:17.577 DEBUG:teuthology.orchestra.run.trial155:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-22T23:19:17.594 DEBUG:teuthology.orchestra.run.trial093:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-22T23:19:17.751 DEBUG:teuthology.orchestra.run.trial093:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-22T23:19:17.777 DEBUG:teuthology.orchestra.run.trial093:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-22T23:19:17.921 DEBUG:teuthology.orchestra.run.trial093:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-22T23:19:17.946 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-22T23:19:17.946 DEBUG:teuthology.orchestra.run.trial093:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-22T23:19:18.010 DEBUG:teuthology.orchestra.run.trial155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-22T23:19:18.084 DEBUG:teuthology.orchestra.run.trial155:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-22T23:19:18.108 DEBUG:teuthology.orchestra.run.trial155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-22T23:19:18.224 DEBUG:teuthology.orchestra.run.trial155:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-22T23:19:18.249 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T23:19:18.249 DEBUG:teuthology.orchestra.run.trial155:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-22T23:19:18.313 DEBUG:teuthology.orchestra.run.trial093:> sudo service rsyslog restart 2026-02-22T23:19:18.316 DEBUG:teuthology.orchestra.run.trial155:> sudo service rsyslog restart 2026-02-22T23:19:18.343 INFO:teuthology.orchestra.run.trial093.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-22T23:19:18.380 INFO:teuthology.orchestra.run.trial155.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-22T23:19:18.693 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-22T23:19:18.706 INFO:teuthology.task.internal:Starting timer... 2026-02-22T23:19:18.706 INFO:teuthology.run_tasks:Running task pcp... 2026-02-22T23:19:18.729 INFO:teuthology.run_tasks:Running task selinux... 2026-02-22T23:19:18.747 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2026-02-22T23:19:18.747 DEBUG:teuthology.orchestra.run.trial093:> sudo service auditd rotate 2026-02-22T23:19:18.777 INFO:teuthology.orchestra.run.trial093.stdout:Rotating logs: 2026-02-22T23:19:18.779 DEBUG:teuthology.orchestra.run.trial155:> sudo service auditd rotate 2026-02-22T23:19:18.809 INFO:teuthology.orchestra.run.trial155.stdout:Rotating logs: 2026-02-22T23:19:18.811 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-22T23:19:18.811 DEBUG:teuthology.orchestra.run.trial093:> /usr/sbin/getenforce 2026-02-22T23:19:18.835 INFO:teuthology.orchestra.run.trial093.stdout:Permissive 2026-02-22T23:19:18.836 DEBUG:teuthology.orchestra.run.trial155:> /usr/sbin/getenforce 2026-02-22T23:19:18.867 INFO:teuthology.orchestra.run.trial155.stdout:Permissive 2026-02-22T23:19:18.868 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial093.front.sepia.ceph.com': 'permissive', 'ubuntu@trial155.front.sepia.ceph.com': 'permissive'} 2026-02-22T23:19:18.868 DEBUG:teuthology.orchestra.run.trial093:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-22T23:19:18.900 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T23:19:18.901 DEBUG:teuthology.orchestra.run.trial155:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-22T23:19:18.931 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T23:19:18.932 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-22T23:19:18.932 DEBUG:teuthology.orchestra.run.trial093:> sudo /usr/sbin/setenforce permissive 2026-02-22T23:19:18.966 DEBUG:teuthology.orchestra.run.trial155:> sudo /usr/sbin/setenforce permissive 2026-02-22T23:19:18.995 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-22T23:19:19.008 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2026-02-22T23:19:19.012 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2026-02-22T23:19:19.111 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-22T23:19:19.118 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-22T23:19:19.118 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial093.front.sepia.ceph.com,trial155.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-22T23:22:10.309 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial093.front.sepia.ceph.com'), Remote(name='ubuntu@trial155.front.sepia.ceph.com')] 2026-02-22T23:22:10.319 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial093.front.sepia.ceph.com' 2026-02-22T23:22:10.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-22T23:22:10.430 DEBUG:teuthology.orchestra.run.trial093:> true 2026-02-22T23:22:10.508 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial093.front.sepia.ceph.com' 2026-02-22T23:22:10.509 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial155.front.sepia.ceph.com' 2026-02-22T23:22:10.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-22T23:22:10.599 DEBUG:teuthology.orchestra.run.trial155:> true 2026-02-22T23:22:10.674 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial155.front.sepia.ceph.com' 2026-02-22T23:22:10.674 INFO:teuthology.run_tasks:Running task clock... 2026-02-22T23:22:10.687 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-22T23:22:10.687 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-22T23:22:10.688 DEBUG:teuthology.orchestra.run.trial093:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-22T23:22:10.690 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-22T23:22:10.690 DEBUG:teuthology.orchestra.run.trial155:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-22T23:22:10.717 INFO:teuthology.orchestra.run.trial093.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-22T23:22:10.729 INFO:teuthology.orchestra.run.trial093.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-22T23:22:10.741 INFO:teuthology.orchestra.run.trial155.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-22T23:22:10.750 INFO:teuthology.orchestra.run.trial093.stderr:sudo: ntpd: command not found 2026-02-22T23:22:10.752 INFO:teuthology.orchestra.run.trial155.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-22T23:22:10.759 INFO:teuthology.orchestra.run.trial093.stdout:506 Cannot talk to daemon 2026-02-22T23:22:10.771 INFO:teuthology.orchestra.run.trial155.stderr:sudo: ntpd: command not found 2026-02-22T23:22:10.771 INFO:teuthology.orchestra.run.trial093.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-22T23:22:10.781 INFO:teuthology.orchestra.run.trial155.stdout:506 Cannot talk to daemon 2026-02-22T23:22:10.784 INFO:teuthology.orchestra.run.trial093.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-22T23:22:10.793 INFO:teuthology.orchestra.run.trial155.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-22T23:22:10.805 INFO:teuthology.orchestra.run.trial155.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-22T23:22:10.830 INFO:teuthology.orchestra.run.trial093.stderr:bash: line 1: ntpq: command not found 2026-02-22T23:22:10.856 INFO:teuthology.orchestra.run.trial093.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-22T23:22:10.856 INFO:teuthology.orchestra.run.trial093.stdout:=============================================================================== 2026-02-22T23:22:10.857 INFO:teuthology.orchestra.run.trial093.stdout:^? 73.185.182.209 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-22T23:22:10.857 INFO:teuthology.orchestra.run.trial093.stdout:^? 198-23-133-146-host.colo> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-22T23:22:10.857 INFO:teuthology.orchestra.run.trial093.stdout:^? 149.28.200.179.vultruser> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-22T23:22:10.857 INFO:teuthology.orchestra.run.trial093.stdout:^? 216.82.35.115 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-22T23:22:10.863 INFO:teuthology.orchestra.run.trial155.stderr:bash: line 1: ntpq: command not found 2026-02-22T23:22:10.884 INFO:teuthology.orchestra.run.trial155.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-22T23:22:10.884 INFO:teuthology.orchestra.run.trial155.stdout:=============================================================================== 2026-02-22T23:22:10.884 INFO:teuthology.orchestra.run.trial155.stdout:^? gopher.fart.website 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-22T23:22:10.884 INFO:teuthology.orchestra.run.trial155.stdout:^? ntp2.zeus.frumentum.media 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-22T23:22:10.884 INFO:teuthology.orchestra.run.trial155.stdout:^? 172-233-157-223.ip.linod> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-22T23:22:10.884 INFO:teuthology.orchestra.run.trial155.stdout:^? 172-234-44-141.ip.linode> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-22T23:22:10.884 INFO:teuthology.run_tasks:Running task install... 2026-02-22T23:22:10.896 DEBUG:teuthology.task.install:project ceph 2026-02-22T23:22:10.896 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'}} 2026-02-22T23:22:10.896 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['sqlite3'], 'rpm': ['sqlite-devel']}, 'flavor': 'default', 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'} 2026-02-22T23:22:10.896 INFO:teuthology.task.install:Using flavor: default 2026-02-22T23:22:10.899 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-22T23:22:10.899 INFO:teuthology.task.install:extra packages: [] 2026-02-22T23:22:10.899 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['sqlite3'], 'rpm': ['sqlite-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579', 'tag': None, 'wait_for_package': False} 2026-02-22T23:22:10.899 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-22T23:22:10.900 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['sqlite3'], 'rpm': ['sqlite-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579', 'tag': None, 'wait_for_package': False} 2026-02-22T23:22:10.900 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-22T23:22:11.059 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/centos/9/flavors/default/ 2026-02-22T23:22:11.059 INFO:teuthology.task.install.rpm:Package version is 19.2.3-689.gf90f4eae 2026-02-22T23:22:11.069 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/centos/9/flavors/default/ 2026-02-22T23:22:11.069 INFO:teuthology.task.install.rpm:Package version is 19.2.3-689.gf90f4eae 2026-02-22T23:22:11.206 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-22T23:22:11.206 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-22T23:22:11.206 DEBUG:teuthology.orchestra.run.trial093:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-22T23:22:11.218 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-22T23:22:11.218 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T23:22:11.218 DEBUG:teuthology.orchestra.run.trial155:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-22T23:22:11.232 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, sqlite-devel on remote rpm x86_64 2026-02-22T23:22:11.232 DEBUG:teuthology.orchestra.run.trial093:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/f90f4eaebb28b619cf76e80cbbe997656da69579/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-22T23:22:11.244 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, sqlite-devel on remote rpm x86_64 2026-02-22T23:22:11.244 DEBUG:teuthology.orchestra.run.trial155:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/f90f4eaebb28b619cf76e80cbbe997656da69579/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-22T23:22:11.296 DEBUG:teuthology.orchestra.run.trial093:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-22T23:22:11.308 DEBUG:teuthology.orchestra.run.trial155:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-22T23:22:11.370 DEBUG:teuthology.orchestra.run.trial093:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-22T23:22:11.381 DEBUG:teuthology.orchestra.run.trial155:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-22T23:22:11.434 INFO:teuthology.orchestra.run.trial093.stdout:check_obsoletes = 1 2026-02-22T23:22:11.436 DEBUG:teuthology.orchestra.run.trial093:> sudo yum clean all 2026-02-22T23:22:11.444 INFO:teuthology.orchestra.run.trial155.stdout:check_obsoletes = 1 2026-02-22T23:22:11.445 DEBUG:teuthology.orchestra.run.trial155:> sudo yum clean all 2026-02-22T23:22:11.597 INFO:teuthology.orchestra.run.trial093.stdout:41 files removed 2026-02-22T23:22:11.601 INFO:teuthology.orchestra.run.trial155.stdout:41 files removed 2026-02-22T23:22:11.613 DEBUG:teuthology.orchestra.run.trial093:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd sqlite-devel 2026-02-22T23:22:11.615 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd sqlite-devel 2026-02-22T23:22:11.887 INFO:teuthology.orchestra.run.trial155.stdout:ceph packages for x86_64 665 kB/s | 86 kB 00:00 2026-02-22T23:22:11.888 INFO:teuthology.orchestra.run.trial093.stdout:ceph packages for x86_64 651 kB/s | 86 kB 00:00 2026-02-22T23:22:12.022 INFO:teuthology.orchestra.run.trial155.stdout:ceph noarch packages 111 kB/s | 12 kB 00:00 2026-02-22T23:22:12.022 INFO:teuthology.orchestra.run.trial093.stdout:ceph noarch packages 111 kB/s | 12 kB 00:00 2026-02-22T23:22:12.146 INFO:teuthology.orchestra.run.trial093.stdout:ceph source packages 18 kB/s | 1.9 kB 00:00 2026-02-22T23:22:12.147 INFO:teuthology.orchestra.run.trial155.stdout:ceph source packages 18 kB/s | 1.9 kB 00:00 2026-02-22T23:22:12.403 INFO:teuthology.orchestra.run.trial155.stdout:CentOS Stream 9 - BaseOS 38 MB/s | 8.9 MB 00:00 2026-02-22T23:22:12.880 INFO:teuthology.orchestra.run.trial093.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.9 MB 00:00 2026-02-22T23:22:15.648 INFO:teuthology.orchestra.run.trial155.stdout:CentOS Stream 9 - AppStream 9.9 MB/s | 27 MB 00:02 2026-02-22T23:22:16.846 INFO:teuthology.orchestra.run.trial093.stdout:CentOS Stream 9 - AppStream 7.8 MB/s | 27 MB 00:03 2026-02-22T23:22:19.039 INFO:teuthology.orchestra.run.trial155.stdout:CentOS Stream 9 - CRB 7.6 MB/s | 7.8 MB 00:01 2026-02-22T23:22:19.687 INFO:teuthology.orchestra.run.trial093.stdout:CentOS Stream 9 - CRB 18 MB/s | 7.8 MB 00:00 2026-02-22T23:22:20.056 INFO:teuthology.orchestra.run.trial155.stdout:CentOS Stream 9 - Extras packages 72 kB/s | 20 kB 00:00 2026-02-22T23:22:20.898 INFO:teuthology.orchestra.run.trial093.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 20 kB 00:00 2026-02-22T23:22:21.584 INFO:teuthology.orchestra.run.trial093.stdout:Extra Packages for Enterprise Linux 33 MB/s | 20 MB 00:00 2026-02-22T23:22:24.785 INFO:teuthology.orchestra.run.trial093.stdout:lab-extras 2.1 MB/s | 50 kB 00:00 2026-02-22T23:22:24.980 INFO:teuthology.orchestra.run.trial155.stdout:Extra Packages for Enterprise Linux 4.2 MB/s | 20 MB 00:04 2026-02-22T23:22:25.964 INFO:teuthology.orchestra.run.trial093.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-22T23:22:25.965 INFO:teuthology.orchestra.run.trial093.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-22T23:22:25.991 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-22T23:22:25.995 INFO:teuthology.orchestra.run.trial093.stdout:====================================================================================== 2026-02-22T23:22:25.996 INFO:teuthology.orchestra.run.trial093.stdout: Package Arch Version Repository Size 2026-02-22T23:22:25.996 INFO:teuthology.orchestra.run.trial093.stdout:====================================================================================== 2026-02-22T23:22:25.996 INFO:teuthology.orchestra.run.trial093.stdout:Installing: 2026-02-22T23:22:25.996 INFO:teuthology.orchestra.run.trial093.stdout: ceph x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 6.5 k 2026-02-22T23:22:25.996 INFO:teuthology.orchestra.run.trial093.stdout: ceph-base x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 5.5 M 2026-02-22T23:22:25.996 INFO:teuthology.orchestra.run.trial093.stdout: ceph-fuse x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 1.2 M 2026-02-22T23:22:25.996 INFO:teuthology.orchestra.run.trial093.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 145 k 2026-02-22T23:22:25.996 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mgr x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 1.1 M 2026-02-22T23:22:25.996 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mgr-cephadm noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 150 k 2026-02-22T23:22:25.996 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mgr-dashboard noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 3.8 M 2026-02-22T23:22:25.996 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 7.4 M 2026-02-22T23:22:25.997 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mgr-rook noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 49 k 2026-02-22T23:22:25.997 INFO:teuthology.orchestra.run.trial093.stdout: ceph-radosgw x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 11 M 2026-02-22T23:22:25.997 INFO:teuthology.orchestra.run.trial093.stdout: ceph-test x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 50 M 2026-02-22T23:22:25.997 INFO:teuthology.orchestra.run.trial093.stdout: ceph-volume noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 299 k 2026-02-22T23:22:25.997 INFO:teuthology.orchestra.run.trial093.stdout: cephadm noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 769 k 2026-02-22T23:22:25.997 INFO:teuthology.orchestra.run.trial093.stdout: libcephfs-devel x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 34 k 2026-02-22T23:22:25.997 INFO:teuthology.orchestra.run.trial093.stdout: libcephfs2 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 999 k 2026-02-22T23:22:25.997 INFO:teuthology.orchestra.run.trial093.stdout: librados-devel x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 126 k 2026-02-22T23:22:25.997 INFO:teuthology.orchestra.run.trial093.stdout: python3-cephfs x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 165 k 2026-02-22T23:22:25.997 INFO:teuthology.orchestra.run.trial093.stdout: python3-rados x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 322 k 2026-02-22T23:22:25.997 INFO:teuthology.orchestra.run.trial093.stdout: python3-rbd x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 303 k 2026-02-22T23:22:25.997 INFO:teuthology.orchestra.run.trial093.stdout: python3-rgw x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 100 k 2026-02-22T23:22:25.998 INFO:teuthology.orchestra.run.trial093.stdout: rbd-fuse x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 85 k 2026-02-22T23:22:25.998 INFO:teuthology.orchestra.run.trial093.stdout: rbd-mirror x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 3.1 M 2026-02-22T23:22:25.998 INFO:teuthology.orchestra.run.trial093.stdout: rbd-nbd x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 170 k 2026-02-22T23:22:25.998 INFO:teuthology.orchestra.run.trial093.stdout: sqlite-devel x86_64 3.34.1-9.el9 appstream 133 k 2026-02-22T23:22:25.998 INFO:teuthology.orchestra.run.trial093.stdout:Upgrading: 2026-02-22T23:22:25.998 INFO:teuthology.orchestra.run.trial093.stdout: librados2 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 3.4 M 2026-02-22T23:22:25.998 INFO:teuthology.orchestra.run.trial093.stdout: librbd1 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 3.2 M 2026-02-22T23:22:25.998 INFO:teuthology.orchestra.run.trial093.stdout:Installing dependencies: 2026-02-22T23:22:25.998 INFO:teuthology.orchestra.run.trial093.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-22T23:22:25.998 INFO:teuthology.orchestra.run.trial093.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-22T23:22:25.998 INFO:teuthology.orchestra.run.trial093.stdout: ceph-common x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 22 M 2026-02-22T23:22:25.998 INFO:teuthology.orchestra.run.trial093.stdout: ceph-grafana-dashboards noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 31 k 2026-02-22T23:22:25.998 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mds x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 2.4 M 2026-02-22T23:22:25.999 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mgr-modules-core noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 253 k 2026-02-22T23:22:25.999 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mon x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 4.7 M 2026-02-22T23:22:25.999 INFO:teuthology.orchestra.run.trial093.stdout: ceph-osd x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 17 M 2026-02-22T23:22:25.999 INFO:teuthology.orchestra.run.trial093.stdout: ceph-prometheus-alerts noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 17 k 2026-02-22T23:22:25.999 INFO:teuthology.orchestra.run.trial093.stdout: ceph-selinux x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 25 k 2026-02-22T23:22:25.999 INFO:teuthology.orchestra.run.trial093.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-22T23:22:25.999 INFO:teuthology.orchestra.run.trial093.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-22T23:22:25.999 INFO:teuthology.orchestra.run.trial093.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-22T23:22:25.999 INFO:teuthology.orchestra.run.trial093.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-22T23:22:25.999 INFO:teuthology.orchestra.run.trial093.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-22T23:22:25.999 INFO:teuthology.orchestra.run.trial093.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-22T23:22:25.999 INFO:teuthology.orchestra.run.trial093.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-22T23:22:25.999 INFO:teuthology.orchestra.run.trial093.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-22T23:22:26.000 INFO:teuthology.orchestra.run.trial093.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-22T23:22:26.000 INFO:teuthology.orchestra.run.trial093.stdout: libcephsqlite x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 163 k 2026-02-22T23:22:26.000 INFO:teuthology.orchestra.run.trial093.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-22T23:22:26.000 INFO:teuthology.orchestra.run.trial093.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-22T23:22:26.000 INFO:teuthology.orchestra.run.trial093.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-22T23:22:26.000 INFO:teuthology.orchestra.run.trial093.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-22T23:22:26.000 INFO:teuthology.orchestra.run.trial093.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-22T23:22:26.000 INFO:teuthology.orchestra.run.trial093.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-22T23:22:26.000 INFO:teuthology.orchestra.run.trial093.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-22T23:22:26.000 INFO:teuthology.orchestra.run.trial093.stdout: libradosstriper1 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 503 k 2026-02-22T23:22:26.000 INFO:teuthology.orchestra.run.trial093.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-22T23:22:26.000 INFO:teuthology.orchestra.run.trial093.stdout: librgw2 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 5.4 M 2026-02-22T23:22:26.000 INFO:teuthology.orchestra.run.trial093.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-22T23:22:26.001 INFO:teuthology.orchestra.run.trial093.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-22T23:22:26.001 INFO:teuthology.orchestra.run.trial093.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-22T23:22:26.001 INFO:teuthology.orchestra.run.trial093.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-22T23:22:26.001 INFO:teuthology.orchestra.run.trial093.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-22T23:22:26.001 INFO:teuthology.orchestra.run.trial093.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-22T23:22:26.001 INFO:teuthology.orchestra.run.trial093.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-22T23:22:26.001 INFO:teuthology.orchestra.run.trial093.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-22T23:22:26.001 INFO:teuthology.orchestra.run.trial093.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-22T23:22:26.001 INFO:teuthology.orchestra.run.trial093.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-22T23:22:26.001 INFO:teuthology.orchestra.run.trial093.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-22T23:22:26.001 INFO:teuthology.orchestra.run.trial093.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-22T23:22:26.001 INFO:teuthology.orchestra.run.trial093.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-22T23:22:26.002 INFO:teuthology.orchestra.run.trial093.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-22T23:22:26.002 INFO:teuthology.orchestra.run.trial093.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-22T23:22:26.002 INFO:teuthology.orchestra.run.trial093.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-22T23:22:26.002 INFO:teuthology.orchestra.run.trial093.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-22T23:22:26.002 INFO:teuthology.orchestra.run.trial093.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-22T23:22:26.002 INFO:teuthology.orchestra.run.trial093.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-22T23:22:26.002 INFO:teuthology.orchestra.run.trial093.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-22T23:22:26.002 INFO:teuthology.orchestra.run.trial093.stdout: python3-ceph-argparse x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 45 k 2026-02-22T23:22:26.002 INFO:teuthology.orchestra.run.trial093.stdout: python3-ceph-common x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 142 k 2026-02-22T23:22:26.002 INFO:teuthology.orchestra.run.trial093.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-22T23:22:26.002 INFO:teuthology.orchestra.run.trial093.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-22T23:22:26.002 INFO:teuthology.orchestra.run.trial093.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-22T23:22:26.002 INFO:teuthology.orchestra.run.trial093.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-22T23:22:26.003 INFO:teuthology.orchestra.run.trial093.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-22T23:22:26.003 INFO:teuthology.orchestra.run.trial093.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-22T23:22:26.003 INFO:teuthology.orchestra.run.trial093.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-22T23:22:26.003 INFO:teuthology.orchestra.run.trial093.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-22T23:22:26.003 INFO:teuthology.orchestra.run.trial093.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-22T23:22:26.003 INFO:teuthology.orchestra.run.trial093.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-22T23:22:26.003 INFO:teuthology.orchestra.run.trial093.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-22T23:22:26.003 INFO:teuthology.orchestra.run.trial093.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-22T23:22:26.003 INFO:teuthology.orchestra.run.trial093.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-22T23:22:26.003 INFO:teuthology.orchestra.run.trial093.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-22T23:22:26.003 INFO:teuthology.orchestra.run.trial093.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-22T23:22:26.003 INFO:teuthology.orchestra.run.trial093.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-22T23:22:26.003 INFO:teuthology.orchestra.run.trial093.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-22T23:22:26.004 INFO:teuthology.orchestra.run.trial093.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-22T23:22:26.004 INFO:teuthology.orchestra.run.trial093.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-22T23:22:26.004 INFO:teuthology.orchestra.run.trial093.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-22T23:22:26.004 INFO:teuthology.orchestra.run.trial093.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-22T23:22:26.004 INFO:teuthology.orchestra.run.trial093.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-22T23:22:26.004 INFO:teuthology.orchestra.run.trial093.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-22T23:22:26.004 INFO:teuthology.orchestra.run.trial093.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-22T23:22:26.004 INFO:teuthology.orchestra.run.trial093.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-22T23:22:26.004 INFO:teuthology.orchestra.run.trial093.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-22T23:22:26.004 INFO:teuthology.orchestra.run.trial093.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-22T23:22:26.004 INFO:teuthology.orchestra.run.trial093.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-22T23:22:26.004 INFO:teuthology.orchestra.run.trial093.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-22T23:22:26.004 INFO:teuthology.orchestra.run.trial093.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-22T23:22:26.005 INFO:teuthology.orchestra.run.trial093.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-22T23:22:26.005 INFO:teuthology.orchestra.run.trial093.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-22T23:22:26.005 INFO:teuthology.orchestra.run.trial093.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-22T23:22:26.005 INFO:teuthology.orchestra.run.trial093.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-22T23:22:26.005 INFO:teuthology.orchestra.run.trial093.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-22T23:22:26.005 INFO:teuthology.orchestra.run.trial093.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-22T23:22:26.005 INFO:teuthology.orchestra.run.trial093.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-22T23:22:26.005 INFO:teuthology.orchestra.run.trial093.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-22T23:22:26.006 INFO:teuthology.orchestra.run.trial093.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-22T23:22:26.006 INFO:teuthology.orchestra.run.trial093.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-22T23:22:26.006 INFO:teuthology.orchestra.run.trial093.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-22T23:22:26.006 INFO:teuthology.orchestra.run.trial093.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-22T23:22:26.006 INFO:teuthology.orchestra.run.trial093.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-22T23:22:26.006 INFO:teuthology.orchestra.run.trial093.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-22T23:22:26.006 INFO:teuthology.orchestra.run.trial093.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-22T23:22:26.007 INFO:teuthology.orchestra.run.trial093.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-22T23:22:26.007 INFO:teuthology.orchestra.run.trial093.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-22T23:22:26.007 INFO:teuthology.orchestra.run.trial093.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-22T23:22:26.007 INFO:teuthology.orchestra.run.trial093.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-22T23:22:26.007 INFO:teuthology.orchestra.run.trial093.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-22T23:22:26.007 INFO:teuthology.orchestra.run.trial093.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-22T23:22:26.007 INFO:teuthology.orchestra.run.trial093.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-22T23:22:26.008 INFO:teuthology.orchestra.run.trial093.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-22T23:22:26.008 INFO:teuthology.orchestra.run.trial093.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-22T23:22:26.008 INFO:teuthology.orchestra.run.trial093.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-22T23:22:26.008 INFO:teuthology.orchestra.run.trial093.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-22T23:22:26.008 INFO:teuthology.orchestra.run.trial093.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-22T23:22:26.008 INFO:teuthology.orchestra.run.trial093.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-22T23:22:26.008 INFO:teuthology.orchestra.run.trial093.stdout: sqlite x86_64 3.34.1-9.el9 appstream 758 k 2026-02-22T23:22:26.009 INFO:teuthology.orchestra.run.trial093.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-22T23:22:26.009 INFO:teuthology.orchestra.run.trial093.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-22T23:22:26.009 INFO:teuthology.orchestra.run.trial093.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-22T23:22:26.009 INFO:teuthology.orchestra.run.trial093.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-22T23:22:26.009 INFO:teuthology.orchestra.run.trial093.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-22T23:22:26.009 INFO:teuthology.orchestra.run.trial093.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-22T23:22:26.010 INFO:teuthology.orchestra.run.trial093.stdout:Installing weak dependencies: 2026-02-22T23:22:26.010 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 22 k 2026-02-22T23:22:26.010 INFO:teuthology.orchestra.run.trial093.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-22T23:22:26.010 INFO:teuthology.orchestra.run.trial093.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-22T23:22:26.010 INFO:teuthology.orchestra.run.trial093.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-22T23:22:26.010 INFO:teuthology.orchestra.run.trial093.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-22T23:22:26.010 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:22:26.011 INFO:teuthology.orchestra.run.trial093.stdout:Transaction Summary 2026-02-22T23:22:26.011 INFO:teuthology.orchestra.run.trial093.stdout:====================================================================================== 2026-02-22T23:22:26.011 INFO:teuthology.orchestra.run.trial093.stdout:Install 146 Packages 2026-02-22T23:22:26.011 INFO:teuthology.orchestra.run.trial093.stdout:Upgrade 2 Packages 2026-02-22T23:22:26.011 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:22:26.012 INFO:teuthology.orchestra.run.trial093.stdout:Total download size: 214 M 2026-02-22T23:22:26.012 INFO:teuthology.orchestra.run.trial093.stdout:Downloading Packages: 2026-02-22T23:22:26.650 INFO:teuthology.orchestra.run.trial093.stdout:(1/148): ceph-19.2.3-689.gf90f4eae.el9.x86_64.r 126 kB/s | 6.5 kB 00:00 2026-02-22T23:22:26.757 INFO:teuthology.orchestra.run.trial093.stdout:(2/148): ceph-fuse-19.2.3-689.gf90f4eae.el9.x86 11 MB/s | 1.2 MB 00:00 2026-02-22T23:22:26.798 INFO:teuthology.orchestra.run.trial093.stdout:(3/148): ceph-immutable-object-cache-19.2.3-689 3.5 MB/s | 145 kB 00:00 2026-02-22T23:22:26.878 INFO:teuthology.orchestra.run.trial093.stdout:(4/148): ceph-base-19.2.3-689.gf90f4eae.el9.x86 20 MB/s | 5.5 MB 00:00 2026-02-22T23:22:26.936 INFO:teuthology.orchestra.run.trial093.stdout:(5/148): ceph-mgr-19.2.3-689.gf90f4eae.el9.x86_ 19 MB/s | 1.1 MB 00:00 2026-02-22T23:22:26.954 INFO:teuthology.orchestra.run.trial093.stdout:(6/148): ceph-mds-19.2.3-689.gf90f4eae.el9.x86_ 16 MB/s | 2.4 MB 00:00 2026-02-22T23:22:27.172 INFO:teuthology.orchestra.run.trial093.stdout:(7/148): ceph-mon-19.2.3-689.gf90f4eae.el9.x86_ 20 MB/s | 4.7 MB 00:00 2026-02-22T23:22:27.704 INFO:teuthology.orchestra.run.trial093.stdout:(8/148): ceph-radosgw-19.2.3-689.gf90f4eae.el9. 20 MB/s | 11 MB 00:00 2026-02-22T23:22:27.737 INFO:teuthology.orchestra.run.trial093.stdout:(9/148): ceph-selinux-19.2.3-689.gf90f4eae.el9. 771 kB/s | 25 kB 00:00 2026-02-22T23:22:27.780 INFO:teuthology.orchestra.run.trial093.stdout:(10/148): ceph-common-19.2.3-689.gf90f4eae.el9. 18 MB/s | 22 MB 00:01 2026-02-22T23:22:27.796 INFO:teuthology.orchestra.run.trial093.stdout:(11/148): libcephfs-devel-19.2.3-689.gf90f4eae. 1.9 MB/s | 34 kB 00:00 2026-02-22T23:22:27.852 INFO:teuthology.orchestra.run.trial093.stdout:(12/148): ceph-osd-19.2.3-689.gf90f4eae.el9.x86 19 MB/s | 17 MB 00:00 2026-02-22T23:22:27.856 INFO:teuthology.orchestra.run.trial093.stdout:(13/148): libcephfs2-19.2.3-689.gf90f4eae.el9.x 17 MB/s | 999 kB 00:00 2026-02-22T23:22:27.878 INFO:teuthology.orchestra.run.trial093.stdout:(14/148): libcephsqlite-19.2.3-689.gf90f4eae.el 6.2 MB/s | 163 kB 00:00 2026-02-22T23:22:27.882 INFO:teuthology.orchestra.run.trial093.stdout:(15/148): librados-devel-19.2.3-689.gf90f4eae.e 4.6 MB/s | 126 kB 00:00 2026-02-22T23:22:27.912 INFO:teuthology.orchestra.run.trial093.stdout:(16/148): libradosstriper1-19.2.3-689.gf90f4eae 14 MB/s | 503 kB 00:00 2026-02-22T23:22:27.954 INFO:teuthology.orchestra.run.trial093.stdout:(17/148): python3-ceph-argparse-19.2.3-689.gf90 1.1 MB/s | 45 kB 00:00 2026-02-22T23:22:27.997 INFO:teuthology.orchestra.run.trial093.stdout:(18/148): python3-ceph-common-19.2.3-689.gf90f4 3.2 MB/s | 142 kB 00:00 2026-02-22T23:22:28.041 INFO:teuthology.orchestra.run.trial093.stdout:(19/148): python3-cephfs-19.2.3-689.gf90f4eae.e 3.7 MB/s | 165 kB 00:00 2026-02-22T23:22:28.088 INFO:teuthology.orchestra.run.trial093.stdout:(20/148): python3-rados-19.2.3-689.gf90f4eae.el 6.7 MB/s | 322 kB 00:00 2026-02-22T23:22:28.135 INFO:teuthology.orchestra.run.trial093.stdout:(21/148): librgw2-19.2.3-689.gf90f4eae.el9.x86_ 21 MB/s | 5.4 MB 00:00 2026-02-22T23:22:28.136 INFO:teuthology.orchestra.run.trial093.stdout:(22/148): python3-rbd-19.2.3-689.gf90f4eae.el9. 6.2 MB/s | 303 kB 00:00 2026-02-22T23:22:28.160 INFO:teuthology.orchestra.run.trial093.stdout:(23/148): python3-rgw-19.2.3-689.gf90f4eae.el9. 3.9 MB/s | 100 kB 00:00 2026-02-22T23:22:28.163 INFO:teuthology.orchestra.run.trial093.stdout:(24/148): rbd-fuse-19.2.3-689.gf90f4eae.el9.x86 3.2 MB/s | 85 kB 00:00 2026-02-22T23:22:28.207 INFO:teuthology.orchestra.run.trial093.stdout:(25/148): rbd-nbd-19.2.3-689.gf90f4eae.el9.x86_ 3.8 MB/s | 170 kB 00:00 2026-02-22T23:22:28.210 INFO:teuthology.orchestra.run.trial155.stdout:lab-extras 2.8 MB/s | 50 kB 00:00 2026-02-22T23:22:28.249 INFO:teuthology.orchestra.run.trial093.stdout:(26/148): ceph-grafana-dashboards-19.2.3-689.gf 744 kB/s | 31 kB 00:00 2026-02-22T23:22:28.291 INFO:teuthology.orchestra.run.trial093.stdout:(27/148): rbd-mirror-19.2.3-689.gf90f4eae.el9.x 24 MB/s | 3.1 MB 00:00 2026-02-22T23:22:28.292 INFO:teuthology.orchestra.run.trial093.stdout:(28/148): ceph-mgr-cephadm-19.2.3-689.gf90f4eae 3.5 MB/s | 150 kB 00:00 2026-02-22T23:22:28.507 INFO:teuthology.orchestra.run.trial093.stdout:(29/148): ceph-mgr-dashboard-19.2.3-689.gf90f4e 18 MB/s | 3.8 MB 00:00 2026-02-22T23:22:28.546 INFO:teuthology.orchestra.run.trial093.stdout:(30/148): ceph-mgr-k8sevents-19.2.3-689.gf90f4e 562 kB/s | 22 kB 00:00 2026-02-22T23:22:28.593 INFO:teuthology.orchestra.run.trial093.stdout:(31/148): ceph-mgr-modules-core-19.2.3-689.gf90 5.3 MB/s | 253 kB 00:00 2026-02-22T23:22:28.636 INFO:teuthology.orchestra.run.trial093.stdout:(32/148): ceph-mgr-rook-19.2.3-689.gf90f4eae.el 1.1 MB/s | 49 kB 00:00 2026-02-22T23:22:28.685 INFO:teuthology.orchestra.run.trial093.stdout:(33/148): ceph-mgr-diskprediction-local-19.2.3- 19 MB/s | 7.4 MB 00:00 2026-02-22T23:22:28.685 INFO:teuthology.orchestra.run.trial093.stdout:(34/148): ceph-prometheus-alerts-19.2.3-689.gf9 341 kB/s | 17 kB 00:00 2026-02-22T23:22:28.716 INFO:teuthology.orchestra.run.trial093.stdout:(35/148): ceph-volume-19.2.3-689.gf90f4eae.el9. 9.4 MB/s | 299 kB 00:00 2026-02-22T23:22:28.729 INFO:teuthology.orchestra.run.trial093.stdout:(36/148): cephadm-19.2.3-689.gf90f4eae.el9.noar 17 MB/s | 769 kB 00:00 2026-02-22T23:22:29.121 INFO:teuthology.orchestra.run.trial093.stdout:(37/148): ceph-test-19.2.3-689.gf90f4eae.el9.x8 36 MB/s | 50 MB 00:01 2026-02-22T23:22:29.283 INFO:teuthology.orchestra.run.trial093.stdout:(38/148): ledmon-libs-1.1.0-3.el9.x86_64.rpm 73 kB/s | 40 kB 00:00 2026-02-22T23:22:29.402 INFO:teuthology.orchestra.run.trial155.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-22T23:22:29.402 INFO:teuthology.orchestra.run.trial155.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-22T23:22:29.429 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T23:22:29.433 INFO:teuthology.orchestra.run.trial155.stdout:====================================================================================== 2026-02-22T23:22:29.433 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repository Size 2026-02-22T23:22:29.433 INFO:teuthology.orchestra.run.trial155.stdout:====================================================================================== 2026-02-22T23:22:29.433 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-22T23:22:29.433 INFO:teuthology.orchestra.run.trial155.stdout: ceph x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 6.5 k 2026-02-22T23:22:29.433 INFO:teuthology.orchestra.run.trial155.stdout: ceph-base x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 5.5 M 2026-02-22T23:22:29.434 INFO:teuthology.orchestra.run.trial155.stdout: ceph-fuse x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 1.2 M 2026-02-22T23:22:29.434 INFO:teuthology.orchestra.run.trial155.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 145 k 2026-02-22T23:22:29.434 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 1.1 M 2026-02-22T23:22:29.434 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-cephadm noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 150 k 2026-02-22T23:22:29.434 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-dashboard noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 3.8 M 2026-02-22T23:22:29.434 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 7.4 M 2026-02-22T23:22:29.434 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-rook noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 49 k 2026-02-22T23:22:29.434 INFO:teuthology.orchestra.run.trial155.stdout: ceph-radosgw x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 11 M 2026-02-22T23:22:29.434 INFO:teuthology.orchestra.run.trial155.stdout: ceph-test x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 50 M 2026-02-22T23:22:29.434 INFO:teuthology.orchestra.run.trial155.stdout: ceph-volume noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 299 k 2026-02-22T23:22:29.434 INFO:teuthology.orchestra.run.trial155.stdout: cephadm noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 769 k 2026-02-22T23:22:29.435 INFO:teuthology.orchestra.run.trial155.stdout: libcephfs-devel x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 34 k 2026-02-22T23:22:29.435 INFO:teuthology.orchestra.run.trial155.stdout: libcephfs2 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 999 k 2026-02-22T23:22:29.435 INFO:teuthology.orchestra.run.trial155.stdout: librados-devel x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 126 k 2026-02-22T23:22:29.435 INFO:teuthology.orchestra.run.trial155.stdout: python3-cephfs x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 165 k 2026-02-22T23:22:29.435 INFO:teuthology.orchestra.run.trial155.stdout: python3-rados x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 322 k 2026-02-22T23:22:29.435 INFO:teuthology.orchestra.run.trial155.stdout: python3-rbd x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 303 k 2026-02-22T23:22:29.435 INFO:teuthology.orchestra.run.trial155.stdout: python3-rgw x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 100 k 2026-02-22T23:22:29.435 INFO:teuthology.orchestra.run.trial155.stdout: rbd-fuse x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 85 k 2026-02-22T23:22:29.435 INFO:teuthology.orchestra.run.trial155.stdout: rbd-mirror x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 3.1 M 2026-02-22T23:22:29.435 INFO:teuthology.orchestra.run.trial155.stdout: rbd-nbd x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 170 k 2026-02-22T23:22:29.435 INFO:teuthology.orchestra.run.trial155.stdout: sqlite-devel x86_64 3.34.1-9.el9 appstream 133 k 2026-02-22T23:22:29.435 INFO:teuthology.orchestra.run.trial155.stdout:Upgrading: 2026-02-22T23:22:29.436 INFO:teuthology.orchestra.run.trial155.stdout: librados2 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 3.4 M 2026-02-22T23:22:29.436 INFO:teuthology.orchestra.run.trial155.stdout: librbd1 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 3.2 M 2026-02-22T23:22:29.436 INFO:teuthology.orchestra.run.trial155.stdout:Installing dependencies: 2026-02-22T23:22:29.436 INFO:teuthology.orchestra.run.trial155.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-22T23:22:29.436 INFO:teuthology.orchestra.run.trial155.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-22T23:22:29.436 INFO:teuthology.orchestra.run.trial155.stdout: ceph-common x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 22 M 2026-02-22T23:22:29.436 INFO:teuthology.orchestra.run.trial155.stdout: ceph-grafana-dashboards noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 31 k 2026-02-22T23:22:29.436 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mds x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 2.4 M 2026-02-22T23:22:29.436 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-modules-core noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 253 k 2026-02-22T23:22:29.436 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mon x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 4.7 M 2026-02-22T23:22:29.436 INFO:teuthology.orchestra.run.trial155.stdout: ceph-osd x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 17 M 2026-02-22T23:22:29.436 INFO:teuthology.orchestra.run.trial155.stdout: ceph-prometheus-alerts noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 17 k 2026-02-22T23:22:29.437 INFO:teuthology.orchestra.run.trial155.stdout: ceph-selinux x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 25 k 2026-02-22T23:22:29.437 INFO:teuthology.orchestra.run.trial155.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-22T23:22:29.437 INFO:teuthology.orchestra.run.trial155.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-22T23:22:29.437 INFO:teuthology.orchestra.run.trial155.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-22T23:22:29.437 INFO:teuthology.orchestra.run.trial155.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-22T23:22:29.437 INFO:teuthology.orchestra.run.trial155.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-22T23:22:29.437 INFO:teuthology.orchestra.run.trial155.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-22T23:22:29.437 INFO:teuthology.orchestra.run.trial155.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-22T23:22:29.437 INFO:teuthology.orchestra.run.trial155.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-22T23:22:29.437 INFO:teuthology.orchestra.run.trial155.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-22T23:22:29.437 INFO:teuthology.orchestra.run.trial155.stdout: libcephsqlite x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 163 k 2026-02-22T23:22:29.437 INFO:teuthology.orchestra.run.trial155.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-22T23:22:29.438 INFO:teuthology.orchestra.run.trial155.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-22T23:22:29.438 INFO:teuthology.orchestra.run.trial155.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-22T23:22:29.438 INFO:teuthology.orchestra.run.trial155.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-22T23:22:29.438 INFO:teuthology.orchestra.run.trial155.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-22T23:22:29.438 INFO:teuthology.orchestra.run.trial155.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-22T23:22:29.438 INFO:teuthology.orchestra.run.trial155.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-22T23:22:29.438 INFO:teuthology.orchestra.run.trial155.stdout: libradosstriper1 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 503 k 2026-02-22T23:22:29.438 INFO:teuthology.orchestra.run.trial155.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-22T23:22:29.438 INFO:teuthology.orchestra.run.trial155.stdout: librgw2 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 5.4 M 2026-02-22T23:22:29.438 INFO:teuthology.orchestra.run.trial155.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-22T23:22:29.438 INFO:teuthology.orchestra.run.trial155.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-22T23:22:29.438 INFO:teuthology.orchestra.run.trial155.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-22T23:22:29.438 INFO:teuthology.orchestra.run.trial155.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-22T23:22:29.439 INFO:teuthology.orchestra.run.trial155.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-22T23:22:29.439 INFO:teuthology.orchestra.run.trial155.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-22T23:22:29.439 INFO:teuthology.orchestra.run.trial155.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-22T23:22:29.439 INFO:teuthology.orchestra.run.trial155.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-22T23:22:29.439 INFO:teuthology.orchestra.run.trial155.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-22T23:22:29.439 INFO:teuthology.orchestra.run.trial155.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-22T23:22:29.439 INFO:teuthology.orchestra.run.trial155.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-22T23:22:29.439 INFO:teuthology.orchestra.run.trial155.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-22T23:22:29.439 INFO:teuthology.orchestra.run.trial155.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-22T23:22:29.439 INFO:teuthology.orchestra.run.trial155.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-22T23:22:29.439 INFO:teuthology.orchestra.run.trial155.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-22T23:22:29.439 INFO:teuthology.orchestra.run.trial155.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-22T23:22:29.439 INFO:teuthology.orchestra.run.trial155.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-22T23:22:29.440 INFO:teuthology.orchestra.run.trial155.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-22T23:22:29.440 INFO:teuthology.orchestra.run.trial155.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-22T23:22:29.440 INFO:teuthology.orchestra.run.trial155.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-22T23:22:29.440 INFO:teuthology.orchestra.run.trial155.stdout: python3-ceph-argparse x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 45 k 2026-02-22T23:22:29.440 INFO:teuthology.orchestra.run.trial155.stdout: python3-ceph-common x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 142 k 2026-02-22T23:22:29.440 INFO:teuthology.orchestra.run.trial155.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-22T23:22:29.440 INFO:teuthology.orchestra.run.trial155.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-22T23:22:29.440 INFO:teuthology.orchestra.run.trial155.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-22T23:22:29.440 INFO:teuthology.orchestra.run.trial155.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-22T23:22:29.440 INFO:teuthology.orchestra.run.trial155.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-22T23:22:29.440 INFO:teuthology.orchestra.run.trial155.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-22T23:22:29.440 INFO:teuthology.orchestra.run.trial155.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-22T23:22:29.440 INFO:teuthology.orchestra.run.trial155.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-22T23:22:29.441 INFO:teuthology.orchestra.run.trial155.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-22T23:22:29.441 INFO:teuthology.orchestra.run.trial155.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-22T23:22:29.441 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-22T23:22:29.441 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-22T23:22:29.441 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-22T23:22:29.441 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-22T23:22:29.441 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-22T23:22:29.441 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-22T23:22:29.441 INFO:teuthology.orchestra.run.trial155.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-22T23:22:29.441 INFO:teuthology.orchestra.run.trial155.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-22T23:22:29.441 INFO:teuthology.orchestra.run.trial155.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-22T23:22:29.441 INFO:teuthology.orchestra.run.trial155.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-22T23:22:29.442 INFO:teuthology.orchestra.run.trial155.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-22T23:22:29.442 INFO:teuthology.orchestra.run.trial155.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-22T23:22:29.442 INFO:teuthology.orchestra.run.trial155.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-22T23:22:29.442 INFO:teuthology.orchestra.run.trial155.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-22T23:22:29.442 INFO:teuthology.orchestra.run.trial155.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-22T23:22:29.442 INFO:teuthology.orchestra.run.trial155.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-22T23:22:29.442 INFO:teuthology.orchestra.run.trial155.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-22T23:22:29.442 INFO:teuthology.orchestra.run.trial155.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-22T23:22:29.442 INFO:teuthology.orchestra.run.trial155.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-22T23:22:29.442 INFO:teuthology.orchestra.run.trial155.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-22T23:22:29.442 INFO:teuthology.orchestra.run.trial155.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-22T23:22:29.442 INFO:teuthology.orchestra.run.trial155.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-22T23:22:29.442 INFO:teuthology.orchestra.run.trial155.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-22T23:22:29.443 INFO:teuthology.orchestra.run.trial155.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-22T23:22:29.443 INFO:teuthology.orchestra.run.trial155.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-22T23:22:29.443 INFO:teuthology.orchestra.run.trial155.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-22T23:22:29.443 INFO:teuthology.orchestra.run.trial155.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-22T23:22:29.443 INFO:teuthology.orchestra.run.trial155.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-22T23:22:29.443 INFO:teuthology.orchestra.run.trial155.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-22T23:22:29.443 INFO:teuthology.orchestra.run.trial155.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-22T23:22:29.443 INFO:teuthology.orchestra.run.trial155.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-22T23:22:29.443 INFO:teuthology.orchestra.run.trial155.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-22T23:22:29.443 INFO:teuthology.orchestra.run.trial155.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-22T23:22:29.443 INFO:teuthology.orchestra.run.trial155.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-22T23:22:29.443 INFO:teuthology.orchestra.run.trial155.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-22T23:22:29.443 INFO:teuthology.orchestra.run.trial155.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-22T23:22:29.444 INFO:teuthology.orchestra.run.trial155.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-22T23:22:29.444 INFO:teuthology.orchestra.run.trial155.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-22T23:22:29.444 INFO:teuthology.orchestra.run.trial155.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-22T23:22:29.444 INFO:teuthology.orchestra.run.trial155.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-22T23:22:29.444 INFO:teuthology.orchestra.run.trial155.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-22T23:22:29.444 INFO:teuthology.orchestra.run.trial155.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-22T23:22:29.444 INFO:teuthology.orchestra.run.trial155.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-22T23:22:29.444 INFO:teuthology.orchestra.run.trial155.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-22T23:22:29.445 INFO:teuthology.orchestra.run.trial155.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-22T23:22:29.445 INFO:teuthology.orchestra.run.trial155.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-22T23:22:29.445 INFO:teuthology.orchestra.run.trial155.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-22T23:22:29.445 INFO:teuthology.orchestra.run.trial155.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-22T23:22:29.445 INFO:teuthology.orchestra.run.trial155.stdout: sqlite x86_64 3.34.1-9.el9 appstream 758 k 2026-02-22T23:22:29.445 INFO:teuthology.orchestra.run.trial155.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-22T23:22:29.445 INFO:teuthology.orchestra.run.trial155.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-22T23:22:29.445 INFO:teuthology.orchestra.run.trial155.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-22T23:22:29.445 INFO:teuthology.orchestra.run.trial155.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-22T23:22:29.445 INFO:teuthology.orchestra.run.trial155.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-22T23:22:29.445 INFO:teuthology.orchestra.run.trial155.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-22T23:22:29.445 INFO:teuthology.orchestra.run.trial155.stdout:Installing weak dependencies: 2026-02-22T23:22:29.445 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 22 k 2026-02-22T23:22:29.445 INFO:teuthology.orchestra.run.trial155.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-22T23:22:29.446 INFO:teuthology.orchestra.run.trial155.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-22T23:22:29.446 INFO:teuthology.orchestra.run.trial155.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-22T23:22:29.446 INFO:teuthology.orchestra.run.trial155.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-22T23:22:29.446 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:22:29.446 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-22T23:22:29.446 INFO:teuthology.orchestra.run.trial155.stdout:====================================================================================== 2026-02-22T23:22:29.446 INFO:teuthology.orchestra.run.trial155.stdout:Install 146 Packages 2026-02-22T23:22:29.446 INFO:teuthology.orchestra.run.trial155.stdout:Upgrade 2 Packages 2026-02-22T23:22:29.446 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:22:29.447 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 214 M 2026-02-22T23:22:29.447 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-22T23:22:29.672 INFO:teuthology.orchestra.run.trial093.stdout:(39/148): cryptsetup-2.8.1-3.el9.x86_64.rpm 367 kB/s | 351 kB 00:00 2026-02-22T23:22:29.680 INFO:teuthology.orchestra.run.trial093.stdout:(40/148): libconfig-1.7.2-9.el9.x86_64.rpm 129 kB/s | 72 kB 00:00 2026-02-22T23:22:29.838 INFO:teuthology.orchestra.run.trial093.stdout:(41/148): mailcap-2.1.49-5.el9.noarch.rpm 210 kB/s | 33 kB 00:00 2026-02-22T23:22:29.988 INFO:teuthology.orchestra.run.trial093.stdout:(42/148): libquadmath-11.5.0-14.el9.x86_64.rpm 583 kB/s | 184 kB 00:00 2026-02-22T23:22:30.073 INFO:teuthology.orchestra.run.trial155.stdout:(1/148): ceph-19.2.3-689.gf90f4eae.el9.x86_64.r 128 kB/s | 6.5 kB 00:00 2026-02-22T23:22:30.181 INFO:teuthology.orchestra.run.trial155.stdout:(2/148): ceph-fuse-19.2.3-689.gf90f4eae.el9.x86 11 MB/s | 1.2 MB 00:00 2026-02-22T23:22:30.222 INFO:teuthology.orchestra.run.trial155.stdout:(3/148): ceph-immutable-object-cache-19.2.3-689 3.5 MB/s | 145 kB 00:00 2026-02-22T23:22:30.226 INFO:teuthology.orchestra.run.trial093.stdout:(43/148): pciutils-3.7.0-7.el9.x86_64.rpm 392 kB/s | 93 kB 00:00 2026-02-22T23:22:30.296 INFO:teuthology.orchestra.run.trial093.stdout:(44/148): libgfortran-11.5.0-14.el9.x86_64.rpm 784 kB/s | 794 kB 00:01 2026-02-22T23:22:30.299 INFO:teuthology.orchestra.run.trial155.stdout:(4/148): ceph-base-19.2.3-689.gf90f4eae.el9.x86 20 MB/s | 5.5 MB 00:00 2026-02-22T23:22:30.354 INFO:teuthology.orchestra.run.trial155.stdout:(5/148): ceph-mgr-19.2.3-689.gf90f4eae.el9.x86_ 20 MB/s | 1.1 MB 00:00 2026-02-22T23:22:30.379 INFO:teuthology.orchestra.run.trial155.stdout:(6/148): ceph-mds-19.2.3-689.gf90f4eae.el9.x86_ 16 MB/s | 2.4 MB 00:00 2026-02-22T23:22:30.585 INFO:teuthology.orchestra.run.trial155.stdout:(7/148): ceph-mon-19.2.3-689.gf90f4eae.el9.x86_ 21 MB/s | 4.7 MB 00:00 2026-02-22T23:22:30.622 INFO:teuthology.orchestra.run.trial093.stdout:(45/148): python3-cffi-1.14.5-5.el9.x86_64.rpm 640 kB/s | 253 kB 00:00 2026-02-22T23:22:30.860 INFO:teuthology.orchestra.run.trial093.stdout:(46/148): python3-ply-3.11-14.el9.noarch.rpm 447 kB/s | 106 kB 00:00 2026-02-22T23:22:31.064 INFO:teuthology.orchestra.run.trial155.stdout:(8/148): ceph-radosgw-19.2.3-689.gf90f4eae.el9. 22 MB/s | 11 MB 00:00 2026-02-22T23:22:31.093 INFO:teuthology.orchestra.run.trial155.stdout:(9/148): ceph-selinux-19.2.3-689.gf90f4eae.el9. 848 kB/s | 25 kB 00:00 2026-02-22T23:22:31.098 INFO:teuthology.orchestra.run.trial093.stdout:(47/148): python3-pycparser-2.20-6.el9.noarch.r 569 kB/s | 135 kB 00:00 2026-02-22T23:22:31.194 INFO:teuthology.orchestra.run.trial155.stdout:(10/148): ceph-common-19.2.3-689.gf90f4eae.el9. 19 MB/s | 22 MB 00:01 2026-02-22T23:22:31.208 INFO:teuthology.orchestra.run.trial155.stdout:(11/148): libcephfs-devel-19.2.3-689.gf90f4eae. 2.3 MB/s | 34 kB 00:00 2026-02-22T23:22:31.256 INFO:teuthology.orchestra.run.trial093.stdout:(48/148): nvme-cli-2.16-1.el9.x86_64.rpm 831 kB/s | 1.2 MB 00:01 2026-02-22T23:22:31.264 INFO:teuthology.orchestra.run.trial155.stdout:(12/148): libcephfs2-19.2.3-689.gf90f4eae.el9.x 17 MB/s | 999 kB 00:00 2026-02-22T23:22:31.305 INFO:teuthology.orchestra.run.trial155.stdout:(13/148): libcephsqlite-19.2.3-689.gf90f4eae.el 3.9 MB/s | 163 kB 00:00 2026-02-22T23:22:31.347 INFO:teuthology.orchestra.run.trial155.stdout:(14/148): librados-devel-19.2.3-689.gf90f4eae.e 2.9 MB/s | 126 kB 00:00 2026-02-22T23:22:31.393 INFO:teuthology.orchestra.run.trial155.stdout:(15/148): ceph-osd-19.2.3-689.gf90f4eae.el9.x86 17 MB/s | 17 MB 00:01 2026-02-22T23:22:31.394 INFO:teuthology.orchestra.run.trial155.stdout:(16/148): libradosstriper1-19.2.3-689.gf90f4eae 10 MB/s | 503 kB 00:00 2026-02-22T23:22:31.415 INFO:teuthology.orchestra.run.trial093.stdout:(49/148): python3-pyparsing-2.4.7-9.el9.noarch. 476 kB/s | 150 kB 00:00 2026-02-22T23:22:31.432 INFO:teuthology.orchestra.run.trial155.stdout:(17/148): python3-ceph-argparse-19.2.3-689.gf90 1.2 MB/s | 45 kB 00:00 2026-02-22T23:22:31.476 INFO:teuthology.orchestra.run.trial155.stdout:(18/148): python3-ceph-common-19.2.3-689.gf90f4 3.2 MB/s | 142 kB 00:00 2026-02-22T23:22:31.495 INFO:teuthology.orchestra.run.trial093.stdout:(50/148): python3-requests-2.25.1-10.el9.noarch 530 kB/s | 126 kB 00:00 2026-02-22T23:22:31.520 INFO:teuthology.orchestra.run.trial155.stdout:(19/148): python3-cephfs-19.2.3-689.gf90f4eae.e 3.6 MB/s | 165 kB 00:00 2026-02-22T23:22:31.570 INFO:teuthology.orchestra.run.trial155.stdout:(20/148): python3-rados-19.2.3-689.gf90f4eae.el 6.4 MB/s | 322 kB 00:00 2026-02-22T23:22:31.620 INFO:teuthology.orchestra.run.trial155.stdout:(21/148): python3-rbd-19.2.3-689.gf90f4eae.el9. 5.8 MB/s | 303 kB 00:00 2026-02-22T23:22:31.654 INFO:teuthology.orchestra.run.trial155.stdout:(22/148): librgw2-19.2.3-689.gf90f4eae.el9.x86_ 21 MB/s | 5.4 MB 00:00 2026-02-22T23:22:31.656 INFO:teuthology.orchestra.run.trial155.stdout:(23/148): python3-rgw-19.2.3-689.gf90f4eae.el9. 2.7 MB/s | 100 kB 00:00 2026-02-22T23:22:31.681 INFO:teuthology.orchestra.run.trial155.stdout:(24/148): rbd-fuse-19.2.3-689.gf90f4eae.el9.x86 3.1 MB/s | 85 kB 00:00 2026-02-22T23:22:31.724 INFO:teuthology.orchestra.run.trial155.stdout:(25/148): rbd-nbd-19.2.3-689.gf90f4eae.el9.x86_ 3.9 MB/s | 170 kB 00:00 2026-02-22T23:22:31.767 INFO:teuthology.orchestra.run.trial155.stdout:(26/148): ceph-grafana-dashboards-19.2.3-689.gf 720 kB/s | 31 kB 00:00 2026-02-22T23:22:31.801 INFO:teuthology.orchestra.run.trial155.stdout:(27/148): rbd-mirror-19.2.3-689.gf90f4eae.el9.x 22 MB/s | 3.1 MB 00:00 2026-02-22T23:22:31.808 INFO:teuthology.orchestra.run.trial155.stdout:(28/148): ceph-mgr-cephadm-19.2.3-689.gf90f4eae 3.6 MB/s | 150 kB 00:00 2026-02-22T23:22:31.811 INFO:teuthology.orchestra.run.trial093.stdout:(51/148): unzip-6.0-59.el9.x86_64.rpm 575 kB/s | 182 kB 00:00 2026-02-22T23:22:31.811 INFO:teuthology.orchestra.run.trial093.stdout:(52/148): python3-urllib3-1.26.5-7.el9.noarch.r 549 kB/s | 218 kB 00:00 2026-02-22T23:22:31.853 INFO:teuthology.orchestra.run.trial093.stdout:(53/148): python3-cryptography-36.0.1-5.el9.x86 819 kB/s | 1.2 MB 00:01 2026-02-22T23:22:31.916 INFO:teuthology.orchestra.run.trial093.stdout:(54/148): flexiblas-3.0.4-9.el9.x86_64.rpm 468 kB/s | 30 kB 00:00 2026-02-22T23:22:31.939 INFO:teuthology.orchestra.run.trial093.stdout:(55/148): boost-program-options-1.75.0-13.el9.x 817 kB/s | 104 kB 00:00 2026-02-22T23:22:31.961 INFO:teuthology.orchestra.run.trial093.stdout:(56/148): flexiblas-openblas-openmp-3.0.4-9.el9 673 kB/s | 15 kB 00:00 2026-02-22T23:22:32.006 INFO:teuthology.orchestra.run.trial093.stdout:(57/148): libnbd-1.20.3-4.el9.x86_64.rpm 3.6 MB/s | 164 kB 00:00 2026-02-22T23:22:32.014 INFO:teuthology.orchestra.run.trial155.stdout:(29/148): ceph-mgr-dashboard-19.2.3-689.gf90f4e 18 MB/s | 3.8 MB 00:00 2026-02-22T23:22:32.031 INFO:teuthology.orchestra.run.trial093.stdout:(58/148): libpmemobj-1.12.1-1.el9.x86_64.rpm 6.2 MB/s | 160 kB 00:00 2026-02-22T23:22:32.051 INFO:teuthology.orchestra.run.trial155.stdout:(30/148): ceph-mgr-k8sevents-19.2.3-689.gf90f4e 598 kB/s | 22 kB 00:00 2026-02-22T23:22:32.054 INFO:teuthology.orchestra.run.trial093.stdout:(59/148): librabbitmq-0.11.0-7.el9.x86_64.rpm 2.0 MB/s | 45 kB 00:00 2026-02-22T23:22:32.068 INFO:teuthology.orchestra.run.trial093.stdout:(60/148): flexiblas-netlib-3.0.4-9.el9.x86_64.r 20 MB/s | 3.0 MB 00:00 2026-02-22T23:22:32.085 INFO:teuthology.orchestra.run.trial155.stdout:(31/148): ceph-mgr-modules-core-19.2.3-689.gf90 7.4 MB/s | 253 kB 00:00 2026-02-22T23:22:32.091 INFO:teuthology.orchestra.run.trial093.stdout:(61/148): libstoragemgmt-1.10.1-1.el9.x86_64.rp 10 MB/s | 246 kB 00:00 2026-02-22T23:22:32.100 INFO:teuthology.orchestra.run.trial093.stdout:(62/148): librdkafka-1.6.1-102.el9.x86_64.rpm 14 MB/s | 662 kB 00:00 2026-02-22T23:22:32.116 INFO:teuthology.orchestra.run.trial093.stdout:(63/148): libxslt-1.1.34-12.el9.x86_64.rpm 9.5 MB/s | 233 kB 00:00 2026-02-22T23:22:32.125 INFO:teuthology.orchestra.run.trial093.stdout:(64/148): lttng-ust-2.12.0-6.el9.x86_64.rpm 12 MB/s | 292 kB 00:00 2026-02-22T23:22:32.125 INFO:teuthology.orchestra.run.trial155.stdout:(32/148): ceph-mgr-rook-19.2.3-689.gf90f4eae.el 1.2 MB/s | 49 kB 00:00 2026-02-22T23:22:32.140 INFO:teuthology.orchestra.run.trial093.stdout:(65/148): lua-5.4.4-4.el9.x86_64.rpm 7.7 MB/s | 188 kB 00:00 2026-02-22T23:22:32.147 INFO:teuthology.orchestra.run.trial093.stdout:(66/148): openblas-0.3.29-1.el9.x86_64.rpm 1.8 MB/s | 42 kB 00:00 2026-02-22T23:22:32.152 INFO:teuthology.orchestra.run.trial155.stdout:(33/148): ceph-prometheus-alerts-19.2.3-689.gf9 634 kB/s | 17 kB 00:00 2026-02-22T23:22:32.190 INFO:teuthology.orchestra.run.trial155.stdout:(34/148): ceph-volume-19.2.3-689.gf90f4eae.el9. 7.7 MB/s | 299 kB 00:00 2026-02-22T23:22:32.193 INFO:teuthology.orchestra.run.trial093.stdout:(67/148): protobuf-3.14.0-17.el9.x86_64.rpm 22 MB/s | 1.0 MB 00:00 2026-02-22T23:22:32.205 INFO:teuthology.orchestra.run.trial093.stdout:(68/148): openblas-openmp-0.3.29-1.el9.x86_64.r 81 MB/s | 5.3 MB 00:00 2026-02-22T23:22:32.206 INFO:teuthology.orchestra.run.trial093.stdout:(69/148): zip-3.0-35.el9.x86_64.rpm 673 kB/s | 266 kB 00:00 2026-02-22T23:22:32.224 INFO:teuthology.orchestra.run.trial155.stdout:(35/148): cephadm-19.2.3-689.gf90f4eae.el9.noar 22 MB/s | 769 kB 00:00 2026-02-22T23:22:32.240 INFO:teuthology.orchestra.run.trial155.stdout:(36/148): ceph-mgr-diskprediction-local-19.2.3- 17 MB/s | 7.4 MB 00:00 2026-02-22T23:22:32.242 INFO:teuthology.orchestra.run.trial093.stdout:(70/148): python3-devel-3.9.25-3.el9.x86_64.rpm 6.6 MB/s | 244 kB 00:00 2026-02-22T23:22:32.267 INFO:teuthology.orchestra.run.trial093.stdout:(71/148): python3-libstoragemgmt-1.10.1-1.el9.x 6.8 MB/s | 177 kB 00:00 2026-02-22T23:22:32.293 INFO:teuthology.orchestra.run.trial093.stdout:(72/148): python3-babel-2.9.1-2.el9.noarch.rpm 60 MB/s | 6.0 MB 00:00 2026-02-22T23:22:32.296 INFO:teuthology.orchestra.run.trial093.stdout:(73/148): python3-lxml-4.6.5-3.el9.x86_64.rpm 42 MB/s | 1.2 MB 00:00 2026-02-22T23:22:32.319 INFO:teuthology.orchestra.run.trial093.stdout:(74/148): python3-markupsafe-1.1.1-12.el9.x86_6 1.5 MB/s | 35 kB 00:00 2026-02-22T23:22:32.320 INFO:teuthology.orchestra.run.trial093.stdout:(75/148): python3-mako-1.1.4-6.el9.noarch.rpm 6.1 MB/s | 172 kB 00:00 2026-02-22T23:22:32.347 INFO:teuthology.orchestra.run.trial093.stdout:(76/148): python3-numpy-f2py-1.23.5-2.el9.x86_6 16 MB/s | 442 kB 00:00 2026-02-22T23:22:32.356 INFO:teuthology.orchestra.run.trial093.stdout:(77/148): python3-jinja2-2.11.3-8.el9.noarch.rp 1.6 MB/s | 249 kB 00:00 2026-02-22T23:22:32.371 INFO:teuthology.orchestra.run.trial093.stdout:(78/148): python3-packaging-20.9-5.el9.noarch.r 3.1 MB/s | 77 kB 00:00 2026-02-22T23:22:32.398 INFO:teuthology.orchestra.run.trial093.stdout:(79/148): python3-numpy-1.23.5-2.el9.x86_64.rpm 79 MB/s | 6.1 MB 00:00 2026-02-22T23:22:32.398 INFO:teuthology.orchestra.run.trial093.stdout:(80/148): python3-pyasn1-0.4.8-6.el9.noarch.rpm 5.8 MB/s | 159 kB 00:00 2026-02-22T23:22:32.403 INFO:teuthology.orchestra.run.trial093.stdout:(81/148): python3-protobuf-3.14.0-17.el9.noarch 5.5 MB/s | 267 kB 00:00 2026-02-22T23:22:32.422 INFO:teuthology.orchestra.run.trial093.stdout:(82/148): python3-requests-oauthlib-1.3.0-12.el 2.2 MB/s | 54 kB 00:00 2026-02-22T23:22:32.422 INFO:teuthology.orchestra.run.trial093.stdout:(83/148): python3-pyasn1-modules-0.4.8-6.el9.no 11 MB/s | 279 kB 00:00 2026-02-22T23:22:32.445 INFO:teuthology.orchestra.run.trial093.stdout:(84/148): python3-toml-0.10.2-6.el9.noarch.rpm 1.8 MB/s | 42 kB 00:00 2026-02-22T23:22:32.446 INFO:teuthology.orchestra.run.trial093.stdout:(85/148): qatlib-25.08.0-2.el9.x86_64.rpm 9.8 MB/s | 240 kB 00:00 2026-02-22T23:22:32.467 INFO:teuthology.orchestra.run.trial093.stdout:(86/148): qatlib-service-25.08.0-2.el9.x86_64.r 1.6 MB/s | 37 kB 00:00 2026-02-22T23:22:32.469 INFO:teuthology.orchestra.run.trial093.stdout:(87/148): qatzip-libs-1.3.1-1.el9.x86_64.rpm 2.9 MB/s | 66 kB 00:00 2026-02-22T23:22:32.491 INFO:teuthology.orchestra.run.trial093.stdout:(88/148): socat-1.7.4.1-8.el9.x86_64.rpm 13 MB/s | 303 kB 00:00 2026-02-22T23:22:32.549 INFO:teuthology.orchestra.run.trial155.stdout:(37/148): ceph-test-19.2.3-689.gf90f4eae.el9.x8 34 MB/s | 50 MB 00:01 2026-02-22T23:22:32.551 INFO:teuthology.orchestra.run.trial093.stdout:(89/148): sqlite-3.34.1-9.el9.x86_64.rpm 9.1 MB/s | 758 kB 00:00 2026-02-22T23:22:32.579 INFO:teuthology.orchestra.run.trial093.stdout:(90/148): sqlite-devel-3.34.1-9.el9.x86_64.rpm 1.5 MB/s | 133 kB 00:00 2026-02-22T23:22:32.582 INFO:teuthology.orchestra.run.trial093.stdout:(91/148): xmlsec1-1.2.29-13.el9.x86_64.rpm 5.9 MB/s | 189 kB 00:00 2026-02-22T23:22:32.603 INFO:teuthology.orchestra.run.trial093.stdout:(92/148): xmlsec1-openssl-1.2.29-13.el9.x86_64. 3.7 MB/s | 90 kB 00:00 2026-02-22T23:22:32.604 INFO:teuthology.orchestra.run.trial093.stdout:(93/148): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.8 MB/s | 64 kB 00:00 2026-02-22T23:22:32.692 INFO:teuthology.orchestra.run.trial093.stdout:(94/148): python3-scipy-1.9.3-2.el9.x86_64.rpm 67 MB/s | 19 MB 00:00 2026-02-22T23:22:32.712 INFO:teuthology.orchestra.run.trial155.stdout:(38/148): ledmon-libs-1.1.0-3.el9.x86_64.rpm 86 kB/s | 40 kB 00:00 2026-02-22T23:22:32.862 INFO:teuthology.orchestra.run.trial093.stdout:(95/148): lua-devel-5.4.4-4.el9.x86_64.rpm 86 kB/s | 22 kB 00:00 2026-02-22T23:22:32.944 INFO:teuthology.orchestra.run.trial093.stdout:(96/148): abseil-cpp-20211102.0-4.el9.x86_64.rp 2.1 MB/s | 551 kB 00:00 2026-02-22T23:22:32.978 INFO:teuthology.orchestra.run.trial093.stdout:(97/148): grpc-data-1.46.7-10.el9.noarch.rpm 581 kB/s | 19 kB 00:00 2026-02-22T23:22:33.032 INFO:teuthology.orchestra.run.trial155.stdout:(39/148): libconfig-1.7.2-9.el9.x86_64.rpm 149 kB/s | 72 kB 00:00 2026-02-22T23:22:33.034 INFO:teuthology.orchestra.run.trial155.stdout:(40/148): cryptsetup-2.8.1-3.el9.x86_64.rpm 433 kB/s | 351 kB 00:00 2026-02-22T23:22:33.080 INFO:teuthology.orchestra.run.trial093.stdout:(98/148): gperftools-libs-2.9.1-3.el9.x86_64.rp 1.4 MB/s | 308 kB 00:00 2026-02-22T23:22:33.114 INFO:teuthology.orchestra.run.trial093.stdout:(99/148): libarrow-doc-9.0.0-15.el9.noarch.rpm 743 kB/s | 25 kB 00:00 2026-02-22T23:22:33.120 INFO:teuthology.orchestra.run.trial155.stdout:(41/148): mailcap-2.1.49-5.el9.noarch.rpm 384 kB/s | 33 kB 00:00 2026-02-22T23:22:33.126 INFO:teuthology.orchestra.run.trial093.stdout:(100/148): libarrow-9.0.0-15.el9.x86_64.rpm 30 MB/s | 4.4 MB 00:00 2026-02-22T23:22:33.149 INFO:teuthology.orchestra.run.trial093.stdout:(101/148): liboath-2.6.12-1.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2026-02-22T23:22:33.161 INFO:teuthology.orchestra.run.trial093.stdout:(102/148): libunwind-1.6.2-1.el9.x86_64.rpm 1.9 MB/s | 67 kB 00:00 2026-02-22T23:22:33.192 INFO:teuthology.orchestra.run.trial093.stdout:(103/148): luarocks-3.9.2-5.el9.noarch.rpm 3.4 MB/s | 151 kB 00:00 2026-02-22T23:22:33.198 INFO:teuthology.orchestra.run.trial093.stdout:(104/148): parquet-libs-9.0.0-15.el9.x86_64.rpm 22 MB/s | 838 kB 00:00 2026-02-22T23:22:33.232 INFO:teuthology.orchestra.run.trial093.stdout:(105/148): python3-autocommand-2.2.2-8.el9.noar 870 kB/s | 29 kB 00:00 2026-02-22T23:22:33.251 INFO:teuthology.orchestra.run.trial093.stdout:(106/148): protobuf-compiler-3.14.0-17.el9.x86_ 1.3 MB/s | 862 kB 00:00 2026-02-22T23:22:33.266 INFO:teuthology.orchestra.run.trial093.stdout:(107/148): python3-backports-tarfile-1.2.0-1.el 1.7 MB/s | 60 kB 00:00 2026-02-22T23:22:33.267 INFO:teuthology.orchestra.run.trial093.stdout:(108/148): python3-asyncssh-2.13.2-5.el9.noarch 7.2 MB/s | 548 kB 00:00 2026-02-22T23:22:33.274 INFO:teuthology.orchestra.run.trial155.stdout:(42/148): libquadmath-11.5.0-14.el9.x86_64.rpm 760 kB/s | 184 kB 00:00 2026-02-22T23:22:33.300 INFO:teuthology.orchestra.run.trial093.stdout:(109/148): python3-cachetools-4.2.4-1.el9.noarc 945 kB/s | 32 kB 00:00 2026-02-22T23:22:33.301 INFO:teuthology.orchestra.run.trial093.stdout:(110/148): python3-certifi-2023.05.07-4.el9.noa 417 kB/s | 14 kB 00:00 2026-02-22T23:22:33.338 INFO:teuthology.orchestra.run.trial093.stdout:(111/148): python3-cheroot-10.0.1-4.el9.noarch. 4.5 MB/s | 173 kB 00:00 2026-02-22T23:22:33.343 INFO:teuthology.orchestra.run.trial093.stdout:(112/148): python3-cherrypy-18.6.1-2.el9.noarch 8.3 MB/s | 358 kB 00:00 2026-02-22T23:22:33.377 INFO:teuthology.orchestra.run.trial093.stdout:(113/148): python3-google-auth-2.45.0-1.el9.noa 6.3 MB/s | 254 kB 00:00 2026-02-22T23:22:33.380 INFO:teuthology.orchestra.run.trial093.stdout:(114/148): python3-bcrypt-3.2.2-1.el9.x86_64.rp 337 kB/s | 43 kB 00:00 2026-02-22T23:22:33.414 INFO:teuthology.orchestra.run.trial093.stdout:(115/148): python3-grpcio-tools-1.46.7-10.el9.x 3.8 MB/s | 144 kB 00:00 2026-02-22T23:22:33.434 INFO:teuthology.orchestra.run.trial093.stdout:(116/148): python3-grpcio-1.46.7-10.el9.x86_64. 22 MB/s | 2.0 MB 00:00 2026-02-22T23:22:33.440 INFO:teuthology.orchestra.run.trial155.stdout:(43/148): pciutils-3.7.0-7.el9.x86_64.rpm 564 kB/s | 93 kB 00:00 2026-02-22T23:22:33.449 INFO:teuthology.orchestra.run.trial093.stdout:(117/148): python3-isodate-0.6.1-3.el9.noarch.r 1.6 MB/s | 56 kB 00:00 2026-02-22T23:22:33.467 INFO:teuthology.orchestra.run.trial093.stdout:(118/148): python3-jaraco-8.2.1-3.el9.noarch.rp 320 kB/s | 11 kB 00:00 2026-02-22T23:22:33.476 INFO:teuthology.orchestra.run.trial093.stdout:(119/148): python3-influxdb-5.3.1-1.el9.noarch. 1.4 MB/s | 139 kB 00:00 2026-02-22T23:22:33.482 INFO:teuthology.orchestra.run.trial093.stdout:(120/148): python3-jaraco-classes-3.2.1-5.el9.n 528 kB/s | 18 kB 00:00 2026-02-22T23:22:33.501 INFO:teuthology.orchestra.run.trial093.stdout:(121/148): python3-jaraco-collections-3.0.0-8.e 689 kB/s | 23 kB 00:00 2026-02-22T23:22:33.511 INFO:teuthology.orchestra.run.trial093.stdout:(122/148): python3-jaraco-context-6.0.1-3.el9.n 558 kB/s | 20 kB 00:00 2026-02-22T23:22:33.516 INFO:teuthology.orchestra.run.trial093.stdout:(123/148): python3-jaraco-functools-3.5.0-2.el9 581 kB/s | 19 kB 00:00 2026-02-22T23:22:33.535 INFO:teuthology.orchestra.run.trial093.stdout:(124/148): python3-jaraco-text-4.0.0-2.el9.noar 786 kB/s | 26 kB 00:00 2026-02-22T23:22:33.550 INFO:teuthology.orchestra.run.trial093.stdout:(125/148): python3-logutils-0.3.5-21.el9.noarch 1.3 MB/s | 46 kB 00:00 2026-02-22T23:22:33.570 INFO:teuthology.orchestra.run.trial093.stdout:(126/148): python3-more-itertools-8.12.0-2.el9. 2.2 MB/s | 79 kB 00:00 2026-02-22T23:22:33.587 INFO:teuthology.orchestra.run.trial093.stdout:(127/148): python3-msgpack-1.0.3-2.el9.x86_64.r 2.3 MB/s | 86 kB 00:00 2026-02-22T23:22:33.604 INFO:teuthology.orchestra.run.trial093.stdout:(128/148): python3-natsort-7.1.1-5.el9.noarch.r 1.6 MB/s | 58 kB 00:00 2026-02-22T23:22:33.623 INFO:teuthology.orchestra.run.trial093.stdout:(129/148): python3-pecan-1.4.2-3.el9.noarch.rpm 7.3 MB/s | 272 kB 00:00 2026-02-22T23:22:33.638 INFO:teuthology.orchestra.run.trial093.stdout:(130/148): python3-portend-3.1.0-2.el9.noarch.r 487 kB/s | 16 kB 00:00 2026-02-22T23:22:33.647 INFO:teuthology.orchestra.run.trial093.stdout:(131/148): python3-kubernetes-26.1.0-3.el9.noar 7.5 MB/s | 1.0 MB 00:00 2026-02-22T23:22:33.658 INFO:teuthology.orchestra.run.trial093.stdout:(132/148): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.5 MB/s | 90 kB 00:00 2026-02-22T23:22:33.669 INFO:teuthology.orchestra.run.trial155.stdout:(44/148): libgfortran-11.5.0-14.el9.x86_64.rpm 831 kB/s | 794 kB 00:00 2026-02-22T23:22:33.672 INFO:teuthology.orchestra.run.trial093.stdout:(133/148): python3-repoze-lru-0.7-16.el9.noarch 898 kB/s | 31 kB 00:00 2026-02-22T23:22:33.684 INFO:teuthology.orchestra.run.trial093.stdout:(134/148): python3-routes-2.5.1-5.el9.noarch.rp 5.0 MB/s | 188 kB 00:00 2026-02-22T23:22:33.692 INFO:teuthology.orchestra.run.trial093.stdout:(135/148): python3-rsa-4.9-2.el9.noarch.rpm 1.7 MB/s | 59 kB 00:00 2026-02-22T23:22:33.710 INFO:teuthology.orchestra.run.trial093.stdout:(136/148): python3-saml-1.16.0-1.el9.noarch.rpm 3.3 MB/s | 125 kB 00:00 2026-02-22T23:22:33.718 INFO:teuthology.orchestra.run.trial093.stdout:(137/148): python3-tempora-5.0.0-2.el9.noarch.r 1.0 MB/s | 36 kB 00:00 2026-02-22T23:22:33.728 INFO:teuthology.orchestra.run.trial093.stdout:(138/148): python3-typing-extensions-4.15.0-1.e 2.4 MB/s | 86 kB 00:00 2026-02-22T23:22:33.745 INFO:teuthology.orchestra.run.trial093.stdout:(139/148): python3-webob-1.8.8-2.el9.noarch.rpm 6.3 MB/s | 230 kB 00:00 2026-02-22T23:22:33.753 INFO:teuthology.orchestra.run.trial093.stdout:(140/148): python3-websocket-client-1.2.3-2.el9 2.5 MB/s | 90 kB 00:00 2026-02-22T23:22:33.762 INFO:teuthology.orchestra.run.trial155.stdout:(45/148): python3-cffi-1.14.5-5.el9.x86_64.rpm 785 kB/s | 253 kB 00:00 2026-02-22T23:22:33.764 INFO:teuthology.orchestra.run.trial093.stdout:(141/148): python3-werkzeug-2.0.3-3.el9.1.noarc 11 MB/s | 427 kB 00:00 2026-02-22T23:22:33.781 INFO:teuthology.orchestra.run.trial093.stdout:(142/148): python3-xmlsec-1.3.13-1.el9.x86_64.r 1.3 MB/s | 48 kB 00:00 2026-02-22T23:22:33.786 INFO:teuthology.orchestra.run.trial093.stdout:(143/148): python3-xmltodict-0.12.0-15.el9.noar 661 kB/s | 22 kB 00:00 2026-02-22T23:22:33.798 INFO:teuthology.orchestra.run.trial093.stdout:(144/148): python3-zc-lockfile-2.0-10.el9.noarc 596 kB/s | 20 kB 00:00 2026-02-22T23:22:33.817 INFO:teuthology.orchestra.run.trial093.stdout:(145/148): re2-20211101-20.el9.x86_64.rpm 5.1 MB/s | 191 kB 00:00 2026-02-22T23:22:33.856 INFO:teuthology.orchestra.run.trial093.stdout:(146/148): thrift-0.15.0-4.el9.x86_64.rpm 23 MB/s | 1.6 MB 00:00 2026-02-22T23:22:33.926 INFO:teuthology.orchestra.run.trial155.stdout:(46/148): python3-ply-3.11-14.el9.noarch.rpm 652 kB/s | 106 kB 00:00 2026-02-22T23:22:33.963 INFO:teuthology.orchestra.run.trial093.stdout:(147/148): librados2-19.2.3-689.gf90f4eae.el9.x 21 MB/s | 3.4 MB 00:00 2026-02-22T23:22:34.003 INFO:teuthology.orchestra.run.trial093.stdout:(148/148): librbd1-19.2.3-689.gf90f4eae.el9.x86 17 MB/s | 3.2 MB 00:00 2026-02-22T23:22:34.004 INFO:teuthology.orchestra.run.trial093.stdout:-------------------------------------------------------------------------------- 2026-02-22T23:22:34.004 INFO:teuthology.orchestra.run.trial093.stdout:Total 27 MB/s | 214 MB 00:08 2026-02-22T23:22:34.089 INFO:teuthology.orchestra.run.trial155.stdout:(47/148): python3-pycparser-2.20-6.el9.noarch.r 830 kB/s | 135 kB 00:00 2026-02-22T23:22:34.331 INFO:teuthology.orchestra.run.trial155.stdout:(48/148): python3-pyparsing-2.4.7-9.el9.noarch. 621 kB/s | 150 kB 00:00 2026-02-22T23:22:34.456 INFO:teuthology.orchestra.run.trial155.stdout:(49/148): nvme-cli-2.16-1.el9.x86_64.rpm 883 kB/s | 1.2 MB 00:01 2026-02-22T23:22:34.494 INFO:teuthology.orchestra.run.trial155.stdout:(50/148): python3-requests-2.25.1-10.el9.noarch 778 kB/s | 126 kB 00:00 2026-02-22T23:22:34.574 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction check 2026-02-22T23:22:34.623 INFO:teuthology.orchestra.run.trial093.stdout:Transaction check succeeded. 2026-02-22T23:22:34.623 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction test 2026-02-22T23:22:34.735 INFO:teuthology.orchestra.run.trial155.stdout:(51/148): unzip-6.0-59.el9.x86_64.rpm 755 kB/s | 182 kB 00:00 2026-02-22T23:22:34.773 INFO:teuthology.orchestra.run.trial155.stdout:(52/148): python3-urllib3-1.26.5-7.el9.noarch.r 688 kB/s | 218 kB 00:00 2026-02-22T23:22:34.827 INFO:teuthology.orchestra.run.trial155.stdout:(53/148): boost-program-options-1.75.0-13.el9.x 1.9 MB/s | 104 kB 00:00 2026-02-22T23:22:34.837 INFO:teuthology.orchestra.run.trial155.stdout:(54/148): flexiblas-3.0.4-9.el9.x86_64.rpm 2.9 MB/s | 30 kB 00:00 2026-02-22T23:22:34.896 INFO:teuthology.orchestra.run.trial155.stdout:(55/148): flexiblas-netlib-3.0.4-9.el9.x86_64.r 51 MB/s | 3.0 MB 00:00 2026-02-22T23:22:34.906 INFO:teuthology.orchestra.run.trial155.stdout:(56/148): flexiblas-openblas-openmp-3.0.4-9.el9 1.4 MB/s | 15 kB 00:00 2026-02-22T23:22:34.918 INFO:teuthology.orchestra.run.trial155.stdout:(57/148): libnbd-1.20.3-4.el9.x86_64.rpm 14 MB/s | 164 kB 00:00 2026-02-22T23:22:34.930 INFO:teuthology.orchestra.run.trial155.stdout:(58/148): libpmemobj-1.12.1-1.el9.x86_64.rpm 13 MB/s | 160 kB 00:00 2026-02-22T23:22:34.940 INFO:teuthology.orchestra.run.trial155.stdout:(59/148): librabbitmq-0.11.0-7.el9.x86_64.rpm 4.3 MB/s | 45 kB 00:00 2026-02-22T23:22:34.953 INFO:teuthology.orchestra.run.trial155.stdout:(60/148): librdkafka-1.6.1-102.el9.x86_64.rpm 52 MB/s | 662 kB 00:00 2026-02-22T23:22:34.965 INFO:teuthology.orchestra.run.trial155.stdout:(61/148): libstoragemgmt-1.10.1-1.el9.x86_64.rp 20 MB/s | 246 kB 00:00 2026-02-22T23:22:34.976 INFO:teuthology.orchestra.run.trial155.stdout:(62/148): libxslt-1.1.34-12.el9.x86_64.rpm 19 MB/s | 233 kB 00:00 2026-02-22T23:22:34.989 INFO:teuthology.orchestra.run.trial155.stdout:(63/148): lttng-ust-2.12.0-6.el9.x86_64.rpm 24 MB/s | 292 kB 00:00 2026-02-22T23:22:35.001 INFO:teuthology.orchestra.run.trial155.stdout:(64/148): lua-5.4.4-4.el9.x86_64.rpm 15 MB/s | 188 kB 00:00 2026-02-22T23:22:35.011 INFO:teuthology.orchestra.run.trial155.stdout:(65/148): openblas-0.3.29-1.el9.x86_64.rpm 4.1 MB/s | 42 kB 00:00 2026-02-22T23:22:35.041 INFO:teuthology.orchestra.run.trial155.stdout:(66/148): openblas-openmp-0.3.29-1.el9.x86_64.r 178 MB/s | 5.3 MB 00:00 2026-02-22T23:22:35.054 INFO:teuthology.orchestra.run.trial155.stdout:(67/148): zip-3.0-35.el9.x86_64.rpm 831 kB/s | 266 kB 00:00 2026-02-22T23:22:35.056 INFO:teuthology.orchestra.run.trial155.stdout:(68/148): protobuf-3.14.0-17.el9.x86_64.rpm 67 MB/s | 1.0 MB 00:00 2026-02-22T23:22:35.069 INFO:teuthology.orchestra.run.trial155.stdout:(69/148): python3-devel-3.9.25-3.el9.x86_64.rpm 18 MB/s | 244 kB 00:00 2026-02-22T23:22:35.082 INFO:teuthology.orchestra.run.trial155.stdout:(70/148): python3-jinja2-2.11.3-8.el9.noarch.rp 19 MB/s | 249 kB 00:00 2026-02-22T23:22:35.095 INFO:teuthology.orchestra.run.trial155.stdout:(71/148): python3-libstoragemgmt-1.10.1-1.el9.x 14 MB/s | 177 kB 00:00 2026-02-22T23:22:35.110 INFO:teuthology.orchestra.run.trial155.stdout:(72/148): python3-lxml-4.6.5-3.el9.x86_64.rpm 79 MB/s | 1.2 MB 00:00 2026-02-22T23:22:35.123 INFO:teuthology.orchestra.run.trial155.stdout:(73/148): python3-mako-1.1.4-6.el9.noarch.rpm 14 MB/s | 172 kB 00:00 2026-02-22T23:22:35.133 INFO:teuthology.orchestra.run.trial155.stdout:(74/148): python3-markupsafe-1.1.1-12.el9.x86_6 3.2 MB/s | 35 kB 00:00 2026-02-22T23:22:35.153 INFO:teuthology.orchestra.run.trial155.stdout:(75/148): python3-cryptography-36.0.1-5.el9.x86 860 kB/s | 1.2 MB 00:01 2026-02-22T23:22:35.163 INFO:teuthology.orchestra.run.trial155.stdout:(76/148): python3-babel-2.9.1-2.el9.noarch.rpm 55 MB/s | 6.0 MB 00:00 2026-02-22T23:22:35.174 INFO:teuthology.orchestra.run.trial155.stdout:(77/148): python3-numpy-1.23.5-2.el9.x86_64.rpm 154 MB/s | 6.1 MB 00:00 2026-02-22T23:22:35.175 INFO:teuthology.orchestra.run.trial155.stdout:(78/148): python3-packaging-20.9-5.el9.noarch.r 6.5 MB/s | 77 kB 00:00 2026-02-22T23:22:35.186 INFO:teuthology.orchestra.run.trial155.stdout:(79/148): python3-pyasn1-0.4.8-6.el9.noarch.rpm 14 MB/s | 159 kB 00:00 2026-02-22T23:22:35.187 INFO:teuthology.orchestra.run.trial155.stdout:(80/148): python3-protobuf-3.14.0-17.el9.noarch 20 MB/s | 267 kB 00:00 2026-02-22T23:22:35.198 INFO:teuthology.orchestra.run.trial155.stdout:(81/148): python3-requests-oauthlib-1.3.0-12.el 4.9 MB/s | 54 kB 00:00 2026-02-22T23:22:35.199 INFO:teuthology.orchestra.run.trial155.stdout:(82/148): python3-pyasn1-modules-0.4.8-6.el9.no 21 MB/s | 279 kB 00:00 2026-02-22T23:22:35.210 INFO:teuthology.orchestra.run.trial155.stdout:(83/148): python3-toml-0.10.2-6.el9.noarch.rpm 3.8 MB/s | 42 kB 00:00 2026-02-22T23:22:35.216 INFO:teuthology.orchestra.run.trial155.stdout:(84/148): python3-numpy-f2py-1.23.5-2.el9.x86_6 6.9 MB/s | 442 kB 00:00 2026-02-22T23:22:35.221 INFO:teuthology.orchestra.run.trial155.stdout:(85/148): qatlib-25.08.0-2.el9.x86_64.rpm 21 MB/s | 240 kB 00:00 2026-02-22T23:22:35.226 INFO:teuthology.orchestra.run.trial155.stdout:(86/148): qatlib-service-25.08.0-2.el9.x86_64.r 3.8 MB/s | 37 kB 00:00 2026-02-22T23:22:35.232 INFO:teuthology.orchestra.run.trial155.stdout:(87/148): qatzip-libs-1.3.1-1.el9.x86_64.rpm 6.1 MB/s | 66 kB 00:00 2026-02-22T23:22:35.238 INFO:teuthology.orchestra.run.trial155.stdout:(88/148): socat-1.7.4.1-8.el9.x86_64.rpm 25 MB/s | 303 kB 00:00 2026-02-22T23:22:35.244 INFO:teuthology.orchestra.run.trial155.stdout:(89/148): sqlite-3.34.1-9.el9.x86_64.rpm 60 MB/s | 758 kB 00:00 2026-02-22T23:22:35.249 INFO:teuthology.orchestra.run.trial155.stdout:(90/148): sqlite-devel-3.34.1-9.el9.x86_64.rpm 12 MB/s | 133 kB 00:00 2026-02-22T23:22:35.256 INFO:teuthology.orchestra.run.trial155.stdout:(91/148): xmlsec1-1.2.29-13.el9.x86_64.rpm 15 MB/s | 189 kB 00:00 2026-02-22T23:22:35.258 INFO:teuthology.orchestra.run.trial155.stdout:(92/148): xmlsec1-openssl-1.2.29-13.el9.x86_64. 9.0 MB/s | 90 kB 00:00 2026-02-22T23:22:35.267 INFO:teuthology.orchestra.run.trial155.stdout:(93/148): xmlstarlet-1.6.1-20.el9.x86_64.rpm 5.9 MB/s | 64 kB 00:00 2026-02-22T23:22:35.293 INFO:teuthology.orchestra.run.trial155.stdout:(94/148): python3-scipy-1.9.3-2.el9.x86_64.rpm 202 MB/s | 19 MB 00:00 2026-02-22T23:22:35.427 INFO:teuthology.orchestra.run.trial093.stdout:Transaction test succeeded. 2026-02-22T23:22:35.427 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction 2026-02-22T23:22:35.504 INFO:teuthology.orchestra.run.trial155.stdout:(95/148): lua-devel-5.4.4-4.el9.x86_64.rpm 91 kB/s | 22 kB 00:00 2026-02-22T23:22:35.617 INFO:teuthology.orchestra.run.trial155.stdout:(96/148): abseil-cpp-20211102.0-4.el9.x86_64.rp 1.7 MB/s | 551 kB 00:00 2026-02-22T23:22:35.655 INFO:teuthology.orchestra.run.trial155.stdout:(97/148): grpc-data-1.46.7-10.el9.noarch.rpm 511 kB/s | 19 kB 00:00 2026-02-22T23:22:35.788 INFO:teuthology.orchestra.run.trial155.stdout:(98/148): gperftools-libs-2.9.1-3.el9.x86_64.rp 1.1 MB/s | 308 kB 00:00 2026-02-22T23:22:35.835 INFO:teuthology.orchestra.run.trial155.stdout:(99/148): libarrow-doc-9.0.0-15.el9.noarch.rpm 534 kB/s | 25 kB 00:00 2026-02-22T23:22:35.842 INFO:teuthology.orchestra.run.trial155.stdout:(100/148): libarrow-9.0.0-15.el9.x86_64.rpm 24 MB/s | 4.4 MB 00:00 2026-02-22T23:22:35.886 INFO:teuthology.orchestra.run.trial155.stdout:(101/148): liboath-2.6.12-1.el9.x86_64.rpm 969 kB/s | 49 kB 00:00 2026-02-22T23:22:35.895 INFO:teuthology.orchestra.run.trial155.stdout:(102/148): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2026-02-22T23:22:35.898 INFO:teuthology.orchestra.run.trial155.stdout:(103/148): protobuf-compiler-3.14.0-17.el9.x86_ 1.3 MB/s | 862 kB 00:00 2026-02-22T23:22:35.936 INFO:teuthology.orchestra.run.trial155.stdout:(104/148): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2026-02-22T23:22:35.957 INFO:teuthology.orchestra.run.trial155.stdout:(105/148): parquet-libs-9.0.0-15.el9.x86_64.rpm 13 MB/s | 838 kB 00:00 2026-02-22T23:22:35.975 INFO:teuthology.orchestra.run.trial155.stdout:(106/148): python3-autocommand-2.2.2-8.el9.noar 753 kB/s | 29 kB 00:00 2026-02-22T23:22:35.994 INFO:teuthology.orchestra.run.trial155.stdout:(107/148): python3-backports-tarfile-1.2.0-1.el 1.6 MB/s | 60 kB 00:00 2026-02-22T23:22:36.015 INFO:teuthology.orchestra.run.trial155.stdout:(108/148): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.1 MB/s | 43 kB 00:00 2026-02-22T23:22:36.033 INFO:teuthology.orchestra.run.trial155.stdout:(109/148): python3-cachetools-4.2.4-1.el9.noarc 851 kB/s | 32 kB 00:00 2026-02-22T23:22:36.053 INFO:teuthology.orchestra.run.trial155.stdout:(110/148): python3-certifi-2023.05.07-4.el9.noa 369 kB/s | 14 kB 00:00 2026-02-22T23:22:36.071 INFO:teuthology.orchestra.run.trial155.stdout:(111/148): python3-cheroot-10.0.1-4.el9.noarch. 4.4 MB/s | 173 kB 00:00 2026-02-22T23:22:36.113 INFO:teuthology.orchestra.run.trial155.stdout:(112/148): python3-google-auth-2.45.0-1.el9.noa 6.0 MB/s | 254 kB 00:00 2026-02-22T23:22:36.121 INFO:teuthology.orchestra.run.trial155.stdout:(113/148): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2026-02-22T23:22:36.165 INFO:teuthology.orchestra.run.trial155.stdout:(114/148): python3-grpcio-1.46.7-10.el9.x86_64. 39 MB/s | 2.0 MB 00:00 2026-02-22T23:22:36.167 INFO:teuthology.orchestra.run.trial155.stdout:(115/148): python3-grpcio-tools-1.46.7-10.el9.x 3.0 MB/s | 144 kB 00:00 2026-02-22T23:22:36.205 INFO:teuthology.orchestra.run.trial155.stdout:(116/148): python3-influxdb-5.3.1-1.el9.noarch. 3.4 MB/s | 139 kB 00:00 2026-02-22T23:22:36.207 INFO:teuthology.orchestra.run.trial155.stdout:(117/148): python3-isodate-0.6.1-3.el9.noarch.r 1.4 MB/s | 56 kB 00:00 2026-02-22T23:22:36.222 INFO:teuthology.orchestra.run.trial155.stdout:(118/148): python3-asyncssh-2.13.2-5.el9.noarch 1.6 MB/s | 548 kB 00:00 2026-02-22T23:22:36.244 INFO:teuthology.orchestra.run.trial155.stdout:(119/148): python3-jaraco-8.2.1-3.el9.noarch.rp 272 kB/s | 11 kB 00:00 2026-02-22T23:22:36.246 INFO:teuthology.orchestra.run.trial155.stdout:(120/148): python3-jaraco-classes-3.2.1-5.el9.n 461 kB/s | 18 kB 00:00 2026-02-22T23:22:36.261 INFO:teuthology.orchestra.run.trial155.stdout:(121/148): python3-jaraco-collections-3.0.0-8.e 604 kB/s | 23 kB 00:00 2026-02-22T23:22:36.282 INFO:teuthology.orchestra.run.trial155.stdout:(122/148): python3-jaraco-context-6.0.1-3.el9.n 521 kB/s | 20 kB 00:00 2026-02-22T23:22:36.284 INFO:teuthology.orchestra.run.trial155.stdout:(123/148): python3-jaraco-functools-3.5.0-2.el9 509 kB/s | 19 kB 00:00 2026-02-22T23:22:36.301 INFO:teuthology.orchestra.run.trial155.stdout:(124/148): python3-jaraco-text-4.0.0-2.el9.noar 654 kB/s | 26 kB 00:00 2026-02-22T23:22:36.309 INFO:teuthology.orchestra.run.trial093.stdout: Preparing : 1/1 2026-02-22T23:22:36.322 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/150 2026-02-22T23:22:36.325 INFO:teuthology.orchestra.run.trial155.stdout:(125/148): python3-logutils-0.3.5-21.el9.noarch 1.1 MB/s | 46 kB 00:00 2026-02-22T23:22:36.328 INFO:teuthology.orchestra.run.trial155.stdout:(126/148): python3-kubernetes-26.1.0-3.el9.noar 23 MB/s | 1.0 MB 00:00 2026-02-22T23:22:36.334 INFO:teuthology.orchestra.run.trial093.stdout: Installing : thrift-0.15.0-4.el9.x86_64 2/150 2026-02-22T23:22:36.343 INFO:teuthology.orchestra.run.trial155.stdout:(127/148): python3-more-itertools-8.12.0-2.el9. 1.8 MB/s | 79 kB 00:00 2026-02-22T23:22:36.367 INFO:teuthology.orchestra.run.trial155.stdout:(128/148): python3-msgpack-1.0.3-2.el9.x86_64.r 2.0 MB/s | 86 kB 00:00 2026-02-22T23:22:36.369 INFO:teuthology.orchestra.run.trial155.stdout:(129/148): python3-natsort-7.1.1-5.el9.noarch.r 1.4 MB/s | 58 kB 00:00 2026-02-22T23:22:36.395 INFO:teuthology.orchestra.run.trial155.stdout:(130/148): python3-pecan-1.4.2-3.el9.noarch.rpm 5.1 MB/s | 272 kB 00:00 2026-02-22T23:22:36.405 INFO:teuthology.orchestra.run.trial155.stdout:(131/148): python3-portend-3.1.0-2.el9.noarch.r 430 kB/s | 16 kB 00:00 2026-02-22T23:22:36.409 INFO:teuthology.orchestra.run.trial155.stdout:(132/148): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.2 MB/s | 90 kB 00:00 2026-02-22T23:22:36.433 INFO:teuthology.orchestra.run.trial155.stdout:(133/148): python3-repoze-lru-0.7-16.el9.noarch 808 kB/s | 31 kB 00:00 2026-02-22T23:22:36.448 INFO:teuthology.orchestra.run.trial155.stdout:(134/148): python3-rsa-4.9-2.el9.noarch.rpm 1.5 MB/s | 59 kB 00:00 2026-02-22T23:22:36.454 INFO:teuthology.orchestra.run.trial155.stdout:(135/148): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2026-02-22T23:22:36.478 INFO:teuthology.orchestra.run.trial155.stdout:(136/148): python3-saml-1.16.0-1.el9.noarch.rpm 2.7 MB/s | 125 kB 00:00 2026-02-22T23:22:36.485 INFO:teuthology.orchestra.run.trial093.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 3/150 2026-02-22T23:22:36.489 INFO:teuthology.orchestra.run.trial155.stdout:(137/148): python3-tempora-5.0.0-2.el9.noarch.r 875 kB/s | 36 kB 00:00 2026-02-22T23:22:36.489 INFO:teuthology.orchestra.run.trial093.stdout: Upgrading : librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 4/150 2026-02-22T23:22:36.497 INFO:teuthology.orchestra.run.trial155.stdout:(138/148): python3-typing-extensions-4.15.0-1.e 2.0 MB/s | 86 kB 00:00 2026-02-22T23:22:36.528 INFO:teuthology.orchestra.run.trial155.stdout:(139/148): python3-webob-1.8.8-2.el9.noarch.rpm 4.4 MB/s | 230 kB 00:00 2026-02-22T23:22:36.530 INFO:teuthology.orchestra.run.trial155.stdout:(140/148): python3-websocket-client-1.2.3-2.el9 2.1 MB/s | 90 kB 00:00 2026-02-22T23:22:36.547 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 4/150 2026-02-22T23:22:36.548 INFO:teuthology.orchestra.run.trial093.stdout: Installing : libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 5/150 2026-02-22T23:22:36.562 INFO:teuthology.orchestra.run.trial155.stdout:(141/148): python3-werkzeug-2.0.3-3.el9.1.noarc 6.4 MB/s | 427 kB 00:00 2026-02-22T23:22:36.568 INFO:teuthology.orchestra.run.trial155.stdout:(142/148): python3-xmlsec-1.3.13-1.el9.x86_64.r 1.2 MB/s | 48 kB 00:00 2026-02-22T23:22:36.571 INFO:teuthology.orchestra.run.trial155.stdout:(143/148): python3-xmltodict-0.12.0-15.el9.noar 545 kB/s | 22 kB 00:00 2026-02-22T23:22:36.578 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 5/150 2026-02-22T23:22:36.584 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-rados-2:19.2.3-689.gf90f4eae.el9.x86_64 6/150 2026-02-22T23:22:36.593 INFO:teuthology.orchestra.run.trial093.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 7/150 2026-02-22T23:22:36.596 INFO:teuthology.orchestra.run.trial093.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/150 2026-02-22T23:22:36.597 INFO:teuthology.orchestra.run.trial093.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/150 2026-02-22T23:22:36.600 INFO:teuthology.orchestra.run.trial155.stdout:(144/148): python3-zc-lockfile-2.0-10.el9.noarc 524 kB/s | 20 kB 00:00 2026-02-22T23:22:36.602 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 10/150 2026-02-22T23:22:36.628 INFO:teuthology.orchestra.run.trial155.stdout:(145/148): re2-20211101-20.el9.x86_64.rpm 3.1 MB/s | 191 kB 00:00 2026-02-22T23:22:36.636 INFO:teuthology.orchestra.run.trial093.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 11/150 2026-02-22T23:22:36.642 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 12/150 2026-02-22T23:22:36.648 INFO:teuthology.orchestra.run.trial155.stdout:(146/148): thrift-0.15.0-4.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2026-02-22T23:22:36.650 INFO:teuthology.orchestra.run.trial093.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 13/150 2026-02-22T23:22:36.650 INFO:teuthology.orchestra.run.trial093.stdout: Installing : libcephsqlite-2:19.2.3-689.gf90f4eae.el9.x86_64 14/150 2026-02-22T23:22:36.685 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: libcephsqlite-2:19.2.3-689.gf90f4eae.el9.x86_64 14/150 2026-02-22T23:22:36.686 INFO:teuthology.orchestra.run.trial093.stdout: Installing : libradosstriper1-2:19.2.3-689.gf90f4eae.el9.x86_ 15/150 2026-02-22T23:22:36.700 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: libradosstriper1-2:19.2.3-689.gf90f4eae.el9.x86_ 15/150 2026-02-22T23:22:36.731 INFO:teuthology.orchestra.run.trial093.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/150 2026-02-22T23:22:36.762 INFO:teuthology.orchestra.run.trial093.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 17/150 2026-02-22T23:22:36.765 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/150 2026-02-22T23:22:36.769 INFO:teuthology.orchestra.run.trial155.stdout:(147/148): librados2-19.2.3-689.gf90f4eae.el9.x 20 MB/s | 3.4 MB 00:00 2026-02-22T23:22:36.786 INFO:teuthology.orchestra.run.trial093.stdout: Installing : liboath-2.6.12-1.el9.x86_64 19/150 2026-02-22T23:22:36.792 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/150 2026-02-22T23:22:36.801 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 21/150 2026-02-22T23:22:36.806 INFO:teuthology.orchestra.run.trial093.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 22/150 2026-02-22T23:22:36.809 INFO:teuthology.orchestra.run.trial093.stdout: Installing : lua-5.4.4-4.el9.x86_64 23/150 2026-02-22T23:22:36.813 INFO:teuthology.orchestra.run.trial093.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 24/150 2026-02-22T23:22:36.821 INFO:teuthology.orchestra.run.trial155.stdout:(148/148): librbd1-19.2.3-689.gf90f4eae.el9.x86 16 MB/s | 3.2 MB 00:00 2026-02-22T23:22:36.824 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-22T23:22:36.824 INFO:teuthology.orchestra.run.trial155.stdout:Total 29 MB/s | 214 MB 00:07 2026-02-22T23:22:36.836 INFO:teuthology.orchestra.run.trial093.stdout: Installing : unzip-6.0-59.el9.x86_64 25/150 2026-02-22T23:22:36.849 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 26/150 2026-02-22T23:22:36.852 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 27/150 2026-02-22T23:22:36.858 INFO:teuthology.orchestra.run.trial093.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 28/150 2026-02-22T23:22:36.860 INFO:teuthology.orchestra.run.trial093.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 29/150 2026-02-22T23:22:36.886 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 30/150 2026-02-22T23:22:36.890 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-ceph-common-2:19.2.3-689.gf90f4eae.el9.x 31/150 2026-02-22T23:22:36.899 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-ceph-argparse-2:19.2.3-689.gf90f4eae.el9 32/150 2026-02-22T23:22:36.910 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-cephfs-2:19.2.3-689.gf90f4eae.el9.x86_64 33/150 2026-02-22T23:22:36.916 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 34/150 2026-02-22T23:22:36.940 INFO:teuthology.orchestra.run.trial093.stdout: Installing : zip-3.0-35.el9.x86_64 35/150 2026-02-22T23:22:36.943 INFO:teuthology.orchestra.run.trial093.stdout: Installing : luarocks-3.9.2-5.el9.noarch 36/150 2026-02-22T23:22:36.950 INFO:teuthology.orchestra.run.trial093.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/150 2026-02-22T23:22:36.975 INFO:teuthology.orchestra.run.trial093.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 38/150 2026-02-22T23:22:37.026 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 39/150 2026-02-22T23:22:37.039 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 40/150 2026-02-22T23:22:37.041 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-rsa-4.9-2.el9.noarch 41/150 2026-02-22T23:22:37.046 INFO:teuthology.orchestra.run.trial093.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 42/150 2026-02-22T23:22:37.051 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 43/150 2026-02-22T23:22:37.054 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/150 2026-02-22T23:22:37.062 INFO:teuthology.orchestra.run.trial093.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 45/150 2026-02-22T23:22:37.067 INFO:teuthology.orchestra.run.trial093.stdout: Installing : librados-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 46/150 2026-02-22T23:22:37.070 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/150 2026-02-22T23:22:37.084 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 48/150 2026-02-22T23:22:37.105 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 49/150 2026-02-22T23:22:37.110 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 50/150 2026-02-22T23:22:37.115 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 51/150 2026-02-22T23:22:37.127 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 52/150 2026-02-22T23:22:37.136 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 53/150 2026-02-22T23:22:37.142 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/150 2026-02-22T23:22:37.162 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 55/150 2026-02-22T23:22:37.170 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 56/150 2026-02-22T23:22:37.225 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/150 2026-02-22T23:22:37.237 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/150 2026-02-22T23:22:37.252 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 59/150 2026-02-22T23:22:37.257 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 60/150 2026-02-22T23:22:37.265 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/150 2026-02-22T23:22:37.305 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/150 2026-02-22T23:22:37.365 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-22T23:22:37.417 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-22T23:22:37.417 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-22T23:22:37.630 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 63/150 2026-02-22T23:22:37.639 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 64/150 2026-02-22T23:22:37.643 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 65/150 2026-02-22T23:22:37.649 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 66/150 2026-02-22T23:22:37.652 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 67/150 2026-02-22T23:22:37.660 INFO:teuthology.orchestra.run.trial093.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 68/150 2026-02-22T23:22:37.662 INFO:teuthology.orchestra.run.trial093.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 69/150 2026-02-22T23:22:37.663 INFO:teuthology.orchestra.run.trial093.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 70/150 2026-02-22T23:22:37.693 INFO:teuthology.orchestra.run.trial093.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 71/150 2026-02-22T23:22:37.736 INFO:teuthology.orchestra.run.trial093.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 72/150 2026-02-22T23:22:37.742 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 73/150 2026-02-22T23:22:37.751 INFO:teuthology.orchestra.run.trial093.stdout: Installing : sqlite-3.34.1-9.el9.x86_64 74/150 2026-02-22T23:22:37.756 INFO:teuthology.orchestra.run.trial093.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 75/150 2026-02-22T23:22:37.760 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 76/150 2026-02-22T23:22:37.766 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 77/150 2026-02-22T23:22:37.769 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 78/150 2026-02-22T23:22:37.776 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 79/150 2026-02-22T23:22:37.780 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 80/150 2026-02-22T23:22:37.808 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 81/150 2026-02-22T23:22:37.817 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 82/150 2026-02-22T23:22:37.853 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 83/150 2026-02-22T23:22:38.077 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 84/150 2026-02-22T23:22:38.101 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 85/150 2026-02-22T23:22:38.104 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 86/150 2026-02-22T23:22:38.162 INFO:teuthology.orchestra.run.trial093.stdout: Installing : openblas-0.3.29-1.el9.x86_64 87/150 2026-02-22T23:22:38.164 INFO:teuthology.orchestra.run.trial093.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 88/150 2026-02-22T23:22:38.186 INFO:teuthology.orchestra.run.trial093.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 89/150 2026-02-22T23:22:38.218 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-22T23:22:38.218 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-22T23:22:38.511 INFO:teuthology.orchestra.run.trial093.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 90/150 2026-02-22T23:22:38.585 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 91/150 2026-02-22T23:22:39.093 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-22T23:22:39.105 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/150 2026-02-22T23:22:39.119 INFO:teuthology.orchestra.run.trial155.stdout: Installing : thrift-0.15.0-4.el9.x86_64 2/150 2026-02-22T23:22:39.256 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 92/150 2026-02-22T23:22:39.269 INFO:teuthology.orchestra.run.trial155.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 3/150 2026-02-22T23:22:39.273 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 93/150 2026-02-22T23:22:39.274 INFO:teuthology.orchestra.run.trial155.stdout: Upgrading : librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 4/150 2026-02-22T23:22:39.330 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 4/150 2026-02-22T23:22:39.331 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 5/150 2026-02-22T23:22:39.357 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 5/150 2026-02-22T23:22:39.362 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-rados-2:19.2.3-689.gf90f4eae.el9.x86_64 6/150 2026-02-22T23:22:39.371 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 7/150 2026-02-22T23:22:39.373 INFO:teuthology.orchestra.run.trial155.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/150 2026-02-22T23:22:39.375 INFO:teuthology.orchestra.run.trial155.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/150 2026-02-22T23:22:39.380 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 10/150 2026-02-22T23:22:39.412 INFO:teuthology.orchestra.run.trial093.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 94/150 2026-02-22T23:22:39.413 INFO:teuthology.orchestra.run.trial093.stdout: Upgrading : librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 95/150 2026-02-22T23:22:39.414 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 11/150 2026-02-22T23:22:39.419 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 12/150 2026-02-22T23:22:39.427 INFO:teuthology.orchestra.run.trial155.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 13/150 2026-02-22T23:22:39.428 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libcephsqlite-2:19.2.3-689.gf90f4eae.el9.x86_64 14/150 2026-02-22T23:22:39.442 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 95/150 2026-02-22T23:22:39.444 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-rbd-2:19.2.3-689.gf90f4eae.el9.x86_64 96/150 2026-02-22T23:22:39.450 INFO:teuthology.orchestra.run.trial093.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 97/150 2026-02-22T23:22:39.462 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: libcephsqlite-2:19.2.3-689.gf90f4eae.el9.x86_64 14/150 2026-02-22T23:22:39.463 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libradosstriper1-2:19.2.3-689.gf90f4eae.el9.x86_ 15/150 2026-02-22T23:22:39.477 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: libradosstriper1-2:19.2.3-689.gf90f4eae.el9.x86_ 15/150 2026-02-22T23:22:39.512 INFO:teuthology.orchestra.run.trial155.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/150 2026-02-22T23:22:39.544 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 17/150 2026-02-22T23:22:39.548 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/150 2026-02-22T23:22:39.569 INFO:teuthology.orchestra.run.trial155.stdout: Installing : liboath-2.6.12-1.el9.x86_64 19/150 2026-02-22T23:22:39.576 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/150 2026-02-22T23:22:39.585 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 21/150 2026-02-22T23:22:39.590 INFO:teuthology.orchestra.run.trial155.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 22/150 2026-02-22T23:22:39.593 INFO:teuthology.orchestra.run.trial155.stdout: Installing : lua-5.4.4-4.el9.x86_64 23/150 2026-02-22T23:22:39.598 INFO:teuthology.orchestra.run.trial155.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 24/150 2026-02-22T23:22:39.621 INFO:teuthology.orchestra.run.trial155.stdout: Installing : unzip-6.0-59.el9.x86_64 25/150 2026-02-22T23:22:39.634 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 26/150 2026-02-22T23:22:39.637 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 27/150 2026-02-22T23:22:39.643 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 28/150 2026-02-22T23:22:39.645 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 29/150 2026-02-22T23:22:39.671 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 30/150 2026-02-22T23:22:39.675 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-ceph-common-2:19.2.3-689.gf90f4eae.el9.x 31/150 2026-02-22T23:22:39.676 INFO:teuthology.orchestra.run.trial093.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 98/150 2026-02-22T23:22:39.677 INFO:teuthology.orchestra.run.trial093.stdout: Installing : librgw2-2:19.2.3-689.gf90f4eae.el9.x86_64 99/150 2026-02-22T23:22:39.684 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-ceph-argparse-2:19.2.3-689.gf90f4eae.el9 32/150 2026-02-22T23:22:39.695 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: librgw2-2:19.2.3-689.gf90f4eae.el9.x86_64 99/150 2026-02-22T23:22:39.695 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-cephfs-2:19.2.3-689.gf90f4eae.el9.x86_64 33/150 2026-02-22T23:22:39.696 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-rgw-2:19.2.3-689.gf90f4eae.el9.x86_64 100/150 2026-02-22T23:22:39.702 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 34/150 2026-02-22T23:22:39.726 INFO:teuthology.orchestra.run.trial155.stdout: Installing : zip-3.0-35.el9.x86_64 35/150 2026-02-22T23:22:39.729 INFO:teuthology.orchestra.run.trial155.stdout: Installing : luarocks-3.9.2-5.el9.noarch 36/150 2026-02-22T23:22:39.738 INFO:teuthology.orchestra.run.trial155.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/150 2026-02-22T23:22:39.763 INFO:teuthology.orchestra.run.trial155.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 38/150 2026-02-22T23:22:39.815 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 39/150 2026-02-22T23:22:39.828 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 40/150 2026-02-22T23:22:39.832 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-rsa-4.9-2.el9.noarch 41/150 2026-02-22T23:22:39.836 INFO:teuthology.orchestra.run.trial155.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 42/150 2026-02-22T23:22:39.842 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 43/150 2026-02-22T23:22:39.845 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/150 2026-02-22T23:22:39.853 INFO:teuthology.orchestra.run.trial155.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 45/150 2026-02-22T23:22:39.858 INFO:teuthology.orchestra.run.trial155.stdout: Installing : librados-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 46/150 2026-02-22T23:22:39.861 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/150 2026-02-22T23:22:39.876 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 48/150 2026-02-22T23:22:39.897 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 49/150 2026-02-22T23:22:39.901 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 50/150 2026-02-22T23:22:39.907 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 51/150 2026-02-22T23:22:39.918 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 52/150 2026-02-22T23:22:39.927 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 53/150 2026-02-22T23:22:39.934 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/150 2026-02-22T23:22:39.953 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 55/150 2026-02-22T23:22:39.963 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 56/150 2026-02-22T23:22:40.018 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/150 2026-02-22T23:22:40.030 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/150 2026-02-22T23:22:40.046 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 59/150 2026-02-22T23:22:40.050 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 60/150 2026-02-22T23:22:40.058 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/150 2026-02-22T23:22:40.099 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/150 2026-02-22T23:22:40.428 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 63/150 2026-02-22T23:22:40.437 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 64/150 2026-02-22T23:22:40.441 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 65/150 2026-02-22T23:22:40.447 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 66/150 2026-02-22T23:22:40.452 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 67/150 2026-02-22T23:22:40.458 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 68/150 2026-02-22T23:22:40.460 INFO:teuthology.orchestra.run.trial155.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 69/150 2026-02-22T23:22:40.462 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 70/150 2026-02-22T23:22:40.492 INFO:teuthology.orchestra.run.trial155.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 71/150 2026-02-22T23:22:40.535 INFO:teuthology.orchestra.run.trial155.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 72/150 2026-02-22T23:22:40.541 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 73/150 2026-02-22T23:22:40.549 INFO:teuthology.orchestra.run.trial155.stdout: Installing : sqlite-3.34.1-9.el9.x86_64 74/150 2026-02-22T23:22:40.555 INFO:teuthology.orchestra.run.trial155.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 75/150 2026-02-22T23:22:40.559 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 76/150 2026-02-22T23:22:40.565 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 77/150 2026-02-22T23:22:40.568 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 78/150 2026-02-22T23:22:40.575 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 79/150 2026-02-22T23:22:40.579 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 80/150 2026-02-22T23:22:40.607 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 81/150 2026-02-22T23:22:40.617 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 82/150 2026-02-22T23:22:40.652 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 83/150 2026-02-22T23:22:40.677 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 101/150 2026-02-22T23:22:40.679 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 101/150 2026-02-22T23:22:40.699 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 101/150 2026-02-22T23:22:40.709 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 102/150 2026-02-22T23:22:40.716 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-packaging-20.9-5.el9.noarch 103/150 2026-02-22T23:22:40.729 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-ply-3.11-14.el9.noarch 104/150 2026-02-22T23:22:40.745 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 105/150 2026-02-22T23:22:40.821 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 106/150 2026-02-22T23:22:40.830 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 107/150 2026-02-22T23:22:40.854 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 108/150 2026-02-22T23:22:40.880 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 84/150 2026-02-22T23:22:40.884 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 109/150 2026-02-22T23:22:40.904 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 85/150 2026-02-22T23:22:40.908 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 86/150 2026-02-22T23:22:40.935 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 110/150 2026-02-22T23:22:40.941 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 111/150 2026-02-22T23:22:40.945 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 112/150 2026-02-22T23:22:40.949 INFO:teuthology.orchestra.run.trial093.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 113/150 2026-02-22T23:22:40.951 INFO:teuthology.orchestra.run.trial093.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 114/150 2026-02-22T23:22:40.952 INFO:teuthology.orchestra.run.trial093.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 115/150 2026-02-22T23:22:40.966 INFO:teuthology.orchestra.run.trial155.stdout: Installing : openblas-0.3.29-1.el9.x86_64 87/150 2026-02-22T23:22:40.968 INFO:teuthology.orchestra.run.trial155.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 88/150 2026-02-22T23:22:40.971 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 115/150 2026-02-22T23:22:40.991 INFO:teuthology.orchestra.run.trial155.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 89/150 2026-02-22T23:22:41.089 INFO:teuthology.orchestra.run.trial093.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 116/150 2026-02-22T23:22:41.092 INFO:teuthology.orchestra.run.trial093.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 117/150 2026-02-22T23:22:41.321 INFO:teuthology.orchestra.run.trial155.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 90/150 2026-02-22T23:22:41.371 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 117/150 2026-02-22T23:22:41.371 INFO:teuthology.orchestra.run.trial093.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-22T23:22:41.371 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:22:41.395 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 91/150 2026-02-22T23:22:41.653 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 118/150 2026-02-22T23:22:41.696 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 118/150 2026-02-22T23:22:41.696 INFO:teuthology.orchestra.run.trial093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-22T23:22:41.696 INFO:teuthology.orchestra.run.trial093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-22T23:22:41.696 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:22:41.700 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-selinux-2:19.2.3-689.gf90f4eae.el9.x86_64 119/150 2026-02-22T23:22:42.076 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 92/150 2026-02-22T23:22:42.092 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 93/150 2026-02-22T23:22:42.234 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 94/150 2026-02-22T23:22:42.235 INFO:teuthology.orchestra.run.trial155.stdout: Upgrading : librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 95/150 2026-02-22T23:22:42.262 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 95/150 2026-02-22T23:22:42.265 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-rbd-2:19.2.3-689.gf90f4eae.el9.x86_64 96/150 2026-02-22T23:22:42.272 INFO:teuthology.orchestra.run.trial155.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 97/150 2026-02-22T23:22:42.498 INFO:teuthology.orchestra.run.trial155.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 98/150 2026-02-22T23:22:42.499 INFO:teuthology.orchestra.run.trial155.stdout: Installing : librgw2-2:19.2.3-689.gf90f4eae.el9.x86_64 99/150 2026-02-22T23:22:42.516 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: librgw2-2:19.2.3-689.gf90f4eae.el9.x86_64 99/150 2026-02-22T23:22:42.517 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-rgw-2:19.2.3-689.gf90f4eae.el9.x86_64 100/150 2026-02-22T23:22:43.495 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 101/150 2026-02-22T23:22:43.498 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 101/150 2026-02-22T23:22:43.515 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 101/150 2026-02-22T23:22:43.526 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 102/150 2026-02-22T23:22:43.533 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-packaging-20.9-5.el9.noarch 103/150 2026-02-22T23:22:43.546 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-ply-3.11-14.el9.noarch 104/150 2026-02-22T23:22:43.562 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 105/150 2026-02-22T23:22:43.639 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 106/150 2026-02-22T23:22:43.648 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 107/150 2026-02-22T23:22:43.672 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 108/150 2026-02-22T23:22:43.702 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 109/150 2026-02-22T23:22:43.754 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 110/150 2026-02-22T23:22:43.759 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 111/150 2026-02-22T23:22:43.763 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 112/150 2026-02-22T23:22:43.767 INFO:teuthology.orchestra.run.trial155.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 113/150 2026-02-22T23:22:43.770 INFO:teuthology.orchestra.run.trial155.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 114/150 2026-02-22T23:22:43.771 INFO:teuthology.orchestra.run.trial155.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 115/150 2026-02-22T23:22:43.787 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 115/150 2026-02-22T23:22:43.905 INFO:teuthology.orchestra.run.trial155.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 116/150 2026-02-22T23:22:43.908 INFO:teuthology.orchestra.run.trial155.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 117/150 2026-02-22T23:22:44.184 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 117/150 2026-02-22T23:22:44.184 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-22T23:22:44.184 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:22:44.461 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 118/150 2026-02-22T23:22:44.501 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 118/150 2026-02-22T23:22:44.502 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-22T23:22:44.502 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-22T23:22:44.502 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:22:44.505 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-selinux-2:19.2.3-689.gf90f4eae.el9.x86_64 119/150 2026-02-22T23:22:46.399 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-selinux-2:19.2.3-689.gf90f4eae.el9.x86_64 119/150 2026-02-22T23:22:46.399 INFO:teuthology.orchestra.run.trial093.stdout:skipping the directory /sys 2026-02-22T23:22:46.399 INFO:teuthology.orchestra.run.trial093.stdout:skipping the directory /proc 2026-02-22T23:22:46.400 INFO:teuthology.orchestra.run.trial093.stdout:skipping the directory /mnt 2026-02-22T23:22:46.400 INFO:teuthology.orchestra.run.trial093.stdout:skipping the directory /var/tmp 2026-02-22T23:22:46.400 INFO:teuthology.orchestra.run.trial093.stdout:skipping the directory /home 2026-02-22T23:22:46.400 INFO:teuthology.orchestra.run.trial093.stdout:skipping the directory /root 2026-02-22T23:22:46.400 INFO:teuthology.orchestra.run.trial093.stdout:skipping the directory /tmp 2026-02-22T23:22:46.400 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:22:46.508 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-mds-2:19.2.3-689.gf90f4eae.el9.x86_64 120/150 2026-02-22T23:22:46.531 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-mds-2:19.2.3-689.gf90f4eae.el9.x86_64 120/150 2026-02-22T23:22:46.531 INFO:teuthology.orchestra.run.trial093.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T23:22:46.531 INFO:teuthology.orchestra.run.trial093.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-22T23:22:46.531 INFO:teuthology.orchestra.run.trial093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-22T23:22:46.532 INFO:teuthology.orchestra.run.trial093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-22T23:22:46.532 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:22:46.739 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-mon-2:19.2.3-689.gf90f4eae.el9.x86_64 121/150 2026-02-22T23:22:46.762 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-mon-2:19.2.3-689.gf90f4eae.el9.x86_64 121/150 2026-02-22T23:22:46.762 INFO:teuthology.orchestra.run.trial093.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T23:22:46.762 INFO:teuthology.orchestra.run.trial093.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-22T23:22:46.762 INFO:teuthology.orchestra.run.trial093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-22T23:22:46.762 INFO:teuthology.orchestra.run.trial093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-22T23:22:46.763 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:22:46.771 INFO:teuthology.orchestra.run.trial093.stdout: Installing : mailcap-2.1.49-5.el9.noarch 122/150 2026-02-22T23:22:46.773 INFO:teuthology.orchestra.run.trial093.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 123/150 2026-02-22T23:22:46.792 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 124/150 2026-02-22T23:22:46.792 INFO:teuthology.orchestra.run.trial093.stdout:Creating group 'qat' with GID 992. 2026-02-22T23:22:46.792 INFO:teuthology.orchestra.run.trial093.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-22T23:22:46.792 INFO:teuthology.orchestra.run.trial093.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-22T23:22:46.792 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:22:46.800 INFO:teuthology.orchestra.run.trial093.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 124/150 2026-02-22T23:22:46.825 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 124/150 2026-02-22T23:22:46.825 INFO:teuthology.orchestra.run.trial093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-22T23:22:46.825 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:22:46.859 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 125/150 2026-02-22T23:22:46.922 INFO:teuthology.orchestra.run.trial093.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 126/150 2026-02-22T23:22:46.924 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch 127/150 2026-02-22T23:22:46.938 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch 127/150 2026-02-22T23:22:46.938 INFO:teuthology.orchestra.run.trial093.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T23:22:46.938 INFO:teuthology.orchestra.run.trial093.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-22T23:22:46.938 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:22:47.640 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-osd-2:19.2.3-689.gf90f4eae.el9.x86_64 128/150 2026-02-22T23:22:47.665 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-osd-2:19.2.3-689.gf90f4eae.el9.x86_64 128/150 2026-02-22T23:22:47.665 INFO:teuthology.orchestra.run.trial093.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T23:22:47.665 INFO:teuthology.orchestra.run.trial093.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-22T23:22:47.665 INFO:teuthology.orchestra.run.trial093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-22T23:22:47.665 INFO:teuthology.orchestra.run.trial093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-22T23:22:47.665 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:22:47.724 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 129/150 2026-02-22T23:22:47.725 INFO:teuthology.orchestra.run.trial093.stdout: Installing : cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 129/150 2026-02-22T23:22:47.730 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-689.gf90f4eae.el 130/150 2026-02-22T23:22:47.750 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-689.gf90f4eae.e 131/150 2026-02-22T23:22:47.751 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noar 132/150 2026-02-22T23:22:48.239 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noar 132/150 2026-02-22T23:22:48.243 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.no 133/150 2026-02-22T23:22:48.697 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.no 133/150 2026-02-22T23:22:48.698 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f 134/150 2026-02-22T23:22:48.710 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f 134/150 2026-02-22T23:22:48.711 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-689.gf90f4eae.el9.no 135/150 2026-02-22T23:22:48.766 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-689.gf90f4eae.el9.no 135/150 2026-02-22T23:22:48.816 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-689.gf90f4eae.el9 136/150 2026-02-22T23:22:48.817 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 137/150 2026-02-22T23:22:48.838 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 137/150 2026-02-22T23:22:48.838 INFO:teuthology.orchestra.run.trial093.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T23:22:48.838 INFO:teuthology.orchestra.run.trial093.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-22T23:22:48.838 INFO:teuthology.orchestra.run.trial093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-22T23:22:48.838 INFO:teuthology.orchestra.run.trial093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-22T23:22:48.838 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:22:48.849 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch 138/150 2026-02-22T23:22:48.859 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch 138/150 2026-02-22T23:22:49.257 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-selinux-2:19.2.3-689.gf90f4eae.el9.x86_64 119/150 2026-02-22T23:22:49.257 INFO:teuthology.orchestra.run.trial155.stdout:skipping the directory /sys 2026-02-22T23:22:49.257 INFO:teuthology.orchestra.run.trial155.stdout:skipping the directory /proc 2026-02-22T23:22:49.257 INFO:teuthology.orchestra.run.trial155.stdout:skipping the directory /mnt 2026-02-22T23:22:49.258 INFO:teuthology.orchestra.run.trial155.stdout:skipping the directory /var/tmp 2026-02-22T23:22:49.258 INFO:teuthology.orchestra.run.trial155.stdout:skipping the directory /home 2026-02-22T23:22:49.258 INFO:teuthology.orchestra.run.trial155.stdout:skipping the directory /root 2026-02-22T23:22:49.258 INFO:teuthology.orchestra.run.trial155.stdout:skipping the directory /tmp 2026-02-22T23:22:49.258 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:22:49.309 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-2:19.2.3-689.gf90f4eae.el9.x86_64 139/150 2026-02-22T23:22:49.311 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-radosgw-2:19.2.3-689.gf90f4eae.el9.x86_64 140/150 2026-02-22T23:22:49.333 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-689.gf90f4eae.el9.x86_64 140/150 2026-02-22T23:22:49.333 INFO:teuthology.orchestra.run.trial093.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T23:22:49.333 INFO:teuthology.orchestra.run.trial093.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-22T23:22:49.333 INFO:teuthology.orchestra.run.trial093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-22T23:22:49.334 INFO:teuthology.orchestra.run.trial093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-22T23:22:49.334 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:22:49.343 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-689.gf90f4e 141/150 2026-02-22T23:22:49.364 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-689.gf90f4e 141/150 2026-02-22T23:22:49.364 INFO:teuthology.orchestra.run.trial093.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T23:22:49.364 INFO:teuthology.orchestra.run.trial093.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-22T23:22:49.364 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:22:49.365 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mds-2:19.2.3-689.gf90f4eae.el9.x86_64 120/150 2026-02-22T23:22:49.387 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-mds-2:19.2.3-689.gf90f4eae.el9.x86_64 120/150 2026-02-22T23:22:49.387 INFO:teuthology.orchestra.run.trial155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T23:22:49.388 INFO:teuthology.orchestra.run.trial155.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-22T23:22:49.388 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-22T23:22:49.388 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-22T23:22:49.388 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:22:49.503 INFO:teuthology.orchestra.run.trial093.stdout: Installing : rbd-mirror-2:19.2.3-689.gf90f4eae.el9.x86_64 142/150 2026-02-22T23:22:49.524 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: rbd-mirror-2:19.2.3-689.gf90f4eae.el9.x86_64 142/150 2026-02-22T23:22:49.524 INFO:teuthology.orchestra.run.trial093.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T23:22:49.524 INFO:teuthology.orchestra.run.trial093.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-22T23:22:49.524 INFO:teuthology.orchestra.run.trial093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-22T23:22:49.524 INFO:teuthology.orchestra.run.trial093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-22T23:22:49.524 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:22:49.597 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mon-2:19.2.3-689.gf90f4eae.el9.x86_64 121/150 2026-02-22T23:22:49.618 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-mon-2:19.2.3-689.gf90f4eae.el9.x86_64 121/150 2026-02-22T23:22:49.619 INFO:teuthology.orchestra.run.trial155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T23:22:49.619 INFO:teuthology.orchestra.run.trial155.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-22T23:22:49.619 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-22T23:22:49.619 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-22T23:22:49.619 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:22:49.625 INFO:teuthology.orchestra.run.trial155.stdout: Installing : mailcap-2.1.49-5.el9.noarch 122/150 2026-02-22T23:22:49.627 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 123/150 2026-02-22T23:22:49.645 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 124/150 2026-02-22T23:22:49.645 INFO:teuthology.orchestra.run.trial155.stdout:Creating group 'qat' with GID 992. 2026-02-22T23:22:49.645 INFO:teuthology.orchestra.run.trial155.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-22T23:22:49.645 INFO:teuthology.orchestra.run.trial155.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-22T23:22:49.645 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:22:49.654 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 124/150 2026-02-22T23:22:49.678 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 124/150 2026-02-22T23:22:49.678 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-22T23:22:49.678 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:22:49.716 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 125/150 2026-02-22T23:22:49.779 INFO:teuthology.orchestra.run.trial155.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 126/150 2026-02-22T23:22:49.781 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch 127/150 2026-02-22T23:22:49.795 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch 127/150 2026-02-22T23:22:49.795 INFO:teuthology.orchestra.run.trial155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T23:22:49.796 INFO:teuthology.orchestra.run.trial155.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-22T23:22:49.796 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:22:50.490 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-osd-2:19.2.3-689.gf90f4eae.el9.x86_64 128/150 2026-02-22T23:22:50.515 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-osd-2:19.2.3-689.gf90f4eae.el9.x86_64 128/150 2026-02-22T23:22:50.515 INFO:teuthology.orchestra.run.trial155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T23:22:50.516 INFO:teuthology.orchestra.run.trial155.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-22T23:22:50.516 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-22T23:22:50.516 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-22T23:22:50.516 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:22:50.574 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 129/150 2026-02-22T23:22:50.576 INFO:teuthology.orchestra.run.trial155.stdout: Installing : cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 129/150 2026-02-22T23:22:50.580 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-689.gf90f4eae.el 130/150 2026-02-22T23:22:50.600 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-689.gf90f4eae.e 131/150 2026-02-22T23:22:50.601 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noar 132/150 2026-02-22T23:22:51.093 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noar 132/150 2026-02-22T23:22:51.096 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.no 133/150 2026-02-22T23:22:51.549 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.no 133/150 2026-02-22T23:22:51.550 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f 134/150 2026-02-22T23:22:51.562 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f 134/150 2026-02-22T23:22:51.563 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-689.gf90f4eae.el9.no 135/150 2026-02-22T23:22:51.618 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-689.gf90f4eae.el9.no 135/150 2026-02-22T23:22:51.667 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-689.gf90f4eae.el9 136/150 2026-02-22T23:22:51.668 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 137/150 2026-02-22T23:22:51.689 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 137/150 2026-02-22T23:22:51.689 INFO:teuthology.orchestra.run.trial155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T23:22:51.689 INFO:teuthology.orchestra.run.trial155.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-22T23:22:51.690 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-22T23:22:51.690 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-22T23:22:51.690 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:22:51.701 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch 138/150 2026-02-22T23:22:51.711 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch 138/150 2026-02-22T23:22:51.769 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-test-2:19.2.3-689.gf90f4eae.el9.x86_64 143/150 2026-02-22T23:22:51.778 INFO:teuthology.orchestra.run.trial093.stdout: Installing : rbd-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 144/150 2026-02-22T23:22:51.781 INFO:teuthology.orchestra.run.trial093.stdout: Installing : rbd-nbd-2:19.2.3-689.gf90f4eae.el9.x86_64 145/150 2026-02-22T23:22:51.784 INFO:teuthology.orchestra.run.trial093.stdout: Installing : sqlite-devel-3.34.1-9.el9.x86_64 146/150 2026-02-22T23:22:51.834 INFO:teuthology.orchestra.run.trial093.stdout: Installing : libcephfs-devel-2:19.2.3-689.gf90f4eae.el9.x86_6 147/150 2026-02-22T23:22:51.837 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 148/150 2026-02-22T23:22:51.837 INFO:teuthology.orchestra.run.trial093.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 149/150 2026-02-22T23:22:51.850 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 149/150 2026-02-22T23:22:51.851 INFO:teuthology.orchestra.run.trial093.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 150/150 2026-02-22T23:22:52.160 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-2:19.2.3-689.gf90f4eae.el9.x86_64 139/150 2026-02-22T23:22:52.161 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-radosgw-2:19.2.3-689.gf90f4eae.el9.x86_64 140/150 2026-02-22T23:22:52.184 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-689.gf90f4eae.el9.x86_64 140/150 2026-02-22T23:22:52.184 INFO:teuthology.orchestra.run.trial155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T23:22:52.184 INFO:teuthology.orchestra.run.trial155.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-22T23:22:52.184 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-22T23:22:52.184 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-22T23:22:52.184 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:22:52.193 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-689.gf90f4e 141/150 2026-02-22T23:22:52.213 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-689.gf90f4e 141/150 2026-02-22T23:22:52.213 INFO:teuthology.orchestra.run.trial155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T23:22:52.214 INFO:teuthology.orchestra.run.trial155.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-22T23:22:52.214 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:22:52.351 INFO:teuthology.orchestra.run.trial155.stdout: Installing : rbd-mirror-2:19.2.3-689.gf90f4eae.el9.x86_64 142/150 2026-02-22T23:22:52.373 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: rbd-mirror-2:19.2.3-689.gf90f4eae.el9.x86_64 142/150 2026-02-22T23:22:52.374 INFO:teuthology.orchestra.run.trial155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T23:22:52.374 INFO:teuthology.orchestra.run.trial155.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-22T23:22:52.374 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-22T23:22:52.374 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-22T23:22:52.374 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:22:52.591 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 150/150 2026-02-22T23:22:52.591 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-2:19.2.3-689.gf90f4eae.el9.x86_64 1/150 2026-02-22T23:22:52.592 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 2/150 2026-02-22T23:22:52.592 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 3/150 2026-02-22T23:22:52.592 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 4/150 2026-02-22T23:22:52.592 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-689.gf90f4e 5/150 2026-02-22T23:22:52.592 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-mds-2:19.2.3-689.gf90f4eae.el9.x86_64 6/150 2026-02-22T23:22:52.592 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 7/150 2026-02-22T23:22:52.592 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-mon-2:19.2.3-689.gf90f4eae.el9.x86_64 8/150 2026-02-22T23:22:52.592 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-osd-2:19.2.3-689.gf90f4eae.el9.x86_64 9/150 2026-02-22T23:22:52.592 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-radosgw-2:19.2.3-689.gf90f4eae.el9.x86_64 10/150 2026-02-22T23:22:52.592 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-selinux-2:19.2.3-689.gf90f4eae.el9.x86_64 11/150 2026-02-22T23:22:52.592 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-test-2:19.2.3-689.gf90f4eae.el9.x86_64 12/150 2026-02-22T23:22:52.593 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : libcephfs-devel-2:19.2.3-689.gf90f4eae.el9.x86_6 13/150 2026-02-22T23:22:52.593 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 14/150 2026-02-22T23:22:52.593 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : libcephsqlite-2:19.2.3-689.gf90f4eae.el9.x86_64 15/150 2026-02-22T23:22:52.593 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : librados-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 16/150 2026-02-22T23:22:52.593 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : libradosstriper1-2:19.2.3-689.gf90f4eae.el9.x86_ 17/150 2026-02-22T23:22:52.593 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : librgw2-2:19.2.3-689.gf90f4eae.el9.x86_64 18/150 2026-02-22T23:22:52.593 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-ceph-argparse-2:19.2.3-689.gf90f4eae.el9 19/150 2026-02-22T23:22:52.593 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-ceph-common-2:19.2.3-689.gf90f4eae.el9.x 20/150 2026-02-22T23:22:52.593 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-cephfs-2:19.2.3-689.gf90f4eae.el9.x86_64 21/150 2026-02-22T23:22:52.593 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-rados-2:19.2.3-689.gf90f4eae.el9.x86_64 22/150 2026-02-22T23:22:52.593 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-rbd-2:19.2.3-689.gf90f4eae.el9.x86_64 23/150 2026-02-22T23:22:52.593 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-rgw-2:19.2.3-689.gf90f4eae.el9.x86_64 24/150 2026-02-22T23:22:52.594 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : rbd-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 25/150 2026-02-22T23:22:52.594 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : rbd-mirror-2:19.2.3-689.gf90f4eae.el9.x86_64 26/150 2026-02-22T23:22:52.594 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : rbd-nbd-2:19.2.3-689.gf90f4eae.el9.x86_64 27/150 2026-02-22T23:22:52.594 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-689.gf90f4eae.e 28/150 2026-02-22T23:22:52.594 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noar 29/150 2026-02-22T23:22:52.594 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.no 30/150 2026-02-22T23:22:52.594 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f 31/150 2026-02-22T23:22:52.594 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-689.gf90f4eae.el9.no 32/150 2026-02-22T23:22:52.594 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-689.gf90f4eae.el9 33/150 2026-02-22T23:22:52.594 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch 34/150 2026-02-22T23:22:52.594 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-689.gf90f4eae.el 35/150 2026-02-22T23:22:52.594 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch 36/150 2026-02-22T23:22:52.594 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 37/150 2026-02-22T23:22:52.595 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 38/150 2026-02-22T23:22:52.595 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 39/150 2026-02-22T23:22:52.595 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 40/150 2026-02-22T23:22:52.595 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 41/150 2026-02-22T23:22:52.595 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 42/150 2026-02-22T23:22:52.595 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 43/150 2026-02-22T23:22:52.595 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 44/150 2026-02-22T23:22:52.595 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 45/150 2026-02-22T23:22:52.595 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/150 2026-02-22T23:22:52.595 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 47/150 2026-02-22T23:22:52.595 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/150 2026-02-22T23:22:52.596 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/150 2026-02-22T23:22:52.596 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 50/150 2026-02-22T23:22:52.596 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 51/150 2026-02-22T23:22:52.596 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 52/150 2026-02-22T23:22:52.596 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : unzip-6.0-59.el9.x86_64 53/150 2026-02-22T23:22:52.596 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : zip-3.0-35.el9.x86_64 54/150 2026-02-22T23:22:52.596 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 55/150 2026-02-22T23:22:52.596 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 56/150 2026-02-22T23:22:52.596 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 57/150 2026-02-22T23:22:52.596 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 58/150 2026-02-22T23:22:52.596 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 59/150 2026-02-22T23:22:52.596 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 60/150 2026-02-22T23:22:52.596 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 61/150 2026-02-22T23:22:52.597 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 62/150 2026-02-22T23:22:52.597 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 63/150 2026-02-22T23:22:52.597 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 64/150 2026-02-22T23:22:52.597 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/150 2026-02-22T23:22:52.597 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/150 2026-02-22T23:22:52.597 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 67/150 2026-02-22T23:22:52.597 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 68/150 2026-02-22T23:22:52.597 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 69/150 2026-02-22T23:22:52.597 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 70/150 2026-02-22T23:22:52.597 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 71/150 2026-02-22T23:22:52.597 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 72/150 2026-02-22T23:22:52.597 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 73/150 2026-02-22T23:22:52.597 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 74/150 2026-02-22T23:22:52.598 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 75/150 2026-02-22T23:22:52.598 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 76/150 2026-02-22T23:22:52.598 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 77/150 2026-02-22T23:22:52.598 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 78/150 2026-02-22T23:22:52.598 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 79/150 2026-02-22T23:22:52.598 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 80/150 2026-02-22T23:22:52.598 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 81/150 2026-02-22T23:22:52.598 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 82/150 2026-02-22T23:22:52.598 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/150 2026-02-22T23:22:52.598 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 84/150 2026-02-22T23:22:52.598 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 85/150 2026-02-22T23:22:52.598 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 86/150 2026-02-22T23:22:52.598 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 87/150 2026-02-22T23:22:52.599 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 88/150 2026-02-22T23:22:52.599 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 89/150 2026-02-22T23:22:52.599 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : sqlite-3.34.1-9.el9.x86_64 90/150 2026-02-22T23:22:52.599 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : sqlite-devel-3.34.1-9.el9.x86_64 91/150 2026-02-22T23:22:52.599 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 92/150 2026-02-22T23:22:52.599 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 93/150 2026-02-22T23:22:52.599 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 94/150 2026-02-22T23:22:52.599 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 95/150 2026-02-22T23:22:52.599 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 96/150 2026-02-22T23:22:52.599 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 97/150 2026-02-22T23:22:52.599 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 98/150 2026-02-22T23:22:52.599 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 99/150 2026-02-22T23:22:52.599 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 100/150 2026-02-22T23:22:52.600 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 101/150 2026-02-22T23:22:52.600 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 102/150 2026-02-22T23:22:52.600 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 103/150 2026-02-22T23:22:52.600 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 104/150 2026-02-22T23:22:52.600 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 105/150 2026-02-22T23:22:52.600 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 106/150 2026-02-22T23:22:52.600 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 107/150 2026-02-22T23:22:52.600 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 108/150 2026-02-22T23:22:52.600 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 109/150 2026-02-22T23:22:52.600 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 110/150 2026-02-22T23:22:52.600 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 111/150 2026-02-22T23:22:52.600 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 112/150 2026-02-22T23:22:52.601 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 113/150 2026-02-22T23:22:52.601 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 114/150 2026-02-22T23:22:52.601 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 115/150 2026-02-22T23:22:52.601 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 116/150 2026-02-22T23:22:52.601 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 117/150 2026-02-22T23:22:52.601 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 118/150 2026-02-22T23:22:52.601 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 119/150 2026-02-22T23:22:52.601 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 120/150 2026-02-22T23:22:52.601 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 121/150 2026-02-22T23:22:52.601 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 122/150 2026-02-22T23:22:52.601 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 123/150 2026-02-22T23:22:52.601 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 124/150 2026-02-22T23:22:52.601 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 125/150 2026-02-22T23:22:52.602 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 126/150 2026-02-22T23:22:52.602 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 127/150 2026-02-22T23:22:52.602 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 128/150 2026-02-22T23:22:52.602 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 129/150 2026-02-22T23:22:52.602 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 130/150 2026-02-22T23:22:52.602 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 131/150 2026-02-22T23:22:52.602 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 132/150 2026-02-22T23:22:52.602 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 133/150 2026-02-22T23:22:52.602 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 134/150 2026-02-22T23:22:52.602 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 135/150 2026-02-22T23:22:52.602 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 136/150 2026-02-22T23:22:52.602 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 137/150 2026-02-22T23:22:52.602 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 138/150 2026-02-22T23:22:52.603 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 139/150 2026-02-22T23:22:52.603 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 140/150 2026-02-22T23:22:52.603 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 141/150 2026-02-22T23:22:52.603 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 142/150 2026-02-22T23:22:52.603 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 143/150 2026-02-22T23:22:52.603 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 144/150 2026-02-22T23:22:52.603 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : re2-1:20211101-20.el9.x86_64 145/150 2026-02-22T23:22:52.603 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 146/150 2026-02-22T23:22:52.603 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 147/150 2026-02-22T23:22:52.603 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 148/150 2026-02-22T23:22:52.603 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 149/150 2026-02-22T23:22:52.659 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 150/150 2026-02-22T23:22:52.659 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:22:52.659 INFO:teuthology.orchestra.run.trial093.stdout:Upgraded: 2026-02-22T23:22:52.659 INFO:teuthology.orchestra.run.trial093.stdout: librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:52.659 INFO:teuthology.orchestra.run.trial093.stdout: librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:52.659 INFO:teuthology.orchestra.run.trial093.stdout:Installed: 2026-02-22T23:22:52.659 INFO:teuthology.orchestra.run.trial093.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-22T23:22:52.659 INFO:teuthology.orchestra.run.trial093.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-22T23:22:52.659 INFO:teuthology.orchestra.run.trial093.stdout: ceph-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:52.659 INFO:teuthology.orchestra.run.trial093.stdout: ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:52.659 INFO:teuthology.orchestra.run.trial093.stdout: ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:52.659 INFO:teuthology.orchestra.run.trial093.stdout: ceph-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:52.659 INFO:teuthology.orchestra.run.trial093.stdout: ceph-grafana-dashboards-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T23:22:52.659 INFO:teuthology.orchestra.run.trial093.stdout: ceph-immutable-object-cache-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:52.659 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mds-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:52.659 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:52.659 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T23:22:52.659 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T23:22:52.659 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T23:22:52.659 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mgr-k8sevents-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T23:22:52.659 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mgr-modules-core-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T23:22:52.660 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T23:22:52.660 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mon-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:52.660 INFO:teuthology.orchestra.run.trial093.stdout: ceph-osd-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:52.660 INFO:teuthology.orchestra.run.trial093.stdout: ceph-prometheus-alerts-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T23:22:52.660 INFO:teuthology.orchestra.run.trial093.stdout: ceph-radosgw-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:52.660 INFO:teuthology.orchestra.run.trial093.stdout: ceph-selinux-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:52.660 INFO:teuthology.orchestra.run.trial093.stdout: ceph-test-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:52.660 INFO:teuthology.orchestra.run.trial093.stdout: ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T23:22:52.660 INFO:teuthology.orchestra.run.trial093.stdout: cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T23:22:52.660 INFO:teuthology.orchestra.run.trial093.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-22T23:22:52.660 INFO:teuthology.orchestra.run.trial093.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-22T23:22:52.660 INFO:teuthology.orchestra.run.trial093.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-22T23:22:52.660 INFO:teuthology.orchestra.run.trial093.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-22T23:22:52.660 INFO:teuthology.orchestra.run.trial093.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-22T23:22:52.660 INFO:teuthology.orchestra.run.trial093.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-22T23:22:52.660 INFO:teuthology.orchestra.run.trial093.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-22T23:22:52.660 INFO:teuthology.orchestra.run.trial093.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-22T23:22:52.660 INFO:teuthology.orchestra.run.trial093.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-22T23:22:52.660 INFO:teuthology.orchestra.run.trial093.stdout: libcephfs-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:52.660 INFO:teuthology.orchestra.run.trial093.stdout: libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:52.660 INFO:teuthology.orchestra.run.trial093.stdout: libcephsqlite-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:52.660 INFO:teuthology.orchestra.run.trial093.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-22T23:22:52.660 INFO:teuthology.orchestra.run.trial093.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-22T23:22:52.660 INFO:teuthology.orchestra.run.trial093.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-22T23:22:52.660 INFO:teuthology.orchestra.run.trial093.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-22T23:22:52.660 INFO:teuthology.orchestra.run.trial093.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-22T23:22:52.660 INFO:teuthology.orchestra.run.trial093.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-22T23:22:52.660 INFO:teuthology.orchestra.run.trial093.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-22T23:22:52.660 INFO:teuthology.orchestra.run.trial093.stdout: librados-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:52.660 INFO:teuthology.orchestra.run.trial093.stdout: libradosstriper1-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:52.660 INFO:teuthology.orchestra.run.trial093.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-22T23:22:52.661 INFO:teuthology.orchestra.run.trial093.stdout: librgw2-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:52.661 INFO:teuthology.orchestra.run.trial093.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-22T23:22:52.661 INFO:teuthology.orchestra.run.trial093.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-22T23:22:52.661 INFO:teuthology.orchestra.run.trial093.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-22T23:22:52.661 INFO:teuthology.orchestra.run.trial093.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-22T23:22:52.661 INFO:teuthology.orchestra.run.trial093.stdout: lua-5.4.4-4.el9.x86_64 2026-02-22T23:22:52.661 INFO:teuthology.orchestra.run.trial093.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-22T23:22:52.661 INFO:teuthology.orchestra.run.trial093.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-22T23:22:52.661 INFO:teuthology.orchestra.run.trial093.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-22T23:22:52.661 INFO:teuthology.orchestra.run.trial093.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-22T23:22:52.661 INFO:teuthology.orchestra.run.trial093.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-22T23:22:52.661 INFO:teuthology.orchestra.run.trial093.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-22T23:22:52.661 INFO:teuthology.orchestra.run.trial093.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-22T23:22:52.661 INFO:teuthology.orchestra.run.trial093.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-22T23:22:52.661 INFO:teuthology.orchestra.run.trial093.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-22T23:22:52.661 INFO:teuthology.orchestra.run.trial093.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-22T23:22:52.661 INFO:teuthology.orchestra.run.trial093.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-22T23:22:52.661 INFO:teuthology.orchestra.run.trial093.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-22T23:22:52.661 INFO:teuthology.orchestra.run.trial093.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-22T23:22:52.661 INFO:teuthology.orchestra.run.trial093.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-22T23:22:52.661 INFO:teuthology.orchestra.run.trial093.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-22T23:22:52.661 INFO:teuthology.orchestra.run.trial093.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-22T23:22:52.661 INFO:teuthology.orchestra.run.trial093.stdout: python3-ceph-argparse-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:52.661 INFO:teuthology.orchestra.run.trial093.stdout: python3-ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:52.661 INFO:teuthology.orchestra.run.trial093.stdout: python3-cephfs-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:52.661 INFO:teuthology.orchestra.run.trial093.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-22T23:22:52.661 INFO:teuthology.orchestra.run.trial093.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-22T23:22:52.661 INFO:teuthology.orchestra.run.trial093.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-22T23:22:52.661 INFO:teuthology.orchestra.run.trial093.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-22T23:22:52.661 INFO:teuthology.orchestra.run.trial093.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-22T23:22:52.661 INFO:teuthology.orchestra.run.trial093.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-22T23:22:52.662 INFO:teuthology.orchestra.run.trial093.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-22T23:22:52.662 INFO:teuthology.orchestra.run.trial093.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-22T23:22:52.662 INFO:teuthology.orchestra.run.trial093.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-22T23:22:52.662 INFO:teuthology.orchestra.run.trial093.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-22T23:22:52.662 INFO:teuthology.orchestra.run.trial093.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-22T23:22:52.662 INFO:teuthology.orchestra.run.trial093.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-22T23:22:52.662 INFO:teuthology.orchestra.run.trial093.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-22T23:22:52.662 INFO:teuthology.orchestra.run.trial093.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-22T23:22:52.662 INFO:teuthology.orchestra.run.trial093.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-22T23:22:52.662 INFO:teuthology.orchestra.run.trial093.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-22T23:22:52.662 INFO:teuthology.orchestra.run.trial093.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-22T23:22:52.662 INFO:teuthology.orchestra.run.trial093.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-22T23:22:52.662 INFO:teuthology.orchestra.run.trial093.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-22T23:22:52.662 INFO:teuthology.orchestra.run.trial093.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-22T23:22:52.662 INFO:teuthology.orchestra.run.trial093.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-22T23:22:52.662 INFO:teuthology.orchestra.run.trial093.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-22T23:22:52.662 INFO:teuthology.orchestra.run.trial093.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-22T23:22:52.662 INFO:teuthology.orchestra.run.trial093.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-22T23:22:52.662 INFO:teuthology.orchestra.run.trial093.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-22T23:22:52.662 INFO:teuthology.orchestra.run.trial093.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-22T23:22:52.662 INFO:teuthology.orchestra.run.trial093.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-22T23:22:52.662 INFO:teuthology.orchestra.run.trial093.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-22T23:22:52.662 INFO:teuthology.orchestra.run.trial093.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-22T23:22:52.662 INFO:teuthology.orchestra.run.trial093.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-22T23:22:52.662 INFO:teuthology.orchestra.run.trial093.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-22T23:22:52.662 INFO:teuthology.orchestra.run.trial093.stdout: python3-ply-3.11-14.el9.noarch 2026-02-22T23:22:52.662 INFO:teuthology.orchestra.run.trial093.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-22T23:22:52.662 INFO:teuthology.orchestra.run.trial093.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-22T23:22:52.662 INFO:teuthology.orchestra.run.trial093.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-22T23:22:52.662 INFO:teuthology.orchestra.run.trial093.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-22T23:22:52.662 INFO:teuthology.orchestra.run.trial093.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-22T23:22:52.662 INFO:teuthology.orchestra.run.trial093.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-22T23:22:52.663 INFO:teuthology.orchestra.run.trial093.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-22T23:22:52.663 INFO:teuthology.orchestra.run.trial093.stdout: python3-rados-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:52.663 INFO:teuthology.orchestra.run.trial093.stdout: python3-rbd-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:52.663 INFO:teuthology.orchestra.run.trial093.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-22T23:22:52.663 INFO:teuthology.orchestra.run.trial093.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-22T23:22:52.663 INFO:teuthology.orchestra.run.trial093.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-22T23:22:52.663 INFO:teuthology.orchestra.run.trial093.stdout: python3-rgw-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:52.663 INFO:teuthology.orchestra.run.trial093.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-22T23:22:52.663 INFO:teuthology.orchestra.run.trial093.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-22T23:22:52.663 INFO:teuthology.orchestra.run.trial093.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-22T23:22:52.663 INFO:teuthology.orchestra.run.trial093.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-22T23:22:52.663 INFO:teuthology.orchestra.run.trial093.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-22T23:22:52.663 INFO:teuthology.orchestra.run.trial093.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-22T23:22:52.663 INFO:teuthology.orchestra.run.trial093.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-22T23:22:52.663 INFO:teuthology.orchestra.run.trial093.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-22T23:22:52.663 INFO:teuthology.orchestra.run.trial093.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-22T23:22:52.663 INFO:teuthology.orchestra.run.trial093.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-22T23:22:52.663 INFO:teuthology.orchestra.run.trial093.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-22T23:22:52.663 INFO:teuthology.orchestra.run.trial093.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-22T23:22:52.663 INFO:teuthology.orchestra.run.trial093.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-22T23:22:52.663 INFO:teuthology.orchestra.run.trial093.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-22T23:22:52.663 INFO:teuthology.orchestra.run.trial093.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-22T23:22:52.663 INFO:teuthology.orchestra.run.trial093.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-22T23:22:52.663 INFO:teuthology.orchestra.run.trial093.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-22T23:22:52.663 INFO:teuthology.orchestra.run.trial093.stdout: rbd-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:52.663 INFO:teuthology.orchestra.run.trial093.stdout: rbd-mirror-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:52.663 INFO:teuthology.orchestra.run.trial093.stdout: rbd-nbd-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:52.663 INFO:teuthology.orchestra.run.trial093.stdout: re2-1:20211101-20.el9.x86_64 2026-02-22T23:22:52.663 INFO:teuthology.orchestra.run.trial093.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-22T23:22:52.663 INFO:teuthology.orchestra.run.trial093.stdout: sqlite-3.34.1-9.el9.x86_64 2026-02-22T23:22:52.663 INFO:teuthology.orchestra.run.trial093.stdout: sqlite-devel-3.34.1-9.el9.x86_64 2026-02-22T23:22:52.663 INFO:teuthology.orchestra.run.trial093.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-22T23:22:52.664 INFO:teuthology.orchestra.run.trial093.stdout: unzip-6.0-59.el9.x86_64 2026-02-22T23:22:52.664 INFO:teuthology.orchestra.run.trial093.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-22T23:22:52.664 INFO:teuthology.orchestra.run.trial093.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-22T23:22:52.664 INFO:teuthology.orchestra.run.trial093.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-22T23:22:52.664 INFO:teuthology.orchestra.run.trial093.stdout: zip-3.0-35.el9.x86_64 2026-02-22T23:22:52.664 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:22:52.664 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-22T23:22:52.741 DEBUG:teuthology.parallel:result is None 2026-02-22T23:22:54.615 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-test-2:19.2.3-689.gf90f4eae.el9.x86_64 143/150 2026-02-22T23:22:54.624 INFO:teuthology.orchestra.run.trial155.stdout: Installing : rbd-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 144/150 2026-02-22T23:22:54.627 INFO:teuthology.orchestra.run.trial155.stdout: Installing : rbd-nbd-2:19.2.3-689.gf90f4eae.el9.x86_64 145/150 2026-02-22T23:22:54.630 INFO:teuthology.orchestra.run.trial155.stdout: Installing : sqlite-devel-3.34.1-9.el9.x86_64 146/150 2026-02-22T23:22:54.680 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libcephfs-devel-2:19.2.3-689.gf90f4eae.el9.x86_6 147/150 2026-02-22T23:22:54.683 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 148/150 2026-02-22T23:22:54.683 INFO:teuthology.orchestra.run.trial155.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 149/150 2026-02-22T23:22:54.696 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 149/150 2026-02-22T23:22:54.696 INFO:teuthology.orchestra.run.trial155.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 150/150 2026-02-22T23:22:55.459 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 150/150 2026-02-22T23:22:55.460 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-2:19.2.3-689.gf90f4eae.el9.x86_64 1/150 2026-02-22T23:22:55.460 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 2/150 2026-02-22T23:22:55.460 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 3/150 2026-02-22T23:22:55.460 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 4/150 2026-02-22T23:22:55.460 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-689.gf90f4e 5/150 2026-02-22T23:22:55.460 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mds-2:19.2.3-689.gf90f4eae.el9.x86_64 6/150 2026-02-22T23:22:55.460 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 7/150 2026-02-22T23:22:55.460 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mon-2:19.2.3-689.gf90f4eae.el9.x86_64 8/150 2026-02-22T23:22:55.460 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-osd-2:19.2.3-689.gf90f4eae.el9.x86_64 9/150 2026-02-22T23:22:55.461 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-radosgw-2:19.2.3-689.gf90f4eae.el9.x86_64 10/150 2026-02-22T23:22:55.461 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-selinux-2:19.2.3-689.gf90f4eae.el9.x86_64 11/150 2026-02-22T23:22:55.461 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-test-2:19.2.3-689.gf90f4eae.el9.x86_64 12/150 2026-02-22T23:22:55.461 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libcephfs-devel-2:19.2.3-689.gf90f4eae.el9.x86_6 13/150 2026-02-22T23:22:55.461 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 14/150 2026-02-22T23:22:55.461 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libcephsqlite-2:19.2.3-689.gf90f4eae.el9.x86_64 15/150 2026-02-22T23:22:55.461 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : librados-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 16/150 2026-02-22T23:22:55.461 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libradosstriper1-2:19.2.3-689.gf90f4eae.el9.x86_ 17/150 2026-02-22T23:22:55.461 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : librgw2-2:19.2.3-689.gf90f4eae.el9.x86_64 18/150 2026-02-22T23:22:55.461 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-ceph-argparse-2:19.2.3-689.gf90f4eae.el9 19/150 2026-02-22T23:22:55.461 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-ceph-common-2:19.2.3-689.gf90f4eae.el9.x 20/150 2026-02-22T23:22:55.461 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-cephfs-2:19.2.3-689.gf90f4eae.el9.x86_64 21/150 2026-02-22T23:22:55.462 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-rados-2:19.2.3-689.gf90f4eae.el9.x86_64 22/150 2026-02-22T23:22:55.462 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-rbd-2:19.2.3-689.gf90f4eae.el9.x86_64 23/150 2026-02-22T23:22:55.462 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-rgw-2:19.2.3-689.gf90f4eae.el9.x86_64 24/150 2026-02-22T23:22:55.462 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : rbd-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 25/150 2026-02-22T23:22:55.462 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : rbd-mirror-2:19.2.3-689.gf90f4eae.el9.x86_64 26/150 2026-02-22T23:22:55.462 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : rbd-nbd-2:19.2.3-689.gf90f4eae.el9.x86_64 27/150 2026-02-22T23:22:55.462 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-689.gf90f4eae.e 28/150 2026-02-22T23:22:55.462 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noar 29/150 2026-02-22T23:22:55.462 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.no 30/150 2026-02-22T23:22:55.462 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f 31/150 2026-02-22T23:22:55.462 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-689.gf90f4eae.el9.no 32/150 2026-02-22T23:22:55.462 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-689.gf90f4eae.el9 33/150 2026-02-22T23:22:55.463 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch 34/150 2026-02-22T23:22:55.463 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-689.gf90f4eae.el 35/150 2026-02-22T23:22:55.463 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch 36/150 2026-02-22T23:22:55.463 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 37/150 2026-02-22T23:22:55.463 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 38/150 2026-02-22T23:22:55.463 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 39/150 2026-02-22T23:22:55.463 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 40/150 2026-02-22T23:22:55.463 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 41/150 2026-02-22T23:22:55.463 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 42/150 2026-02-22T23:22:55.463 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 43/150 2026-02-22T23:22:55.463 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 44/150 2026-02-22T23:22:55.463 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 45/150 2026-02-22T23:22:55.464 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/150 2026-02-22T23:22:55.464 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 47/150 2026-02-22T23:22:55.464 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/150 2026-02-22T23:22:55.464 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/150 2026-02-22T23:22:55.464 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 50/150 2026-02-22T23:22:55.464 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 51/150 2026-02-22T23:22:55.464 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 52/150 2026-02-22T23:22:55.464 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : unzip-6.0-59.el9.x86_64 53/150 2026-02-22T23:22:55.464 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : zip-3.0-35.el9.x86_64 54/150 2026-02-22T23:22:55.464 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 55/150 2026-02-22T23:22:55.464 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 56/150 2026-02-22T23:22:55.464 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 57/150 2026-02-22T23:22:55.464 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 58/150 2026-02-22T23:22:55.465 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 59/150 2026-02-22T23:22:55.465 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 60/150 2026-02-22T23:22:55.465 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 61/150 2026-02-22T23:22:55.465 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 62/150 2026-02-22T23:22:55.465 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 63/150 2026-02-22T23:22:55.465 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 64/150 2026-02-22T23:22:55.465 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/150 2026-02-22T23:22:55.465 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/150 2026-02-22T23:22:55.465 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 67/150 2026-02-22T23:22:55.465 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 68/150 2026-02-22T23:22:55.465 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 69/150 2026-02-22T23:22:55.465 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 70/150 2026-02-22T23:22:55.465 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 71/150 2026-02-22T23:22:55.466 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 72/150 2026-02-22T23:22:55.466 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 73/150 2026-02-22T23:22:55.466 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 74/150 2026-02-22T23:22:55.466 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 75/150 2026-02-22T23:22:55.466 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 76/150 2026-02-22T23:22:55.466 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 77/150 2026-02-22T23:22:55.466 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 78/150 2026-02-22T23:22:55.466 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 79/150 2026-02-22T23:22:55.466 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 80/150 2026-02-22T23:22:55.466 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 81/150 2026-02-22T23:22:55.466 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 82/150 2026-02-22T23:22:55.466 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/150 2026-02-22T23:22:55.466 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 84/150 2026-02-22T23:22:55.467 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 85/150 2026-02-22T23:22:55.467 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 86/150 2026-02-22T23:22:55.467 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 87/150 2026-02-22T23:22:55.467 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 88/150 2026-02-22T23:22:55.467 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 89/150 2026-02-22T23:22:55.467 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : sqlite-3.34.1-9.el9.x86_64 90/150 2026-02-22T23:22:55.467 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : sqlite-devel-3.34.1-9.el9.x86_64 91/150 2026-02-22T23:22:55.467 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 92/150 2026-02-22T23:22:55.467 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 93/150 2026-02-22T23:22:55.467 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 94/150 2026-02-22T23:22:55.467 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 95/150 2026-02-22T23:22:55.467 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 96/150 2026-02-22T23:22:55.467 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 97/150 2026-02-22T23:22:55.468 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 98/150 2026-02-22T23:22:55.468 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 99/150 2026-02-22T23:22:55.468 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 100/150 2026-02-22T23:22:55.468 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 101/150 2026-02-22T23:22:55.468 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 102/150 2026-02-22T23:22:55.468 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 103/150 2026-02-22T23:22:55.468 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 104/150 2026-02-22T23:22:55.468 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 105/150 2026-02-22T23:22:55.468 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 106/150 2026-02-22T23:22:55.468 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 107/150 2026-02-22T23:22:55.468 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 108/150 2026-02-22T23:22:55.468 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 109/150 2026-02-22T23:22:55.469 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 110/150 2026-02-22T23:22:55.469 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 111/150 2026-02-22T23:22:55.469 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 112/150 2026-02-22T23:22:55.469 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 113/150 2026-02-22T23:22:55.469 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 114/150 2026-02-22T23:22:55.469 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 115/150 2026-02-22T23:22:55.469 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 116/150 2026-02-22T23:22:55.469 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 117/150 2026-02-22T23:22:55.469 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 118/150 2026-02-22T23:22:55.469 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 119/150 2026-02-22T23:22:55.469 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 120/150 2026-02-22T23:22:55.469 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 121/150 2026-02-22T23:22:55.469 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 122/150 2026-02-22T23:22:55.470 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 123/150 2026-02-22T23:22:55.470 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 124/150 2026-02-22T23:22:55.470 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 125/150 2026-02-22T23:22:55.470 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 126/150 2026-02-22T23:22:55.470 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 127/150 2026-02-22T23:22:55.470 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 128/150 2026-02-22T23:22:55.470 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 129/150 2026-02-22T23:22:55.470 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 130/150 2026-02-22T23:22:55.470 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 131/150 2026-02-22T23:22:55.470 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 132/150 2026-02-22T23:22:55.470 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 133/150 2026-02-22T23:22:55.470 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 134/150 2026-02-22T23:22:55.470 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 135/150 2026-02-22T23:22:55.471 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 136/150 2026-02-22T23:22:55.471 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 137/150 2026-02-22T23:22:55.471 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 138/150 2026-02-22T23:22:55.471 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 139/150 2026-02-22T23:22:55.471 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 140/150 2026-02-22T23:22:55.471 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 141/150 2026-02-22T23:22:55.471 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 142/150 2026-02-22T23:22:55.471 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 143/150 2026-02-22T23:22:55.471 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 144/150 2026-02-22T23:22:55.471 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : re2-1:20211101-20.el9.x86_64 145/150 2026-02-22T23:22:55.471 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 146/150 2026-02-22T23:22:55.471 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 147/150 2026-02-22T23:22:55.471 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 148/150 2026-02-22T23:22:55.472 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 149/150 2026-02-22T23:22:55.528 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 150/150 2026-02-22T23:22:55.528 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:22:55.528 INFO:teuthology.orchestra.run.trial155.stdout:Upgraded: 2026-02-22T23:22:55.528 INFO:teuthology.orchestra.run.trial155.stdout: librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:55.528 INFO:teuthology.orchestra.run.trial155.stdout: librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:55.528 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-22T23:22:55.528 INFO:teuthology.orchestra.run.trial155.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-22T23:22:55.528 INFO:teuthology.orchestra.run.trial155.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-22T23:22:55.528 INFO:teuthology.orchestra.run.trial155.stdout: ceph-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:55.529 INFO:teuthology.orchestra.run.trial155.stdout: ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:55.529 INFO:teuthology.orchestra.run.trial155.stdout: ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:55.529 INFO:teuthology.orchestra.run.trial155.stdout: ceph-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:55.529 INFO:teuthology.orchestra.run.trial155.stdout: ceph-grafana-dashboards-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T23:22:55.529 INFO:teuthology.orchestra.run.trial155.stdout: ceph-immutable-object-cache-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:55.529 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mds-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:55.529 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:55.529 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T23:22:55.529 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T23:22:55.529 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T23:22:55.529 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-k8sevents-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T23:22:55.530 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-modules-core-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T23:22:55.530 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T23:22:55.530 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mon-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:55.530 INFO:teuthology.orchestra.run.trial155.stdout: ceph-osd-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:55.530 INFO:teuthology.orchestra.run.trial155.stdout: ceph-prometheus-alerts-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T23:22:55.530 INFO:teuthology.orchestra.run.trial155.stdout: ceph-radosgw-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:55.530 INFO:teuthology.orchestra.run.trial155.stdout: ceph-selinux-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:55.530 INFO:teuthology.orchestra.run.trial155.stdout: ceph-test-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:55.530 INFO:teuthology.orchestra.run.trial155.stdout: ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T23:22:55.530 INFO:teuthology.orchestra.run.trial155.stdout: cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T23:22:55.530 INFO:teuthology.orchestra.run.trial155.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-22T23:22:55.531 INFO:teuthology.orchestra.run.trial155.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-22T23:22:55.531 INFO:teuthology.orchestra.run.trial155.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-22T23:22:55.531 INFO:teuthology.orchestra.run.trial155.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-22T23:22:55.531 INFO:teuthology.orchestra.run.trial155.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-22T23:22:55.531 INFO:teuthology.orchestra.run.trial155.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-22T23:22:55.531 INFO:teuthology.orchestra.run.trial155.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-22T23:22:55.531 INFO:teuthology.orchestra.run.trial155.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-22T23:22:55.531 INFO:teuthology.orchestra.run.trial155.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-22T23:22:55.531 INFO:teuthology.orchestra.run.trial155.stdout: libcephfs-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:55.531 INFO:teuthology.orchestra.run.trial155.stdout: libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:55.532 INFO:teuthology.orchestra.run.trial155.stdout: libcephsqlite-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:55.532 INFO:teuthology.orchestra.run.trial155.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-22T23:22:55.532 INFO:teuthology.orchestra.run.trial155.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-22T23:22:55.532 INFO:teuthology.orchestra.run.trial155.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-22T23:22:55.532 INFO:teuthology.orchestra.run.trial155.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-22T23:22:55.532 INFO:teuthology.orchestra.run.trial155.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-22T23:22:55.532 INFO:teuthology.orchestra.run.trial155.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-22T23:22:55.532 INFO:teuthology.orchestra.run.trial155.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-22T23:22:55.532 INFO:teuthology.orchestra.run.trial155.stdout: librados-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:55.532 INFO:teuthology.orchestra.run.trial155.stdout: libradosstriper1-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:55.532 INFO:teuthology.orchestra.run.trial155.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-22T23:22:55.532 INFO:teuthology.orchestra.run.trial155.stdout: librgw2-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:55.532 INFO:teuthology.orchestra.run.trial155.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-22T23:22:55.533 INFO:teuthology.orchestra.run.trial155.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-22T23:22:55.533 INFO:teuthology.orchestra.run.trial155.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-22T23:22:55.533 INFO:teuthology.orchestra.run.trial155.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-22T23:22:55.533 INFO:teuthology.orchestra.run.trial155.stdout: lua-5.4.4-4.el9.x86_64 2026-02-22T23:22:55.533 INFO:teuthology.orchestra.run.trial155.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-22T23:22:55.533 INFO:teuthology.orchestra.run.trial155.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-22T23:22:55.533 INFO:teuthology.orchestra.run.trial155.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-22T23:22:55.533 INFO:teuthology.orchestra.run.trial155.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-22T23:22:55.533 INFO:teuthology.orchestra.run.trial155.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-22T23:22:55.533 INFO:teuthology.orchestra.run.trial155.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-22T23:22:55.533 INFO:teuthology.orchestra.run.trial155.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-22T23:22:55.533 INFO:teuthology.orchestra.run.trial155.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-22T23:22:55.534 INFO:teuthology.orchestra.run.trial155.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-22T23:22:55.534 INFO:teuthology.orchestra.run.trial155.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-22T23:22:55.534 INFO:teuthology.orchestra.run.trial155.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-22T23:22:55.534 INFO:teuthology.orchestra.run.trial155.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-22T23:22:55.534 INFO:teuthology.orchestra.run.trial155.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-22T23:22:55.534 INFO:teuthology.orchestra.run.trial155.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-22T23:22:55.534 INFO:teuthology.orchestra.run.trial155.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-22T23:22:55.534 INFO:teuthology.orchestra.run.trial155.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-22T23:22:55.534 INFO:teuthology.orchestra.run.trial155.stdout: python3-ceph-argparse-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:55.534 INFO:teuthology.orchestra.run.trial155.stdout: python3-ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:55.534 INFO:teuthology.orchestra.run.trial155.stdout: python3-cephfs-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:55.534 INFO:teuthology.orchestra.run.trial155.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-22T23:22:55.535 INFO:teuthology.orchestra.run.trial155.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-22T23:22:55.535 INFO:teuthology.orchestra.run.trial155.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-22T23:22:55.535 INFO:teuthology.orchestra.run.trial155.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-22T23:22:55.535 INFO:teuthology.orchestra.run.trial155.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-22T23:22:55.535 INFO:teuthology.orchestra.run.trial155.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-22T23:22:55.535 INFO:teuthology.orchestra.run.trial155.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-22T23:22:55.535 INFO:teuthology.orchestra.run.trial155.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-22T23:22:55.535 INFO:teuthology.orchestra.run.trial155.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-22T23:22:55.535 INFO:teuthology.orchestra.run.trial155.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-22T23:22:55.535 INFO:teuthology.orchestra.run.trial155.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-22T23:22:55.535 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-22T23:22:55.535 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-22T23:22:55.535 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-22T23:22:55.536 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-22T23:22:55.536 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-22T23:22:55.536 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-22T23:22:55.536 INFO:teuthology.orchestra.run.trial155.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-22T23:22:55.536 INFO:teuthology.orchestra.run.trial155.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-22T23:22:55.536 INFO:teuthology.orchestra.run.trial155.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-22T23:22:55.536 INFO:teuthology.orchestra.run.trial155.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-22T23:22:55.536 INFO:teuthology.orchestra.run.trial155.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-22T23:22:55.536 INFO:teuthology.orchestra.run.trial155.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-22T23:22:55.536 INFO:teuthology.orchestra.run.trial155.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-22T23:22:55.536 INFO:teuthology.orchestra.run.trial155.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-22T23:22:55.536 INFO:teuthology.orchestra.run.trial155.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-22T23:22:55.536 INFO:teuthology.orchestra.run.trial155.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-22T23:22:55.537 INFO:teuthology.orchestra.run.trial155.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-22T23:22:55.537 INFO:teuthology.orchestra.run.trial155.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-22T23:22:55.537 INFO:teuthology.orchestra.run.trial155.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-22T23:22:55.537 INFO:teuthology.orchestra.run.trial155.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-22T23:22:55.537 INFO:teuthology.orchestra.run.trial155.stdout: python3-ply-3.11-14.el9.noarch 2026-02-22T23:22:55.537 INFO:teuthology.orchestra.run.trial155.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-22T23:22:55.537 INFO:teuthology.orchestra.run.trial155.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-22T23:22:55.537 INFO:teuthology.orchestra.run.trial155.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-22T23:22:55.537 INFO:teuthology.orchestra.run.trial155.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-22T23:22:55.537 INFO:teuthology.orchestra.run.trial155.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-22T23:22:55.537 INFO:teuthology.orchestra.run.trial155.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-22T23:22:55.537 INFO:teuthology.orchestra.run.trial155.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-22T23:22:55.538 INFO:teuthology.orchestra.run.trial155.stdout: python3-rados-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:55.538 INFO:teuthology.orchestra.run.trial155.stdout: python3-rbd-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:55.538 INFO:teuthology.orchestra.run.trial155.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-22T23:22:55.538 INFO:teuthology.orchestra.run.trial155.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-22T23:22:55.538 INFO:teuthology.orchestra.run.trial155.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-22T23:22:55.538 INFO:teuthology.orchestra.run.trial155.stdout: python3-rgw-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:55.538 INFO:teuthology.orchestra.run.trial155.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-22T23:22:55.538 INFO:teuthology.orchestra.run.trial155.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-22T23:22:55.538 INFO:teuthology.orchestra.run.trial155.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-22T23:22:55.538 INFO:teuthology.orchestra.run.trial155.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-22T23:22:55.538 INFO:teuthology.orchestra.run.trial155.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-22T23:22:55.538 INFO:teuthology.orchestra.run.trial155.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-22T23:22:55.538 INFO:teuthology.orchestra.run.trial155.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-22T23:22:55.539 INFO:teuthology.orchestra.run.trial155.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-22T23:22:55.539 INFO:teuthology.orchestra.run.trial155.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-22T23:22:55.539 INFO:teuthology.orchestra.run.trial155.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-22T23:22:55.539 INFO:teuthology.orchestra.run.trial155.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-22T23:22:55.539 INFO:teuthology.orchestra.run.trial155.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-22T23:22:55.539 INFO:teuthology.orchestra.run.trial155.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-22T23:22:55.539 INFO:teuthology.orchestra.run.trial155.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-22T23:22:55.539 INFO:teuthology.orchestra.run.trial155.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-22T23:22:55.539 INFO:teuthology.orchestra.run.trial155.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-22T23:22:55.539 INFO:teuthology.orchestra.run.trial155.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-22T23:22:55.539 INFO:teuthology.orchestra.run.trial155.stdout: rbd-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:55.539 INFO:teuthology.orchestra.run.trial155.stdout: rbd-mirror-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:55.539 INFO:teuthology.orchestra.run.trial155.stdout: rbd-nbd-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T23:22:55.540 INFO:teuthology.orchestra.run.trial155.stdout: re2-1:20211101-20.el9.x86_64 2026-02-22T23:22:55.540 INFO:teuthology.orchestra.run.trial155.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-22T23:22:55.540 INFO:teuthology.orchestra.run.trial155.stdout: sqlite-3.34.1-9.el9.x86_64 2026-02-22T23:22:55.540 INFO:teuthology.orchestra.run.trial155.stdout: sqlite-devel-3.34.1-9.el9.x86_64 2026-02-22T23:22:55.540 INFO:teuthology.orchestra.run.trial155.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-22T23:22:55.540 INFO:teuthology.orchestra.run.trial155.stdout: unzip-6.0-59.el9.x86_64 2026-02-22T23:22:55.540 INFO:teuthology.orchestra.run.trial155.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-22T23:22:55.540 INFO:teuthology.orchestra.run.trial155.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-22T23:22:55.540 INFO:teuthology.orchestra.run.trial155.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-22T23:22:55.540 INFO:teuthology.orchestra.run.trial155.stdout: zip-3.0-35.el9.x86_64 2026-02-22T23:22:55.540 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:22:55.540 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T23:22:55.607 DEBUG:teuthology.parallel:result is None 2026-02-22T23:22:55.607 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-22T23:22:55.770 DEBUG:teuthology.orchestra.run.trial093:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-22T23:22:55.794 INFO:teuthology.orchestra.run.trial093.stdout:19.2.3-689.gf90f4eae.el9 2026-02-22T23:22:55.794 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-689.gf90f4eae.el9 2026-02-22T23:22:55.794 INFO:teuthology.task.install:The correct ceph version 19.2.3-689.gf90f4eae is installed. 2026-02-22T23:22:55.796 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-22T23:22:55.954 DEBUG:teuthology.orchestra.run.trial155:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-22T23:22:55.974 INFO:teuthology.orchestra.run.trial155.stdout:19.2.3-689.gf90f4eae.el9 2026-02-22T23:22:55.974 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-689.gf90f4eae.el9 2026-02-22T23:22:55.975 INFO:teuthology.task.install:The correct ceph version 19.2.3-689.gf90f4eae is installed. 2026-02-22T23:22:55.976 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-22T23:22:55.976 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-22T23:22:55.976 DEBUG:teuthology.orchestra.run.trial093:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-22T23:22:56.003 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T23:22:56.003 DEBUG:teuthology.orchestra.run.trial155:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-22T23:22:56.042 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-22T23:22:56.042 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-22T23:22:56.042 DEBUG:teuthology.orchestra.run.trial093:> sudo dd of=/usr/bin/daemon-helper 2026-02-22T23:22:56.068 DEBUG:teuthology.orchestra.run.trial093:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-22T23:22:56.131 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T23:22:56.131 DEBUG:teuthology.orchestra.run.trial155:> sudo dd of=/usr/bin/daemon-helper 2026-02-22T23:22:56.156 DEBUG:teuthology.orchestra.run.trial155:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-22T23:22:56.219 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-22T23:22:56.219 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-22T23:22:56.219 DEBUG:teuthology.orchestra.run.trial093:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-22T23:22:56.243 DEBUG:teuthology.orchestra.run.trial093:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-22T23:22:56.307 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T23:22:56.307 DEBUG:teuthology.orchestra.run.trial155:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-22T23:22:56.332 DEBUG:teuthology.orchestra.run.trial155:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-22T23:22:56.395 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-22T23:22:56.396 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-22T23:22:56.396 DEBUG:teuthology.orchestra.run.trial093:> sudo dd of=/usr/bin/stdin-killer 2026-02-22T23:22:56.422 DEBUG:teuthology.orchestra.run.trial093:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-22T23:22:56.486 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T23:22:56.486 DEBUG:teuthology.orchestra.run.trial155:> sudo dd of=/usr/bin/stdin-killer 2026-02-22T23:22:56.509 DEBUG:teuthology.orchestra.run.trial155:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-22T23:22:56.574 INFO:teuthology.run_tasks:Running task ceph... 2026-02-22T23:22:56.680 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-22T23:22:56.680 DEBUG:teuthology.orchestra.run.trial093:> sudo chmod 777 /var/log/ceph 2026-02-22T23:22:56.683 DEBUG:teuthology.orchestra.run.trial155:> sudo chmod 777 /var/log/ceph 2026-02-22T23:22:56.707 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-22T23:22:56.707 DEBUG:teuthology.orchestra.run.trial093:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-22T23:22:56.747 DEBUG:teuthology.orchestra.run.trial155:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-22T23:22:56.773 INFO:tasks.ceph:Creating extra log directories... 2026-02-22T23:22:56.773 DEBUG:teuthology.orchestra.run.trial093:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-22T23:22:56.811 DEBUG:teuthology.orchestra.run.trial155:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-22T23:22:56.850 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-22T23:22:56.851 INFO:tasks.ceph:config {'conf': {'client': {'debug cephsqlite': 20, 'debug client': 20, 'debug ms': 1}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr2': False, 'ms inject socket failures': 1500, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'paxos service trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': False, 'mon_bind_addrvec': True} 2026-02-22T23:22:56.851 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64383', 'branch': 'wip-yuri6-testing-2026-02-22-1629-squid', 'description': 'rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} tasks/libcephsqlite}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'flavor': 'default', 'job_id': '64383', 'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}, {'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-yuri6-testing-2026-02-22-1629-squid'}, 'ceph': {'conf': {'client': {'debug cephsqlite': 20, 'debug client': 20, 'debug ms': 1}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr2': False, 'ms inject socket failures': 1500, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'paxos service trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled'], 'mon_bind_msgr2': False, 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri6-testing-2026-02-22-1629-squid', 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'}}, 'owner': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'priority': 69, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 5907, 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-yuri6-testing-2026-02-22-1629-squid', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579', 'targets': {'trial093.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMrpK6O9hi0YPkGzlrwOiunQhIXZQYy5DJiKIAvhUNP0GcrB/u6tqGlRpVhAjaqmgjaoXcjy1mpcE7084f178PA=', 'trial155.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE4hf29MP+OplcqrNbhRhyoWqarvAYUR/Y+p2tDRAfm29sBTt4XuVIq4Ml6LJUFIa5eiJrNNqtTwDLkTRSHkgz4='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['sqlite3'], 'rpm': ['sqlite-devel']}, 'flavor': 'default', 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'}}, {'ceph': None}, {'exec': {'client.0': ['ceph osd pool create cephsqlite', "ceph auth get-or-create client.libcephsqlite mon 'profile simple-rados-client-with-blocklist' osd 'allow rwx pool=cephsqlite' >> /etc/ceph/ceph.keyring"]}}, {'exec': {'client.0': ['ceph_test_libcephsqlite --id libcephsqlite --no-log-to-stderr']}}, {'workunit': {'clients': {'client.0': ['rados/test_libcephsqlite.sh cephsqlite']}, 'env': {'CEPH_ARGS': '--id libcephsqlite --no-log-to-stderr'}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'fa17720d0088c3ac28e473468bfc79eeaff5cd38', 'timestamp': '2026-02-22_19:35:40', 'tube': 'trial', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3318653'} 2026-02-22T23:22:56.852 DEBUG:teuthology.orchestra.run.trial093:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-22T23:22:56.875 DEBUG:teuthology.orchestra.run.trial155:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-22T23:22:56.893 DEBUG:teuthology.orchestra.run.trial093:> sudo install -d -m0777 -- /var/run/ceph 2026-02-22T23:22:56.931 DEBUG:teuthology.orchestra.run.trial155:> sudo install -d -m0777 -- /var/run/ceph 2026-02-22T23:22:56.956 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-22T23:22:56.956 DEBUG:teuthology.orchestra.run.trial093:> dd if=/scratch_devs of=/dev/stdout 2026-02-22T23:22:57.010 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-22T23:22:57.010 DEBUG:teuthology.orchestra.run.trial093:> stat /dev/vg_nvme/lv_1 2026-02-22T23:22:57.067 INFO:teuthology.orchestra.run.trial093.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-22T23:22:57.067 INFO:teuthology.orchestra.run.trial093.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T23:22:57.068 INFO:teuthology.orchestra.run.trial093.stdout:Device: 6h/6d Inode: 1308 Links: 1 2026-02-22T23:22:57.068 INFO:teuthology.orchestra.run.trial093.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T23:22:57.068 INFO:teuthology.orchestra.run.trial093.stdout:Context: system_u:object_r:device_t:s0 2026-02-22T23:22:57.068 INFO:teuthology.orchestra.run.trial093.stdout:Access: 2026-02-22 23:22:52.100320370 +0000 2026-02-22T23:22:57.068 INFO:teuthology.orchestra.run.trial093.stdout:Modify: 2026-02-22 23:22:41.396590888 +0000 2026-02-22T23:22:57.068 INFO:teuthology.orchestra.run.trial093.stdout:Change: 2026-02-22 23:22:41.396590888 +0000 2026-02-22T23:22:57.068 INFO:teuthology.orchestra.run.trial093.stdout: Birth: 2026-02-22 23:22:41.396590888 +0000 2026-02-22T23:22:57.069 DEBUG:teuthology.orchestra.run.trial093:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-22T23:22:57.130 INFO:teuthology.orchestra.run.trial093.stderr:1+0 records in 2026-02-22T23:22:57.131 INFO:teuthology.orchestra.run.trial093.stderr:1+0 records out 2026-02-22T23:22:57.131 INFO:teuthology.orchestra.run.trial093.stderr:512 bytes copied, 0.000248962 s, 2.1 MB/s 2026-02-22T23:22:57.132 DEBUG:teuthology.orchestra.run.trial093:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-22T23:22:57.190 DEBUG:teuthology.orchestra.run.trial093:> stat /dev/vg_nvme/lv_2 2026-02-22T23:22:57.246 INFO:teuthology.orchestra.run.trial093.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-22T23:22:57.247 INFO:teuthology.orchestra.run.trial093.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T23:22:57.247 INFO:teuthology.orchestra.run.trial093.stdout:Device: 6h/6d Inode: 1307 Links: 1 2026-02-22T23:22:57.247 INFO:teuthology.orchestra.run.trial093.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T23:22:57.247 INFO:teuthology.orchestra.run.trial093.stdout:Context: system_u:object_r:device_t:s0 2026-02-22T23:22:57.247 INFO:teuthology.orchestra.run.trial093.stdout:Access: 2026-02-22 23:22:52.100320370 +0000 2026-02-22T23:22:57.247 INFO:teuthology.orchestra.run.trial093.stdout:Modify: 2026-02-22 23:22:41.396590888 +0000 2026-02-22T23:22:57.247 INFO:teuthology.orchestra.run.trial093.stdout:Change: 2026-02-22 23:22:41.396590888 +0000 2026-02-22T23:22:57.247 INFO:teuthology.orchestra.run.trial093.stdout: Birth: 2026-02-22 23:22:41.396590888 +0000 2026-02-22T23:22:57.248 DEBUG:teuthology.orchestra.run.trial093:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-22T23:22:57.309 INFO:teuthology.orchestra.run.trial093.stderr:1+0 records in 2026-02-22T23:22:57.310 INFO:teuthology.orchestra.run.trial093.stderr:1+0 records out 2026-02-22T23:22:57.310 INFO:teuthology.orchestra.run.trial093.stderr:512 bytes copied, 0.000219397 s, 2.3 MB/s 2026-02-22T23:22:57.310 DEBUG:teuthology.orchestra.run.trial093:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-22T23:22:57.368 DEBUG:teuthology.orchestra.run.trial093:> stat /dev/vg_nvme/lv_3 2026-02-22T23:22:57.423 INFO:teuthology.orchestra.run.trial093.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-22T23:22:57.424 INFO:teuthology.orchestra.run.trial093.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T23:22:57.424 INFO:teuthology.orchestra.run.trial093.stdout:Device: 6h/6d Inode: 1291 Links: 1 2026-02-22T23:22:57.424 INFO:teuthology.orchestra.run.trial093.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T23:22:57.424 INFO:teuthology.orchestra.run.trial093.stdout:Context: system_u:object_r:device_t:s0 2026-02-22T23:22:57.424 INFO:teuthology.orchestra.run.trial093.stdout:Access: 2026-02-22 23:22:52.100320370 +0000 2026-02-22T23:22:57.424 INFO:teuthology.orchestra.run.trial093.stdout:Modify: 2026-02-22 23:22:41.395590914 +0000 2026-02-22T23:22:57.424 INFO:teuthology.orchestra.run.trial093.stdout:Change: 2026-02-22 23:22:41.395590914 +0000 2026-02-22T23:22:57.424 INFO:teuthology.orchestra.run.trial093.stdout: Birth: 2026-02-22 23:22:41.395590914 +0000 2026-02-22T23:22:57.424 DEBUG:teuthology.orchestra.run.trial093:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-22T23:22:57.486 INFO:teuthology.orchestra.run.trial093.stderr:1+0 records in 2026-02-22T23:22:57.486 INFO:teuthology.orchestra.run.trial093.stderr:1+0 records out 2026-02-22T23:22:57.487 INFO:teuthology.orchestra.run.trial093.stderr:512 bytes copied, 0.000153354 s, 3.3 MB/s 2026-02-22T23:22:57.488 DEBUG:teuthology.orchestra.run.trial093:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-22T23:22:57.545 DEBUG:teuthology.orchestra.run.trial093:> stat /dev/vg_nvme/lv_4 2026-02-22T23:22:57.602 INFO:teuthology.orchestra.run.trial093.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-22T23:22:57.602 INFO:teuthology.orchestra.run.trial093.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T23:22:57.602 INFO:teuthology.orchestra.run.trial093.stdout:Device: 6h/6d Inode: 1296 Links: 1 2026-02-22T23:22:57.602 INFO:teuthology.orchestra.run.trial093.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T23:22:57.602 INFO:teuthology.orchestra.run.trial093.stdout:Context: system_u:object_r:device_t:s0 2026-02-22T23:22:57.602 INFO:teuthology.orchestra.run.trial093.stdout:Access: 2026-02-22 23:22:52.101320345 +0000 2026-02-22T23:22:57.602 INFO:teuthology.orchestra.run.trial093.stdout:Modify: 2026-02-22 23:22:41.395590914 +0000 2026-02-22T23:22:57.603 INFO:teuthology.orchestra.run.trial093.stdout:Change: 2026-02-22 23:22:41.395590914 +0000 2026-02-22T23:22:57.603 INFO:teuthology.orchestra.run.trial093.stdout: Birth: 2026-02-22 23:22:41.395590914 +0000 2026-02-22T23:22:57.603 DEBUG:teuthology.orchestra.run.trial093:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-22T23:22:57.665 INFO:teuthology.orchestra.run.trial093.stderr:1+0 records in 2026-02-22T23:22:57.666 INFO:teuthology.orchestra.run.trial093.stderr:1+0 records out 2026-02-22T23:22:57.666 INFO:teuthology.orchestra.run.trial093.stderr:512 bytes copied, 0.000143176 s, 3.6 MB/s 2026-02-22T23:22:57.667 DEBUG:teuthology.orchestra.run.trial093:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-22T23:22:57.723 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-22T23:22:57.724 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T23:22:57.724 DEBUG:teuthology.orchestra.run.trial155:> dd if=/scratch_devs of=/dev/stdout 2026-02-22T23:22:57.743 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-22T23:22:57.743 DEBUG:teuthology.orchestra.run.trial155:> stat /dev/vg_nvme/lv_1 2026-02-22T23:22:57.801 INFO:teuthology.orchestra.run.trial155.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-22T23:22:57.801 INFO:teuthology.orchestra.run.trial155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T23:22:57.801 INFO:teuthology.orchestra.run.trial155.stdout:Device: 6h/6d Inode: 1311 Links: 1 2026-02-22T23:22:57.801 INFO:teuthology.orchestra.run.trial155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T23:22:57.801 INFO:teuthology.orchestra.run.trial155.stdout:Context: system_u:object_r:device_t:s0 2026-02-22T23:22:57.801 INFO:teuthology.orchestra.run.trial155.stdout:Access: 2026-02-22 23:22:54.952882767 +0000 2026-02-22T23:22:57.801 INFO:teuthology.orchestra.run.trial155.stdout:Modify: 2026-02-22 23:22:44.231613287 +0000 2026-02-22T23:22:57.801 INFO:teuthology.orchestra.run.trial155.stdout:Change: 2026-02-22 23:22:44.231613287 +0000 2026-02-22T23:22:57.801 INFO:teuthology.orchestra.run.trial155.stdout: Birth: 2026-02-22 23:22:44.231613287 +0000 2026-02-22T23:22:57.801 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-22T23:22:57.863 INFO:teuthology.orchestra.run.trial155.stderr:1+0 records in 2026-02-22T23:22:57.863 INFO:teuthology.orchestra.run.trial155.stderr:1+0 records out 2026-02-22T23:22:57.863 INFO:teuthology.orchestra.run.trial155.stderr:512 bytes copied, 0.000165794 s, 3.1 MB/s 2026-02-22T23:22:57.864 DEBUG:teuthology.orchestra.run.trial155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-22T23:22:57.921 DEBUG:teuthology.orchestra.run.trial155:> stat /dev/vg_nvme/lv_2 2026-02-22T23:22:57.978 INFO:teuthology.orchestra.run.trial155.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-22T23:22:57.978 INFO:teuthology.orchestra.run.trial155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T23:22:57.978 INFO:teuthology.orchestra.run.trial155.stdout:Device: 6h/6d Inode: 1302 Links: 1 2026-02-22T23:22:57.978 INFO:teuthology.orchestra.run.trial155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T23:22:57.978 INFO:teuthology.orchestra.run.trial155.stdout:Context: system_u:object_r:device_t:s0 2026-02-22T23:22:57.978 INFO:teuthology.orchestra.run.trial155.stdout:Access: 2026-02-22 23:22:54.953882606 +0000 2026-02-22T23:22:57.978 INFO:teuthology.orchestra.run.trial155.stdout:Modify: 2026-02-22 23:22:44.231613287 +0000 2026-02-22T23:22:57.978 INFO:teuthology.orchestra.run.trial155.stdout:Change: 2026-02-22 23:22:44.231613287 +0000 2026-02-22T23:22:57.979 INFO:teuthology.orchestra.run.trial155.stdout: Birth: 2026-02-22 23:22:44.231613287 +0000 2026-02-22T23:22:57.979 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-22T23:22:58.040 INFO:teuthology.orchestra.run.trial155.stderr:1+0 records in 2026-02-22T23:22:58.040 INFO:teuthology.orchestra.run.trial155.stderr:1+0 records out 2026-02-22T23:22:58.041 INFO:teuthology.orchestra.run.trial155.stderr:512 bytes copied, 0.000141182 s, 3.6 MB/s 2026-02-22T23:22:58.041 DEBUG:teuthology.orchestra.run.trial155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-22T23:22:58.100 DEBUG:teuthology.orchestra.run.trial155:> stat /dev/vg_nvme/lv_3 2026-02-22T23:22:58.156 INFO:teuthology.orchestra.run.trial155.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-22T23:22:58.156 INFO:teuthology.orchestra.run.trial155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T23:22:58.156 INFO:teuthology.orchestra.run.trial155.stdout:Device: 6h/6d Inode: 1291 Links: 1 2026-02-22T23:22:58.157 INFO:teuthology.orchestra.run.trial155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T23:22:58.157 INFO:teuthology.orchestra.run.trial155.stdout:Context: system_u:object_r:device_t:s0 2026-02-22T23:22:58.157 INFO:teuthology.orchestra.run.trial155.stdout:Access: 2026-02-22 23:22:54.953882606 +0000 2026-02-22T23:22:58.157 INFO:teuthology.orchestra.run.trial155.stdout:Modify: 2026-02-22 23:22:44.230613448 +0000 2026-02-22T23:22:58.157 INFO:teuthology.orchestra.run.trial155.stdout:Change: 2026-02-22 23:22:44.230613448 +0000 2026-02-22T23:22:58.157 INFO:teuthology.orchestra.run.trial155.stdout: Birth: 2026-02-22 23:22:44.230613448 +0000 2026-02-22T23:22:58.157 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-22T23:22:58.218 INFO:teuthology.orchestra.run.trial155.stderr:1+0 records in 2026-02-22T23:22:58.218 INFO:teuthology.orchestra.run.trial155.stderr:1+0 records out 2026-02-22T23:22:58.219 INFO:teuthology.orchestra.run.trial155.stderr:512 bytes copied, 0.000157119 s, 3.3 MB/s 2026-02-22T23:22:58.220 DEBUG:teuthology.orchestra.run.trial155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-22T23:22:58.276 DEBUG:teuthology.orchestra.run.trial155:> stat /dev/vg_nvme/lv_4 2026-02-22T23:22:58.332 INFO:teuthology.orchestra.run.trial155.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-22T23:22:58.332 INFO:teuthology.orchestra.run.trial155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T23:22:58.332 INFO:teuthology.orchestra.run.trial155.stdout:Device: 6h/6d Inode: 1301 Links: 1 2026-02-22T23:22:58.333 INFO:teuthology.orchestra.run.trial155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T23:22:58.333 INFO:teuthology.orchestra.run.trial155.stdout:Context: system_u:object_r:device_t:s0 2026-02-22T23:22:58.333 INFO:teuthology.orchestra.run.trial155.stdout:Access: 2026-02-22 23:22:54.953882606 +0000 2026-02-22T23:22:58.333 INFO:teuthology.orchestra.run.trial155.stdout:Modify: 2026-02-22 23:22:44.231613287 +0000 2026-02-22T23:22:58.333 INFO:teuthology.orchestra.run.trial155.stdout:Change: 2026-02-22 23:22:44.231613287 +0000 2026-02-22T23:22:58.333 INFO:teuthology.orchestra.run.trial155.stdout: Birth: 2026-02-22 23:22:44.231613287 +0000 2026-02-22T23:22:58.333 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-22T23:22:58.395 INFO:teuthology.orchestra.run.trial155.stderr:1+0 records in 2026-02-22T23:22:58.396 INFO:teuthology.orchestra.run.trial155.stderr:1+0 records out 2026-02-22T23:22:58.396 INFO:teuthology.orchestra.run.trial155.stderr:512 bytes copied, 0.000141052 s, 3.6 MB/s 2026-02-22T23:22:58.397 DEBUG:teuthology.orchestra.run.trial155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-22T23:22:58.454 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2026-02-22T23:22:58.454 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial093.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial155.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2026-02-22T23:22:58.454 INFO:tasks.ceph:Generating config... 2026-02-22T23:22:58.455 INFO:tasks.ceph:[client] debug cephsqlite = 20 2026-02-22T23:22:58.456 INFO:tasks.ceph:[client] debug client = 20 2026-02-22T23:22:58.456 INFO:tasks.ceph:[client] debug ms = 1 2026-02-22T23:22:58.456 INFO:tasks.ceph:[global] mon client directed command retry = 5 2026-02-22T23:22:58.456 INFO:tasks.ceph:[global] mon election default strategy = 1 2026-02-22T23:22:58.456 INFO:tasks.ceph:[global] ms bind msgr2 = False 2026-02-22T23:22:58.456 INFO:tasks.ceph:[global] ms inject socket failures = 1500 2026-02-22T23:22:58.456 INFO:tasks.ceph:[global] ms type = async 2026-02-22T23:22:58.456 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-22T23:22:58.456 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-22T23:22:58.456 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-22T23:22:58.456 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-22T23:22:58.456 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-22T23:22:58.456 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2026-02-22T23:22:58.456 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2026-02-22T23:22:58.456 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2026-02-22T23:22:58.456 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2026-02-22T23:22:58.457 INFO:tasks.ceph:[mon] mon scrub interval = 300 2026-02-22T23:22:58.457 INFO:tasks.ceph:[mon] paxos service trim min = 10 2026-02-22T23:22:58.457 INFO:tasks.ceph:[osd] bdev async discard = True 2026-02-22T23:22:58.457 INFO:tasks.ceph:[osd] bdev enable discard = True 2026-02-22T23:22:58.457 INFO:tasks.ceph:[osd] bluestore allocator = stupid 2026-02-22T23:22:58.457 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2026-02-22T23:22:58.457 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2026-02-22T23:22:58.457 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2026-02-22T23:22:58.457 INFO:tasks.ceph:[osd] debug bluefs = 20 2026-02-22T23:22:58.457 INFO:tasks.ceph:[osd] debug bluestore = 20 2026-02-22T23:22:58.457 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-22T23:22:58.457 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-22T23:22:58.457 INFO:tasks.ceph:[osd] debug rocksdb = 10 2026-02-22T23:22:58.457 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2026-02-22T23:22:58.457 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2026-02-22T23:22:58.457 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2026-02-22T23:22:58.457 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2026-02-22T23:22:58.457 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2026-02-22T23:22:58.458 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2026-02-22T23:22:58.458 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2026-02-22T23:22:58.458 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2026-02-22T23:22:58.458 INFO:tasks.ceph:[osd] osd mclock skip benchmark = True 2026-02-22T23:22:58.458 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2026-02-22T23:22:58.458 INFO:tasks.ceph:[osd] osd op queue = debug_random 2026-02-22T23:22:58.458 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2026-02-22T23:22:58.458 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2026-02-22T23:22:58.458 INFO:tasks.ceph:Setting up mon.a... 2026-02-22T23:22:58.458 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-22T23:22:58.494 INFO:teuthology.orchestra.run.trial093.stdout:creating /etc/ceph/ceph.keyring 2026-02-22T23:22:58.497 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-22T23:22:58.573 DEBUG:teuthology.orchestra.run.trial093:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-22T23:22:58.636 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '[v1:10.20.193.93:6789]'), ('mon.c', '[v1:10.20.193.93:6790]'), ('mon.b', '[v1:10.20.193.155:6789]')] 2026-02-22T23:22:58.636 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '[v1:10.20.193.93:6789],[v1:10.20.193.93:6790],[v1:10.20.193.155:6789]', 'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr2': False, 'ms inject socket failures': 1500, 'ms type': 'async'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'paxos service trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug cephsqlite': 20, 'debug client': 20, 'debug ms': 1}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2026-02-22T23:22:58.636 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-22T23:22:58.636 DEBUG:teuthology.orchestra.run.trial093:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-22T23:22:58.691 DEBUG:teuthology.orchestra.run.trial093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --addv a '[v1:10.20.193.93:6789]' --addv c '[v1:10.20.193.93:6790]' --addv b '[v1:10.20.193.155:6789]' --print /home/ubuntu/cephtest/ceph.monmap 2026-02-22T23:22:58.764 INFO:teuthology.orchestra.run.trial093.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-22T23:22:58.765 INFO:teuthology.orchestra.run.trial093.stdout:monmaptool: generated fsid 964c49d0-be38-4661-88a8-21893fbedc4f 2026-02-22T23:22:58.765 INFO:teuthology.orchestra.run.trial093.stdout:setting min_mon_release = quincy 2026-02-22T23:22:58.765 INFO:teuthology.orchestra.run.trial093.stdout:epoch 0 2026-02-22T23:22:58.765 INFO:teuthology.orchestra.run.trial093.stdout:fsid 964c49d0-be38-4661-88a8-21893fbedc4f 2026-02-22T23:22:58.765 INFO:teuthology.orchestra.run.trial093.stdout:last_changed 2026-02-22T23:22:58.763353+0000 2026-02-22T23:22:58.765 INFO:teuthology.orchestra.run.trial093.stdout:created 2026-02-22T23:22:58.763353+0000 2026-02-22T23:22:58.765 INFO:teuthology.orchestra.run.trial093.stdout:min_mon_release 17 (quincy) 2026-02-22T23:22:58.765 INFO:teuthology.orchestra.run.trial093.stdout:election_strategy: 1 2026-02-22T23:22:58.765 INFO:teuthology.orchestra.run.trial093.stdout:0: v1:10.20.193.93:6789/0 mon.a 2026-02-22T23:22:58.765 INFO:teuthology.orchestra.run.trial093.stdout:1: v1:10.20.193.155:6789/0 mon.b 2026-02-22T23:22:58.765 INFO:teuthology.orchestra.run.trial093.stdout:2: v1:10.20.193.93:6790/0 mon.c 2026-02-22T23:22:58.765 INFO:teuthology.orchestra.run.trial093.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2026-02-22T23:22:58.766 DEBUG:teuthology.orchestra.run.trial093:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-22T23:22:58.823 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 964c49d0-be38-4661-88a8-21893fbedc4f... 2026-02-22T23:22:58.823 DEBUG:teuthology.orchestra.run.trial093:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-22T23:22:58.865 DEBUG:teuthology.orchestra.run.trial155:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-22T23:22:58.903 INFO:teuthology.orchestra.run.trial093.stdout:[global] 2026-02-22T23:22:58.903 INFO:teuthology.orchestra.run.trial093.stdout: chdir = "" 2026-02-22T23:22:58.903 INFO:teuthology.orchestra.run.trial093.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-22T23:22:58.903 INFO:teuthology.orchestra.run.trial093.stdout: auth supported = cephx 2026-02-22T23:22:58.903 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:22:58.903 INFO:teuthology.orchestra.run.trial093.stdout: filestore xattr use omap = true 2026-02-22T23:22:58.903 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:22:58.904 INFO:teuthology.orchestra.run.trial093.stdout: mon clock drift allowed = 1.000 2026-02-22T23:22:58.904 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:22:58.904 INFO:teuthology.orchestra.run.trial093.stdout: osd crush chooseleaf type = 0 2026-02-22T23:22:58.904 INFO:teuthology.orchestra.run.trial093.stdout: auth debug = true 2026-02-22T23:22:58.904 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:22:58.904 INFO:teuthology.orchestra.run.trial093.stdout: ms die on old message = true 2026-02-22T23:22:58.904 INFO:teuthology.orchestra.run.trial093.stdout: ms die on bug = true 2026-02-22T23:22:58.904 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:22:58.904 INFO:teuthology.orchestra.run.trial093.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-22T23:22:58.904 INFO:teuthology.orchestra.run.trial093.stdout: mon pg warn max object skew = 0 2026-02-22T23:22:58.904 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:22:58.905 INFO:teuthology.orchestra.run.trial093.stdout: # disable pg_autoscaler by default for new pools 2026-02-22T23:22:58.905 INFO:teuthology.orchestra.run.trial093.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-22T23:22:58.905 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:22:58.905 INFO:teuthology.orchestra.run.trial093.stdout: osd pool default size = 2 2026-02-22T23:22:58.905 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:22:58.905 INFO:teuthology.orchestra.run.trial093.stdout: mon osd allow primary affinity = true 2026-02-22T23:22:58.905 INFO:teuthology.orchestra.run.trial093.stdout: mon osd allow pg remap = true 2026-02-22T23:22:58.905 INFO:teuthology.orchestra.run.trial093.stdout: mon warn on legacy crush tunables = false 2026-02-22T23:22:58.905 INFO:teuthology.orchestra.run.trial093.stdout: mon warn on crush straw calc version zero = false 2026-02-22T23:22:58.905 INFO:teuthology.orchestra.run.trial093.stdout: mon warn on no sortbitwise = false 2026-02-22T23:22:58.906 INFO:teuthology.orchestra.run.trial093.stdout: mon warn on osd down out interval zero = false 2026-02-22T23:22:58.906 INFO:teuthology.orchestra.run.trial093.stdout: mon warn on too few osds = false 2026-02-22T23:22:58.906 INFO:teuthology.orchestra.run.trial093.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-22T23:22:58.906 INFO:teuthology.orchestra.run.trial093.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-22T23:22:58.906 INFO:teuthology.orchestra.run.trial093.stdout: mon_allow_pool_size_one = true 2026-02-22T23:22:58.906 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:22:58.906 INFO:teuthology.orchestra.run.trial093.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-22T23:22:58.906 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:22:58.906 INFO:teuthology.orchestra.run.trial093.stdout: osd default data pool replay window = 5 2026-02-22T23:22:58.906 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:22:58.907 INFO:teuthology.orchestra.run.trial093.stdout: mon allow pool delete = true 2026-02-22T23:22:58.907 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:22:58.907 INFO:teuthology.orchestra.run.trial093.stdout: mon cluster log file level = debug 2026-02-22T23:22:58.907 INFO:teuthology.orchestra.run.trial093.stdout: debug asserts on shutdown = true 2026-02-22T23:22:58.907 INFO:teuthology.orchestra.run.trial093.stdout: mon health detail to clog = false 2026-02-22T23:22:58.907 INFO:teuthology.orchestra.run.trial093.stdout: mon host = "[v1:10.20.193.93:6789],[v1:10.20.193.93:6790],[v1:10.20.193.155:6789]" 2026-02-22T23:22:58.907 INFO:teuthology.orchestra.run.trial093.stdout: mon client directed command retry = 5 2026-02-22T23:22:58.907 INFO:teuthology.orchestra.run.trial093.stdout: mon election default strategy = 1 2026-02-22T23:22:58.907 INFO:teuthology.orchestra.run.trial093.stdout: ms bind msgr2 = False 2026-02-22T23:22:58.907 INFO:teuthology.orchestra.run.trial093.stdout: ms inject socket failures = 1500 2026-02-22T23:22:58.908 INFO:teuthology.orchestra.run.trial093.stdout: ms type = async 2026-02-22T23:22:58.908 INFO:teuthology.orchestra.run.trial093.stdout: fsid = 964c49d0-be38-4661-88a8-21893fbedc4f 2026-02-22T23:22:58.908 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:22:58.908 INFO:teuthology.orchestra.run.trial093.stdout:[osd] 2026-02-22T23:22:58.908 INFO:teuthology.orchestra.run.trial093.stdout: osd journal size = 100 2026-02-22T23:22:58.908 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:22:58.908 INFO:teuthology.orchestra.run.trial093.stdout: osd scrub load threshold = 5.0 2026-02-22T23:22:58.908 INFO:teuthology.orchestra.run.trial093.stdout: osd scrub max interval = 600 2026-02-22T23:22:58.908 INFO:teuthology.orchestra.run.trial093.stdout: osd mclock profile = high_recovery_ops 2026-02-22T23:22:58.908 INFO:teuthology.orchestra.run.trial093.stdout: osd mclock skip benchmark = True 2026-02-22T23:22:58.908 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:22:58.909 INFO:teuthology.orchestra.run.trial093.stdout: osd recover clone overlap = true 2026-02-22T23:22:58.909 INFO:teuthology.orchestra.run.trial093.stdout: osd recovery max chunk = 1048576 2026-02-22T23:22:58.909 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:22:58.909 INFO:teuthology.orchestra.run.trial093.stdout: osd debug shutdown = true 2026-02-22T23:22:58.909 INFO:teuthology.orchestra.run.trial093.stdout: osd debug op order = true 2026-02-22T23:22:58.909 INFO:teuthology.orchestra.run.trial093.stdout: osd debug verify stray on activate = true 2026-02-22T23:22:58.909 INFO:teuthology.orchestra.run.trial093.stdout: osd debug trim objects = true 2026-02-22T23:22:58.909 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:22:58.909 INFO:teuthology.orchestra.run.trial093.stdout: osd open classes on start = true 2026-02-22T23:22:58.910 INFO:teuthology.orchestra.run.trial093.stdout: osd debug pg log writeout = true 2026-02-22T23:22:58.910 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:22:58.910 INFO:teuthology.orchestra.run.trial093.stdout: osd deep scrub update digest min age = 30 2026-02-22T23:22:58.910 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:22:58.910 INFO:teuthology.orchestra.run.trial093.stdout: osd map max advance = 10 2026-02-22T23:22:58.910 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:22:58.910 INFO:teuthology.orchestra.run.trial093.stdout: journal zero on create = true 2026-02-22T23:22:58.910 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:22:58.910 INFO:teuthology.orchestra.run.trial093.stdout: filestore ondisk finisher threads = 3 2026-02-22T23:22:58.910 INFO:teuthology.orchestra.run.trial093.stdout: filestore apply finisher threads = 3 2026-02-22T23:22:58.911 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:22:58.911 INFO:teuthology.orchestra.run.trial093.stdout: bdev debug aio = true 2026-02-22T23:22:58.911 INFO:teuthology.orchestra.run.trial093.stdout: osd debug misdirected ops = true 2026-02-22T23:22:58.911 INFO:teuthology.orchestra.run.trial093.stdout: bdev async discard = True 2026-02-22T23:22:58.911 INFO:teuthology.orchestra.run.trial093.stdout: bdev enable discard = True 2026-02-22T23:22:58.911 INFO:teuthology.orchestra.run.trial093.stdout: bluestore allocator = stupid 2026-02-22T23:22:58.911 INFO:teuthology.orchestra.run.trial093.stdout: bluestore block size = 96636764160 2026-02-22T23:22:58.911 INFO:teuthology.orchestra.run.trial093.stdout: bluestore fsck on mount = True 2026-02-22T23:22:58.911 INFO:teuthology.orchestra.run.trial093.stdout: bluestore zero block detection = True 2026-02-22T23:22:58.911 INFO:teuthology.orchestra.run.trial093.stdout: debug bluefs = 20 2026-02-22T23:22:58.911 INFO:teuthology.orchestra.run.trial093.stdout: debug bluestore = 20 2026-02-22T23:22:58.912 INFO:teuthology.orchestra.run.trial093.stdout: debug ms = 1 2026-02-22T23:22:58.912 INFO:teuthology.orchestra.run.trial093.stdout: debug osd = 20 2026-02-22T23:22:58.912 INFO:teuthology.orchestra.run.trial093.stdout: debug rocksdb = 10 2026-02-22T23:22:58.912 INFO:teuthology.orchestra.run.trial093.stdout: mon osd backfillfull_ratio = 0.85 2026-02-22T23:22:58.912 INFO:teuthology.orchestra.run.trial093.stdout: mon osd full ratio = 0.9 2026-02-22T23:22:58.912 INFO:teuthology.orchestra.run.trial093.stdout: mon osd nearfull ratio = 0.8 2026-02-22T23:22:58.912 INFO:teuthology.orchestra.run.trial093.stdout: osd debug verify cached snaps = True 2026-02-22T23:22:58.912 INFO:teuthology.orchestra.run.trial093.stdout: osd debug verify missing on start = True 2026-02-22T23:22:58.912 INFO:teuthology.orchestra.run.trial093.stdout: osd failsafe full ratio = 0.95 2026-02-22T23:22:58.912 INFO:teuthology.orchestra.run.trial093.stdout: osd mclock override recovery settings = True 2026-02-22T23:22:58.912 INFO:teuthology.orchestra.run.trial093.stdout: osd objectstore = bluestore 2026-02-22T23:22:58.913 INFO:teuthology.orchestra.run.trial093.stdout: osd op queue = debug_random 2026-02-22T23:22:58.913 INFO:teuthology.orchestra.run.trial093.stdout: osd op queue cut off = debug_random 2026-02-22T23:22:58.913 INFO:teuthology.orchestra.run.trial093.stdout: osd shutdown pgref assert = True 2026-02-22T23:22:58.913 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:22:58.913 INFO:teuthology.orchestra.run.trial093.stdout:[mgr] 2026-02-22T23:22:58.913 INFO:teuthology.orchestra.run.trial093.stdout: debug ms = 1 2026-02-22T23:22:58.913 INFO:teuthology.orchestra.run.trial093.stdout: debug mgr = 20 2026-02-22T23:22:58.913 INFO:teuthology.orchestra.run.trial093.stdout: debug mon = 20 2026-02-22T23:22:58.913 INFO:teuthology.orchestra.run.trial093.stdout: debug auth = 20 2026-02-22T23:22:58.913 INFO:teuthology.orchestra.run.trial093.stdout: mon reweight min pgs per osd = 4 2026-02-22T23:22:58.913 INFO:teuthology.orchestra.run.trial093.stdout: mon reweight min bytes per osd = 10 2026-02-22T23:22:58.913 INFO:teuthology.orchestra.run.trial093.stdout: mgr/telemetry/nag = false 2026-02-22T23:22:58.914 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:22:58.914 INFO:teuthology.orchestra.run.trial093.stdout:[mon] 2026-02-22T23:22:58.914 INFO:teuthology.orchestra.run.trial093.stdout: debug ms = 1 2026-02-22T23:22:58.914 INFO:teuthology.orchestra.run.trial093.stdout: debug mon = 20 2026-02-22T23:22:58.914 INFO:teuthology.orchestra.run.trial093.stdout: debug paxos = 20 2026-02-22T23:22:58.914 INFO:teuthology.orchestra.run.trial093.stdout: debug auth = 20 2026-02-22T23:22:58.914 INFO:teuthology.orchestra.run.trial093.stdout: mon data avail warn = 5 2026-02-22T23:22:58.914 INFO:teuthology.orchestra.run.trial093.stdout: mon mgr mkfs grace = 240 2026-02-22T23:22:58.914 INFO:teuthology.orchestra.run.trial093.stdout: mon reweight min pgs per osd = 4 2026-02-22T23:22:58.914 INFO:teuthology.orchestra.run.trial093.stdout: mon osd reporter subtree level = osd 2026-02-22T23:22:58.915 INFO:teuthology.orchestra.run.trial093.stdout: mon osd prime pg temp = true 2026-02-22T23:22:58.915 INFO:teuthology.orchestra.run.trial093.stdout: mon reweight min bytes per osd = 10 2026-02-22T23:22:58.915 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:22:58.915 INFO:teuthology.orchestra.run.trial093.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-22T23:22:58.915 INFO:teuthology.orchestra.run.trial093.stdout: auth mon ticket ttl = 660 # 11m 2026-02-22T23:22:58.915 INFO:teuthology.orchestra.run.trial093.stdout: auth service ticket ttl = 240 # 4m 2026-02-22T23:22:58.915 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:22:58.915 INFO:teuthology.orchestra.run.trial093.stdout: # don't complain about insecure global_id in the test suite 2026-02-22T23:22:58.915 INFO:teuthology.orchestra.run.trial093.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-22T23:22:58.915 INFO:teuthology.orchestra.run.trial093.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-22T23:22:58.915 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:22:58.916 INFO:teuthology.orchestra.run.trial093.stdout: # 1m isn't quite enough 2026-02-22T23:22:58.916 INFO:teuthology.orchestra.run.trial093.stdout: mon_down_mkfs_grace = 2m 2026-02-22T23:22:58.916 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:22:58.916 INFO:teuthology.orchestra.run.trial093.stdout: mon_warn_on_filestore_osds = false 2026-02-22T23:22:58.916 INFO:teuthology.orchestra.run.trial093.stdout: mon min osdmap epochs = 50 2026-02-22T23:22:58.916 INFO:teuthology.orchestra.run.trial093.stdout: mon osdmap full prune interval = 2 2026-02-22T23:22:58.916 INFO:teuthology.orchestra.run.trial093.stdout: mon osdmap full prune min = 15 2026-02-22T23:22:58.916 INFO:teuthology.orchestra.run.trial093.stdout: mon osdmap full prune txsize = 2 2026-02-22T23:22:58.916 INFO:teuthology.orchestra.run.trial093.stdout: mon scrub interval = 300 2026-02-22T23:22:58.916 INFO:teuthology.orchestra.run.trial093.stdout: paxos service trim min = 10 2026-02-22T23:22:58.916 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:22:58.917 INFO:teuthology.orchestra.run.trial093.stdout:[client] 2026-02-22T23:22:58.917 INFO:teuthology.orchestra.run.trial093.stdout: rgw cache enabled = true 2026-02-22T23:22:58.917 INFO:teuthology.orchestra.run.trial093.stdout: rgw enable ops log = true 2026-02-22T23:22:58.917 INFO:teuthology.orchestra.run.trial093.stdout: rgw enable usage log = true 2026-02-22T23:22:58.917 INFO:teuthology.orchestra.run.trial093.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-22T23:22:58.917 INFO:teuthology.orchestra.run.trial093.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-22T23:22:58.917 INFO:teuthology.orchestra.run.trial093.stdout: debug cephsqlite = 20 2026-02-22T23:22:58.917 INFO:teuthology.orchestra.run.trial093.stdout: debug client = 20 2026-02-22T23:22:58.917 INFO:teuthology.orchestra.run.trial093.stdout: debug ms = 1 2026-02-22T23:22:58.917 INFO:teuthology.orchestra.run.trial093.stdout:[mon.a] 2026-02-22T23:22:58.917 INFO:teuthology.orchestra.run.trial093.stdout:[mon.c] 2026-02-22T23:22:58.917 INFO:teuthology.orchestra.run.trial093.stdout:[mon.b] 2026-02-22T23:22:58.920 INFO:teuthology.orchestra.run.trial155.stdout:[global] 2026-02-22T23:22:58.920 INFO:teuthology.orchestra.run.trial155.stdout: chdir = "" 2026-02-22T23:22:58.920 INFO:teuthology.orchestra.run.trial155.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-22T23:22:58.920 INFO:teuthology.orchestra.run.trial155.stdout: auth supported = cephx 2026-02-22T23:22:58.920 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:22:58.920 INFO:teuthology.orchestra.run.trial155.stdout: filestore xattr use omap = true 2026-02-22T23:22:58.920 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:22:58.921 INFO:teuthology.orchestra.run.trial155.stdout: mon clock drift allowed = 1.000 2026-02-22T23:22:58.921 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:22:58.921 INFO:teuthology.orchestra.run.trial155.stdout: osd crush chooseleaf type = 0 2026-02-22T23:22:58.921 INFO:teuthology.orchestra.run.trial155.stdout: auth debug = true 2026-02-22T23:22:58.921 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:22:58.921 INFO:teuthology.orchestra.run.trial155.stdout: ms die on old message = true 2026-02-22T23:22:58.921 INFO:teuthology.orchestra.run.trial155.stdout: ms die on bug = true 2026-02-22T23:22:58.921 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:22:58.921 INFO:teuthology.orchestra.run.trial155.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-22T23:22:58.921 INFO:teuthology.orchestra.run.trial155.stdout: mon pg warn max object skew = 0 2026-02-22T23:22:58.922 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:22:58.922 INFO:teuthology.orchestra.run.trial155.stdout: # disable pg_autoscaler by default for new pools 2026-02-22T23:22:58.922 INFO:teuthology.orchestra.run.trial155.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-22T23:22:58.922 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:22:58.922 INFO:teuthology.orchestra.run.trial155.stdout: osd pool default size = 2 2026-02-22T23:22:58.922 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:22:58.922 INFO:teuthology.orchestra.run.trial155.stdout: mon osd allow primary affinity = true 2026-02-22T23:22:58.922 INFO:teuthology.orchestra.run.trial155.stdout: mon osd allow pg remap = true 2026-02-22T23:22:58.922 INFO:teuthology.orchestra.run.trial155.stdout: mon warn on legacy crush tunables = false 2026-02-22T23:22:58.922 INFO:teuthology.orchestra.run.trial155.stdout: mon warn on crush straw calc version zero = false 2026-02-22T23:22:58.922 INFO:teuthology.orchestra.run.trial155.stdout: mon warn on no sortbitwise = false 2026-02-22T23:22:58.922 INFO:teuthology.orchestra.run.trial155.stdout: mon warn on osd down out interval zero = false 2026-02-22T23:22:58.922 INFO:teuthology.orchestra.run.trial155.stdout: mon warn on too few osds = false 2026-02-22T23:22:58.923 INFO:teuthology.orchestra.run.trial155.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-22T23:22:58.923 INFO:teuthology.orchestra.run.trial155.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-22T23:22:58.923 INFO:teuthology.orchestra.run.trial155.stdout: mon_allow_pool_size_one = true 2026-02-22T23:22:58.923 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:22:58.923 INFO:teuthology.orchestra.run.trial155.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-22T23:22:58.923 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:22:58.923 INFO:teuthology.orchestra.run.trial155.stdout: osd default data pool replay window = 5 2026-02-22T23:22:58.923 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:22:58.923 INFO:teuthology.orchestra.run.trial155.stdout: mon allow pool delete = true 2026-02-22T23:22:58.923 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:22:58.923 INFO:teuthology.orchestra.run.trial155.stdout: mon cluster log file level = debug 2026-02-22T23:22:58.923 INFO:teuthology.orchestra.run.trial155.stdout: debug asserts on shutdown = true 2026-02-22T23:22:58.924 INFO:teuthology.orchestra.run.trial155.stdout: mon health detail to clog = false 2026-02-22T23:22:58.924 INFO:teuthology.orchestra.run.trial155.stdout: mon host = "[v1:10.20.193.93:6789],[v1:10.20.193.93:6790],[v1:10.20.193.155:6789]" 2026-02-22T23:22:58.924 INFO:teuthology.orchestra.run.trial155.stdout: mon client directed command retry = 5 2026-02-22T23:22:58.924 INFO:teuthology.orchestra.run.trial155.stdout: mon election default strategy = 1 2026-02-22T23:22:58.924 INFO:teuthology.orchestra.run.trial155.stdout: ms bind msgr2 = False 2026-02-22T23:22:58.924 INFO:teuthology.orchestra.run.trial155.stdout: ms inject socket failures = 1500 2026-02-22T23:22:58.924 INFO:teuthology.orchestra.run.trial155.stdout: ms type = async 2026-02-22T23:22:58.924 INFO:teuthology.orchestra.run.trial155.stdout: fsid = 964c49d0-be38-4661-88a8-21893fbedc4f 2026-02-22T23:22:58.924 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:22:58.924 INFO:teuthology.orchestra.run.trial155.stdout:[osd] 2026-02-22T23:22:58.924 INFO:teuthology.orchestra.run.trial155.stdout: osd journal size = 100 2026-02-22T23:22:58.924 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:22:58.925 INFO:teuthology.orchestra.run.trial155.stdout: osd scrub load threshold = 5.0 2026-02-22T23:22:58.925 INFO:teuthology.orchestra.run.trial155.stdout: osd scrub max interval = 600 2026-02-22T23:22:58.925 INFO:teuthology.orchestra.run.trial155.stdout: osd mclock profile = high_recovery_ops 2026-02-22T23:22:58.925 INFO:teuthology.orchestra.run.trial155.stdout: osd mclock skip benchmark = True 2026-02-22T23:22:58.925 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:22:58.925 INFO:teuthology.orchestra.run.trial155.stdout: osd recover clone overlap = true 2026-02-22T23:22:58.925 INFO:teuthology.orchestra.run.trial155.stdout: osd recovery max chunk = 1048576 2026-02-22T23:22:58.925 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:22:58.925 INFO:teuthology.orchestra.run.trial155.stdout: osd debug shutdown = true 2026-02-22T23:22:58.925 INFO:teuthology.orchestra.run.trial155.stdout: osd debug op order = true 2026-02-22T23:22:58.925 INFO:teuthology.orchestra.run.trial155.stdout: osd debug verify stray on activate = true 2026-02-22T23:22:58.925 INFO:teuthology.orchestra.run.trial155.stdout: osd debug trim objects = true 2026-02-22T23:22:58.925 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:22:58.926 INFO:teuthology.orchestra.run.trial155.stdout: osd open classes on start = true 2026-02-22T23:22:58.926 INFO:teuthology.orchestra.run.trial155.stdout: osd debug pg log writeout = true 2026-02-22T23:22:58.926 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:22:58.926 INFO:teuthology.orchestra.run.trial155.stdout: osd deep scrub update digest min age = 30 2026-02-22T23:22:58.926 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:22:58.926 INFO:teuthology.orchestra.run.trial155.stdout: osd map max advance = 10 2026-02-22T23:22:58.926 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:22:58.926 INFO:teuthology.orchestra.run.trial155.stdout: journal zero on create = true 2026-02-22T23:22:58.926 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:22:58.926 INFO:teuthology.orchestra.run.trial155.stdout: filestore ondisk finisher threads = 3 2026-02-22T23:22:58.926 INFO:teuthology.orchestra.run.trial155.stdout: filestore apply finisher threads = 3 2026-02-22T23:22:58.926 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:22:58.926 INFO:teuthology.orchestra.run.trial155.stdout: bdev debug aio = true 2026-02-22T23:22:58.927 INFO:teuthology.orchestra.run.trial155.stdout: osd debug misdirected ops = true 2026-02-22T23:22:58.927 INFO:teuthology.orchestra.run.trial155.stdout: bdev async discard = True 2026-02-22T23:22:58.927 INFO:teuthology.orchestra.run.trial155.stdout: bdev enable discard = True 2026-02-22T23:22:58.927 INFO:teuthology.orchestra.run.trial155.stdout: bluestore allocator = stupid 2026-02-22T23:22:58.927 INFO:teuthology.orchestra.run.trial155.stdout: bluestore block size = 96636764160 2026-02-22T23:22:58.927 INFO:teuthology.orchestra.run.trial155.stdout: bluestore fsck on mount = True 2026-02-22T23:22:58.927 INFO:teuthology.orchestra.run.trial155.stdout: bluestore zero block detection = True 2026-02-22T23:22:58.927 INFO:teuthology.orchestra.run.trial155.stdout: debug bluefs = 20 2026-02-22T23:22:58.927 INFO:teuthology.orchestra.run.trial155.stdout: debug bluestore = 20 2026-02-22T23:22:58.927 INFO:teuthology.orchestra.run.trial155.stdout: debug ms = 1 2026-02-22T23:22:58.927 INFO:teuthology.orchestra.run.trial155.stdout: debug osd = 20 2026-02-22T23:22:58.927 INFO:teuthology.orchestra.run.trial155.stdout: debug rocksdb = 10 2026-02-22T23:22:58.927 INFO:teuthology.orchestra.run.trial155.stdout: mon osd backfillfull_ratio = 0.85 2026-02-22T23:22:58.928 INFO:teuthology.orchestra.run.trial155.stdout: mon osd full ratio = 0.9 2026-02-22T23:22:58.928 INFO:teuthology.orchestra.run.trial155.stdout: mon osd nearfull ratio = 0.8 2026-02-22T23:22:58.928 INFO:teuthology.orchestra.run.trial155.stdout: osd debug verify cached snaps = True 2026-02-22T23:22:58.928 INFO:teuthology.orchestra.run.trial155.stdout: osd debug verify missing on start = True 2026-02-22T23:22:58.928 INFO:teuthology.orchestra.run.trial155.stdout: osd failsafe full ratio = 0.95 2026-02-22T23:22:58.928 INFO:teuthology.orchestra.run.trial155.stdout: osd mclock override recovery settings = True 2026-02-22T23:22:58.928 INFO:teuthology.orchestra.run.trial155.stdout: osd objectstore = bluestore 2026-02-22T23:22:58.928 INFO:teuthology.orchestra.run.trial155.stdout: osd op queue = debug_random 2026-02-22T23:22:58.928 INFO:teuthology.orchestra.run.trial155.stdout: osd op queue cut off = debug_random 2026-02-22T23:22:58.928 INFO:teuthology.orchestra.run.trial155.stdout: osd shutdown pgref assert = True 2026-02-22T23:22:58.928 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:22:58.929 INFO:teuthology.orchestra.run.trial155.stdout:[mgr] 2026-02-22T23:22:58.929 INFO:teuthology.orchestra.run.trial155.stdout: debug ms = 1 2026-02-22T23:22:58.929 INFO:teuthology.orchestra.run.trial155.stdout: debug mgr = 20 2026-02-22T23:22:58.929 INFO:teuthology.orchestra.run.trial155.stdout: debug mon = 20 2026-02-22T23:22:58.929 INFO:teuthology.orchestra.run.trial155.stdout: debug auth = 20 2026-02-22T23:22:58.929 INFO:teuthology.orchestra.run.trial155.stdout: mon reweight min pgs per osd = 4 2026-02-22T23:22:58.929 INFO:teuthology.orchestra.run.trial155.stdout: mon reweight min bytes per osd = 10 2026-02-22T23:22:58.929 INFO:teuthology.orchestra.run.trial155.stdout: mgr/telemetry/nag = false 2026-02-22T23:22:58.929 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:22:58.929 INFO:teuthology.orchestra.run.trial155.stdout:[mon] 2026-02-22T23:22:58.929 INFO:teuthology.orchestra.run.trial155.stdout: debug ms = 1 2026-02-22T23:22:58.929 INFO:teuthology.orchestra.run.trial155.stdout: debug mon = 20 2026-02-22T23:22:58.930 INFO:teuthology.orchestra.run.trial155.stdout: debug paxos = 20 2026-02-22T23:22:58.930 INFO:teuthology.orchestra.run.trial155.stdout: debug auth = 20 2026-02-22T23:22:58.930 INFO:teuthology.orchestra.run.trial155.stdout: mon data avail warn = 5 2026-02-22T23:22:58.930 INFO:teuthology.orchestra.run.trial155.stdout: mon mgr mkfs grace = 240 2026-02-22T23:22:58.930 INFO:teuthology.orchestra.run.trial155.stdout: mon reweight min pgs per osd = 4 2026-02-22T23:22:58.930 INFO:teuthology.orchestra.run.trial155.stdout: mon osd reporter subtree level = osd 2026-02-22T23:22:58.930 INFO:teuthology.orchestra.run.trial155.stdout: mon osd prime pg temp = true 2026-02-22T23:22:58.930 INFO:teuthology.orchestra.run.trial155.stdout: mon reweight min bytes per osd = 10 2026-02-22T23:22:58.930 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:22:58.930 INFO:teuthology.orchestra.run.trial155.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-22T23:22:58.930 INFO:teuthology.orchestra.run.trial155.stdout: auth mon ticket ttl = 660 # 11m 2026-02-22T23:22:58.930 INFO:teuthology.orchestra.run.trial155.stdout: auth service ticket ttl = 240 # 4m 2026-02-22T23:22:58.930 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:22:58.931 INFO:teuthology.orchestra.run.trial155.stdout: # don't complain about insecure global_id in the test suite 2026-02-22T23:22:58.931 INFO:teuthology.orchestra.run.trial155.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-22T23:22:58.931 INFO:teuthology.orchestra.run.trial155.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-22T23:22:58.931 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:22:58.931 INFO:teuthology.orchestra.run.trial155.stdout: # 1m isn't quite enough 2026-02-22T23:22:58.931 INFO:teuthology.orchestra.run.trial155.stdout: mon_down_mkfs_grace = 2m 2026-02-22T23:22:58.931 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:22:58.931 INFO:teuthology.orchestra.run.trial155.stdout: mon_warn_on_filestore_osds = false 2026-02-22T23:22:58.931 INFO:teuthology.orchestra.run.trial155.stdout: mon min osdmap epochs = 50 2026-02-22T23:22:58.931 INFO:teuthology.orchestra.run.trial155.stdout: mon osdmap full prune interval = 2 2026-02-22T23:22:58.931 INFO:teuthology.orchestra.run.trial155.stdout: mon osdmap full prune min = 15 2026-02-22T23:22:58.931 INFO:teuthology.orchestra.run.trial155.stdout: mon osdmap full prune txsize = 2 2026-02-22T23:22:58.931 INFO:teuthology.orchestra.run.trial155.stdout: mon scrub interval = 300 2026-02-22T23:22:58.932 INFO:teuthology.orchestra.run.trial155.stdout: paxos service trim min = 10 2026-02-22T23:22:58.932 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T23:22:58.932 INFO:teuthology.orchestra.run.trial155.stdout:[client] 2026-02-22T23:22:58.932 INFO:teuthology.orchestra.run.trial155.stdout: rgw cache enabled = true 2026-02-22T23:22:58.932 INFO:teuthology.orchestra.run.trial155.stdout: rgw enable ops log = true 2026-02-22T23:22:58.932 INFO:teuthology.orchestra.run.trial155.stdout: rgw enable usage log = true 2026-02-22T23:22:58.932 INFO:teuthology.orchestra.run.trial155.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-22T23:22:58.932 INFO:teuthology.orchestra.run.trial155.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-22T23:22:58.932 INFO:teuthology.orchestra.run.trial155.stdout: debug cephsqlite = 20 2026-02-22T23:22:58.932 INFO:teuthology.orchestra.run.trial155.stdout: debug client = 20 2026-02-22T23:22:58.932 INFO:teuthology.orchestra.run.trial155.stdout: debug ms = 1 2026-02-22T23:22:58.932 INFO:teuthology.orchestra.run.trial155.stdout:[mon.a] 2026-02-22T23:22:58.932 INFO:teuthology.orchestra.run.trial155.stdout:[mon.c] 2026-02-22T23:22:58.933 INFO:teuthology.orchestra.run.trial155.stdout:[mon.b] 2026-02-22T23:22:58.933 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-22T23:22:58.933 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-22T23:22:59.002 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-22T23:22:59.002 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-22T23:22:59.003 DEBUG:teuthology.orchestra.run.trial093:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-22T23:22:59.057 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-22T23:22:59.057 DEBUG:teuthology.orchestra.run.trial093:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-22T23:22:59.114 INFO:tasks.ceph:Sending monmap to node ubuntu@trial093.front.sepia.ceph.com 2026-02-22T23:22:59.114 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-22T23:22:59.115 DEBUG:teuthology.orchestra.run.trial093:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-22T23:22:59.115 DEBUG:teuthology.orchestra.run.trial093:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-22T23:22:59.188 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-22T23:22:59.188 DEBUG:teuthology.orchestra.run.trial093:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-22T23:22:59.245 INFO:tasks.ceph:Sending monmap to node ubuntu@trial155.front.sepia.ceph.com 2026-02-22T23:22:59.245 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T23:22:59.245 DEBUG:teuthology.orchestra.run.trial155:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-22T23:22:59.245 DEBUG:teuthology.orchestra.run.trial155:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-22T23:22:59.279 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T23:22:59.279 DEBUG:teuthology.orchestra.run.trial155:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-22T23:22:59.334 INFO:tasks.ceph:Setting up mon nodes... 2026-02-22T23:22:59.335 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-22T23:22:59.335 DEBUG:teuthology.orchestra.run.trial093:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2026-02-22T23:22:59.379 INFO:teuthology.orchestra.run.trial093.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2026-02-22T23:22:59.382 DEBUG:teuthology.orchestra.run.trial155:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-22T23:22:59.425 INFO:teuthology.orchestra.run.trial155.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-22T23:22:59.427 INFO:tasks.ceph:Setting up mds nodes... 2026-02-22T23:22:59.428 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-22T23:22:59.428 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-22T23:22:59.464 INFO:teuthology.orchestra.run.trial093.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-22T23:22:59.475 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2026-02-22T23:22:59.511 INFO:teuthology.orchestra.run.trial155.stdout:creating /etc/ceph/ceph.client.1.keyring 2026-02-22T23:22:59.522 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-22T23:22:59.523 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial093.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial155.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2026-02-22T23:22:59.523 DEBUG:teuthology.orchestra.run.trial093:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-22T23:22:59.547 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-22T23:22:59.547 INFO:tasks.ceph:role: osd.0 2026-02-22T23:22:59.548 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial093.front.sepia.ceph.com 2026-02-22T23:22:59.548 DEBUG:teuthology.orchestra.run.trial093:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-22T23:22:59.612 INFO:teuthology.orchestra.run.trial093.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-22T23:22:59.612 INFO:teuthology.orchestra.run.trial093.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-22T23:22:59.612 INFO:teuthology.orchestra.run.trial093.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-22T23:22:59.612 INFO:teuthology.orchestra.run.trial093.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-22T23:22:59.612 INFO:teuthology.orchestra.run.trial093.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-22T23:22:59.612 INFO:teuthology.orchestra.run.trial093.stdout: = sunit=0 swidth=0 blks 2026-02-22T23:22:59.612 INFO:teuthology.orchestra.run.trial093.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-22T23:22:59.613 INFO:teuthology.orchestra.run.trial093.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-22T23:22:59.613 INFO:teuthology.orchestra.run.trial093.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-22T23:22:59.613 INFO:teuthology.orchestra.run.trial093.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-22T23:23:00.200 INFO:teuthology.orchestra.run.trial093.stdout:Discarding blocks...Done. 2026-02-22T23:23:00.202 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial093.front.sepia.ceph.com -o noatime 2026-02-22T23:23:00.202 DEBUG:teuthology.orchestra.run.trial093:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-22T23:23:00.270 DEBUG:teuthology.orchestra.run.trial093:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-22T23:23:00.337 DEBUG:teuthology.orchestra.run.trial093:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-22T23:23:00.401 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-22T23:23:00.401 INFO:tasks.ceph:role: osd.1 2026-02-22T23:23:00.401 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial093.front.sepia.ceph.com 2026-02-22T23:23:00.401 DEBUG:teuthology.orchestra.run.trial093:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-22T23:23:00.465 INFO:teuthology.orchestra.run.trial093.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-22T23:23:00.465 INFO:teuthology.orchestra.run.trial093.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-22T23:23:00.465 INFO:teuthology.orchestra.run.trial093.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-22T23:23:00.465 INFO:teuthology.orchestra.run.trial093.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-22T23:23:00.465 INFO:teuthology.orchestra.run.trial093.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-22T23:23:00.465 INFO:teuthology.orchestra.run.trial093.stdout: = sunit=0 swidth=0 blks 2026-02-22T23:23:00.466 INFO:teuthology.orchestra.run.trial093.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-22T23:23:00.466 INFO:teuthology.orchestra.run.trial093.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-22T23:23:00.466 INFO:teuthology.orchestra.run.trial093.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-22T23:23:00.466 INFO:teuthology.orchestra.run.trial093.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-22T23:23:01.025 INFO:teuthology.orchestra.run.trial093.stdout:Discarding blocks...Done. 2026-02-22T23:23:01.027 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial093.front.sepia.ceph.com -o noatime 2026-02-22T23:23:01.027 DEBUG:teuthology.orchestra.run.trial093:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-22T23:23:01.096 DEBUG:teuthology.orchestra.run.trial093:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-22T23:23:01.163 DEBUG:teuthology.orchestra.run.trial093:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-22T23:23:01.228 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-22T23:23:01.228 INFO:tasks.ceph:role: osd.2 2026-02-22T23:23:01.228 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial093.front.sepia.ceph.com 2026-02-22T23:23:01.228 DEBUG:teuthology.orchestra.run.trial093:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-22T23:23:01.292 INFO:teuthology.orchestra.run.trial093.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-22T23:23:01.292 INFO:teuthology.orchestra.run.trial093.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-22T23:23:01.292 INFO:teuthology.orchestra.run.trial093.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-22T23:23:01.292 INFO:teuthology.orchestra.run.trial093.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-22T23:23:01.292 INFO:teuthology.orchestra.run.trial093.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-22T23:23:01.292 INFO:teuthology.orchestra.run.trial093.stdout: = sunit=0 swidth=0 blks 2026-02-22T23:23:01.293 INFO:teuthology.orchestra.run.trial093.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-22T23:23:01.293 INFO:teuthology.orchestra.run.trial093.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-22T23:23:01.293 INFO:teuthology.orchestra.run.trial093.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-22T23:23:01.293 INFO:teuthology.orchestra.run.trial093.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-22T23:23:01.863 INFO:teuthology.orchestra.run.trial093.stdout:Discarding blocks...Done. 2026-02-22T23:23:01.865 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial093.front.sepia.ceph.com -o noatime 2026-02-22T23:23:01.865 DEBUG:teuthology.orchestra.run.trial093:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2026-02-22T23:23:01.932 DEBUG:teuthology.orchestra.run.trial093:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-22T23:23:01.999 DEBUG:teuthology.orchestra.run.trial093:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2026-02-22T23:23:02.063 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-22T23:23:02.063 INFO:tasks.ceph:role: osd.3 2026-02-22T23:23:02.063 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial093.front.sepia.ceph.com 2026-02-22T23:23:02.064 DEBUG:teuthology.orchestra.run.trial093:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-22T23:23:02.130 INFO:teuthology.orchestra.run.trial093.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-22T23:23:02.130 INFO:teuthology.orchestra.run.trial093.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-22T23:23:02.130 INFO:teuthology.orchestra.run.trial093.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-22T23:23:02.130 INFO:teuthology.orchestra.run.trial093.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-22T23:23:02.130 INFO:teuthology.orchestra.run.trial093.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-22T23:23:02.130 INFO:teuthology.orchestra.run.trial093.stdout: = sunit=0 swidth=0 blks 2026-02-22T23:23:02.130 INFO:teuthology.orchestra.run.trial093.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-22T23:23:02.131 INFO:teuthology.orchestra.run.trial093.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-22T23:23:02.131 INFO:teuthology.orchestra.run.trial093.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-22T23:23:02.131 INFO:teuthology.orchestra.run.trial093.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-22T23:23:02.689 INFO:teuthology.orchestra.run.trial093.stdout:Discarding blocks...Done. 2026-02-22T23:23:02.691 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial093.front.sepia.ceph.com -o noatime 2026-02-22T23:23:02.691 DEBUG:teuthology.orchestra.run.trial093:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2026-02-22T23:23:02.759 DEBUG:teuthology.orchestra.run.trial093:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2026-02-22T23:23:02.825 DEBUG:teuthology.orchestra.run.trial093:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T23:23:02.904 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:02.902+0000 7f74f8e20780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-22T23:23:02.905 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:02.903+0000 7f74f8e20780 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-22T23:23:02.905 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:02.903+0000 7f74f8e20780 -1 bdev(0x5616b03af800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2026-02-22T23:23:02.905 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:02.903+0000 7f74f8e20780 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-22T23:23:06.791 DEBUG:teuthology.orchestra.run.trial093:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-22T23:23:06.856 DEBUG:teuthology.orchestra.run.trial093:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T23:23:06.934 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:06.931+0000 7fbc8ead0780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-22T23:23:06.935 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:06.931+0000 7fbc8ead0780 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-22T23:23:06.935 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:06.931+0000 7fbc8ead0780 -1 bdev(0x561ee1167800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2026-02-22T23:23:06.935 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:06.931+0000 7fbc8ead0780 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-22T23:23:10.830 DEBUG:teuthology.orchestra.run.trial093:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-22T23:23:10.895 DEBUG:teuthology.orchestra.run.trial093:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T23:23:10.973 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:10.970+0000 7fdc98316780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2026-02-22T23:23:10.974 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:10.971+0000 7fdc98316780 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2026-02-22T23:23:10.974 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:10.971+0000 7fdc98316780 -1 bdev(0x55d5c7fdd800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2026-02-22T23:23:10.974 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:10.971+0000 7fdc98316780 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2026-02-22T23:23:14.860 DEBUG:teuthology.orchestra.run.trial093:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-22T23:23:14.926 DEBUG:teuthology.orchestra.run.trial093:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T23:23:15.005 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:15.002+0000 7f805f6e7780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2026-02-22T23:23:15.006 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:15.002+0000 7f805f6e7780 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2026-02-22T23:23:15.006 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:15.002+0000 7f805f6e7780 -1 bdev(0x561f0fe5f800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2026-02-22T23:23:15.007 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:15.003+0000 7f805f6e7780 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2026-02-22T23:23:18.908 DEBUG:teuthology.orchestra.run.trial093:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2026-02-22T23:23:18.972 DEBUG:teuthology.orchestra.run.trial155:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2026-02-22T23:23:18.998 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2026-02-22T23:23:18.998 INFO:tasks.ceph:role: osd.4 2026-02-22T23:23:18.998 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial155.front.sepia.ceph.com 2026-02-22T23:23:18.998 DEBUG:teuthology.orchestra.run.trial155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-22T23:23:19.063 INFO:teuthology.orchestra.run.trial155.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-22T23:23:19.063 INFO:teuthology.orchestra.run.trial155.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-22T23:23:19.063 INFO:teuthology.orchestra.run.trial155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-22T23:23:19.064 INFO:teuthology.orchestra.run.trial155.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-22T23:23:19.064 INFO:teuthology.orchestra.run.trial155.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-22T23:23:19.064 INFO:teuthology.orchestra.run.trial155.stdout: = sunit=0 swidth=0 blks 2026-02-22T23:23:19.064 INFO:teuthology.orchestra.run.trial155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-22T23:23:19.064 INFO:teuthology.orchestra.run.trial155.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-22T23:23:19.064 INFO:teuthology.orchestra.run.trial155.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-22T23:23:19.064 INFO:teuthology.orchestra.run.trial155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-22T23:23:19.633 INFO:teuthology.orchestra.run.trial155.stdout:Discarding blocks...Done. 2026-02-22T23:23:19.634 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial155.front.sepia.ceph.com -o noatime 2026-02-22T23:23:19.634 DEBUG:teuthology.orchestra.run.trial155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2026-02-22T23:23:19.703 DEBUG:teuthology.orchestra.run.trial155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2026-02-22T23:23:19.769 DEBUG:teuthology.orchestra.run.trial155:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2026-02-22T23:23:19.833 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2026-02-22T23:23:19.833 INFO:tasks.ceph:role: osd.5 2026-02-22T23:23:19.833 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial155.front.sepia.ceph.com 2026-02-22T23:23:19.833 DEBUG:teuthology.orchestra.run.trial155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-22T23:23:19.898 INFO:teuthology.orchestra.run.trial155.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-22T23:23:19.898 INFO:teuthology.orchestra.run.trial155.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-22T23:23:19.898 INFO:teuthology.orchestra.run.trial155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-22T23:23:19.898 INFO:teuthology.orchestra.run.trial155.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-22T23:23:19.898 INFO:teuthology.orchestra.run.trial155.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-22T23:23:19.898 INFO:teuthology.orchestra.run.trial155.stdout: = sunit=0 swidth=0 blks 2026-02-22T23:23:19.898 INFO:teuthology.orchestra.run.trial155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-22T23:23:19.898 INFO:teuthology.orchestra.run.trial155.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-22T23:23:19.898 INFO:teuthology.orchestra.run.trial155.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-22T23:23:19.898 INFO:teuthology.orchestra.run.trial155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-22T23:23:20.456 INFO:teuthology.orchestra.run.trial155.stdout:Discarding blocks...Done. 2026-02-22T23:23:20.458 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial155.front.sepia.ceph.com -o noatime 2026-02-22T23:23:20.459 DEBUG:teuthology.orchestra.run.trial155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2026-02-22T23:23:20.526 DEBUG:teuthology.orchestra.run.trial155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2026-02-22T23:23:20.592 DEBUG:teuthology.orchestra.run.trial155:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2026-02-22T23:23:20.657 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2026-02-22T23:23:20.657 INFO:tasks.ceph:role: osd.6 2026-02-22T23:23:20.657 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial155.front.sepia.ceph.com 2026-02-22T23:23:20.657 DEBUG:teuthology.orchestra.run.trial155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-22T23:23:20.721 INFO:teuthology.orchestra.run.trial155.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-22T23:23:20.721 INFO:teuthology.orchestra.run.trial155.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-22T23:23:20.722 INFO:teuthology.orchestra.run.trial155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-22T23:23:20.722 INFO:teuthology.orchestra.run.trial155.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-22T23:23:20.722 INFO:teuthology.orchestra.run.trial155.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-22T23:23:20.722 INFO:teuthology.orchestra.run.trial155.stdout: = sunit=0 swidth=0 blks 2026-02-22T23:23:20.722 INFO:teuthology.orchestra.run.trial155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-22T23:23:20.722 INFO:teuthology.orchestra.run.trial155.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-22T23:23:20.722 INFO:teuthology.orchestra.run.trial155.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-22T23:23:20.722 INFO:teuthology.orchestra.run.trial155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-22T23:23:21.296 INFO:teuthology.orchestra.run.trial155.stdout:Discarding blocks...Done. 2026-02-22T23:23:21.298 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial155.front.sepia.ceph.com -o noatime 2026-02-22T23:23:21.298 DEBUG:teuthology.orchestra.run.trial155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2026-02-22T23:23:21.365 DEBUG:teuthology.orchestra.run.trial155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2026-02-22T23:23:21.432 DEBUG:teuthology.orchestra.run.trial155:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2026-02-22T23:23:21.497 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2026-02-22T23:23:21.497 INFO:tasks.ceph:role: osd.7 2026-02-22T23:23:21.497 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial155.front.sepia.ceph.com 2026-02-22T23:23:21.497 DEBUG:teuthology.orchestra.run.trial155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-22T23:23:21.561 INFO:teuthology.orchestra.run.trial155.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-22T23:23:21.561 INFO:teuthology.orchestra.run.trial155.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-22T23:23:21.561 INFO:teuthology.orchestra.run.trial155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-22T23:23:21.562 INFO:teuthology.orchestra.run.trial155.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-22T23:23:21.562 INFO:teuthology.orchestra.run.trial155.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-22T23:23:21.562 INFO:teuthology.orchestra.run.trial155.stdout: = sunit=0 swidth=0 blks 2026-02-22T23:23:21.562 INFO:teuthology.orchestra.run.trial155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-22T23:23:21.562 INFO:teuthology.orchestra.run.trial155.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-22T23:23:21.562 INFO:teuthology.orchestra.run.trial155.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-22T23:23:21.562 INFO:teuthology.orchestra.run.trial155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-22T23:23:22.117 INFO:teuthology.orchestra.run.trial155.stdout:Discarding blocks...Done. 2026-02-22T23:23:22.119 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial155.front.sepia.ceph.com -o noatime 2026-02-22T23:23:22.119 DEBUG:teuthology.orchestra.run.trial155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2026-02-22T23:23:22.188 DEBUG:teuthology.orchestra.run.trial155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2026-02-22T23:23:22.255 DEBUG:teuthology.orchestra.run.trial155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T23:23:22.331 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:22.349+0000 7f79f7334780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2026-02-22T23:23:22.332 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:22.349+0000 7f79f7334780 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2026-02-22T23:23:22.332 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:22.349+0000 7f79f7334780 -1 bdev(0x5590d8781800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2026-02-22T23:23:22.332 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:22.349+0000 7f79f7334780 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2026-02-22T23:23:26.221 DEBUG:teuthology.orchestra.run.trial155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2026-02-22T23:23:26.287 DEBUG:teuthology.orchestra.run.trial155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T23:23:26.365 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:26.383+0000 7f826880c780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2026-02-22T23:23:26.366 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:26.383+0000 7f826880c780 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2026-02-22T23:23:26.366 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:26.383+0000 7f826880c780 -1 bdev(0x5642c48f5800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2026-02-22T23:23:26.366 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:26.383+0000 7f826880c780 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2026-02-22T23:23:30.254 DEBUG:teuthology.orchestra.run.trial155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2026-02-22T23:23:30.319 DEBUG:teuthology.orchestra.run.trial155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T23:23:30.399 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:30.416+0000 7f688fbf9780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2026-02-22T23:23:30.399 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:30.416+0000 7f688fbf9780 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2026-02-22T23:23:30.399 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:30.416+0000 7f688fbf9780 -1 bdev(0x556b94d65800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2026-02-22T23:23:30.399 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:30.416+0000 7f688fbf9780 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2026-02-22T23:23:34.296 DEBUG:teuthology.orchestra.run.trial155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2026-02-22T23:23:34.361 DEBUG:teuthology.orchestra.run.trial155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T23:23:34.441 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:34.458+0000 7f2d6960f780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2026-02-22T23:23:34.441 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:34.458+0000 7f2d6960f780 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2026-02-22T23:23:34.441 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:34.458+0000 7f2d6960f780 -1 bdev(0x55ace9e43800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2026-02-22T23:23:34.442 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:34.458+0000 7f2d6960f780 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2026-02-22T23:23:38.330 DEBUG:teuthology.orchestra.run.trial155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2026-02-22T23:23:38.396 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-22T23:23:38.397 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-22T23:23:38.397 DEBUG:teuthology.orchestra.run.trial093:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2026-02-22T23:23:38.422 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-22T23:23:38.422 DEBUG:teuthology.orchestra.run.trial093:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-22T23:23:38.487 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-22T23:23:38.487 DEBUG:teuthology.orchestra.run.trial093:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-22T23:23:38.550 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-22T23:23:38.550 DEBUG:teuthology.orchestra.run.trial093:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-22T23:23:38.615 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-22T23:23:38.615 DEBUG:teuthology.orchestra.run.trial093:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2026-02-22T23:23:38.678 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T23:23:38.679 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-22T23:23:38.705 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T23:23:38.705 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2026-02-22T23:23:38.769 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T23:23:38.770 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2026-02-22T23:23:38.836 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T23:23:38.836 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2026-02-22T23:23:38.899 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T23:23:38.899 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2026-02-22T23:23:38.963 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-22T23:23:38.963 DEBUG:teuthology.orchestra.run.trial093:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-22T23:23:38.980 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T23:23:38.980 DEBUG:teuthology.orchestra.run.trial155:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2026-02-22T23:23:39.019 INFO:tasks.ceph:Adding keys to all mons... 2026-02-22T23:23:39.020 DEBUG:teuthology.orchestra.run.trial093:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-22T23:23:39.022 DEBUG:teuthology.orchestra.run.trial155:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-22T23:23:39.063 INFO:teuthology.orchestra.run.trial093.stdout:[mgr.y] 2026-02-22T23:23:39.063 INFO:teuthology.orchestra.run.trial093.stdout: key = AQDTj5tp4+KFFhAAV3vHqyffiQC797nosmWpNQ== 2026-02-22T23:23:39.064 INFO:teuthology.orchestra.run.trial093.stdout:[osd.0] 2026-02-22T23:23:39.064 INFO:teuthology.orchestra.run.trial093.stdout: key = AQDWj5tp5jLXNRAASWrh5Si3+tUy0994XrzCjw== 2026-02-22T23:23:39.064 INFO:teuthology.orchestra.run.trial093.stdout:[osd.1] 2026-02-22T23:23:39.064 INFO:teuthology.orchestra.run.trial093.stdout: key = AQDaj5tpS7aYNxAAMBmnT3a92wh/CXHY2kNPiA== 2026-02-22T23:23:39.064 INFO:teuthology.orchestra.run.trial093.stdout:[osd.2] 2026-02-22T23:23:39.064 INFO:teuthology.orchestra.run.trial093.stdout: key = AQDej5tpbrnyORAATASzIT7TGqTLKOncSCCDgw== 2026-02-22T23:23:39.065 INFO:teuthology.orchestra.run.trial093.stdout:[osd.3] 2026-02-22T23:23:39.065 INFO:teuthology.orchestra.run.trial093.stdout: key = AQDjj5tpakc8ABAAkOG23JO6w8mHtZZqGfBQxQ== 2026-02-22T23:23:39.065 INFO:teuthology.orchestra.run.trial093.stdout:[mgr.x] 2026-02-22T23:23:39.065 INFO:teuthology.orchestra.run.trial093.stdout: key = AQDTj5tpFCKAGhAArnemxg6kadOCjMBEy9lzIA== 2026-02-22T23:23:39.065 INFO:teuthology.orchestra.run.trial093.stdout:[osd.4] 2026-02-22T23:23:39.065 INFO:teuthology.orchestra.run.trial093.stdout: key = AQDqj5tpzN7oFBAAMNGATpXeSq20r/YPcf2niQ== 2026-02-22T23:23:39.065 INFO:teuthology.orchestra.run.trial093.stdout:[osd.5] 2026-02-22T23:23:39.065 INFO:teuthology.orchestra.run.trial093.stdout: key = AQDuj5tp2hv1FhAAIQ9S20Pe4M3p47usiMlBzA== 2026-02-22T23:23:39.065 INFO:teuthology.orchestra.run.trial093.stdout:[osd.6] 2026-02-22T23:23:39.065 INFO:teuthology.orchestra.run.trial093.stdout: key = AQDyj5tp/GDsGBAAFq54G1I9ve5ikIHZR38uRg== 2026-02-22T23:23:39.066 INFO:teuthology.orchestra.run.trial093.stdout:[osd.7] 2026-02-22T23:23:39.066 INFO:teuthology.orchestra.run.trial093.stdout: key = AQD2j5tpavpsGxAARHjUvn+BfncNfl3r2Y75xw== 2026-02-22T23:23:39.066 INFO:teuthology.orchestra.run.trial093.stdout:[client.0] 2026-02-22T23:23:39.066 INFO:teuthology.orchestra.run.trial093.stdout: key = AQDTj5tpKFmRGxAANaWSuWnfQM43RNk0dOt5LQ== 2026-02-22T23:23:39.066 INFO:teuthology.orchestra.run.trial093.stdout:[client.1] 2026-02-22T23:23:39.066 INFO:teuthology.orchestra.run.trial093.stdout: key = AQDTj5tppLKkHxAAk7dP/Cwm07mrOlthGddItg== 2026-02-22T23:23:39.083 INFO:teuthology.orchestra.run.trial155.stdout:[mgr.y] 2026-02-22T23:23:39.083 INFO:teuthology.orchestra.run.trial155.stdout: key = AQDTj5tp4+KFFhAAV3vHqyffiQC797nosmWpNQ== 2026-02-22T23:23:39.083 INFO:teuthology.orchestra.run.trial155.stdout:[osd.0] 2026-02-22T23:23:39.083 INFO:teuthology.orchestra.run.trial155.stdout: key = AQDWj5tp5jLXNRAASWrh5Si3+tUy0994XrzCjw== 2026-02-22T23:23:39.083 INFO:teuthology.orchestra.run.trial155.stdout:[osd.1] 2026-02-22T23:23:39.083 INFO:teuthology.orchestra.run.trial155.stdout: key = AQDaj5tpS7aYNxAAMBmnT3a92wh/CXHY2kNPiA== 2026-02-22T23:23:39.083 INFO:teuthology.orchestra.run.trial155.stdout:[osd.2] 2026-02-22T23:23:39.083 INFO:teuthology.orchestra.run.trial155.stdout: key = AQDej5tpbrnyORAATASzIT7TGqTLKOncSCCDgw== 2026-02-22T23:23:39.083 INFO:teuthology.orchestra.run.trial155.stdout:[osd.3] 2026-02-22T23:23:39.083 INFO:teuthology.orchestra.run.trial155.stdout: key = AQDjj5tpakc8ABAAkOG23JO6w8mHtZZqGfBQxQ== 2026-02-22T23:23:39.083 INFO:teuthology.orchestra.run.trial155.stdout:[mgr.x] 2026-02-22T23:23:39.083 INFO:teuthology.orchestra.run.trial155.stdout: key = AQDTj5tpFCKAGhAArnemxg6kadOCjMBEy9lzIA== 2026-02-22T23:23:39.083 INFO:teuthology.orchestra.run.trial155.stdout:[osd.4] 2026-02-22T23:23:39.083 INFO:teuthology.orchestra.run.trial155.stdout: key = AQDqj5tpzN7oFBAAMNGATpXeSq20r/YPcf2niQ== 2026-02-22T23:23:39.083 INFO:teuthology.orchestra.run.trial155.stdout:[osd.5] 2026-02-22T23:23:39.083 INFO:teuthology.orchestra.run.trial155.stdout: key = AQDuj5tp2hv1FhAAIQ9S20Pe4M3p47usiMlBzA== 2026-02-22T23:23:39.083 INFO:teuthology.orchestra.run.trial155.stdout:[osd.6] 2026-02-22T23:23:39.083 INFO:teuthology.orchestra.run.trial155.stdout: key = AQDyj5tp/GDsGBAAFq54G1I9ve5ikIHZR38uRg== 2026-02-22T23:23:39.083 INFO:teuthology.orchestra.run.trial155.stdout:[osd.7] 2026-02-22T23:23:39.083 INFO:teuthology.orchestra.run.trial155.stdout: key = AQD2j5tpavpsGxAARHjUvn+BfncNfl3r2Y75xw== 2026-02-22T23:23:39.083 INFO:teuthology.orchestra.run.trial155.stdout:[client.0] 2026-02-22T23:23:39.083 INFO:teuthology.orchestra.run.trial155.stdout: key = AQDTj5tpKFmRGxAANaWSuWnfQM43RNk0dOt5LQ== 2026-02-22T23:23:39.083 INFO:teuthology.orchestra.run.trial155.stdout:[client.1] 2026-02-22T23:23:39.083 INFO:teuthology.orchestra.run.trial155.stdout: key = AQDTj5tppLKkHxAAk7dP/Cwm07mrOlthGddItg== 2026-02-22T23:23:39.084 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-22T23:23:39.110 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-22T23:23:39.165 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T23:23:39.190 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T23:23:39.243 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T23:23:39.270 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T23:23:39.322 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T23:23:39.351 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T23:23:39.403 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T23:23:39.431 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T23:23:39.481 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-22T23:23:39.511 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-22T23:23:39.559 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T23:23:39.590 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T23:23:39.638 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T23:23:39.669 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T23:23:39.719 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T23:23:39.748 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T23:23:39.796 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T23:23:39.827 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T23:23:39.874 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-22T23:23:39.907 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-22T23:23:39.954 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-22T23:23:39.989 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-22T23:23:40.035 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-22T23:23:40.035 DEBUG:teuthology.orchestra.run.trial093:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-22T23:23:40.089 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-22T23:23:40.173 DEBUG:teuthology.orchestra.run.trial093:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-22T23:23:40.238 DEBUG:teuthology.orchestra.run.trial093:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2026-02-22T23:23:40.302 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-22T23:23:40.387 DEBUG:teuthology.orchestra.run.trial093:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2026-02-22T23:23:40.412 DEBUG:teuthology.orchestra.run.trial155:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2026-02-22T23:23:40.438 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-22T23:23:40.525 DEBUG:teuthology.orchestra.run.trial155:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2026-02-22T23:23:40.550 DEBUG:teuthology.orchestra.run.trial093:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-22T23:23:40.554 DEBUG:teuthology.orchestra.run.trial155:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-22T23:23:40.606 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-22T23:23:40.606 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-22T23:23:40.607 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-22T23:23:40.610 INFO:tasks.ceph.mon.a:Started 2026-02-22T23:23:40.611 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-22T23:23:40.611 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-22T23:23:40.612 INFO:tasks.ceph.mon.c:Started 2026-02-22T23:23:40.612 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-22T23:23:40.612 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-22T23:23:40.649 INFO:tasks.ceph.mon.b:Started 2026-02-22T23:23:40.649 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-22T23:23:40.649 INFO:tasks.ceph.mgr.y:Restarting daemon 2026-02-22T23:23:40.650 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2026-02-22T23:23:40.652 INFO:tasks.ceph.mgr.y:Started 2026-02-22T23:23:40.652 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-22T23:23:40.653 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-22T23:23:40.655 INFO:tasks.ceph.mgr.x:Started 2026-02-22T23:23:40.655 INFO:tasks.ceph:Setting crush tunables to default 2026-02-22T23:23:40.655 DEBUG:teuthology.orchestra.run.trial093:> sudo ceph --cluster ceph osd crush tunables default 2026-02-22T23:23:40.721 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.718+0000 7f8f0e3ce640 1 Processor -- start 2026-02-22T23:23:40.721 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.718+0000 7f8f0e3ce640 1 -- start start 2026-02-22T23:23:40.722 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.719+0000 7f8f0e3ce640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f0813ee30 con 0x7f8f08144a00 2026-02-22T23:23:40.722 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.719+0000 7f8f0e3ce640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f08144de0 con 0x7f8f0813ea10 2026-02-22T23:23:40.722 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.719+0000 7f8f0e3ce640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f08074040 con 0x7f8f081452d0 2026-02-22T23:23:40.722 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.719+0000 7f8f07fff640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7f8f08144a00 0x7f8f080afa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:55668/0 (socket says 10.20.193.93:55668) 2026-02-22T23:23:40.722 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.719+0000 7f8f07fff640 1 -- 10.20.193.93:0/2374479992 learned_addr learned my addr 10.20.193.93:0/2374479992 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:23:40.722 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.719+0000 7f8f077fe640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7f8f081452d0 0x7f8f0813e300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:53050/0 (socket says 10.20.193.93:53050) 2026-02-22T23:23:40.908 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.906+0000 7f8f06ffd640 1 -- 10.20.193.93:0/2374479992 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 60565623 0 0) 0x7f8ef4002920 con 0x7f8f08144a00 2026-02-22T23:23:40.908 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.906+0000 7f8f06ffd640 1 -- 10.20.193.93:0/2374479992 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8eec003620 con 0x7f8f08144a00 2026-02-22T23:23:40.909 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.906+0000 7f8f06ffd640 1 -- 10.20.193.93:0/2374479992 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1797661079 0 0) 0x7f8f08144de0 con 0x7f8f0813ea10 2026-02-22T23:23:40.909 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.906+0000 7f8f06ffd640 1 -- 10.20.193.93:0/2374479992 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ef4002920 con 0x7f8f0813ea10 2026-02-22T23:23:40.909 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.907+0000 7f8f06ffd640 1 -- 10.20.193.93:0/2374479992 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 264356033 0 0) 0x7f8eec003620 con 0x7f8f08144a00 2026-02-22T23:23:40.909 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.907+0000 7f8f06ffd640 1 -- 10.20.193.93:0/2374479992 >> v1:10.20.193.93:6790/0 conn(0x7f8f081452d0 legacy=0x7f8f0813e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:40.909 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.907+0000 7f8f06ffd640 1 -- 10.20.193.93:0/2374479992 >> v1:10.20.193.155:6789/0 conn(0x7f8f0813ea10 legacy=0x7f8f0814cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:40.909 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.907+0000 7f8f06ffd640 1 -- 10.20.193.93:0/2374479992 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f08074320 con 0x7f8f08144a00 2026-02-22T23:23:40.909 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.907+0000 7f8f06ffd640 1 -- 10.20.193.93:0/2374479992 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f8ef4003070 con 0x7f8f08144a00 2026-02-22T23:23:40.909 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.907+0000 7f8f06ffd640 1 -- 10.20.193.93:0/2374479992 <== mon.0 v1:10.20.193.93:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8ef4003210 con 0x7f8f08144a00 2026-02-22T23:23:40.909 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.907+0000 7f8f06ffd640 1 -- 10.20.193.93:0/2374479992 <== mon.0 v1:10.20.193.93:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f8ef40049a0 con 0x7f8f08144a00 2026-02-22T23:23:40.909 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.907+0000 7f8f0e3ce640 1 -- 10.20.193.93:0/2374479992 >> v1:10.20.193.93:6789/0 conn(0x7f8f08144a00 legacy=0x7f8f080afa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:40.909 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.907+0000 7f8f0e3ce640 1 -- 10.20.193.93:0/2374479992 shutdown_connections 2026-02-22T23:23:40.909 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.907+0000 7f8f0e3ce640 1 -- 10.20.193.93:0/2374479992 >> 10.20.193.93:0/2374479992 conn(0x7f8f080b1d30 msgr2=0x7f8f080b2140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:23:40.909 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.907+0000 7f8f0e3ce640 1 -- 10.20.193.93:0/2374479992 shutdown_connections 2026-02-22T23:23:40.909 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.907+0000 7f8f0e3ce640 1 -- 10.20.193.93:0/2374479992 wait complete. 2026-02-22T23:23:40.910 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.908+0000 7f8f0e3ce640 1 Processor -- start 2026-02-22T23:23:40.910 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.908+0000 7f8f0e3ce640 1 -- start start 2026-02-22T23:23:40.910 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.908+0000 7f8f0e3ce640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f08143fa0 con 0x7f8f081452d0 2026-02-22T23:23:40.910 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.908+0000 7f8f0e3ce640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f081437a0 con 0x7f8f08144a00 2026-02-22T23:23:40.910 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.908+0000 7f8f0e3ce640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f08143a80 con 0x7f8f0813ea10 2026-02-22T23:23:40.910 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.908+0000 7f8f07fff640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7f8f0813ea10 0x7f8f081db930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:53062/0 (socket says 10.20.193.93:53062) 2026-02-22T23:23:40.910 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.908+0000 7f8f07fff640 1 -- 10.20.193.93:0/2387105609 learned_addr learned my addr 10.20.193.93:0/2387105609 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:23:40.910 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.909+0000 7f8f04ff9640 1 -- 10.20.193.93:0/2387105609 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4068940918 0 0) 0x7f8f08143fa0 con 0x7f8f081452d0 2026-02-22T23:23:40.911 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.909+0000 7f8f04ff9640 1 -- 10.20.193.93:0/2387105609 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ed8003620 con 0x7f8f081452d0 2026-02-22T23:23:40.911 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.909+0000 7f8f04ff9640 1 -- 10.20.193.93:0/2387105609 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1386892934 0 0) 0x7f8ed8003620 con 0x7f8f081452d0 2026-02-22T23:23:40.911 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.909+0000 7f8f04ff9640 1 -- 10.20.193.93:0/2387105609 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8f08143fa0 con 0x7f8f081452d0 2026-02-22T23:23:40.911 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.909+0000 7f8f04ff9640 1 -- 10.20.193.93:0/2387105609 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f8efc0033e0 con 0x7f8f081452d0 2026-02-22T23:23:40.912 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.909+0000 7f8f04ff9640 1 -- 10.20.193.93:0/2387105609 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2365508011 0 0) 0x7f8f081437a0 con 0x7f8f08144a00 2026-02-22T23:23:40.912 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.909+0000 7f8f04ff9640 1 -- 10.20.193.93:0/2387105609 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ed8003620 con 0x7f8f08144a00 2026-02-22T23:23:40.912 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.909+0000 7f8f04ff9640 1 -- 10.20.193.93:0/2387105609 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2683250649 0 0) 0x7f8f08143a80 con 0x7f8f0813ea10 2026-02-22T23:23:40.912 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.909+0000 7f8f04ff9640 1 -- 10.20.193.93:0/2387105609 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f081437a0 con 0x7f8f0813ea10 2026-02-22T23:23:40.912 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.910+0000 7f8f04ff9640 1 -- 10.20.193.93:0/2387105609 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2791389938 0 0) 0x7f8ed8003620 con 0x7f8f08144a00 2026-02-22T23:23:40.912 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.910+0000 7f8f04ff9640 1 -- 10.20.193.93:0/2387105609 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8f08143a80 con 0x7f8f08144a00 2026-02-22T23:23:40.912 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.910+0000 7f8f04ff9640 1 -- 10.20.193.93:0/2387105609 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2990620337 0 0) 0x7f8f081437a0 con 0x7f8f0813ea10 2026-02-22T23:23:40.912 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.910+0000 7f8f04ff9640 1 -- 10.20.193.93:0/2387105609 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8ed8003620 con 0x7f8f0813ea10 2026-02-22T23:23:40.912 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.910+0000 7f8f04ff9640 1 -- 10.20.193.93:0/2387105609 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f8ef40033c0 con 0x7f8f0813ea10 2026-02-22T23:23:40.912 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.910+0000 7f8f04ff9640 1 -- 10.20.193.93:0/2387105609 <== mon.2 v1:10.20.193.93:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 325580707 0 0) 0x7f8ed8003620 con 0x7f8f0813ea10 2026-02-22T23:23:40.912 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.910+0000 7f8f04ff9640 1 -- 10.20.193.93:0/2387105609 >> v1:10.20.193.155:6789/0 conn(0x7f8f08144a00 legacy=0x7f8f081321d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:40.912 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.910+0000 7f8f04ff9640 1 -- 10.20.193.93:0/2387105609 >> v1:10.20.193.93:6789/0 conn(0x7f8f081452d0 legacy=0x7f8f081e3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:40.912 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.910+0000 7f8f04ff9640 1 -- 10.20.193.93:0/2387105609 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f081414b0 con 0x7f8f0813ea10 2026-02-22T23:23:40.912 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.910+0000 7f8f0e3ce640 1 -- 10.20.193.93:0/2387105609 --> v1:10.20.193.93:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8f08141d20 con 0x7f8f0813ea10 2026-02-22T23:23:40.912 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.910+0000 7f8f0e3ce640 1 -- 10.20.193.93:0/2387105609 --> v1:10.20.193.93:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f8f080aabe0 con 0x7f8f0813ea10 2026-02-22T23:23:40.912 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.910+0000 7f8f04ff9640 1 -- 10.20.193.93:0/2387105609 <== mon.2 v1:10.20.193.93:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8ef4003560 con 0x7f8f0813ea10 2026-02-22T23:23:40.912 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.910+0000 7f8f04ff9640 1 -- 10.20.193.93:0/2387105609 <== mon.2 v1:10.20.193.93:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f8ef4004f50 con 0x7f8f0813ea10 2026-02-22T23:23:40.912 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.910+0000 7f8f04ff9640 1 -- 10.20.193.93:0/2387105609 <== mon.2 v1:10.20.193.93:6790/0 7 ==== mgrmap(e 1) ==== 811+0+0 (unknown 4133961934 0 0) 0x7f8ef4005480 con 0x7f8f0813ea10 2026-02-22T23:23:40.912 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.910+0000 7f8f04ff9640 1 -- 10.20.193.93:0/2387105609 <== mon.2 v1:10.20.193.93:6790/0 8 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (unknown 2231510098 0 0) 0x7f8ef4006930 con 0x7f8f0813ea10 2026-02-22T23:23:40.912 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.910+0000 7f8f0e3ce640 1 -- 10.20.193.93:0/2387105609 --> v1:10.20.193.93:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f080aaf20 con 0x7f8f0813ea10 2026-02-22T23:23:40.913 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.912+0000 7f8f04ff9640 1 -- 10.20.193.93:0/2387105609 <== mon.2 v1:10.20.193.93:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (unknown 1092875540 0 4127419540) 0x7f8f0813ee30 con 0x7f8f0813ea10 2026-02-22T23:23:40.944 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.942+0000 7f8f0e3ce640 1 -- 10.20.193.93:0/2387105609 --> v1:10.20.193.93:6790/0 -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f8f08076960 con 0x7f8f0813ea10 2026-02-22T23:23:40.946 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.944+0000 7f8f04ff9640 1 -- 10.20.193.93:0/2387105609 <== mon.2 v1:10.20.193.93:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (unknown 2277712955 0 0) 0x7f8ef4005920 con 0x7f8f0813ea10 2026-02-22T23:23:40.946 INFO:teuthology.orchestra.run.trial093.stderr:adjusted tunables profile to default 2026-02-22T23:23:40.947 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.945+0000 7f8f0e3ce640 1 -- 10.20.193.93:0/2387105609 >> v1:10.20.193.93:6790/0 conn(0x7f8f0813ea10 legacy=0x7f8f081db930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:40.947 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.945+0000 7f8f0e3ce640 1 -- 10.20.193.93:0/2387105609 shutdown_connections 2026-02-22T23:23:40.947 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.945+0000 7f8f0e3ce640 1 -- 10.20.193.93:0/2387105609 >> 10.20.193.93:0/2387105609 conn(0x7f8f080b1d30 msgr2=0x7f8f0806cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:23:40.947 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.945+0000 7f8f0e3ce640 1 -- 10.20.193.93:0/2387105609 shutdown_connections 2026-02-22T23:23:40.947 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:40.945+0000 7f8f0e3ce640 1 -- 10.20.193.93:0/2387105609 wait complete. 2026-02-22T23:23:40.954 INFO:tasks.ceph:check_enable_crimson: False 2026-02-22T23:23:40.954 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-22T23:23:40.954 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-22T23:23:40.954 DEBUG:teuthology.orchestra.run.trial093:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-22T23:23:40.979 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-22T23:23:40.979 DEBUG:teuthology.orchestra.run.trial093:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-22T23:23:41.044 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-22T23:23:41.045 DEBUG:teuthology.orchestra.run.trial093:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-22T23:23:41.108 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-22T23:23:41.108 DEBUG:teuthology.orchestra.run.trial093:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2026-02-22T23:23:41.173 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T23:23:41.174 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2026-02-22T23:23:41.198 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T23:23:41.198 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2026-02-22T23:23:41.260 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T23:23:41.278+0000 7f9a87e2e140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-22T23:23:41.263 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T23:23:41.263 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2026-02-22T23:23:41.264 INFO:tasks.ceph.mgr.y.trial093.stderr:2026-02-22T23:23:41.261+0000 7f06a77db140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-22T23:23:41.327 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T23:23:41.328 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2026-02-22T23:23:41.381 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T23:23:41.399+0000 7f9a87e2e140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-22T23:23:41.383 INFO:tasks.ceph.mgr.y.trial093.stderr:2026-02-22T23:23:41.382+0000 7f06a77db140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-22T23:23:41.390 DEBUG:teuthology.orchestra.run.trial155:> sudo ceph --cluster ceph osd new d1ce1e9f-bb70-4b7b-9dbc-e380de9324c0 0 2026-02-22T23:23:41.408 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T23:23:41.426+0000 7f9a87e2e140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-22T23:23:41.410 INFO:tasks.ceph.mgr.y.trial093.stderr:2026-02-22T23:23:41.409+0000 7f06a77db140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-22T23:23:41.441 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T23:23:41.459+0000 7f9a87e2e140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-22T23:23:41.444 INFO:tasks.ceph.mgr.y.trial093.stderr:2026-02-22T23:23:41.442+0000 7f06a77db140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-22T23:23:41.464 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T23:23:41.483+0000 7f9a87e2e140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-22T23:23:41.467 INFO:tasks.ceph.mgr.y.trial093.stderr:2026-02-22T23:23:41.465+0000 7f06a77db140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-22T23:23:41.472 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.491+0000 7f4492e4c640 1 Processor -- start 2026-02-22T23:23:41.472 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.491+0000 7f4492e4c640 1 -- start start 2026-02-22T23:23:41.473 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.491+0000 7f4492e4c640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f448c13ee30 con 0x7f448c13ea10 2026-02-22T23:23:41.473 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.491+0000 7f4492e4c640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f448c144de0 con 0x7f448c144a00 2026-02-22T23:23:41.473 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.491+0000 7f4492e4c640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f448c074040 con 0x7f448c1452d0 2026-02-22T23:23:41.473 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.491+0000 7f4490bc1640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7f448c144a00 0x7f448c0afa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.155:49454/0 (socket says 10.20.193.155:49454) 2026-02-22T23:23:41.473 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.491+0000 7f4490bc1640 1 -- 10.20.193.155:0/2215904640 learned_addr learned my addr 10.20.193.155:0/2215904640 (peer_addr_for_me v1:10.20.193.155:0/0) 2026-02-22T23:23:41.473 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.492+0000 7f44837fe640 1 -- 10.20.193.155:0/2215904640 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1443339372 0 0) 0x7f448c144de0 con 0x7f448c144a00 2026-02-22T23:23:41.473 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.492+0000 7f44837fe640 1 -- 10.20.193.155:0/2215904640 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4478003620 con 0x7f448c144a00 2026-02-22T23:23:41.474 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.492+0000 7f44837fe640 1 -- 10.20.193.155:0/2215904640 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2300521618 0 0) 0x7f4488002ca0 con 0x7f448c13ea10 2026-02-22T23:23:41.474 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.492+0000 7f44837fe640 1 -- 10.20.193.155:0/2215904640 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f448c144de0 con 0x7f448c13ea10 2026-02-22T23:23:41.474 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.492+0000 7f44837fe640 1 -- 10.20.193.155:0/2215904640 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2689879907 0 0) 0x7f4478003620 con 0x7f448c144a00 2026-02-22T23:23:41.474 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.492+0000 7f44837fe640 1 -- 10.20.193.155:0/2215904640 >> v1:10.20.193.93:6790/0 conn(0x7f448c1452d0 legacy=0x7f448c13e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:41.474 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.492+0000 7f44837fe640 1 -- 10.20.193.155:0/2215904640 >> v1:10.20.193.93:6789/0 conn(0x7f448c13ea10 legacy=0x7f448c14cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:41.474 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.492+0000 7f44837fe640 1 -- 10.20.193.155:0/2215904640 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f448c074320 con 0x7f448c144a00 2026-02-22T23:23:41.474 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.492+0000 7f44837fe640 1 -- 10.20.193.155:0/2215904640 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f447c002ea0 con 0x7f448c144a00 2026-02-22T23:23:41.474 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.492+0000 7f44837fe640 1 -- 10.20.193.155:0/2215904640 <== mon.1 v1:10.20.193.155:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f447c0030c0 con 0x7f448c144a00 2026-02-22T23:23:41.474 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.492+0000 7f44837fe640 1 -- 10.20.193.155:0/2215904640 <== mon.1 v1:10.20.193.155:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f447c003490 con 0x7f448c144a00 2026-02-22T23:23:41.474 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.492+0000 7f4492e4c640 1 -- 10.20.193.155:0/2215904640 >> v1:10.20.193.155:6789/0 conn(0x7f448c144a00 legacy=0x7f448c0afa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:41.474 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.492+0000 7f4492e4c640 1 -- 10.20.193.155:0/2215904640 shutdown_connections 2026-02-22T23:23:41.474 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.492+0000 7f4492e4c640 1 -- 10.20.193.155:0/2215904640 >> 10.20.193.155:0/2215904640 conn(0x7f448c0b1d30 msgr2=0x7f448c0b2140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:23:41.474 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.492+0000 7f4492e4c640 1 -- 10.20.193.155:0/2215904640 shutdown_connections 2026-02-22T23:23:41.474 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.492+0000 7f4492e4c640 1 -- 10.20.193.155:0/2215904640 wait complete. 2026-02-22T23:23:41.474 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.493+0000 7f4492e4c640 1 Processor -- start 2026-02-22T23:23:41.474 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.493+0000 7f4492e4c640 1 -- start start 2026-02-22T23:23:41.474 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.493+0000 7f4492e4c640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f448c0abe70 con 0x7f448c13ea10 2026-02-22T23:23:41.475 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.493+0000 7f4492e4c640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f448c0ac150 con 0x7f448c144a00 2026-02-22T23:23:41.475 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.493+0000 7f4492e4c640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f448c0ac430 con 0x7f448c1452d0 2026-02-22T23:23:41.475 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.493+0000 7f4483fff640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7f448c144a00 0x7f448c0adc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.155:49466/0 (socket says 10.20.193.155:49466) 2026-02-22T23:23:41.475 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.493+0000 7f4483fff640 1 -- 10.20.193.155:0/2515630761 learned_addr learned my addr 10.20.193.155:0/2515630761 (peer_addr_for_me v1:10.20.193.155:0/0) 2026-02-22T23:23:41.475 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.493+0000 7f44817fa640 1 -- 10.20.193.155:0/2515630761 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1172931820 0 0) 0x7f448c0ac150 con 0x7f448c144a00 2026-02-22T23:23:41.475 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.493+0000 7f44817fa640 1 -- 10.20.193.155:0/2515630761 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f445c003620 con 0x7f448c144a00 2026-02-22T23:23:41.475 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.493+0000 7f44817fa640 1 -- 10.20.193.155:0/2515630761 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2489129065 0 0) 0x7f445c003620 con 0x7f448c144a00 2026-02-22T23:23:41.475 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.493+0000 7f44817fa640 1 -- 10.20.193.155:0/2515630761 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f448c0ac150 con 0x7f448c144a00 2026-02-22T23:23:41.475 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.493+0000 7f44817fa640 1 -- 10.20.193.155:0/2515630761 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f4474003140 con 0x7f448c144a00 2026-02-22T23:23:41.475 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.493+0000 7f44817fa640 1 -- 10.20.193.155:0/2515630761 <== mon.1 v1:10.20.193.155:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1482957683 0 0) 0x7f448c0ac150 con 0x7f448c144a00 2026-02-22T23:23:41.475 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.493+0000 7f44817fa640 1 -- 10.20.193.155:0/2515630761 >> v1:10.20.193.93:6790/0 conn(0x7f448c1452d0 legacy=0x7f448c0ae350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:41.475 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.493+0000 7f44817fa640 1 -- 10.20.193.155:0/2515630761 >> v1:10.20.193.93:6789/0 conn(0x7f448c13ea10 legacy=0x7f448c1d89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:41.475 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.493+0000 7f44817fa640 1 -- 10.20.193.155:0/2515630761 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f448c141ca0 con 0x7f448c144a00 2026-02-22T23:23:41.475 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.493+0000 7f4492e4c640 1 -- 10.20.193.155:0/2515630761 --> v1:10.20.193.155:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f448c0aba00 con 0x7f448c144a00 2026-02-22T23:23:41.475 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.494+0000 7f4492e4c640 1 -- 10.20.193.155:0/2515630761 --> v1:10.20.193.155:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f448c1d92c0 con 0x7f448c144a00 2026-02-22T23:23:41.475 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.494+0000 7f44817fa640 1 -- 10.20.193.155:0/2515630761 <== mon.1 v1:10.20.193.155:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4474003500 con 0x7f448c144a00 2026-02-22T23:23:41.475 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.494+0000 7f44817fa640 1 -- 10.20.193.155:0/2515630761 <== mon.1 v1:10.20.193.155:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f4474003b60 con 0x7f448c144a00 2026-02-22T23:23:41.475 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.494+0000 7f44817fa640 1 -- 10.20.193.155:0/2515630761 <== mon.1 v1:10.20.193.155:6789/0 7 ==== mgrmap(e 1) ==== 811+0+0 (unknown 4133961934 0 0) 0x7f4474004110 con 0x7f448c144a00 2026-02-22T23:23:41.475 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.494+0000 7f44817fa640 1 -- 10.20.193.155:0/2515630761 <== mon.1 v1:10.20.193.155:6789/0 8 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (unknown 3836109764 0 0) 0x7f44740068c0 con 0x7f448c144a00 2026-02-22T23:23:41.476 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.494+0000 7f4492e4c640 1 -- 10.20.193.155:0/2515630761 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f448c0ab730 con 0x7f448c144a00 2026-02-22T23:23:41.477 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.495+0000 7f44817fa640 1 -- 10.20.193.155:0/2515630761 <== mon.1 v1:10.20.193.155:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (unknown 1092875540 0 4127419540) 0x7f4474006be0 con 0x7f448c144a00 2026-02-22T23:23:41.490 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T23:23:41.509+0000 7f9a87e2e140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-22T23:23:41.493 INFO:tasks.ceph.mgr.y.trial093.stderr:2026-02-22T23:23:41.491+0000 7f06a77db140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-22T23:23:41.508 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.527+0000 7f4492e4c640 1 -- 10.20.193.155:0/2515630761 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "osd new", "uuid": "d1ce1e9f-bb70-4b7b-9dbc-e380de9324c0", "id": 0} v 0) -- 0x7f448c073a20 con 0x7f448c144a00 2026-02-22T23:23:41.511 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.529+0000 7f44817fa640 1 -- 10.20.193.155:0/2515630761 <== mon.1 v1:10.20.193.155:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d1ce1e9f-bb70-4b7b-9dbc-e380de9324c0", "id": 0}]=0 v3) ==== 112+0+2 (unknown 4061713846 0 732707515) 0x7f44740059f0 con 0x7f448c144a00 2026-02-22T23:23:41.511 INFO:teuthology.orchestra.run.trial155.stdout:0 2026-02-22T23:23:41.511 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.530+0000 7f4492e4c640 1 -- 10.20.193.155:0/2515630761 >> v1:10.20.193.155:6789/0 conn(0x7f448c144a00 legacy=0x7f448c0adc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:41.511 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.530+0000 7f4492e4c640 1 -- 10.20.193.155:0/2515630761 shutdown_connections 2026-02-22T23:23:41.511 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.530+0000 7f4492e4c640 1 -- 10.20.193.155:0/2515630761 >> 10.20.193.155:0/2515630761 conn(0x7f448c0b1d30 msgr2=0x7f448c06cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:23:41.511 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.530+0000 7f4492e4c640 1 -- 10.20.193.155:0/2515630761 shutdown_connections 2026-02-22T23:23:41.511 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.530+0000 7f4492e4c640 1 -- 10.20.193.155:0/2515630761 wait complete. 2026-02-22T23:23:41.518 DEBUG:teuthology.orchestra.run.trial155:> sudo ceph --cluster ceph osd new e5ab5de3-2e0f-4f91-8dfe-c74bff8838d5 1 2026-02-22T23:23:41.547 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T23:23:41.565+0000 7f9a87e2e140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-22T23:23:41.549 INFO:tasks.ceph.mgr.y.trial093.stderr:2026-02-22T23:23:41.547+0000 7f06a77db140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-22T23:23:41.610 INFO:tasks.ceph.mgr.x.trial155.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-22T23:23:41.610 INFO:tasks.ceph.mgr.x.trial155.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-22T23:23:41.610 INFO:tasks.ceph.mgr.x.trial155.stderr: from numpy import show_config as show_numpy_config 2026-02-22T23:23:41.611 INFO:tasks.ceph.mgr.y.trial093.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-22T23:23:41.611 INFO:tasks.ceph.mgr.y.trial093.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-22T23:23:41.611 INFO:tasks.ceph.mgr.y.trial093.stderr: from numpy import show_config as show_numpy_config 2026-02-22T23:23:41.613 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.631+0000 7f8e667c3640 1 Processor -- start 2026-02-22T23:23:41.613 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.631+0000 7f8e667c3640 1 -- start start 2026-02-22T23:23:41.613 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.632+0000 7f8e667c3640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e60147180 con 0x7f8e600b36c0 2026-02-22T23:23:41.613 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.632+0000 7f8e667c3640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e600b5fc0 con 0x7f8e600aa8e0 2026-02-22T23:23:41.613 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.632+0000 7f8e667c3640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e600b6190 con 0x7f8e600b5be0 2026-02-22T23:23:41.614 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T23:23:41.632+0000 7f9a87e2e140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-22T23:23:41.614 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.632+0000 7f8e5f7fe640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7f8e600aa8e0 0x7f8e60140710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.155:49478/0 (socket says 10.20.193.155:49478) 2026-02-22T23:23:41.614 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.632+0000 7f8e5f7fe640 1 -- 10.20.193.155:0/4268316075 learned_addr learned my addr 10.20.193.155:0/4268316075 (peer_addr_for_me v1:10.20.193.155:0/0) 2026-02-22T23:23:41.614 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.632+0000 7f8e5effd640 1 -- 10.20.193.155:0/4268316075 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 984819934 0 0) 0x7f8e600b5fc0 con 0x7f8e600aa8e0 2026-02-22T23:23:41.614 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.632+0000 7f8e5effd640 1 -- 10.20.193.155:0/4268316075 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e44003620 con 0x7f8e600aa8e0 2026-02-22T23:23:41.614 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.632+0000 7f8e5effd640 1 -- 10.20.193.155:0/4268316075 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 153115605 0 0) 0x7f8e44003620 con 0x7f8e600aa8e0 2026-02-22T23:23:41.614 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.632+0000 7f8e5effd640 1 -- 10.20.193.155:0/4268316075 >> v1:10.20.193.93:6790/0 conn(0x7f8e600b5be0 legacy=0x7f8e60146a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T23:23:41.615 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.632+0000 7f8e5effd640 1 -- 10.20.193.155:0/4268316075 >> v1:10.20.193.93:6789/0 conn(0x7f8e600b36c0 legacy=0x7f8e6014edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:41.615 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.632+0000 7f8e5effd640 1 -- 10.20.193.155:0/4268316075 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e600ab290 con 0x7f8e600aa8e0 2026-02-22T23:23:41.615 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.632+0000 7f8e5effd640 1 -- 10.20.193.155:0/4268316075 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f8e50002ea0 con 0x7f8e600aa8e0 2026-02-22T23:23:41.615 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.632+0000 7f8e5effd640 1 -- 10.20.193.155:0/4268316075 <== mon.1 v1:10.20.193.155:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8e500030b0 con 0x7f8e600aa8e0 2026-02-22T23:23:41.615 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.632+0000 7f8e5effd640 1 -- 10.20.193.155:0/4268316075 <== mon.1 v1:10.20.193.155:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f8e50003540 con 0x7f8e600aa8e0 2026-02-22T23:23:41.615 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.632+0000 7f8e667c3640 1 -- 10.20.193.155:0/4268316075 >> v1:10.20.193.155:6789/0 conn(0x7f8e600aa8e0 legacy=0x7f8e60140710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:41.615 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.632+0000 7f8e667c3640 1 -- 10.20.193.155:0/4268316075 shutdown_connections 2026-02-22T23:23:41.615 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.632+0000 7f8e667c3640 1 -- 10.20.193.155:0/4268316075 >> 10.20.193.155:0/4268316075 conn(0x7f8e60068410 msgr2=0x7f8e60068820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:23:41.615 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.632+0000 7f8e667c3640 1 -- 10.20.193.155:0/4268316075 shutdown_connections 2026-02-22T23:23:41.615 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.632+0000 7f8e667c3640 1 -- 10.20.193.155:0/4268316075 wait complete. 2026-02-22T23:23:41.615 INFO:tasks.ceph.mgr.y.trial093.stderr:2026-02-22T23:23:41.613+0000 7f06a77db140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-22T23:23:41.616 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.633+0000 7f8e667c3640 1 Processor -- start 2026-02-22T23:23:41.616 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.633+0000 7f8e667c3640 1 -- start start 2026-02-22T23:23:41.616 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.633+0000 7f8e667c3640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e600af530 con 0x7f8e600b5be0 2026-02-22T23:23:41.616 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.633+0000 7f8e667c3640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e600af810 con 0x7f8e600b2a00 2026-02-22T23:23:41.616 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.633+0000 7f8e667c3640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e6013b040 con 0x7f8e600b36c0 2026-02-22T23:23:41.616 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.633+0000 7f8e64d39640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7f8e600b2a00 0x7f8e601da620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.155:49492/0 (socket says 10.20.193.155:49492) 2026-02-22T23:23:41.616 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.633+0000 7f8e64d39640 1 -- 10.20.193.155:0/2762730074 learned_addr learned my addr 10.20.193.155:0/2762730074 (peer_addr_for_me v1:10.20.193.155:0/0) 2026-02-22T23:23:41.616 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.633+0000 7f8e5cff9640 1 -- 10.20.193.155:0/2762730074 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2721308698 0 0) 0x7f8e600af810 con 0x7f8e600b2a00 2026-02-22T23:23:41.616 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.634+0000 7f8e5cff9640 1 -- 10.20.193.155:0/2762730074 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e30003620 con 0x7f8e600b2a00 2026-02-22T23:23:41.616 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.634+0000 7f8e5cff9640 1 -- 10.20.193.155:0/2762730074 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 331892791 0 0) 0x7f8e30003620 con 0x7f8e600b2a00 2026-02-22T23:23:41.616 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.634+0000 7f8e5cff9640 1 -- 10.20.193.155:0/2762730074 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8e600af810 con 0x7f8e600b2a00 2026-02-22T23:23:41.616 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.634+0000 7f8e5cff9640 1 -- 10.20.193.155:0/2762730074 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f8e540034e0 con 0x7f8e600b2a00 2026-02-22T23:23:41.617 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.634+0000 7f8e5cff9640 1 -- 10.20.193.155:0/2762730074 <== mon.1 v1:10.20.193.155:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1005437105 0 0) 0x7f8e600af810 con 0x7f8e600b2a00 2026-02-22T23:23:41.617 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.634+0000 7f8e5cff9640 1 -- 10.20.193.155:0/2762730074 >> v1:10.20.193.93:6790/0 conn(0x7f8e600b36c0 legacy=0x7f8e600add50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:41.617 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.634+0000 7f8e5cff9640 1 -- 10.20.193.155:0/2762730074 >> v1:10.20.193.93:6789/0 conn(0x7f8e600b5be0 legacy=0x7f8e600b22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:41.617 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.634+0000 7f8e5cff9640 1 -- 10.20.193.155:0/2762730074 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e601dad30 con 0x7f8e600b2a00 2026-02-22T23:23:41.617 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.634+0000 7f8e667c3640 1 -- 10.20.193.155:0/2762730074 --> v1:10.20.193.155:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8e601dafc0 con 0x7f8e600b2a00 2026-02-22T23:23:41.617 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.634+0000 7f8e667c3640 1 -- 10.20.193.155:0/2762730074 --> v1:10.20.193.155:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8e601e6ed0 con 0x7f8e600b2a00 2026-02-22T23:23:41.617 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.634+0000 7f8e5cff9640 1 -- 10.20.193.155:0/2762730074 <== mon.1 v1:10.20.193.155:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8e54003820 con 0x7f8e600b2a00 2026-02-22T23:23:41.617 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.634+0000 7f8e5cff9640 1 -- 10.20.193.155:0/2762730074 <== mon.1 v1:10.20.193.155:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f8e54003ee0 con 0x7f8e600b2a00 2026-02-22T23:23:41.617 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.634+0000 7f8e5cff9640 1 -- 10.20.193.155:0/2762730074 <== mon.1 v1:10.20.193.155:6789/0 7 ==== mgrmap(e 1) ==== 811+0+0 (unknown 4133961934 0 0) 0x7f8e540044d0 con 0x7f8e600b2a00 2026-02-22T23:23:41.617 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.634+0000 7f8e5cff9640 1 -- 10.20.193.155:0/2762730074 <== mon.1 v1:10.20.193.155:6789/0 8 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (unknown 1044879701 0 0) 0x7f8e54006bc0 con 0x7f8e600b2a00 2026-02-22T23:23:41.617 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.634+0000 7f8e667c3640 1 -- 10.20.193.155:0/2762730074 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e600ae790 con 0x7f8e600b2a00 2026-02-22T23:23:41.617 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.635+0000 7f8e5cff9640 1 -- 10.20.193.155:0/2762730074 <== mon.1 v1:10.20.193.155:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (unknown 1092875540 0 4127419540) 0x7f8e600ae790 con 0x7f8e600b2a00 2026-02-22T23:23:41.639 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T23:23:41.658+0000 7f9a87e2e140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-22T23:23:41.640 INFO:tasks.ceph.mgr.y.trial093.stderr:2026-02-22T23:23:41.638+0000 7f06a77db140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-22T23:23:41.649 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.667+0000 7f8e667c3640 1 -- 10.20.193.155:0/2762730074 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "osd new", "uuid": "e5ab5de3-2e0f-4f91-8dfe-c74bff8838d5", "id": 1} v 0) -- 0x7f8e601da3e0 con 0x7f8e600b2a00 2026-02-22T23:23:41.651 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.669+0000 7f8e5cff9640 1 -- 10.20.193.155:0/2762730074 <== mon.1 v1:10.20.193.155:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e5ab5de3-2e0f-4f91-8dfe-c74bff8838d5", "id": 1}]=0 v4) ==== 112+0+2 (unknown 2209595005 0 940483276) 0x7f8e54005cc0 con 0x7f8e600b2a00 2026-02-22T23:23:41.651 INFO:teuthology.orchestra.run.trial155.stdout:1 2026-02-22T23:23:41.651 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.669+0000 7f8e667c3640 1 -- 10.20.193.155:0/2762730074 >> v1:10.20.193.155:6789/0 conn(0x7f8e600b2a00 legacy=0x7f8e601da620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:41.651 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.669+0000 7f8e667c3640 1 -- 10.20.193.155:0/2762730074 shutdown_connections 2026-02-22T23:23:41.651 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.669+0000 7f8e667c3640 1 -- 10.20.193.155:0/2762730074 >> 10.20.193.155:0/2762730074 conn(0x7f8e60068410 msgr2=0x7f8e600b9960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:23:41.652 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.669+0000 7f8e667c3640 1 -- 10.20.193.155:0/2762730074 shutdown_connections 2026-02-22T23:23:41.652 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.669+0000 7f8e667c3640 1 -- 10.20.193.155:0/2762730074 wait complete. 2026-02-22T23:23:41.658 DEBUG:teuthology.orchestra.run.trial155:> sudo ceph --cluster ceph osd new 10d76c55-707a-43c8-b51e-0e5ae595f89e 2 2026-02-22T23:23:41.696 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T23:23:41.714+0000 7f9a87e2e140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-22T23:23:41.696 INFO:tasks.ceph.mgr.y.trial093.stderr:2026-02-22T23:23:41.694+0000 7f06a77db140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-22T23:23:41.721 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.740+0000 7fb295ca6640 1 Processor -- start 2026-02-22T23:23:41.722 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.740+0000 7fb295ca6640 1 -- start start 2026-02-22T23:23:41.723 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.740+0000 7fb295ca6640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb29013ee30 con 0x7fb2901452d0 2026-02-22T23:23:41.723 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.740+0000 7fb295ca6640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb290144de0 con 0x7fb29013ea10 2026-02-22T23:23:41.723 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.740+0000 7fb295ca6640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb290074040 con 0x7fb290144a00 2026-02-22T23:23:41.723 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.740+0000 7fb28ffff640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7fb29013ea10 0x7fb29014cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.155:49494/0 (socket says 10.20.193.155:49494) 2026-02-22T23:23:41.723 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.740+0000 7fb28ffff640 1 -- 10.20.193.155:0/3692265289 learned_addr learned my addr 10.20.193.155:0/3692265289 (peer_addr_for_me v1:10.20.193.155:0/0) 2026-02-22T23:23:41.723 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.740+0000 7fb28e7fc640 1 -- 10.20.193.155:0/3692265289 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4115869205 0 0) 0x7fb290144de0 con 0x7fb29013ea10 2026-02-22T23:23:41.724 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.740+0000 7fb28e7fc640 1 -- 10.20.193.155:0/3692265289 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb274003620 con 0x7fb29013ea10 2026-02-22T23:23:41.724 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.740+0000 7fb28e7fc640 1 -- 10.20.193.155:0/3692265289 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3884283953 0 0) 0x7fb274003620 con 0x7fb29013ea10 2026-02-22T23:23:41.724 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.741+0000 7fb28e7fc640 1 -- 10.20.193.155:0/3692265289 >> v1:10.20.193.93:6790/0 conn(0x7fb290144a00 legacy=0x7fb2900afa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T23:23:41.724 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.741+0000 7fb28e7fc640 1 -- 10.20.193.155:0/3692265289 >> v1:10.20.193.93:6789/0 conn(0x7fb2901452d0 legacy=0x7fb29013e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:41.724 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.741+0000 7fb28e7fc640 1 -- 10.20.193.155:0/3692265289 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb290074320 con 0x7fb29013ea10 2026-02-22T23:23:41.724 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.741+0000 7fb28e7fc640 1 -- 10.20.193.155:0/3692265289 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fb284003220 con 0x7fb29013ea10 2026-02-22T23:23:41.724 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.741+0000 7fb28e7fc640 1 -- 10.20.193.155:0/3692265289 <== mon.1 v1:10.20.193.155:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb2840033c0 con 0x7fb29013ea10 2026-02-22T23:23:41.724 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.741+0000 7fb28e7fc640 1 -- 10.20.193.155:0/3692265289 <== mon.1 v1:10.20.193.155:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fb284003850 con 0x7fb29013ea10 2026-02-22T23:23:41.724 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.741+0000 7fb295ca6640 1 -- 10.20.193.155:0/3692265289 >> v1:10.20.193.155:6789/0 conn(0x7fb29013ea10 legacy=0x7fb29014cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:41.724 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.741+0000 7fb295ca6640 1 -- 10.20.193.155:0/3692265289 shutdown_connections 2026-02-22T23:23:41.724 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.741+0000 7fb295ca6640 1 -- 10.20.193.155:0/3692265289 >> 10.20.193.155:0/3692265289 conn(0x7fb2900b1d30 msgr2=0x7fb2900b2140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:23:41.724 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.741+0000 7fb295ca6640 1 -- 10.20.193.155:0/3692265289 shutdown_connections 2026-02-22T23:23:41.724 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.741+0000 7fb295ca6640 1 -- 10.20.193.155:0/3692265289 wait complete. 2026-02-22T23:23:41.724 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.741+0000 7fb295ca6640 1 Processor -- start 2026-02-22T23:23:41.724 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.741+0000 7fb295ca6640 1 -- start start 2026-02-22T23:23:41.726 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.742+0000 7fb295ca6640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb290140c00 con 0x7fb2901452d0 2026-02-22T23:23:41.726 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.742+0000 7fb295ca6640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb290141eb0 con 0x7fb290144a00 2026-02-22T23:23:41.726 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.742+0000 7fb295ca6640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2901de720 con 0x7fb29013ea10 2026-02-22T23:23:41.726 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.742+0000 7fb28effd640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7fb290144a00 0x7fb2901de010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.155:49506/0 (socket says 10.20.193.155:49506) 2026-02-22T23:23:41.726 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.742+0000 7fb28effd640 1 -- 10.20.193.155:0/2795940358 learned_addr learned my addr 10.20.193.155:0/2795940358 (peer_addr_for_me v1:10.20.193.155:0/0) 2026-02-22T23:23:41.726 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.742+0000 7fb26bfff640 1 -- 10.20.193.155:0/2795940358 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4003181078 0 0) 0x7fb290141eb0 con 0x7fb290144a00 2026-02-22T23:23:41.726 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.742+0000 7fb26bfff640 1 -- 10.20.193.155:0/2795940358 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb260003620 con 0x7fb290144a00 2026-02-22T23:23:41.726 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.742+0000 7fb26bfff640 1 -- 10.20.193.155:0/2795940358 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3597396087 0 0) 0x7fb2901de720 con 0x7fb29013ea10 2026-02-22T23:23:41.726 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.742+0000 7fb26bfff640 1 -- 10.20.193.155:0/2795940358 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb290141eb0 con 0x7fb29013ea10 2026-02-22T23:23:41.727 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.742+0000 7fb26bfff640 1 -- 10.20.193.155:0/2795940358 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2166858091 0 0) 0x7fb260003620 con 0x7fb290144a00 2026-02-22T23:23:41.727 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.742+0000 7fb26bfff640 1 -- 10.20.193.155:0/2795940358 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb2901de720 con 0x7fb290144a00 2026-02-22T23:23:41.727 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.742+0000 7fb26bfff640 1 -- 10.20.193.155:0/2795940358 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fb2800031a0 con 0x7fb290144a00 2026-02-22T23:23:41.727 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.742+0000 7fb26bfff640 1 -- 10.20.193.155:0/2795940358 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2515446805 0 0) 0x7fb290140c00 con 0x7fb2901452d0 2026-02-22T23:23:41.727 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.742+0000 7fb26bfff640 1 -- 10.20.193.155:0/2795940358 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb260003620 con 0x7fb2901452d0 2026-02-22T23:23:41.727 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.742+0000 7fb26bfff640 1 -- 10.20.193.155:0/2795940358 <== mon.1 v1:10.20.193.155:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2410225093 0 0) 0x7fb2901de720 con 0x7fb290144a00 2026-02-22T23:23:41.727 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.742+0000 7fb26bfff640 1 -- 10.20.193.155:0/2795940358 >> v1:10.20.193.93:6790/0 conn(0x7fb29013ea10 legacy=0x7fb2901404f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:41.727 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.742+0000 7fb26bfff640 1 -- 10.20.193.155:0/2795940358 >> v1:10.20.193.93:6789/0 conn(0x7fb2901452d0 legacy=0x7fb2901341f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:41.727 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.742+0000 7fb26bfff640 1 -- 10.20.193.155:0/2795940358 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2901de8f0 con 0x7fb290144a00 2026-02-22T23:23:41.727 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.742+0000 7fb295ca6640 1 -- 10.20.193.155:0/2795940358 --> v1:10.20.193.155:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb2900b3110 con 0x7fb290144a00 2026-02-22T23:23:41.727 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.742+0000 7fb26bfff640 1 -- 10.20.193.155:0/2795940358 <== mon.1 v1:10.20.193.155:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb280003710 con 0x7fb290144a00 2026-02-22T23:23:41.727 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.742+0000 7fb26bfff640 1 -- 10.20.193.155:0/2795940358 <== mon.1 v1:10.20.193.155:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fb280003aa0 con 0x7fb290144a00 2026-02-22T23:23:41.727 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.742+0000 7fb295ca6640 1 -- 10.20.193.155:0/2795940358 --> v1:10.20.193.155:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb290141050 con 0x7fb290144a00 2026-02-22T23:23:41.727 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.742+0000 7fb26bfff640 1 -- 10.20.193.155:0/2795940358 <== mon.1 v1:10.20.193.155:6789/0 7 ==== mgrmap(e 1) ==== 811+0+0 (unknown 4133961934 0 0) 0x7fb280004050 con 0x7fb290144a00 2026-02-22T23:23:41.727 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.742+0000 7fb26bfff640 1 -- 10.20.193.155:0/2795940358 <== mon.1 v1:10.20.193.155:6789/0 8 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (unknown 3135395287 0 0) 0x7fb280005dd0 con 0x7fb290144a00 2026-02-22T23:23:41.727 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.743+0000 7fb295ca6640 1 -- 10.20.193.155:0/2795940358 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb290144570 con 0x7fb290144a00 2026-02-22T23:23:41.727 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.744+0000 7fb26bfff640 1 -- 10.20.193.155:0/2795940358 <== mon.1 v1:10.20.193.155:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (unknown 1092875540 0 4127419540) 0x7fb29013ee30 con 0x7fb290144a00 2026-02-22T23:23:41.740 INFO:tasks.ceph.mgr.y.trial093.stderr:2026-02-22T23:23:41.738+0000 7f06a77db140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-22T23:23:41.740 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T23:23:41.758+0000 7f9a87e2e140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-22T23:23:41.757 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.776+0000 7fb295ca6640 1 -- 10.20.193.155:0/2795940358 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "osd new", "uuid": "10d76c55-707a-43c8-b51e-0e5ae595f89e", "id": 2} v 0) -- 0x7fb290076960 con 0x7fb290144a00 2026-02-22T23:23:41.759 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.778+0000 7fb26bfff640 1 -- 10.20.193.155:0/2795940358 <== mon.1 v1:10.20.193.155:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "10d76c55-707a-43c8-b51e-0e5ae595f89e", "id": 2}]=0 v5) ==== 112+0+2 (unknown 515001653 0 216599125) 0x7fb280004370 con 0x7fb290144a00 2026-02-22T23:23:41.760 INFO:teuthology.orchestra.run.trial155.stdout:2 2026-02-22T23:23:41.760 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.778+0000 7fb295ca6640 1 -- 10.20.193.155:0/2795940358 >> v1:10.20.193.155:6789/0 conn(0x7fb290144a00 legacy=0x7fb2901de010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:41.761 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.778+0000 7fb295ca6640 1 -- 10.20.193.155:0/2795940358 shutdown_connections 2026-02-22T23:23:41.761 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.778+0000 7fb295ca6640 1 -- 10.20.193.155:0/2795940358 >> 10.20.193.155:0/2795940358 conn(0x7fb2900b1d30 msgr2=0x7fb29013e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:23:41.761 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.778+0000 7fb295ca6640 1 -- 10.20.193.155:0/2795940358 shutdown_connections 2026-02-22T23:23:41.761 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.778+0000 7fb295ca6640 1 -- 10.20.193.155:0/2795940358 wait complete. 2026-02-22T23:23:41.766 INFO:tasks.ceph.mgr.y.trial093.stderr:2026-02-22T23:23:41.764+0000 7f06a77db140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-22T23:23:41.766 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T23:23:41.785+0000 7f9a87e2e140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-22T23:23:41.767 DEBUG:teuthology.orchestra.run.trial155:> sudo ceph --cluster ceph osd new d7a29cea-4066-455f-8a32-f4cb5534ae32 3 2026-02-22T23:23:41.790 INFO:tasks.ceph.mgr.y.trial093.stderr:2026-02-22T23:23:41.788+0000 7f06a77db140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-22T23:23:41.791 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T23:23:41.810+0000 7f9a87e2e140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-22T23:23:41.816 INFO:tasks.ceph.mgr.y.trial093.stderr:2026-02-22T23:23:41.814+0000 7f06a77db140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-22T23:23:41.817 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T23:23:41.836+0000 7f9a87e2e140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-22T23:23:41.839 INFO:tasks.ceph.mgr.y.trial093.stderr:2026-02-22T23:23:41.837+0000 7f06a77db140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-22T23:23:41.840 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T23:23:41.859+0000 7f9a87e2e140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-22T23:23:41.859 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.873+0000 7ff3e9355640 1 Processor -- start 2026-02-22T23:23:41.859 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.873+0000 7ff3e9355640 1 -- start start 2026-02-22T23:23:41.859 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.873+0000 7ff3e9355640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3e413ee30 con 0x7ff3e413ea10 2026-02-22T23:23:41.860 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.873+0000 7ff3e9355640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3e4144de0 con 0x7ff3e4144a00 2026-02-22T23:23:41.860 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.873+0000 7ff3e9355640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3e4074040 con 0x7ff3e41452d0 2026-02-22T23:23:41.860 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.873+0000 7ff3e2ffd640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7ff3e4144a00 0x7ff3e40afa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.155:49508/0 (socket says 10.20.193.155:49508) 2026-02-22T23:23:41.860 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.873+0000 7ff3e2ffd640 1 -- 10.20.193.155:0/1338730733 learned_addr learned my addr 10.20.193.155:0/1338730733 (peer_addr_for_me v1:10.20.193.155:0/0) 2026-02-22T23:23:41.860 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.874+0000 7ff3e1ffb640 1 -- 10.20.193.155:0/1338730733 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 504233531 0 0) 0x7ff3e4144de0 con 0x7ff3e4144a00 2026-02-22T23:23:41.860 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.874+0000 7ff3e1ffb640 1 -- 10.20.193.155:0/1338730733 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3d0003620 con 0x7ff3e4144a00 2026-02-22T23:23:41.860 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.874+0000 7ff3e1ffb640 1 -- 10.20.193.155:0/1338730733 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1198440368 0 0) 0x7ff3d4002ca0 con 0x7ff3e413ea10 2026-02-22T23:23:41.860 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.874+0000 7ff3e1ffb640 1 -- 10.20.193.155:0/1338730733 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3e4144de0 con 0x7ff3e413ea10 2026-02-22T23:23:41.860 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.874+0000 7ff3e1ffb640 1 -- 10.20.193.155:0/1338730733 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3228030840 0 0) 0x7ff3d0003620 con 0x7ff3e4144a00 2026-02-22T23:23:41.860 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.874+0000 7ff3e1ffb640 1 -- 10.20.193.155:0/1338730733 >> v1:10.20.193.93:6790/0 conn(0x7ff3e41452d0 legacy=0x7ff3e413e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:41.860 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.874+0000 7ff3e1ffb640 1 -- 10.20.193.155:0/1338730733 >> v1:10.20.193.93:6789/0 conn(0x7ff3e413ea10 legacy=0x7ff3e414cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:41.860 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.874+0000 7ff3e1ffb640 1 -- 10.20.193.155:0/1338730733 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3e4074320 con 0x7ff3e4144a00 2026-02-22T23:23:41.861 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.874+0000 7ff3e1ffb640 1 -- 10.20.193.155:0/1338730733 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7ff3d8002ea0 con 0x7ff3e4144a00 2026-02-22T23:23:41.861 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.874+0000 7ff3e1ffb640 1 -- 10.20.193.155:0/1338730733 <== mon.1 v1:10.20.193.155:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff3d80030c0 con 0x7ff3e4144a00 2026-02-22T23:23:41.861 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.874+0000 7ff3e1ffb640 1 -- 10.20.193.155:0/1338730733 <== mon.1 v1:10.20.193.155:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7ff3d80034d0 con 0x7ff3e4144a00 2026-02-22T23:23:41.861 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.874+0000 7ff3e9355640 1 -- 10.20.193.155:0/1338730733 >> v1:10.20.193.155:6789/0 conn(0x7ff3e4144a00 legacy=0x7ff3e40afa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:41.861 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.874+0000 7ff3e9355640 1 -- 10.20.193.155:0/1338730733 shutdown_connections 2026-02-22T23:23:41.861 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.874+0000 7ff3e9355640 1 -- 10.20.193.155:0/1338730733 >> 10.20.193.155:0/1338730733 conn(0x7ff3e40b1d30 msgr2=0x7ff3e40b2140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:23:41.861 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.874+0000 7ff3e9355640 1 -- 10.20.193.155:0/1338730733 shutdown_connections 2026-02-22T23:23:41.861 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.874+0000 7ff3e9355640 1 -- 10.20.193.155:0/1338730733 wait complete. 2026-02-22T23:23:41.861 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.875+0000 7ff3e9355640 1 Processor -- start 2026-02-22T23:23:41.861 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.875+0000 7ff3e9355640 1 -- start start 2026-02-22T23:23:41.861 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.875+0000 7ff3e9355640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3e40abc80 con 0x7ff3e4144a00 2026-02-22T23:23:41.861 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.875+0000 7ff3e9355640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3e40abf60 con 0x7ff3e413ea10 2026-02-22T23:23:41.862 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.875+0000 7ff3e9355640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3e40ac240 con 0x7ff3e41452d0 2026-02-22T23:23:41.862 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.875+0000 7ff3e2ffd640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7ff3e413ea10 0x7ff3e40ac660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.155:49514/0 (socket says 10.20.193.155:49514) 2026-02-22T23:23:41.862 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.875+0000 7ff3e2ffd640 1 -- 10.20.193.155:0/707912317 learned_addr learned my addr 10.20.193.155:0/707912317 (peer_addr_for_me v1:10.20.193.155:0/0) 2026-02-22T23:23:41.862 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.875+0000 7ff3c37fe640 1 -- 10.20.193.155:0/707912317 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4211888765 0 0) 0x7ff3e40abf60 con 0x7ff3e413ea10 2026-02-22T23:23:41.862 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.875+0000 7ff3c37fe640 1 -- 10.20.193.155:0/707912317 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3b0003620 con 0x7ff3e413ea10 2026-02-22T23:23:41.862 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.875+0000 7ff3c37fe640 1 -- 10.20.193.155:0/707912317 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 532768929 0 0) 0x7ff3b0003620 con 0x7ff3e413ea10 2026-02-22T23:23:41.862 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.875+0000 7ff3c37fe640 1 -- 10.20.193.155:0/707912317 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff3e40abf60 con 0x7ff3e413ea10 2026-02-22T23:23:41.862 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.875+0000 7ff3c37fe640 1 -- 10.20.193.155:0/707912317 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7ff3d8003410 con 0x7ff3e413ea10 2026-02-22T23:23:41.862 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.875+0000 7ff3c37fe640 1 -- 10.20.193.155:0/707912317 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 520704490 0 0) 0x7ff3e40abc80 con 0x7ff3e4144a00 2026-02-22T23:23:41.862 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.875+0000 7ff3c37fe640 1 -- 10.20.193.155:0/707912317 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3b0003620 con 0x7ff3e4144a00 2026-02-22T23:23:41.862 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.875+0000 7ff3c37fe640 1 -- 10.20.193.155:0/707912317 <== mon.1 v1:10.20.193.155:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1044999153 0 0) 0x7ff3e40abf60 con 0x7ff3e413ea10 2026-02-22T23:23:41.862 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.875+0000 7ff3c37fe640 1 -- 10.20.193.155:0/707912317 >> v1:10.20.193.93:6790/0 conn(0x7ff3e41452d0 legacy=0x7ff3e41e31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:41.862 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.875+0000 7ff3c37fe640 1 -- 10.20.193.155:0/707912317 >> v1:10.20.193.93:6789/0 conn(0x7ff3e4144a00 legacy=0x7ff3e4140300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:41.863 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.875+0000 7ff3c37fe640 1 -- 10.20.193.155:0/707912317 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3e4141f00 con 0x7ff3e413ea10 2026-02-22T23:23:41.863 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.875+0000 7ff3e9355640 1 -- 10.20.193.155:0/707912317 --> v1:10.20.193.155:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff3e4141430 con 0x7ff3e413ea10 2026-02-22T23:23:41.863 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.875+0000 7ff3c37fe640 1 -- 10.20.193.155:0/707912317 <== mon.1 v1:10.20.193.155:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff3d8004cf0 con 0x7ff3e413ea10 2026-02-22T23:23:41.863 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.875+0000 7ff3c37fe640 1 -- 10.20.193.155:0/707912317 <== mon.1 v1:10.20.193.155:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7ff3d8005140 con 0x7ff3e413ea10 2026-02-22T23:23:41.863 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.875+0000 7ff3e9355640 1 -- 10.20.193.155:0/707912317 --> v1:10.20.193.155:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff3e40aadc0 con 0x7ff3e413ea10 2026-02-22T23:23:41.863 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.875+0000 7ff3c37fe640 1 -- 10.20.193.155:0/707912317 <== mon.1 v1:10.20.193.155:6789/0 7 ==== mgrmap(e 1) ==== 811+0+0 (unknown 4133961934 0 0) 0x7ff3d8005670 con 0x7ff3e413ea10 2026-02-22T23:23:41.863 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.875+0000 7ff3c37fe640 1 -- 10.20.193.155:0/707912317 <== mon.1 v1:10.20.193.155:6789/0 8 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (unknown 133798011 0 0) 0x7ff3d8003060 con 0x7ff3e413ea10 2026-02-22T23:23:41.863 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.876+0000 7ff3e9355640 1 -- 10.20.193.155:0/707912317 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3e4141c60 con 0x7ff3e413ea10 2026-02-22T23:23:41.863 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.877+0000 7ff3c37fe640 1 -- 10.20.193.155:0/707912317 <== mon.1 v1:10.20.193.155:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (unknown 1092875540 0 4127419540) 0x7ff3d8006a80 con 0x7ff3e413ea10 2026-02-22T23:23:41.890 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.909+0000 7ff3e9355640 1 -- 10.20.193.155:0/707912317 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "osd new", "uuid": "d7a29cea-4066-455f-8a32-f4cb5534ae32", "id": 3} v 0) -- 0x7ff3e413d8d0 con 0x7ff3e413ea10 2026-02-22T23:23:41.892 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.911+0000 7ff3c37fe640 1 -- 10.20.193.155:0/707912317 <== mon.1 v1:10.20.193.155:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d7a29cea-4066-455f-8a32-f4cb5534ae32", "id": 3}]=0 v6) ==== 112+0+2 (unknown 2164875442 0 525046306) 0x7ff3d8005990 con 0x7ff3e413ea10 2026-02-22T23:23:41.892 INFO:teuthology.orchestra.run.trial155.stdout:3 2026-02-22T23:23:41.893 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.911+0000 7ff3e9355640 1 -- 10.20.193.155:0/707912317 >> v1:10.20.193.155:6789/0 conn(0x7ff3e413ea10 legacy=0x7ff3e40ac660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:41.893 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.911+0000 7ff3e9355640 1 -- 10.20.193.155:0/707912317 shutdown_connections 2026-02-22T23:23:41.893 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.911+0000 7ff3e9355640 1 -- 10.20.193.155:0/707912317 >> 10.20.193.155:0/707912317 conn(0x7ff3e40b1d30 msgr2=0x7ff3e40af950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:23:41.893 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.911+0000 7ff3e9355640 1 -- 10.20.193.155:0/707912317 shutdown_connections 2026-02-22T23:23:41.893 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:41.911+0000 7ff3e9355640 1 -- 10.20.193.155:0/707912317 wait complete. 2026-02-22T23:23:41.900 DEBUG:teuthology.orchestra.run.trial155:> sudo ceph --cluster ceph osd new 6a1874d8-3703-429f-839b-d3dc0f448b14 4 2026-02-22T23:23:42.008 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.023+0000 7ff57f3ce640 1 Processor -- start 2026-02-22T23:23:42.008 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.023+0000 7ff57f3ce640 1 -- start start 2026-02-22T23:23:42.009 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.023+0000 7ff57f3ce640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5780aa8e0 con 0x7ff578140700 2026-02-22T23:23:42.009 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.023+0000 7ff57f3ce640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5780aabc0 con 0x7ff5780ab0e0 2026-02-22T23:23:42.009 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.023+0000 7ff57f3ce640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5780b36a0 con 0x7ff5780b58d0 2026-02-22T23:23:42.009 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.023+0000 7ff57dbcb640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7ff5780ab0e0 0x7ff5780b2f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.155:49516/0 (socket says 10.20.193.155:49516) 2026-02-22T23:23:42.009 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.023+0000 7ff57dbcb640 1 -- 10.20.193.155:0/2003841316 learned_addr learned my addr 10.20.193.155:0/2003841316 (peer_addr_for_me v1:10.20.193.155:0/0) 2026-02-22T23:23:42.009 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.023+0000 7ff57d3ca640 1 -- 10.20.193.155:0/2003841316 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3475647296 0 0) 0x7ff5780aabc0 con 0x7ff5780ab0e0 2026-02-22T23:23:42.009 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.023+0000 7ff57d3ca640 1 -- 10.20.193.155:0/2003841316 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff560003620 con 0x7ff5780ab0e0 2026-02-22T23:23:42.009 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.023+0000 7ff57d3ca640 1 -- 10.20.193.155:0/2003841316 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3476094425 0 0) 0x7ff5780b36a0 con 0x7ff5780b58d0 2026-02-22T23:23:42.009 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.023+0000 7ff57d3ca640 1 -- 10.20.193.155:0/2003841316 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5780aabc0 con 0x7ff5780b58d0 2026-02-22T23:23:42.009 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.024+0000 7ff57d3ca640 1 -- 10.20.193.155:0/2003841316 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 325241570 0 0) 0x7ff560003620 con 0x7ff5780ab0e0 2026-02-22T23:23:42.010 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.024+0000 7ff57d3ca640 1 -- 10.20.193.155:0/2003841316 >> v1:10.20.193.93:6790/0 conn(0x7ff5780b58d0 legacy=0x7ff578146890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:42.010 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.024+0000 7ff57d3ca640 1 -- 10.20.193.155:0/2003841316 >> v1:10.20.193.93:6789/0 conn(0x7ff578140700 legacy=0x7ff57814ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:42.010 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.024+0000 7ff57d3ca640 1 -- 10.20.193.155:0/2003841316 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5780ab540 con 0x7ff5780ab0e0 2026-02-22T23:23:42.010 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.024+0000 7ff57d3ca640 1 -- 10.20.193.155:0/2003841316 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7ff56c002ea0 con 0x7ff5780ab0e0 2026-02-22T23:23:42.010 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.024+0000 7ff57d3ca640 1 -- 10.20.193.155:0/2003841316 <== mon.1 v1:10.20.193.155:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff56c0030c0 con 0x7ff5780ab0e0 2026-02-22T23:23:42.010 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.024+0000 7ff57d3ca640 1 -- 10.20.193.155:0/2003841316 <== mon.1 v1:10.20.193.155:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7ff56c003490 con 0x7ff5780ab0e0 2026-02-22T23:23:42.010 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.024+0000 7ff57f3ce640 1 -- 10.20.193.155:0/2003841316 >> v1:10.20.193.155:6789/0 conn(0x7ff5780ab0e0 legacy=0x7ff5780b2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:42.010 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.024+0000 7ff57f3ce640 1 -- 10.20.193.155:0/2003841316 shutdown_connections 2026-02-22T23:23:42.010 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.024+0000 7ff57f3ce640 1 -- 10.20.193.155:0/2003841316 >> 10.20.193.155:0/2003841316 conn(0x7ff578068410 msgr2=0x7ff578068820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:23:42.010 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.024+0000 7ff57f3ce640 1 -- 10.20.193.155:0/2003841316 shutdown_connections 2026-02-22T23:23:42.010 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.024+0000 7ff57f3ce640 1 -- 10.20.193.155:0/2003841316 wait complete. 2026-02-22T23:23:42.010 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.025+0000 7ff57f3ce640 1 Processor -- start 2026-02-22T23:23:42.011 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.025+0000 7ff57f3ce640 1 -- start start 2026-02-22T23:23:42.011 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.025+0000 7ff57f3ce640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff57813b6d0 con 0x7ff578140700 2026-02-22T23:23:42.011 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.025+0000 7ff57f3ce640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5781d7030 con 0x7ff5780ab0e0 2026-02-22T23:23:42.011 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.025+0000 7ff57f3ce640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff578139ba0 con 0x7ff5780b58d0 2026-02-22T23:23:42.011 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.025+0000 7ff57e3cc640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7ff5780ab0e0 0x7ff5781d75e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.155:49532/0 (socket says 10.20.193.155:49532) 2026-02-22T23:23:42.011 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.025+0000 7ff57e3cc640 1 -- 10.20.193.155:0/2012371336 learned_addr learned my addr 10.20.193.155:0/2012371336 (peer_addr_for_me v1:10.20.193.155:0/0) 2026-02-22T23:23:42.011 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.025+0000 7ff55effd640 1 -- 10.20.193.155:0/2012371336 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1414714368 0 0) 0x7ff5781d7030 con 0x7ff5780ab0e0 2026-02-22T23:23:42.011 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.025+0000 7ff55effd640 1 -- 10.20.193.155:0/2012371336 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff548003620 con 0x7ff5780ab0e0 2026-02-22T23:23:42.011 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.025+0000 7ff55effd640 1 -- 10.20.193.155:0/2012371336 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3523024408 0 0) 0x7ff548003620 con 0x7ff5780ab0e0 2026-02-22T23:23:42.011 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.025+0000 7ff55effd640 1 -- 10.20.193.155:0/2012371336 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff5781d7030 con 0x7ff5780ab0e0 2026-02-22T23:23:42.011 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.025+0000 7ff55effd640 1 -- 10.20.193.155:0/2012371336 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7ff568003220 con 0x7ff5780ab0e0 2026-02-22T23:23:42.011 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.025+0000 7ff55effd640 1 -- 10.20.193.155:0/2012371336 <== mon.1 v1:10.20.193.155:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 523858771 0 0) 0x7ff5781d7030 con 0x7ff5780ab0e0 2026-02-22T23:23:42.012 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.025+0000 7ff55effd640 1 -- 10.20.193.155:0/2012371336 >> v1:10.20.193.93:6790/0 conn(0x7ff5780b58d0 legacy=0x7ff5781ddb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:42.012 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.025+0000 7ff55effd640 1 -- 10.20.193.155:0/2012371336 >> v1:10.20.193.93:6789/0 conn(0x7ff578140700 legacy=0x7ff5781de260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:42.012 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.025+0000 7ff55effd640 1 -- 10.20.193.155:0/2012371336 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff578139d70 con 0x7ff5780ab0e0 2026-02-22T23:23:42.012 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.025+0000 7ff57f3ce640 1 -- 10.20.193.155:0/2012371336 --> v1:10.20.193.155:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff5781d7cf0 con 0x7ff5780ab0e0 2026-02-22T23:23:42.012 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.025+0000 7ff57f3ce640 1 -- 10.20.193.155:0/2012371336 --> v1:10.20.193.155:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff57813a260 con 0x7ff5780ab0e0 2026-02-22T23:23:42.012 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.025+0000 7ff55effd640 1 -- 10.20.193.155:0/2012371336 <== mon.1 v1:10.20.193.155:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff568003520 con 0x7ff5780ab0e0 2026-02-22T23:23:42.012 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.025+0000 7ff55effd640 1 -- 10.20.193.155:0/2012371336 <== mon.1 v1:10.20.193.155:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7ff568003b60 con 0x7ff5780ab0e0 2026-02-22T23:23:42.012 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.025+0000 7ff55effd640 1 -- 10.20.193.155:0/2012371336 <== mon.1 v1:10.20.193.155:6789/0 7 ==== mgrmap(e 1) ==== 811+0+0 (unknown 4133961934 0 0) 0x7ff568004090 con 0x7ff5780ab0e0 2026-02-22T23:23:42.012 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.025+0000 7ff55effd640 1 -- 10.20.193.155:0/2012371336 <== mon.1 v1:10.20.193.155:6789/0 8 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (unknown 1299516531 0 0) 0x7ff5680043b0 con 0x7ff5780ab0e0 2026-02-22T23:23:42.012 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.026+0000 7ff57f3ce640 1 -- 10.20.193.155:0/2012371336 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5780008d0 con 0x7ff5780ab0e0 2026-02-22T23:23:42.013 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.027+0000 7ff55effd640 1 -- 10.20.193.155:0/2012371336 <== mon.1 v1:10.20.193.155:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (unknown 1092875540 0 4127419540) 0x7ff5680058c0 con 0x7ff5780ab0e0 2026-02-22T23:23:42.034 INFO:tasks.ceph.mgr.y.trial093.stderr:2026-02-22T23:23:42.032+0000 7f06a77db140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-22T23:23:42.038 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T23:23:42.056+0000 7f9a87e2e140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-22T23:23:42.042 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.060+0000 7ff57f3ce640 1 -- 10.20.193.155:0/2012371336 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "osd new", "uuid": "6a1874d8-3703-429f-839b-d3dc0f448b14", "id": 4} v 0) -- 0x7ff578139530 con 0x7ff5780ab0e0 2026-02-22T23:23:42.044 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.062+0000 7ff55effd640 1 -- 10.20.193.155:0/2012371336 <== mon.1 v1:10.20.193.155:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6a1874d8-3703-429f-839b-d3dc0f448b14", "id": 4}]=0 v7) ==== 112+0+2 (unknown 4280229147 0 1697012583) 0x7ff568005b20 con 0x7ff5780ab0e0 2026-02-22T23:23:42.044 INFO:teuthology.orchestra.run.trial155.stdout:4 2026-02-22T23:23:42.045 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.063+0000 7ff57f3ce640 1 -- 10.20.193.155:0/2012371336 >> v1:10.20.193.155:6789/0 conn(0x7ff5780ab0e0 legacy=0x7ff5781d75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:42.045 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.063+0000 7ff57f3ce640 1 -- 10.20.193.155:0/2012371336 shutdown_connections 2026-02-22T23:23:42.045 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.063+0000 7ff57f3ce640 1 -- 10.20.193.155:0/2012371336 >> 10.20.193.155:0/2012371336 conn(0x7ff578068410 msgr2=0x7ff5780b7220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:23:42.045 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.063+0000 7ff57f3ce640 1 -- 10.20.193.155:0/2012371336 shutdown_connections 2026-02-22T23:23:42.045 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.063+0000 7ff57f3ce640 1 -- 10.20.193.155:0/2012371336 wait complete. 2026-02-22T23:23:42.053 DEBUG:teuthology.orchestra.run.trial155:> sudo ceph --cluster ceph osd new 447cea4f-f753-457e-b654-85ade052dc45 5 2026-02-22T23:23:42.089 INFO:tasks.ceph.mgr.y.trial093.stderr:2026-02-22T23:23:42.086+0000 7f06a77db140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-22T23:23:42.093 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T23:23:42.112+0000 7f9a87e2e140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-22T23:23:42.111 INFO:tasks.ceph.mgr.y.trial093.stderr:2026-02-22T23:23:42.109+0000 7f06a77db140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-22T23:23:42.116 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T23:23:42.135+0000 7f9a87e2e140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-22T23:23:42.117 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.136+0000 7fd6acf44640 1 Processor -- start 2026-02-22T23:23:42.117 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.136+0000 7fd6acf44640 1 -- start start 2026-02-22T23:23:42.122 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.136+0000 7fd6acf44640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6a813ee30 con 0x7fd6a813ea10 2026-02-22T23:23:42.122 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.136+0000 7fd6acf44640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6a8144de0 con 0x7fd6a81452d0 2026-02-22T23:23:42.122 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.136+0000 7fd6acf44640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6a8074040 con 0x7fd6a8144a00 2026-02-22T23:23:42.122 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.136+0000 7fd6a5d74640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7fd6a81452d0 0x7fd6a813e300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.155:49536/0 (socket says 10.20.193.155:49536) 2026-02-22T23:23:42.122 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.136+0000 7fd6a5d74640 1 -- 10.20.193.155:0/4242496108 learned_addr learned my addr 10.20.193.155:0/4242496108 (peer_addr_for_me v1:10.20.193.155:0/0) 2026-02-22T23:23:42.122 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.136+0000 7fd6a5573640 1 -- 10.20.193.155:0/4242496108 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3932480645 0 0) 0x7fd6a8144de0 con 0x7fd6a81452d0 2026-02-22T23:23:42.122 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.136+0000 7fd6a5573640 1 -- 10.20.193.155:0/4242496108 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd694003620 con 0x7fd6a81452d0 2026-02-22T23:23:42.122 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.136+0000 7fd6a5573640 1 -- 10.20.193.155:0/4242496108 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4227432648 0 0) 0x7fd694003620 con 0x7fd6a81452d0 2026-02-22T23:23:42.123 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.136+0000 7fd6a5573640 1 -- 10.20.193.155:0/4242496108 >> v1:10.20.193.93:6790/0 conn(0x7fd6a8144a00 legacy=0x7fd6a80afa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:42.123 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.136+0000 7fd6a5573640 1 -- 10.20.193.155:0/4242496108 >> v1:10.20.193.93:6789/0 conn(0x7fd6a813ea10 legacy=0x7fd6a814cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:42.123 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.136+0000 7fd6a5573640 1 -- 10.20.193.155:0/4242496108 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6a8074320 con 0x7fd6a81452d0 2026-02-22T23:23:42.123 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.136+0000 7fd6a5573640 1 -- 10.20.193.155:0/4242496108 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fd690002ea0 con 0x7fd6a81452d0 2026-02-22T23:23:42.123 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.136+0000 7fd6a5573640 1 -- 10.20.193.155:0/4242496108 <== mon.1 v1:10.20.193.155:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd6900030c0 con 0x7fd6a81452d0 2026-02-22T23:23:42.123 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.136+0000 7fd6a5573640 1 -- 10.20.193.155:0/4242496108 <== mon.1 v1:10.20.193.155:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fd690003490 con 0x7fd6a81452d0 2026-02-22T23:23:42.123 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.137+0000 7fd6acf44640 1 -- 10.20.193.155:0/4242496108 >> v1:10.20.193.155:6789/0 conn(0x7fd6a81452d0 legacy=0x7fd6a813e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:42.123 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.137+0000 7fd6acf44640 1 -- 10.20.193.155:0/4242496108 shutdown_connections 2026-02-22T23:23:42.123 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.137+0000 7fd6acf44640 1 -- 10.20.193.155:0/4242496108 >> 10.20.193.155:0/4242496108 conn(0x7fd6a80b1d30 msgr2=0x7fd6a80b2140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:23:42.123 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.137+0000 7fd6acf44640 1 -- 10.20.193.155:0/4242496108 shutdown_connections 2026-02-22T23:23:42.123 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.137+0000 7fd6acf44640 1 -- 10.20.193.155:0/4242496108 wait complete. 2026-02-22T23:23:42.123 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.138+0000 7fd6acf44640 1 Processor -- start 2026-02-22T23:23:42.124 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.138+0000 7fd6acf44640 1 -- start start 2026-02-22T23:23:42.124 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.138+0000 7fd6acf44640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6a8132ba0 con 0x7fd6a81452d0 2026-02-22T23:23:42.124 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.138+0000 7fd6acf44640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6a813f010 con 0x7fd6a813ea10 2026-02-22T23:23:42.124 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.138+0000 7fd6acf44640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6a813f2f0 con 0x7fd6a8144a00 2026-02-22T23:23:42.124 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.138+0000 7fd6a6575640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7fd6a813ea10 0x7fd6a81da530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.155:49540/0 (socket says 10.20.193.155:49540) 2026-02-22T23:23:42.124 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.138+0000 7fd6a6575640 1 -- 10.20.193.155:0/563574127 learned_addr learned my addr 10.20.193.155:0/563574127 (peer_addr_for_me v1:10.20.193.155:0/0) 2026-02-22T23:23:42.124 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.138+0000 7fd68effd640 1 -- 10.20.193.155:0/563574127 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3254381974 0 0) 0x7fd6a813f010 con 0x7fd6a813ea10 2026-02-22T23:23:42.124 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.138+0000 7fd68effd640 1 -- 10.20.193.155:0/563574127 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd674003620 con 0x7fd6a813ea10 2026-02-22T23:23:42.124 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.138+0000 7fd68effd640 1 -- 10.20.193.155:0/563574127 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1091405571 0 0) 0x7fd674003620 con 0x7fd6a813ea10 2026-02-22T23:23:42.124 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.138+0000 7fd68effd640 1 -- 10.20.193.155:0/563574127 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd6a813f010 con 0x7fd6a813ea10 2026-02-22T23:23:42.124 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.138+0000 7fd68effd640 1 -- 10.20.193.155:0/563574127 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fd69c003240 con 0x7fd6a813ea10 2026-02-22T23:23:42.124 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.138+0000 7fd68effd640 1 -- 10.20.193.155:0/563574127 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 305037727 0 0) 0x7fd6a813f2f0 con 0x7fd6a8144a00 2026-02-22T23:23:42.125 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.138+0000 7fd68effd640 1 -- 10.20.193.155:0/563574127 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd674003620 con 0x7fd6a8144a00 2026-02-22T23:23:42.125 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.138+0000 7fd68effd640 1 -- 10.20.193.155:0/563574127 <== mon.1 v1:10.20.193.155:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2016156520 0 0) 0x7fd6a813f010 con 0x7fd6a813ea10 2026-02-22T23:23:42.125 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.138+0000 7fd68effd640 1 -- 10.20.193.155:0/563574127 >> v1:10.20.193.93:6790/0 conn(0x7fd6a8144a00 legacy=0x7fd6a8131d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:42.125 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.138+0000 7fd68effd640 1 -- 10.20.193.155:0/563574127 >> v1:10.20.193.93:6789/0 conn(0x7fd6a81452d0 legacy=0x7fd6a8132490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:42.125 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.138+0000 7fd68effd640 1 -- 10.20.193.155:0/563574127 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6a8070f80 con 0x7fd6a813ea10 2026-02-22T23:23:42.125 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.139+0000 7fd6acf44640 1 -- 10.20.193.155:0/563574127 --> v1:10.20.193.155:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd6a80b4930 con 0x7fd6a813ea10 2026-02-22T23:23:42.125 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.139+0000 7fd6acf44640 1 -- 10.20.193.155:0/563574127 --> v1:10.20.193.155:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd6a80717b0 con 0x7fd6a813ea10 2026-02-22T23:23:42.125 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.139+0000 7fd68effd640 1 -- 10.20.193.155:0/563574127 <== mon.1 v1:10.20.193.155:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd69c0039c0 con 0x7fd6a813ea10 2026-02-22T23:23:42.125 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.139+0000 7fd68effd640 1 -- 10.20.193.155:0/563574127 <== mon.1 v1:10.20.193.155:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fd69c003d90 con 0x7fd6a813ea10 2026-02-22T23:23:42.125 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.139+0000 7fd68effd640 1 -- 10.20.193.155:0/563574127 <== mon.1 v1:10.20.193.155:6789/0 7 ==== mgrmap(e 1) ==== 811+0+0 (unknown 4133961934 0 0) 0x7fd69c0042c0 con 0x7fd6a813ea10 2026-02-22T23:23:42.125 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.139+0000 7fd68effd640 1 -- 10.20.193.155:0/563574127 <== mon.1 v1:10.20.193.155:6789/0 8 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (unknown 34059809 0 0) 0x7fd69c006a50 con 0x7fd6a813ea10 2026-02-22T23:23:42.126 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.139+0000 7fd6acf44640 1 -- 10.20.193.155:0/563574127 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6a80008d0 con 0x7fd6a813ea10 2026-02-22T23:23:42.126 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.140+0000 7fd68effd640 1 -- 10.20.193.155:0/563574127 <== mon.1 v1:10.20.193.155:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (unknown 1092875540 0 4127419540) 0x7fd69c006530 con 0x7fd6a813ea10 2026-02-22T23:23:42.134 INFO:tasks.ceph.mgr.y.trial093.stderr:2026-02-22T23:23:42.132+0000 7f06a77db140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-22T23:23:42.140 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T23:23:42.158+0000 7f9a87e2e140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-22T23:23:42.154 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.172+0000 7fd6acf44640 1 -- 10.20.193.155:0/563574127 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "osd new", "uuid": "447cea4f-f753-457e-b654-85ade052dc45", "id": 5} v 0) -- 0x7fd6a813ad30 con 0x7fd6a813ea10 2026-02-22T23:23:42.156 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.174+0000 7fd68effd640 1 -- 10.20.193.155:0/563574127 <== mon.1 v1:10.20.193.155:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "447cea4f-f753-457e-b654-85ade052dc45", "id": 5}]=0 v8) ==== 112+0+2 (unknown 3885271753 0 1988412176) 0x7fd69c0058c0 con 0x7fd6a813ea10 2026-02-22T23:23:42.156 INFO:teuthology.orchestra.run.trial155.stdout:5 2026-02-22T23:23:42.157 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.175+0000 7fd6acf44640 1 -- 10.20.193.155:0/563574127 >> v1:10.20.193.155:6789/0 conn(0x7fd6a813ea10 legacy=0x7fd6a81da530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:42.157 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.175+0000 7fd6acf44640 1 -- 10.20.193.155:0/563574127 shutdown_connections 2026-02-22T23:23:42.157 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.175+0000 7fd6acf44640 1 -- 10.20.193.155:0/563574127 >> 10.20.193.155:0/563574127 conn(0x7fd6a80b1d30 msgr2=0x7fd6a806cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:23:42.157 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.175+0000 7fd6acf44640 1 -- 10.20.193.155:0/563574127 shutdown_connections 2026-02-22T23:23:42.158 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.175+0000 7fd6acf44640 1 -- 10.20.193.155:0/563574127 wait complete. 2026-02-22T23:23:42.164 DEBUG:teuthology.orchestra.run.trial155:> sudo ceph --cluster ceph osd new dee8274e-5e87-4e06-a9aa-44439f7f5354 6 2026-02-22T23:23:42.188 INFO:tasks.ceph.mgr.y.trial093.stderr:2026-02-22T23:23:42.186+0000 7f06a77db140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-22T23:23:42.194 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T23:23:42.212+0000 7f9a87e2e140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-22T23:23:42.208 INFO:tasks.ceph.mgr.y.trial093.stderr:2026-02-22T23:23:42.206+0000 7f06a77db140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-22T23:23:42.215 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T23:23:42.233+0000 7f9a87e2e140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-22T23:23:42.258 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.276+0000 7f03b0954640 1 Processor -- start 2026-02-22T23:23:42.259 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.276+0000 7f03b0954640 1 -- start start 2026-02-22T23:23:42.263 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.277+0000 7f03b0954640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03ac0aef60 con 0x7f03ac074440 2026-02-22T23:23:42.263 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.277+0000 7f03b0954640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03ac0af1d0 con 0x7f03ac0ad790 2026-02-22T23:23:42.263 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.277+0000 7f03b0954640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03ac0adda0 con 0x7f03ac0ad3b0 2026-02-22T23:23:42.263 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.277+0000 7f03ab577640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7f03ac0ad790 0x7f03ac144e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.155:49548/0 (socket says 10.20.193.155:49548) 2026-02-22T23:23:42.263 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.277+0000 7f03ab577640 1 -- 10.20.193.155:0/669230063 learned_addr learned my addr 10.20.193.155:0/669230063 (peer_addr_for_me v1:10.20.193.155:0/0) 2026-02-22T23:23:42.264 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.277+0000 7f03a9d74640 1 -- 10.20.193.155:0/669230063 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 391105831 0 0) 0x7f03ac0af1d0 con 0x7f03ac0ad790 2026-02-22T23:23:42.264 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.277+0000 7f03a9d74640 1 -- 10.20.193.155:0/669230063 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0398003620 con 0x7f03ac0ad790 2026-02-22T23:23:42.264 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.277+0000 7f03a9d74640 1 -- 10.20.193.155:0/669230063 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3724963838 0 0) 0x7f03ac0aef60 con 0x7f03ac074440 2026-02-22T23:23:42.264 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.277+0000 7f03a9d74640 1 -- 10.20.193.155:0/669230063 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03ac0af1d0 con 0x7f03ac074440 2026-02-22T23:23:42.264 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.277+0000 7f03a9d74640 1 -- 10.20.193.155:0/669230063 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 744736396 0 0) 0x7f0398003620 con 0x7f03ac0ad790 2026-02-22T23:23:42.264 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.277+0000 7f03a9d74640 1 -- 10.20.193.155:0/669230063 >> v1:10.20.193.93:6790/0 conn(0x7f03ac0ad3b0 legacy=0x7f03ac13e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:42.264 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.277+0000 7f03a9d74640 1 -- 10.20.193.155:0/669230063 >> v1:10.20.193.93:6789/0 conn(0x7f03ac074440 legacy=0x7f03ac144730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:42.264 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.277+0000 7f03a9d74640 1 -- 10.20.193.155:0/669230063 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03ac13eba0 con 0x7f03ac0ad790 2026-02-22T23:23:42.264 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.277+0000 7f03a9d74640 1 -- 10.20.193.155:0/669230063 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f039c003220 con 0x7f03ac0ad790 2026-02-22T23:23:42.264 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.277+0000 7f03ab577640 1 -- 10.20.193.155:0/669230063 >> v1:10.20.193.155:6789/0 conn(0x7f03ac0ad790 legacy=0x7f03ac144e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2026-02-22T23:23:42.264 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.277+0000 7f03ab577640 1 -- 10.20.193.155:0/669230063 >> v1:10.20.193.155:6789/0 conn(0x7f03ac0ad790 legacy=0x7f03ac144e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T23:23:42.264 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.277+0000 7f03ab577640 1 --1- 10.20.193.155:0/669230063 >> v1:10.20.193.155:6789/0 conn(0x7f03ac0ad790 0x7f03ac144e40 :-1 s=OPENED pgs=29 cs=1 l=1).handle_message read tag failed 2026-02-22T23:23:42.264 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.277+0000 7f03ab577640 1 --1- 10.20.193.155:0/669230063 >> v1:10.20.193.155:6789/0 conn(0x7f03ac0ad790 0x7f03ac144e40 :-1 s=OPENED pgs=29 cs=1 l=1).fault on lossy channel, failing 2026-02-22T23:23:42.264 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.277+0000 7f03a9d74640 1 -- 10.20.193.155:0/669230063 >> v1:10.20.193.155:6789/0 conn(0x7f03ac0ad790 legacy=0x7f03ac144e40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:23:42.264 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.278+0000 7f03a9d74640 1 -- 10.20.193.155:0/669230063 --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0398003620 con 0x7f03ac074440 2026-02-22T23:23:42.264 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.278+0000 7f03a9d74640 1 -- 10.20.193.155:0/669230063 --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f03ac0aef60 con 0x7f039800b1d0 2026-02-22T23:23:42.265 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.278+0000 7f03a9d74640 1 -- 10.20.193.155:0/669230063 --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0398011030 con 0x7f03ac0ad3b0 2026-02-22T23:23:42.265 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.278+0000 7f03a9d74640 1 -- 10.20.193.155:0/669230063 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 203453468 0 0) 0x7f03ac0aef60 con 0x7f039800b1d0 2026-02-22T23:23:42.265 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.278+0000 7f03a9d74640 1 -- 10.20.193.155:0/669230063 --> v1:10.20.193.155:6789/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7f039800ff60 con 0x7f039800b1d0 2026-02-22T23:23:42.265 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.278+0000 7f03a9d74640 1 -- 10.20.193.155:0/669230063 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (unknown 971554297 0 0) 0x7f039800ff60 con 0x7f039800b1d0 2026-02-22T23:23:42.265 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.278+0000 7f03a9d74640 1 -- 10.20.193.155:0/669230063 >> v1:10.20.193.93:6790/0 conn(0x7f03ac0ad3b0 legacy=0x7f0398003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:42.265 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.278+0000 7f03a9d74640 1 -- 10.20.193.155:0/669230063 >> v1:10.20.193.93:6789/0 conn(0x7f03ac074440 legacy=0x7f0398009ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T23:23:42.265 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.278+0000 7f03a9d74640 1 -- 10.20.193.155:0/669230063 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=2+}) -- 0x7f0398012390 con 0x7f039800b1d0 2026-02-22T23:23:42.265 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.278+0000 7f03a9d74640 1 -- 10.20.193.155:0/669230063 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f039c004f00 con 0x7f039800b1d0 2026-02-22T23:23:42.265 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.278+0000 7f03a9d74640 1 -- 10.20.193.155:0/669230063 <== mon.1 v1:10.20.193.155:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f039c003440 con 0x7f039800b1d0 2026-02-22T23:23:42.265 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.278+0000 7f03b0954640 1 -- 10.20.193.155:0/669230063 >> v1:10.20.193.155:6789/0 conn(0x7f039800b1d0 legacy=0x7f039800d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:42.265 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.278+0000 7f03b0954640 1 -- 10.20.193.155:0/669230063 shutdown_connections 2026-02-22T23:23:42.265 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.278+0000 7f03b0954640 1 -- 10.20.193.155:0/669230063 >> 10.20.193.155:0/669230063 conn(0x7f03ac0b4c90 msgr2=0x7f03ac0b50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:23:42.266 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.278+0000 7f03b0954640 1 -- 10.20.193.155:0/669230063 shutdown_connections 2026-02-22T23:23:42.266 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.278+0000 7f03b0954640 1 -- 10.20.193.155:0/669230063 wait complete. 2026-02-22T23:23:42.266 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.279+0000 7f03b0954640 1 Processor -- start 2026-02-22T23:23:42.266 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.279+0000 7f03b0954640 1 -- start start 2026-02-22T23:23:42.266 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.279+0000 7f03b0954640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03ac135fa0 con 0x7f03ac0ad3b0 2026-02-22T23:23:42.266 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.279+0000 7f03b0954640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03ac140350 con 0x7f039800b1d0 2026-02-22T23:23:42.266 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.279+0000 7f03b0954640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03ac140630 con 0x7f03ac074440 2026-02-22T23:23:42.266 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.279+0000 7f03aad76640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7f039800b1d0 0x7f03ac0aa8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.155:49574/0 (socket says 10.20.193.155:49574) 2026-02-22T23:23:42.266 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.279+0000 7f03aad76640 1 -- 10.20.193.155:0/2236899624 learned_addr learned my addr 10.20.193.155:0/2236899624 (peer_addr_for_me v1:10.20.193.155:0/0) 2026-02-22T23:23:42.266 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.279+0000 7f038b7fe640 1 -- 10.20.193.155:0/2236899624 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1519959668 0 0) 0x7f03ac140350 con 0x7f039800b1d0 2026-02-22T23:23:42.266 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.279+0000 7f038b7fe640 1 -- 10.20.193.155:0/2236899624 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0378003620 con 0x7f039800b1d0 2026-02-22T23:23:42.266 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.280+0000 7f038b7fe640 1 -- 10.20.193.155:0/2236899624 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2480781492 0 0) 0x7f0378003620 con 0x7f039800b1d0 2026-02-22T23:23:42.267 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.280+0000 7f038b7fe640 1 -- 10.20.193.155:0/2236899624 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f03ac140350 con 0x7f039800b1d0 2026-02-22T23:23:42.267 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.280+0000 7f038b7fe640 1 -- 10.20.193.155:0/2236899624 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f03a0004170 con 0x7f039800b1d0 2026-02-22T23:23:42.267 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.280+0000 7f038b7fe640 1 -- 10.20.193.155:0/2236899624 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2973279118 0 0) 0x7f03ac135fa0 con 0x7f03ac0ad3b0 2026-02-22T23:23:42.267 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.280+0000 7f038b7fe640 1 -- 10.20.193.155:0/2236899624 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0378003620 con 0x7f03ac0ad3b0 2026-02-22T23:23:42.267 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.280+0000 7f038b7fe640 1 -- 10.20.193.155:0/2236899624 <== mon.1 v1:10.20.193.155:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1444122753 0 0) 0x7f03ac140350 con 0x7f039800b1d0 2026-02-22T23:23:42.267 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.280+0000 7f038b7fe640 1 -- 10.20.193.155:0/2236899624 >> v1:10.20.193.93:6790/0 conn(0x7f03ac074440 legacy=0x7f03ac135180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:42.267 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.280+0000 7f038b7fe640 1 -- 10.20.193.155:0/2236899624 >> v1:10.20.193.93:6789/0 conn(0x7f03ac0ad3b0 legacy=0x7f03ac135890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:42.267 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.280+0000 7f038b7fe640 1 -- 10.20.193.155:0/2236899624 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03ac140910 con 0x7f039800b1d0 2026-02-22T23:23:42.267 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.280+0000 7f03b0954640 1 -- 10.20.193.155:0/2236899624 --> v1:10.20.193.155:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f03ac0aaff0 con 0x7f039800b1d0 2026-02-22T23:23:42.267 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.280+0000 7f038b7fe640 1 -- 10.20.193.155:0/2236899624 <== mon.1 v1:10.20.193.155:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f03a00044f0 con 0x7f039800b1d0 2026-02-22T23:23:42.267 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.280+0000 7f03b0954640 1 -- 10.20.193.155:0/2236899624 --> v1:10.20.193.155:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f03ac13f4b0 con 0x7f039800b1d0 2026-02-22T23:23:42.267 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.280+0000 7f038b7fe640 1 -- 10.20.193.155:0/2236899624 <== mon.1 v1:10.20.193.155:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f03a0002f50 con 0x7f039800b1d0 2026-02-22T23:23:42.267 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.280+0000 7f038b7fe640 1 -- 10.20.193.155:0/2236899624 <== mon.1 v1:10.20.193.155:6789/0 7 ==== mgrmap(e 1) ==== 811+0+0 (unknown 4133961934 0 0) 0x7f03a0003500 con 0x7f039800b1d0 2026-02-22T23:23:42.267 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.280+0000 7f038b7fe640 1 -- 10.20.193.155:0/2236899624 <== mon.1 v1:10.20.193.155:6789/0 8 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (unknown 3425912363 0 0) 0x7f03a0003820 con 0x7f039800b1d0 2026-02-22T23:23:42.268 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.280+0000 7f03b0954640 1 -- 10.20.193.155:0/2236899624 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03ac13f7a0 con 0x7f039800b1d0 2026-02-22T23:23:42.268 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.281+0000 7f038b7fe640 1 -- 10.20.193.155:0/2236899624 <== mon.1 v1:10.20.193.155:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (unknown 1092875540 0 4127419540) 0x7f03a0005dd0 con 0x7f039800b1d0 2026-02-22T23:23:42.268 INFO:tasks.ceph.mgr.y.trial093.stderr:2026-02-22T23:23:42.258+0000 7f06a77db140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-22T23:23:42.268 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T23:23:42.286+0000 7f9a87e2e140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-22T23:23:42.296 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.314+0000 7f03b0954640 1 -- 10.20.193.155:0/2236899624 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "osd new", "uuid": "dee8274e-5e87-4e06-a9aa-44439f7f5354", "id": 6} v 0) -- 0x7f03ac1392a0 con 0x7f039800b1d0 2026-02-22T23:23:42.298 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.316+0000 7f038b7fe640 1 -- 10.20.193.155:0/2236899624 <== mon.1 v1:10.20.193.155:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dee8274e-5e87-4e06-a9aa-44439f7f5354", "id": 6}]=0 v9) ==== 112+0+2 (unknown 1734204491 0 1113811849) 0x7f03a00058c0 con 0x7f039800b1d0 2026-02-22T23:23:42.298 INFO:teuthology.orchestra.run.trial155.stdout:6 2026-02-22T23:23:42.299 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.316+0000 7f03b0954640 1 -- 10.20.193.155:0/2236899624 >> v1:10.20.193.155:6789/0 conn(0x7f039800b1d0 legacy=0x7f03ac0aa8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:42.299 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.316+0000 7f03b0954640 1 -- 10.20.193.155:0/2236899624 shutdown_connections 2026-02-22T23:23:42.299 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.316+0000 7f03b0954640 1 -- 10.20.193.155:0/2236899624 >> 10.20.193.155:0/2236899624 conn(0x7f03ac0b4c90 msgr2=0x7f03ac144f20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:23:42.300 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.317+0000 7f03b0954640 1 -- 10.20.193.155:0/2236899624 shutdown_connections 2026-02-22T23:23:42.300 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.317+0000 7f03b0954640 1 -- 10.20.193.155:0/2236899624 wait complete. 2026-02-22T23:23:42.306 DEBUG:teuthology.orchestra.run.trial155:> sudo ceph --cluster ceph osd new c988ac9f-b5ed-48f5-aeb8-96968366722e 7 2026-02-22T23:23:42.418 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.432+0000 7f54f05e3640 1 Processor -- start 2026-02-22T23:23:42.419 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.432+0000 7f54f05e3640 1 -- start start 2026-02-22T23:23:42.419 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.432+0000 7f54f05e3640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54e813ee30 con 0x7f54e8144a00 2026-02-22T23:23:42.419 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.432+0000 7f54f05e3640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54e8144de0 con 0x7f54e813ea10 2026-02-22T23:23:42.419 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.432+0000 7f54f05e3640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54e8074040 con 0x7f54e81452d0 2026-02-22T23:23:42.419 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.432+0000 7f54eeb59640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7f54e813ea10 0x7f54e814cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.155:49584/0 (socket says 10.20.193.155:49584) 2026-02-22T23:23:42.419 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.432+0000 7f54eeb59640 1 -- 10.20.193.155:0/1680972494 learned_addr learned my addr 10.20.193.155:0/1680972494 (peer_addr_for_me v1:10.20.193.155:0/0) 2026-02-22T23:23:42.419 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.432+0000 7f54ed356640 1 -- 10.20.193.155:0/1680972494 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1962038517 0 0) 0x7f54e8144de0 con 0x7f54e813ea10 2026-02-22T23:23:42.419 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.432+0000 7f54ed356640 1 -- 10.20.193.155:0/1680972494 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54d0003620 con 0x7f54e813ea10 2026-02-22T23:23:42.419 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.432+0000 7f54ed356640 1 -- 10.20.193.155:0/1680972494 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4290881118 0 0) 0x7f54e8074040 con 0x7f54e81452d0 2026-02-22T23:23:42.419 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.433+0000 7f54ed356640 1 -- 10.20.193.155:0/1680972494 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54e8144de0 con 0x7f54e81452d0 2026-02-22T23:23:42.419 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.433+0000 7f54ed356640 1 -- 10.20.193.155:0/1680972494 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1502281236 0 0) 0x7f54d0003620 con 0x7f54e813ea10 2026-02-22T23:23:42.420 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.433+0000 7f54ed356640 1 -- 10.20.193.155:0/1680972494 >> v1:10.20.193.93:6790/0 conn(0x7f54e81452d0 legacy=0x7f54e813e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:42.420 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.433+0000 7f54ed356640 1 -- 10.20.193.155:0/1680972494 >> v1:10.20.193.93:6789/0 conn(0x7f54e8144a00 legacy=0x7f54e80afa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:42.420 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.433+0000 7f54ed356640 1 -- 10.20.193.155:0/1680972494 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54e8074320 con 0x7f54e813ea10 2026-02-22T23:23:42.420 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.433+0000 7f54ed356640 1 -- 10.20.193.155:0/1680972494 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f54e4003220 con 0x7f54e813ea10 2026-02-22T23:23:42.420 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.433+0000 7f54ed356640 1 -- 10.20.193.155:0/1680972494 <== mon.1 v1:10.20.193.155:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f54e4003440 con 0x7f54e813ea10 2026-02-22T23:23:42.420 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.433+0000 7f54ed356640 1 -- 10.20.193.155:0/1680972494 <== mon.1 v1:10.20.193.155:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f54e4003850 con 0x7f54e813ea10 2026-02-22T23:23:42.420 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.433+0000 7f54f05e3640 1 -- 10.20.193.155:0/1680972494 >> v1:10.20.193.155:6789/0 conn(0x7f54e813ea10 legacy=0x7f54e814cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:42.420 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.433+0000 7f54f05e3640 1 -- 10.20.193.155:0/1680972494 shutdown_connections 2026-02-22T23:23:42.420 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.433+0000 7f54f05e3640 1 -- 10.20.193.155:0/1680972494 >> 10.20.193.155:0/1680972494 conn(0x7f54e80b1d30 msgr2=0x7f54e80b2140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:23:42.420 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.433+0000 7f54f05e3640 1 -- 10.20.193.155:0/1680972494 shutdown_connections 2026-02-22T23:23:42.420 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.433+0000 7f54f05e3640 1 -- 10.20.193.155:0/1680972494 wait complete. 2026-02-22T23:23:42.420 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.433+0000 7f54f05e3640 1 Processor -- start 2026-02-22T23:23:42.421 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.434+0000 7f54f05e3640 1 -- start start 2026-02-22T23:23:42.421 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.434+0000 7f54f05e3640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54e81409e0 con 0x7f54e8144a00 2026-02-22T23:23:42.421 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.434+0000 7f54f05e3640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54e813f010 con 0x7f54e81452d0 2026-02-22T23:23:42.421 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.434+0000 7f54f05e3640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54e813f2f0 con 0x7f54e813ea10 2026-02-22T23:23:42.421 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.434+0000 7f54eeb59640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7f54e81452d0 0x7f54e81da450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.155:49592/0 (socket says 10.20.193.155:49592) 2026-02-22T23:23:42.421 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.434+0000 7f54eeb59640 1 -- 10.20.193.155:0/3426908724 learned_addr learned my addr 10.20.193.155:0/3426908724 (peer_addr_for_me v1:10.20.193.155:0/0) 2026-02-22T23:23:42.421 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.434+0000 7f54ceffd640 1 -- 10.20.193.155:0/3426908724 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 900130693 0 0) 0x7f54e813f010 con 0x7f54e81452d0 2026-02-22T23:23:42.421 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.434+0000 7f54ceffd640 1 -- 10.20.193.155:0/3426908724 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54b8003620 con 0x7f54e81452d0 2026-02-22T23:23:42.421 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.434+0000 7f54ceffd640 1 -- 10.20.193.155:0/3426908724 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3171715333 0 0) 0x7f54b8003620 con 0x7f54e81452d0 2026-02-22T23:23:42.421 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.434+0000 7f54ceffd640 1 -- 10.20.193.155:0/3426908724 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f54e813f010 con 0x7f54e81452d0 2026-02-22T23:23:42.421 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.434+0000 7f54ceffd640 1 -- 10.20.193.155:0/3426908724 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f54e4003790 con 0x7f54e81452d0 2026-02-22T23:23:42.421 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.434+0000 7f54ceffd640 1 -- 10.20.193.155:0/3426908724 <== mon.1 v1:10.20.193.155:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 862777278 0 0) 0x7f54e813f010 con 0x7f54e81452d0 2026-02-22T23:23:42.422 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.434+0000 7f54ceffd640 1 -- 10.20.193.155:0/3426908724 >> v1:10.20.193.93:6790/0 conn(0x7f54e813ea10 legacy=0x7f54e80715f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:42.422 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.434+0000 7f54ceffd640 1 -- 10.20.193.155:0/3426908724 >> v1:10.20.193.93:6789/0 conn(0x7f54e8144a00 legacy=0x7f54e8132140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:42.422 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.434+0000 7f54ceffd640 1 -- 10.20.193.155:0/3426908724 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54e8132850 con 0x7f54e81452d0 2026-02-22T23:23:42.422 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.434+0000 7f54f05e3640 1 -- 10.20.193.155:0/3426908724 --> v1:10.20.193.155:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f54e8132b60 con 0x7f54e81452d0 2026-02-22T23:23:42.422 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.434+0000 7f54f05e3640 1 -- 10.20.193.155:0/3426908724 --> v1:10.20.193.155:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f54e80b4b20 con 0x7f54e81452d0 2026-02-22T23:23:42.422 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.434+0000 7f54ceffd640 1 -- 10.20.193.155:0/3426908724 <== mon.1 v1:10.20.193.155:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f54e4005070 con 0x7f54e81452d0 2026-02-22T23:23:42.422 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.434+0000 7f54ceffd640 1 -- 10.20.193.155:0/3426908724 <== mon.1 v1:10.20.193.155:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f54e4005220 con 0x7f54e81452d0 2026-02-22T23:23:42.422 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.434+0000 7f54ceffd640 1 -- 10.20.193.155:0/3426908724 <== mon.1 v1:10.20.193.155:6789/0 7 ==== mgrmap(e 1) ==== 811+0+0 (unknown 4133961934 0 0) 0x7f54e4005750 con 0x7f54e81452d0 2026-02-22T23:23:42.422 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.434+0000 7f54ceffd640 1 -- 10.20.193.155:0/3426908724 <== mon.1 v1:10.20.193.155:6789/0 8 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (unknown 1186528439 0 0) 0x7f54e40060d0 con 0x7f54e81452d0 2026-02-22T23:23:42.422 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.435+0000 7f54f05e3640 1 -- 10.20.193.155:0/3426908724 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54e80008d0 con 0x7f54e81452d0 2026-02-22T23:23:42.422 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.436+0000 7f54ceffd640 1 -- 10.20.193.155:0/3426908724 <== mon.1 v1:10.20.193.155:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (unknown 1092875540 0 4127419540) 0x7f54e4005a70 con 0x7f54e81452d0 2026-02-22T23:23:42.449 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.468+0000 7f54f05e3640 1 -- 10.20.193.155:0/3426908724 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "osd new", "uuid": "c988ac9f-b5ed-48f5-aeb8-96968366722e", "id": 7} v 0) -- 0x7f54e81dab60 con 0x7f54e81452d0 2026-02-22T23:23:42.451 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.470+0000 7f54ceffd640 1 -- 10.20.193.155:0/3426908724 <== mon.1 v1:10.20.193.155:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c988ac9f-b5ed-48f5-aeb8-96968366722e", "id": 7}]=0 v10) ==== 112+0+2 (unknown 4149559631 0 1371665406) 0x7f54e4005d10 con 0x7f54e81452d0 2026-02-22T23:23:42.452 INFO:teuthology.orchestra.run.trial155.stdout:7 2026-02-22T23:23:42.452 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.470+0000 7f54f05e3640 1 -- 10.20.193.155:0/3426908724 >> v1:10.20.193.155:6789/0 conn(0x7f54e81452d0 legacy=0x7f54e81da450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:42.452 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.470+0000 7f54f05e3640 1 -- 10.20.193.155:0/3426908724 shutdown_connections 2026-02-22T23:23:42.452 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.470+0000 7f54f05e3640 1 -- 10.20.193.155:0/3426908724 >> 10.20.193.155:0/3426908724 conn(0x7f54e80b1d30 msgr2=0x7f54e806cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:23:42.452 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.470+0000 7f54f05e3640 1 -- 10.20.193.155:0/3426908724 shutdown_connections 2026-02-22T23:23:42.452 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T23:23:42.470+0000 7f54f05e3640 1 -- 10.20.193.155:0/3426908724 wait complete. 2026-02-22T23:23:42.459 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-22T23:23:42.459 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2026-02-22T23:23:42.460 INFO:tasks.ceph.osd.0:Started 2026-02-22T23:23:42.460 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-22T23:23:42.460 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2026-02-22T23:23:42.462 INFO:tasks.ceph.osd.1:Started 2026-02-22T23:23:42.462 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-22T23:23:42.462 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2026-02-22T23:23:42.464 INFO:tasks.ceph.osd.2:Started 2026-02-22T23:23:42.464 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-22T23:23:42.464 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2026-02-22T23:23:42.465 INFO:tasks.ceph.osd.3:Started 2026-02-22T23:23:42.465 INFO:tasks.ceph.osd.4:Restarting daemon 2026-02-22T23:23:42.466 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2026-02-22T23:23:42.467 INFO:tasks.ceph.osd.4:Started 2026-02-22T23:23:42.467 INFO:tasks.ceph.osd.5:Restarting daemon 2026-02-22T23:23:42.467 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2026-02-22T23:23:42.468 INFO:tasks.ceph.osd.5:Started 2026-02-22T23:23:42.469 INFO:tasks.ceph.osd.6:Restarting daemon 2026-02-22T23:23:42.469 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2026-02-22T23:23:42.470 INFO:tasks.ceph.osd.6:Started 2026-02-22T23:23:42.470 INFO:tasks.ceph.osd.7:Restarting daemon 2026-02-22T23:23:42.470 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2026-02-22T23:23:42.471 INFO:tasks.ceph.osd.7:Started 2026-02-22T23:23:42.472 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-22T23:23:42.540 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.537+0000 7f0c95d2c640 1 Processor -- start 2026-02-22T23:23:42.541 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.537+0000 7f0c95d2c640 1 -- start start 2026-02-22T23:23:42.541 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.537+0000 7f0c95d2c640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c90074040 con 0x7f0c90072060 2026-02-22T23:23:42.541 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.537+0000 7f0c95d2c640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c90074320 con 0x7f0c900afa50 2026-02-22T23:23:42.541 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.537+0000 7f0c95d2c640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c90074600 con 0x7f0c90073020 2026-02-22T23:23:42.541 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.537+0000 7f0c8effd640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7f0c90073020 0x7f0c900aece0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:53114/0 (socket says 10.20.193.93:53114) 2026-02-22T23:23:42.541 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.537+0000 7f0c8effd640 1 -- 10.20.193.93:0/1009926226 learned_addr learned my addr 10.20.193.93:0/1009926226 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:23:42.541 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.538+0000 7f0c8f7fe640 1 -- 10.20.193.93:0/1009926226 >> v1:10.20.193.93:6789/0 conn(0x7f0c90072060 legacy=0x7f0c901417e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-22T23:23:42.541 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.538+0000 7f0c8f7fe640 1 -- 10.20.193.93:0/1009926226 >> v1:10.20.193.93:6789/0 conn(0x7f0c90072060 legacy=0x7f0c901417e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T23:23:42.541 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.538+0000 7f0c8f7fe640 1 --1- 10.20.193.93:0/1009926226 >> v1:10.20.193.93:6789/0 conn(0x7f0c90072060 0x7f0c901417e0 :-1 s=OPENED pgs=43 cs=1 l=1).handle_message read tag failed 2026-02-22T23:23:42.541 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.538+0000 7f0c8f7fe640 1 --1- 10.20.193.93:0/1009926226 >> v1:10.20.193.93:6789/0 conn(0x7f0c90072060 0x7f0c901417e0 :-1 s=OPENED pgs=43 cs=1 l=1).fault on lossy channel, failing 2026-02-22T23:23:42.541 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.538+0000 7f0c8e7fc640 1 -- 10.20.193.93:0/1009926226 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1765106387 0 0) 0x7f0c90074600 con 0x7f0c90073020 2026-02-22T23:23:42.541 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.538+0000 7f0c8e7fc640 1 -- 10.20.193.93:0/1009926226 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c74003620 con 0x7f0c90073020 2026-02-22T23:23:42.541 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.538+0000 7f0c8e7fc640 1 -- 10.20.193.93:0/1009926226 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 870895185 0 0) 0x7f0c74003620 con 0x7f0c90073020 2026-02-22T23:23:42.541 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.538+0000 7f0c8e7fc640 1 -- 10.20.193.93:0/1009926226 >> v1:10.20.193.155:6789/0 conn(0x7f0c900afa50 legacy=0x7f0c9014ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:42.541 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.538+0000 7f0c8e7fc640 1 -- 10.20.193.93:0/1009926226 >> v1:10.20.193.93:6789/0 conn(0x7f0c90072060 legacy=0x7f0c901417e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:23:42.541 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.538+0000 7f0c8e7fc640 1 -- 10.20.193.93:0/1009926226 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c90072660 con 0x7f0c90073020 2026-02-22T23:23:42.541 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.538+0000 7f0c8e7fc640 1 -- 10.20.193.93:0/1009926226 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f0c80002ea0 con 0x7f0c90073020 2026-02-22T23:23:42.541 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.538+0000 7f0c8e7fc640 1 -- 10.20.193.93:0/1009926226 <== mon.2 v1:10.20.193.93:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0c800030c0 con 0x7f0c90073020 2026-02-22T23:23:42.541 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.538+0000 7f0c8e7fc640 1 -- 10.20.193.93:0/1009926226 <== mon.2 v1:10.20.193.93:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f0c80003490 con 0x7f0c90073020 2026-02-22T23:23:42.542 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.538+0000 7f0c95d2c640 1 -- 10.20.193.93:0/1009926226 >> v1:10.20.193.93:6790/0 conn(0x7f0c90073020 legacy=0x7f0c900aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:42.542 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.538+0000 7f0c95d2c640 1 -- 10.20.193.93:0/1009926226 shutdown_connections 2026-02-22T23:23:42.542 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.538+0000 7f0c95d2c640 1 -- 10.20.193.93:0/1009926226 >> 10.20.193.93:0/1009926226 conn(0x7f0c900b1d30 msgr2=0x7f0c900b2140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:23:42.542 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.538+0000 7f0c95d2c640 1 -- 10.20.193.93:0/1009926226 shutdown_connections 2026-02-22T23:23:42.542 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.538+0000 7f0c95d2c640 1 -- 10.20.193.93:0/1009926226 wait complete. 2026-02-22T23:23:42.543 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.539+0000 7f0c95d2c640 1 Processor -- start 2026-02-22T23:23:42.543 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.539+0000 7f0c95d2c640 1 -- start start 2026-02-22T23:23:42.543 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.539+0000 7f0c95d2c640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c9013cee0 con 0x7f0c90072060 2026-02-22T23:23:42.543 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.539+0000 7f0c95d2c640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c9013d1c0 con 0x7f0c90073020 2026-02-22T23:23:42.543 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.539+0000 7f0c95d2c640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c9013d4a0 con 0x7f0c900afa50 2026-02-22T23:23:42.543 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.539+0000 7f0c8ffff640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7f0c900afa50 0x7f0c901367b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:53118/0 (socket says 10.20.193.93:53118) 2026-02-22T23:23:42.543 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.539+0000 7f0c8ffff640 1 -- 10.20.193.93:0/2267450917 learned_addr learned my addr 10.20.193.93:0/2267450917 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:23:42.544 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.539+0000 7f0c8f7fe640 1 --1- 10.20.193.93:0/2267450917 >> v1:10.20.193.93:6789/0 conn(0x7f0c90072060 0x7f0c9013dba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:55724/0 (socket says 10.20.193.93:55724) 2026-02-22T23:23:42.544 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.539+0000 7f0c6bfff640 1 -- 10.20.193.93:0/2267450917 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3768490124 0 0) 0x7f0c9013d4a0 con 0x7f0c900afa50 2026-02-22T23:23:42.544 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.540+0000 7f0c6bfff640 1 -- 10.20.193.93:0/2267450917 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c60003620 con 0x7f0c900afa50 2026-02-22T23:23:42.544 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.540+0000 7f0c6bfff640 1 -- 10.20.193.93:0/2267450917 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1436643951 0 0) 0x7f0c9013cee0 con 0x7f0c90072060 2026-02-22T23:23:42.544 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.540+0000 7f0c6bfff640 1 -- 10.20.193.93:0/2267450917 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c9013d4a0 con 0x7f0c90072060 2026-02-22T23:23:42.544 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.540+0000 7f0c6bfff640 1 -- 10.20.193.93:0/2267450917 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1187812107 0 0) 0x7f0c9013d1c0 con 0x7f0c90073020 2026-02-22T23:23:42.544 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.540+0000 7f0c6bfff640 1 -- 10.20.193.93:0/2267450917 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c9013cee0 con 0x7f0c90073020 2026-02-22T23:23:42.544 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.540+0000 7f0c6bfff640 1 -- 10.20.193.93:0/2267450917 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2135926101 0 0) 0x7f0c60003620 con 0x7f0c900afa50 2026-02-22T23:23:42.544 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.540+0000 7f0c6bfff640 1 -- 10.20.193.93:0/2267450917 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0c9013d1c0 con 0x7f0c900afa50 2026-02-22T23:23:42.544 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.540+0000 7f0c6bfff640 1 -- 10.20.193.93:0/2267450917 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3505871099 0 0) 0x7f0c9013d4a0 con 0x7f0c90072060 2026-02-22T23:23:42.544 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.540+0000 7f0c6bfff640 1 -- 10.20.193.93:0/2267450917 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0c60003620 con 0x7f0c90072060 2026-02-22T23:23:42.544 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.540+0000 7f0c6bfff640 1 -- 10.20.193.93:0/2267450917 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f0c84003440 con 0x7f0c900afa50 2026-02-22T23:23:42.544 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.540+0000 7f0c6bfff640 1 -- 10.20.193.93:0/2267450917 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f0c7c003130 con 0x7f0c90072060 2026-02-22T23:23:42.544 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.540+0000 7f0c6bfff640 1 -- 10.20.193.93:0/2267450917 <== mon.0 v1:10.20.193.93:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3058321492 0 0) 0x7f0c60003620 con 0x7f0c90072060 2026-02-22T23:23:42.544 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.540+0000 7f0c6bfff640 1 -- 10.20.193.93:0/2267450917 >> v1:10.20.193.93:6790/0 conn(0x7f0c900afa50 legacy=0x7f0c901367b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:42.544 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.540+0000 7f0c6bfff640 1 -- 10.20.193.93:0/2267450917 >> v1:10.20.193.155:6789/0 conn(0x7f0c90073020 legacy=0x7f0c9013b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:42.544 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.540+0000 7f0c6bfff640 1 -- 10.20.193.93:0/2267450917 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c9013d780 con 0x7f0c90072060 2026-02-22T23:23:42.544 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.540+0000 7f0c95d2c640 1 -- 10.20.193.93:0/2267450917 --> v1:10.20.193.93:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0c901e6340 con 0x7f0c90072060 2026-02-22T23:23:42.544 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.540+0000 7f0c95d2c640 1 -- 10.20.193.93:0/2267450917 --> v1:10.20.193.93:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f0c901e66f0 con 0x7f0c90072060 2026-02-22T23:23:42.544 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.540+0000 7f0c6bfff640 1 -- 10.20.193.93:0/2267450917 <== mon.0 v1:10.20.193.93:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0c7c0044a0 con 0x7f0c90072060 2026-02-22T23:23:42.544 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.540+0000 7f0c6bfff640 1 -- 10.20.193.93:0/2267450917 <== mon.0 v1:10.20.193.93:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f0c7c003720 con 0x7f0c90072060 2026-02-22T23:23:42.544 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.540+0000 7f0c6bfff640 1 -- 10.20.193.93:0/2267450917 <== mon.0 v1:10.20.193.93:6789/0 7 ==== mgrmap(e 1) ==== 811+0+0 (unknown 4133961934 0 0) 0x7f0c7c003c50 con 0x7f0c90072060 2026-02-22T23:23:42.545 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.540+0000 7f0c6bfff640 1 -- 10.20.193.93:0/2267450917 <== mon.0 v1:10.20.193.93:6789/0 8 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (unknown 3461377998 0 0) 0x7f0c7c0058c0 con 0x7f0c90072060 2026-02-22T23:23:42.545 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.540+0000 7f0c95d2c640 1 -- 10.20.193.93:0/2267450917 --> v1:10.20.193.93:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c9006dce0 con 0x7f0c90072060 2026-02-22T23:23:42.545 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.542+0000 7f0c6bfff640 1 -- 10.20.193.93:0/2267450917 <== mon.0 v1:10.20.193.93:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (unknown 1092875540 0 4127419540) 0x7f0c7c005bf0 con 0x7f0c90072060 2026-02-22T23:23:42.572 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.570+0000 7f0c95d2c640 1 -- 10.20.193.93:0/2267450917 --> v1:10.20.193.93:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0c90076960 con 0x7f0c90072060 2026-02-22T23:23:42.572 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.570+0000 7f0c6bfff640 1 -- 10.20.193.93:0/2267450917 <== mon.0 v1:10.20.193.93:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (unknown 4040575075 0 1440500846) 0x7f0c7c003f70 con 0x7f0c90072060 2026-02-22T23:23:42.572 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:23:42.573 INFO:teuthology.orchestra.run.trial093.stdout:{"epoch":10,"fsid":"964c49d0-be38-4661-88a8-21893fbedc4f","created":"2026-02-22T23:23:40.901753+0000","modified":"2026-02-22T23:23:42.448665+0000","last_up_change":"0.000000","last_in_change":"2026-02-22T23:23:42.448665+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d1ce1e9f-bb70-4b7b-9dbc-e380de9324c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e5ab5de3-2e0f-4f91-8dfe-c74bff8838d5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"10d76c55-707a-43c8-b51e-0e5ae595f89e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d7a29cea-4066-455f-8a32-f4cb5534ae32","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"6a1874d8-3703-429f-839b-d3dc0f448b14","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"447cea4f-f753-457e-b654-85ade052dc45","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"dee8274e-5e87-4e06-a9aa-44439f7f5354","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c988ac9f-b5ed-48f5-aeb8-96968366722e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T23:23:42.573 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.570+0000 7f0c95d2c640 1 -- 10.20.193.93:0/2267450917 >> v1:10.20.193.93:6789/0 conn(0x7f0c90072060 legacy=0x7f0c9013dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:42.573 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.570+0000 7f0c95d2c640 1 -- 10.20.193.93:0/2267450917 shutdown_connections 2026-02-22T23:23:42.573 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.570+0000 7f0c95d2c640 1 -- 10.20.193.93:0/2267450917 >> 10.20.193.93:0/2267450917 conn(0x7f0c900b1d30 msgr2=0x7f0c900afe80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:23:42.573 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.570+0000 7f0c95d2c640 1 -- 10.20.193.93:0/2267450917 shutdown_connections 2026-02-22T23:23:42.573 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:42.570+0000 7f0c95d2c640 1 -- 10.20.193.93:0/2267450917 wait complete. 2026-02-22T23:23:42.581 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-22T23:23:42.582 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-22T23:23:42.669 INFO:tasks.ceph.mgr.y.trial093.stderr:2026-02-22T23:23:42.667+0000 7f06a77db140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-22T23:23:42.672 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T23:23:42.690+0000 7f9a87e2e140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-22T23:23:42.691 INFO:tasks.ceph.mgr.y.trial093.stderr:2026-02-22T23:23:42.689+0000 7f06a77db140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-22T23:23:42.694 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T23:23:42.712+0000 7f9a87e2e140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-22T23:23:43.032 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T23:23:43.050+0000 7f9a87e2e140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-22T23:23:43.033 INFO:tasks.ceph.mgr.y.trial093.stderr:2026-02-22T23:23:43.031+0000 7f06a77db140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-22T23:23:43.388 DEBUG:teuthology.orchestra.run.trial093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-22T23:23:43.453 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.446+0000 7f36b0224640 1 Processor -- start 2026-02-22T23:23:43.453 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.446+0000 7f36b0224640 1 -- start start 2026-02-22T23:23:43.453 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.447+0000 7f36b0224640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36a80aee60 con 0x7f36a8141e40 2026-02-22T23:23:43.453 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.447+0000 7f36b0224640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36a80af140 con 0x7f36a80acf10 2026-02-22T23:23:43.453 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.447+0000 7f36b0224640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36a80af6c0 con 0x7f36a80ad2f0 2026-02-22T23:23:43.453 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.447+0000 7f36ad798640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7f36a80ad2f0 0x7f36a8141730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:53126/0 (socket says 10.20.193.93:53126) 2026-02-22T23:23:43.453 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.447+0000 7f36ad798640 1 -- 10.20.193.93:0/447243899 learned_addr learned my addr 10.20.193.93:0/447243899 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:23:43.453 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.447+0000 7f36ae79a640 1 --1- 10.20.193.93:0/447243899 >> v1:10.20.193.93:6789/0 conn(0x7f36a8141e40 0x7f36a814cb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:55728/0 (socket says 10.20.193.93:55728) 2026-02-22T23:23:43.453 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.447+0000 7f36acf97640 1 -- 10.20.193.93:0/447243899 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 956274528 0 0) 0x7f36a80af6c0 con 0x7f36a80ad2f0 2026-02-22T23:23:43.454 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.447+0000 7f36acf97640 1 -- 10.20.193.93:0/447243899 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3690003620 con 0x7f36a80ad2f0 2026-02-22T23:23:43.454 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.447+0000 7f36acf97640 1 -- 10.20.193.93:0/447243899 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 459487580 0 0) 0x7f36a80aee60 con 0x7f36a8141e40 2026-02-22T23:23:43.454 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.447+0000 7f36acf97640 1 -- 10.20.193.93:0/447243899 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36a80af6c0 con 0x7f36a8141e40 2026-02-22T23:23:43.454 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.447+0000 7f36acf97640 1 -- 10.20.193.93:0/447243899 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 574304918 0 0) 0x7f3690003620 con 0x7f36a80ad2f0 2026-02-22T23:23:43.454 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.447+0000 7f36acf97640 1 -- 10.20.193.93:0/447243899 >> v1:10.20.193.155:6789/0 conn(0x7f36a80acf10 legacy=0x7f36a813e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:43.454 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.447+0000 7f36acf97640 1 -- 10.20.193.93:0/447243899 >> v1:10.20.193.93:6789/0 conn(0x7f36a8141e40 legacy=0x7f36a814cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:43.454 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.447+0000 7f36acf97640 1 -- 10.20.193.93:0/447243899 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36a80adf40 con 0x7f36a80ad2f0 2026-02-22T23:23:43.454 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.447+0000 7f36acf97640 1 -- 10.20.193.93:0/447243899 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f369c002ea0 con 0x7f36a80ad2f0 2026-02-22T23:23:43.454 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.447+0000 7f36acf97640 1 -- 10.20.193.93:0/447243899 <== mon.2 v1:10.20.193.93:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f369c0030c0 con 0x7f36a80ad2f0 2026-02-22T23:23:43.454 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.447+0000 7f36acf97640 1 -- 10.20.193.93:0/447243899 <== mon.2 v1:10.20.193.93:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f369c003550 con 0x7f36a80ad2f0 2026-02-22T23:23:43.454 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.448+0000 7f36b0224640 1 -- 10.20.193.93:0/447243899 >> v1:10.20.193.93:6790/0 conn(0x7f36a80ad2f0 legacy=0x7f36a8141730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:43.455 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.448+0000 7f36b0224640 1 -- 10.20.193.93:0/447243899 shutdown_connections 2026-02-22T23:23:43.455 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.448+0000 7f36b0224640 1 -- 10.20.193.93:0/447243899 >> 10.20.193.93:0/447243899 conn(0x7f36a806d2e0 msgr2=0x7f36a80b4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:23:43.455 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.448+0000 7f36b0224640 1 -- 10.20.193.93:0/447243899 shutdown_connections 2026-02-22T23:23:43.455 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.448+0000 7f36b0224640 1 -- 10.20.193.93:0/447243899 wait complete. 2026-02-22T23:23:43.455 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.448+0000 7f36b0224640 1 Processor -- start 2026-02-22T23:23:43.455 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.448+0000 7f36b0224640 1 -- start start 2026-02-22T23:23:43.455 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.448+0000 7f36b0224640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36a81dc840 con 0x7f36a8141e40 2026-02-22T23:23:43.455 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.448+0000 7f36b0224640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36a8070be0 con 0x7f36a80ad2f0 2026-02-22T23:23:43.455 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.448+0000 7f36b0224640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36a8070ec0 con 0x7f36a80acf10 2026-02-22T23:23:43.455 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.448+0000 7f36adf99640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7f36a80acf10 0x7f36a8144ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:53142/0 (socket says 10.20.193.93:53142) 2026-02-22T23:23:43.455 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.449+0000 7f36ae79a640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7f36a8141e40 0x7f36a81dc130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:55730/0 (socket says 10.20.193.93:55730) 2026-02-22T23:23:43.455 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.449+0000 7f36adf99640 1 -- 10.20.193.93:0/1868366540 learned_addr learned my addr 10.20.193.93:0/1868366540 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:23:43.456 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.449+0000 7f36967fc640 1 -- 10.20.193.93:0/1868366540 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1024048363 0 0) 0x7f36a81dc840 con 0x7f36a8141e40 2026-02-22T23:23:43.456 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.449+0000 7f36967fc640 1 -- 10.20.193.93:0/1868366540 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3678003620 con 0x7f36a8141e40 2026-02-22T23:23:43.456 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.449+0000 7f36967fc640 1 -- 10.20.193.93:0/1868366540 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 766827416 0 0) 0x7f36a8070ec0 con 0x7f36a80acf10 2026-02-22T23:23:43.456 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.449+0000 7f36967fc640 1 -- 10.20.193.93:0/1868366540 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36a81dc840 con 0x7f36a80acf10 2026-02-22T23:23:43.456 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.449+0000 7f36967fc640 1 -- 10.20.193.93:0/1868366540 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 278809440 0 0) 0x7f3678003620 con 0x7f36a8141e40 2026-02-22T23:23:43.456 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.449+0000 7f36967fc640 1 -- 10.20.193.93:0/1868366540 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f36a8070ec0 con 0x7f36a8141e40 2026-02-22T23:23:43.456 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.449+0000 7f36967fc640 1 -- 10.20.193.93:0/1868366540 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f36a40032e0 con 0x7f36a8141e40 2026-02-22T23:23:43.456 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.449+0000 7f36967fc640 1 -- 10.20.193.93:0/1868366540 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1419752384 0 0) 0x7f36a81dc840 con 0x7f36a80acf10 2026-02-22T23:23:43.456 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.449+0000 7f36967fc640 1 -- 10.20.193.93:0/1868366540 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3678003620 con 0x7f36a80acf10 2026-02-22T23:23:43.456 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.449+0000 7f36967fc640 1 -- 10.20.193.93:0/1868366540 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f36980031a0 con 0x7f36a80acf10 2026-02-22T23:23:43.456 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.449+0000 7f36967fc640 1 -- 10.20.193.93:0/1868366540 <== mon.0 v1:10.20.193.93:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3732981582 0 0) 0x7f36a8070ec0 con 0x7f36a8141e40 2026-02-22T23:23:43.456 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.449+0000 7f36967fc640 1 -- 10.20.193.93:0/1868366540 >> v1:10.20.193.93:6790/0 conn(0x7f36a80acf10 legacy=0x7f36a8144ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:43.457 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.449+0000 7f36967fc640 1 -- 10.20.193.93:0/1868366540 >> v1:10.20.193.155:6789/0 conn(0x7f36a80ad2f0 legacy=0x7f36a81dba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:43.457 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.449+0000 7f36967fc640 1 -- 10.20.193.93:0/1868366540 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36a806fd30 con 0x7f36a8141e40 2026-02-22T23:23:43.457 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.449+0000 7f36b0224640 1 -- 10.20.193.93:0/1868366540 --> v1:10.20.193.93:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f36a81452b0 con 0x7f36a8141e40 2026-02-22T23:23:43.457 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.449+0000 7f36967fc640 1 -- 10.20.193.93:0/1868366540 <== mon.0 v1:10.20.193.93:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f36a40038b0 con 0x7f36a8141e40 2026-02-22T23:23:43.457 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.449+0000 7f36b0224640 1 -- 10.20.193.93:0/1868366540 --> v1:10.20.193.93:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f36a8144720 con 0x7f36a8141e40 2026-02-22T23:23:43.457 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.449+0000 7f36967fc640 1 -- 10.20.193.93:0/1868366540 <== mon.0 v1:10.20.193.93:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f36a4004e00 con 0x7f36a8141e40 2026-02-22T23:23:43.457 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.449+0000 7f36b0224640 1 -- 10.20.193.93:0/1868366540 --> v1:10.20.193.93:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36a813aa10 con 0x7f36a8141e40 2026-02-22T23:23:43.457 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.449+0000 7f36967fc640 1 -- 10.20.193.93:0/1868366540 <== mon.0 v1:10.20.193.93:6789/0 7 ==== mgrmap(e 2) ==== 49971+0+0 (unknown 2928896636 0 0) 0x7f36a4011360 con 0x7f36a8141e40 2026-02-22T23:23:43.457 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.450+0000 7f36967fc640 1 -- 10.20.193.93:0/1868366540 <== mon.0 v1:10.20.193.93:6789/0 8 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (unknown 3461377998 0 0) 0x7f36a404cf20 con 0x7f36a8141e40 2026-02-22T23:23:43.457 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.451+0000 7f36967fc640 1 -- 10.20.193.93:0/1868366540 <== mon.0 v1:10.20.193.93:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (unknown 1092875540 0 4127419540) 0x7f36a4017600 con 0x7f36a8141e40 2026-02-22T23:23:43.481 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.478+0000 7f36b0224640 1 -- 10.20.193.93:0/1868366540 --> v1:10.20.193.93:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f36a8144320 con 0x7f36a8141e40 2026-02-22T23:23:43.481 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.478+0000 7f36967fc640 1 -- 10.20.193.93:0/1868366540 <== mon.0 v1:10.20.193.93:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (unknown 4040575075 0 1440500846) 0x7f36a4016f00 con 0x7f36a8141e40 2026-02-22T23:23:43.481 INFO:teuthology.misc.health.trial093.stdout: 2026-02-22T23:23:43.481 INFO:teuthology.misc.health.trial093.stdout:{"epoch":10,"fsid":"964c49d0-be38-4661-88a8-21893fbedc4f","created":"2026-02-22T23:23:40.901753+0000","modified":"2026-02-22T23:23:42.448665+0000","last_up_change":"0.000000","last_in_change":"2026-02-22T23:23:42.448665+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d1ce1e9f-bb70-4b7b-9dbc-e380de9324c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e5ab5de3-2e0f-4f91-8dfe-c74bff8838d5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"10d76c55-707a-43c8-b51e-0e5ae595f89e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d7a29cea-4066-455f-8a32-f4cb5534ae32","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"6a1874d8-3703-429f-839b-d3dc0f448b14","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"447cea4f-f753-457e-b654-85ade052dc45","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"dee8274e-5e87-4e06-a9aa-44439f7f5354","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c988ac9f-b5ed-48f5-aeb8-96968366722e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T23:23:43.482 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.479+0000 7f36b0224640 1 -- 10.20.193.93:0/1868366540 >> v1:10.20.193.93:6789/0 conn(0x7f36a8141e40 legacy=0x7f36a81dc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:43.482 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.479+0000 7f36b0224640 1 -- 10.20.193.93:0/1868366540 shutdown_connections 2026-02-22T23:23:43.482 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.479+0000 7f36b0224640 1 -- 10.20.193.93:0/1868366540 >> 10.20.193.93:0/1868366540 conn(0x7f36a806d2e0 msgr2=0x7f36a80b1e80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:23:43.482 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.479+0000 7f36b0224640 1 -- 10.20.193.93:0/1868366540 shutdown_connections 2026-02-22T23:23:43.482 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:43.479+0000 7f36b0224640 1 -- 10.20.193.93:0/1868366540 wait complete. 2026-02-22T23:23:43.487 DEBUG:teuthology.misc:0 of 8 OSDs are up 2026-02-22T23:23:44.043 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T23:23:44.061+0000 7f99a4363640 -1 mgr.server handle_report got status from non-daemon mon.b 2026-02-22T23:23:44.043 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T23:23:44.062+0000 7f99a4363640 -1 mgr.server handle_report got status from non-daemon mon.c 2026-02-22T23:23:44.363 INFO:tasks.ceph.osd.7.trial155.stderr:2026-02-22T23:23:44.381+0000 7ff2db334780 -1 Falling back to public interface 2026-02-22T23:23:44.367 INFO:tasks.ceph.osd.1.trial093.stderr:2026-02-22T23:23:44.363+0000 7f391aa13780 -1 Falling back to public interface 2026-02-22T23:23:44.394 INFO:tasks.ceph.osd.5.trial155.stderr:2026-02-22T23:23:44.412+0000 7fed4b42c780 -1 Falling back to public interface 2026-02-22T23:23:44.394 INFO:tasks.ceph.osd.6.trial155.stderr:2026-02-22T23:23:44.412+0000 7f00828ed780 -1 Falling back to public interface 2026-02-22T23:23:44.394 INFO:tasks.ceph.osd.6.trial155.stderr:2026-02-22T23:23:44.413+0000 7f0081892640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6811/0: (98) Address already in use 2026-02-22T23:23:44.401 INFO:tasks.ceph.osd.3.trial093.stderr:2026-02-22T23:23:44.398+0000 7f8889423780 -1 Falling back to public interface 2026-02-22T23:23:44.401 INFO:tasks.ceph.osd.0.trial093.stderr:2026-02-22T23:23:44.398+0000 7f4ab7bd4780 -1 Falling back to public interface 2026-02-22T23:23:44.402 INFO:tasks.ceph.osd.4.trial155.stderr:2026-02-22T23:23:44.420+0000 7fba22a27780 -1 Falling back to public interface 2026-02-22T23:23:44.427 INFO:tasks.ceph.osd.2.trial093.stderr:2026-02-22T23:23:44.424+0000 7fca72df9780 -1 Falling back to public interface 2026-02-22T23:23:48.826 INFO:tasks.ceph.osd.7.trial155.stderr:2026-02-22T23:23:48.845+0000 7ff2db334780 -1 osd.7 0 log_to_monitors true 2026-02-22T23:23:48.834 INFO:tasks.ceph.osd.1.trial093.stderr:2026-02-22T23:23:48.831+0000 7f391aa13780 -1 osd.1 0 log_to_monitors true 2026-02-22T23:23:48.911 INFO:tasks.ceph.osd.3.trial093.stderr:2026-02-22T23:23:48.908+0000 7f8889423780 -1 osd.3 0 log_to_monitors true 2026-02-22T23:23:48.918 INFO:tasks.ceph.osd.0.trial093.stderr:2026-02-22T23:23:48.916+0000 7f4ab7bd4780 -1 osd.0 0 log_to_monitors true 2026-02-22T23:23:48.926 INFO:tasks.ceph.osd.6.trial155.stderr:2026-02-22T23:23:48.944+0000 7f00828ed780 -1 osd.6 0 log_to_monitors true 2026-02-22T23:23:48.946 INFO:tasks.ceph.osd.2.trial093.stderr:2026-02-22T23:23:48.943+0000 7fca72df9780 -1 osd.2 0 log_to_monitors true 2026-02-22T23:23:48.952 INFO:tasks.ceph.osd.5.trial155.stderr:2026-02-22T23:23:48.970+0000 7fed4b42c780 -1 osd.5 0 log_to_monitors true 2026-02-22T23:23:48.987 INFO:tasks.ceph.osd.4.trial155.stderr:2026-02-22T23:23:49.006+0000 7fba22a27780 -1 osd.4 0 log_to_monitors true 2026-02-22T23:23:49.886 INFO:tasks.ceph.osd.1.trial093.stderr:2026-02-22T23:23:49.883+0000 7f391697e640 -1 osd.1 0 waiting for initial osdmap 2026-02-22T23:23:49.887 INFO:tasks.ceph.osd.7.trial155.stderr:2026-02-22T23:23:49.905+0000 7ff2d729f640 -1 osd.7 0 waiting for initial osdmap 2026-02-22T23:23:49.888 INFO:tasks.ceph.osd.1.trial093.stderr:2026-02-22T23:23:49.885+0000 7f390e7b1640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T23:23:49.889 INFO:tasks.ceph.osd.7.trial155.stderr:2026-02-22T23:23:49.908+0000 7ff2d30da640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T23:23:50.293 DEBUG:teuthology.orchestra.run.trial093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-22T23:23:50.352 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.349+0000 7fc0ac7dc640 1 Processor -- start 2026-02-22T23:23:50.352 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.349+0000 7fc0ac7dc640 1 -- start start 2026-02-22T23:23:50.352 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.349+0000 7fc0ac7dc640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0a40ae2b0 con 0x7fc0a40ac1d0 2026-02-22T23:23:50.352 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.349+0000 7fc0ac7dc640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0a40ac980 con 0x7fc0a40aede0 2026-02-22T23:23:50.352 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.349+0000 7fc0ac7dc640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0a40abcb0 con 0x7fc0a40af930 2026-02-22T23:23:50.353 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.349+0000 7fc0aa551640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7fc0a40af930 0x7fc0a413d540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:35370/0 (socket says 10.20.193.93:35370) 2026-02-22T23:23:50.353 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.349+0000 7fc0aa551640 1 -- 10.20.193.93:0/2258037829 learned_addr learned my addr 10.20.193.93:0/2258037829 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:23:50.353 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.349+0000 7fc0a954f640 1 -- 10.20.193.93:0/2258037829 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 437033676 0 0) 0x7fc0a40ae2b0 con 0x7fc0a40ac1d0 2026-02-22T23:23:50.353 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.349+0000 7fc0a954f640 1 -- 10.20.193.93:0/2258037829 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc08c003620 con 0x7fc0a40ac1d0 2026-02-22T23:23:50.353 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.349+0000 7fc0a954f640 1 -- 10.20.193.93:0/2258037829 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3504242956 0 0) 0x7fc0a40abcb0 con 0x7fc0a40af930 2026-02-22T23:23:50.353 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.349+0000 7fc0a954f640 1 -- 10.20.193.93:0/2258037829 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0a40ae2b0 con 0x7fc0a40af930 2026-02-22T23:23:50.353 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.350+0000 7fc0a954f640 1 -- 10.20.193.93:0/2258037829 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3282754037 0 0) 0x7fc08c003620 con 0x7fc0a40ac1d0 2026-02-22T23:23:50.353 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.350+0000 7fc0a954f640 1 -- 10.20.193.93:0/2258037829 >> v1:10.20.193.93:6790/0 conn(0x7fc0a40af930 legacy=0x7fc0a413d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:50.353 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.350+0000 7fc0a954f640 1 -- 10.20.193.93:0/2258037829 >> v1:10.20.193.155:6789/0 conn(0x7fc0a40aede0 legacy=0x7fc0a414b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:50.353 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.350+0000 7fc0a954f640 1 -- 10.20.193.93:0/2258037829 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0a4074610 con 0x7fc0a40ac1d0 2026-02-22T23:23:50.353 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.350+0000 7fc0a954f640 1 -- 10.20.193.93:0/2258037829 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fc098002ea0 con 0x7fc0a40ac1d0 2026-02-22T23:23:50.353 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.350+0000 7fc0a954f640 1 -- 10.20.193.93:0/2258037829 <== mon.0 v1:10.20.193.93:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc0980030c0 con 0x7fc0a40ac1d0 2026-02-22T23:23:50.353 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.350+0000 7fc0a954f640 1 -- 10.20.193.93:0/2258037829 <== mon.0 v1:10.20.193.93:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fc0980034d0 con 0x7fc0a40ac1d0 2026-02-22T23:23:50.353 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.350+0000 7fc0ac7dc640 1 -- 10.20.193.93:0/2258037829 >> v1:10.20.193.93:6789/0 conn(0x7fc0a40ac1d0 legacy=0x7fc0a40ae6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:50.353 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.350+0000 7fc0ac7dc640 1 -- 10.20.193.93:0/2258037829 shutdown_connections 2026-02-22T23:23:50.353 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.350+0000 7fc0ac7dc640 1 -- 10.20.193.93:0/2258037829 >> 10.20.193.93:0/2258037829 conn(0x7fc0a406d2e0 msgr2=0x7fc0a40b4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:23:50.353 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.350+0000 7fc0ac7dc640 1 -- 10.20.193.93:0/2258037829 shutdown_connections 2026-02-22T23:23:50.353 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.350+0000 7fc0ac7dc640 1 -- 10.20.193.93:0/2258037829 wait complete. 2026-02-22T23:23:50.353 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.350+0000 7fc0ac7dc640 1 Processor -- start 2026-02-22T23:23:50.353 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.351+0000 7fc0ac7dc640 1 -- start start 2026-02-22T23:23:50.354 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.351+0000 7fc0ac7dc640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0a4142900 con 0x7fc0a40aede0 2026-02-22T23:23:50.354 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.351+0000 7fc0ac7dc640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0a4143270 con 0x7fc0a40ac1d0 2026-02-22T23:23:50.354 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.351+0000 7fc0ac7dc640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0a4142b70 con 0x7fc0a40af930 2026-02-22T23:23:50.354 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.351+0000 7fc0a9d50640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7fc0a40aede0 0x7fc0a4143750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:41406/0 (socket says 10.20.193.93:41406) 2026-02-22T23:23:50.354 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.351+0000 7fc0a9d50640 1 -- 10.20.193.93:0/2144176105 learned_addr learned my addr 10.20.193.93:0/2144176105 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:23:50.354 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.351+0000 7fc08affd640 1 -- 10.20.193.93:0/2144176105 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3949183266 0 0) 0x7fc0a4142900 con 0x7fc0a40aede0 2026-02-22T23:23:50.354 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.351+0000 7fc08affd640 1 -- 10.20.193.93:0/2144176105 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc074003620 con 0x7fc0a40aede0 2026-02-22T23:23:50.354 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.351+0000 7fc08affd640 1 -- 10.20.193.93:0/2144176105 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3540263967 0 0) 0x7fc0a4142b70 con 0x7fc0a40af930 2026-02-22T23:23:50.354 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.351+0000 7fc08affd640 1 -- 10.20.193.93:0/2144176105 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0a4142900 con 0x7fc0a40af930 2026-02-22T23:23:50.354 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.351+0000 7fc08affd640 1 -- 10.20.193.93:0/2144176105 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 121753176 0 0) 0x7fc074003620 con 0x7fc0a40aede0 2026-02-22T23:23:50.354 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.351+0000 7fc08affd640 1 -- 10.20.193.93:0/2144176105 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc0a4142b70 con 0x7fc0a40aede0 2026-02-22T23:23:50.354 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.351+0000 7fc08affd640 1 -- 10.20.193.93:0/2144176105 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fc0980034d0 con 0x7fc0a40aede0 2026-02-22T23:23:50.355 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.351+0000 7fc08affd640 1 -- 10.20.193.93:0/2144176105 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 402670222 0 0) 0x7fc0a4142900 con 0x7fc0a40af930 2026-02-22T23:23:50.355 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.351+0000 7fc08affd640 1 -- 10.20.193.93:0/2144176105 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc074003620 con 0x7fc0a40af930 2026-02-22T23:23:50.355 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.351+0000 7fc08affd640 1 -- 10.20.193.93:0/2144176105 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fc0a0003400 con 0x7fc0a40af930 2026-02-22T23:23:50.355 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.351+0000 7fc08affd640 1 -- 10.20.193.93:0/2144176105 <== mon.0 v1:10.20.193.93:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2637616559 0 0) 0x7fc0a4142b70 con 0x7fc0a40aede0 2026-02-22T23:23:50.355 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.351+0000 7fc08affd640 1 -- 10.20.193.93:0/2144176105 >> v1:10.20.193.93:6790/0 conn(0x7fc0a40af930 legacy=0x7fc0a4143e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:50.355 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.351+0000 7fc08affd640 1 -- 10.20.193.93:0/2144176105 >> v1:10.20.193.155:6789/0 conn(0x7fc0a40ac1d0 legacy=0x7fc0a41416a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:50.355 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.351+0000 7fc08affd640 1 -- 10.20.193.93:0/2144176105 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0a4142e50 con 0x7fc0a40aede0 2026-02-22T23:23:50.355 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.351+0000 7fc0ac7dc640 1 -- 10.20.193.93:0/2144176105 --> v1:10.20.193.93:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc0a4140ac0 con 0x7fc0a40aede0 2026-02-22T23:23:50.355 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.351+0000 7fc08affd640 1 -- 10.20.193.93:0/2144176105 <== mon.0 v1:10.20.193.93:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc098003a60 con 0x7fc0a40aede0 2026-02-22T23:23:50.355 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.351+0000 7fc0ac7dc640 1 -- 10.20.193.93:0/2144176105 --> v1:10.20.193.93:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc0a41e6010 con 0x7fc0a40aede0 2026-02-22T23:23:50.355 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.351+0000 7fc08affd640 1 -- 10.20.193.93:0/2144176105 <== mon.0 v1:10.20.193.93:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fc098003e30 con 0x7fc0a40aede0 2026-02-22T23:23:50.355 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.352+0000 7fc0ac7dc640 1 -- 10.20.193.93:0/2144176105 --> v1:10.20.193.93:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0a40008d0 con 0x7fc0a40aede0 2026-02-22T23:23:50.355 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.352+0000 7fc08affd640 1 -- 10.20.193.93:0/2144176105 <== mon.0 v1:10.20.193.93:6789/0 7 ==== mgrmap(e 4) ==== 99810+0+0 (unknown 1563330754 0 0) 0x7fc098003fd0 con 0x7fc0a40aede0 2026-02-22T23:23:50.355 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.352+0000 7fc08affd640 1 -- 10.20.193.93:0/2144176105 <== mon.0 v1:10.20.193.93:6789/0 8 ==== osd_map(12..12 src has 1..12) ==== 2131+0+0 (unknown 3588078816 0 0) 0x7fc0980939f0 con 0x7fc0a40aede0 2026-02-22T23:23:50.358 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.355+0000 7fc08affd640 1 -- 10.20.193.93:0/2144176105 <== mon.0 v1:10.20.193.93:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7fc09805daa0 con 0x7fc0a40aede0 2026-02-22T23:23:50.440 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.437+0000 7fc0ac7dc640 1 -- 10.20.193.93:0/2144176105 --> v1:10.20.193.93:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc0a40acdd0 con 0x7fc0a40aede0 2026-02-22T23:23:50.441 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.438+0000 7fc08affd640 1 -- 10.20.193.93:0/2144176105 <== mon.0 v1:10.20.193.93:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (unknown 4250787923 0 295225182) 0x7fc09805d3a0 con 0x7fc0a40aede0 2026-02-22T23:23:50.441 INFO:teuthology.misc.health.trial093.stdout: 2026-02-22T23:23:50.441 INFO:teuthology.misc.health.trial093.stdout:{"epoch":12,"fsid":"964c49d0-be38-4661-88a8-21893fbedc4f","created":"2026-02-22T23:23:40.901753+0000","modified":"2026-02-22T23:23:49.878726+0000","last_up_change":"0.000000","last_in_change":"2026-02-22T23:23:42.448665+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d1ce1e9f-bb70-4b7b-9dbc-e380de9324c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e5ab5de3-2e0f-4f91-8dfe-c74bff8838d5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"10d76c55-707a-43c8-b51e-0e5ae595f89e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d7a29cea-4066-455f-8a32-f4cb5534ae32","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"6a1874d8-3703-429f-839b-d3dc0f448b14","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"447cea4f-f753-457e-b654-85ade052dc45","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"dee8274e-5e87-4e06-a9aa-44439f7f5354","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c988ac9f-b5ed-48f5-aeb8-96968366722e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T23:23:50.441 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.438+0000 7fc0ac7dc640 1 -- 10.20.193.93:0/2144176105 >> v1:10.20.193.155:6800/3108481844 conn(0x7fc074078040 legacy=0x7fc07407a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:50.441 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.438+0000 7fc0ac7dc640 1 -- 10.20.193.93:0/2144176105 >> v1:10.20.193.93:6789/0 conn(0x7fc0a40aede0 legacy=0x7fc0a4143750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:50.441 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.438+0000 7fc0ac7dc640 1 -- 10.20.193.93:0/2144176105 shutdown_connections 2026-02-22T23:23:50.441 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.438+0000 7fc0ac7dc640 1 -- 10.20.193.93:0/2144176105 >> 10.20.193.93:0/2144176105 conn(0x7fc0a406d2e0 msgr2=0x7fc0a40b08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:23:50.441 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.438+0000 7fc0ac7dc640 1 -- 10.20.193.93:0/2144176105 shutdown_connections 2026-02-22T23:23:50.441 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:50.438+0000 7fc0ac7dc640 1 -- 10.20.193.93:0/2144176105 wait complete. 2026-02-22T23:23:50.447 DEBUG:teuthology.misc:0 of 8 OSDs are up 2026-02-22T23:23:50.887 INFO:tasks.ceph.osd.6.trial155.stderr:2026-02-22T23:23:50.905+0000 7f007e858640 -1 osd.6 0 waiting for initial osdmap 2026-02-22T23:23:50.887 INFO:tasks.ceph.osd.4.trial155.stderr:2026-02-22T23:23:50.905+0000 7fba1e3e9640 -1 osd.4 0 waiting for initial osdmap 2026-02-22T23:23:50.888 INFO:tasks.ceph.osd.5.trial155.stderr:2026-02-22T23:23:50.905+0000 7fed469ba640 -1 osd.5 0 waiting for initial osdmap 2026-02-22T23:23:50.888 INFO:tasks.ceph.osd.2.trial093.stderr:2026-02-22T23:23:50.885+0000 7fca6ed66640 -1 osd.2 0 waiting for initial osdmap 2026-02-22T23:23:50.889 INFO:tasks.ceph.osd.3.trial093.stderr:2026-02-22T23:23:50.885+0000 7f88855e6640 -1 osd.3 0 waiting for initial osdmap 2026-02-22T23:23:50.889 INFO:tasks.ceph.osd.0.trial093.stderr:2026-02-22T23:23:50.885+0000 7f4ab3b41640 -1 osd.0 0 waiting for initial osdmap 2026-02-22T23:23:50.889 INFO:tasks.ceph.osd.6.trial155.stderr:2026-02-22T23:23:50.907+0000 7f007a693640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T23:23:50.890 INFO:tasks.ceph.osd.4.trial155.stderr:2026-02-22T23:23:50.909+0000 7fba1621c640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T23:23:50.890 INFO:tasks.ceph.osd.5.trial155.stderr:2026-02-22T23:23:50.909+0000 7fed427f5640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T23:23:50.892 INFO:tasks.ceph.osd.2.trial093.stderr:2026-02-22T23:23:50.889+0000 7fca6aba1640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T23:23:50.892 INFO:tasks.ceph.osd.3.trial093.stderr:2026-02-22T23:23:50.889+0000 7f887cc18640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T23:23:50.893 INFO:tasks.ceph.osd.0.trial093.stderr:2026-02-22T23:23:50.889+0000 7f4aaf97c640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T23:23:57.254 DEBUG:teuthology.orchestra.run.trial093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-22T23:23:57.318 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.315+0000 7f430eef1640 1 Processor -- start 2026-02-22T23:23:57.318 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.315+0000 7f430eef1640 1 -- start start 2026-02-22T23:23:57.319 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.316+0000 7f430eef1640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43080ae2b0 con 0x7f43080ac1d0 2026-02-22T23:23:57.319 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.316+0000 7f430eef1640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43080ac980 con 0x7f43080aede0 2026-02-22T23:23:57.319 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.316+0000 7f430eef1640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43080abcb0 con 0x7f43080af930 2026-02-22T23:23:57.319 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.316+0000 7f430cc66640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7f43080af930 0x7f430813d540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:35390/0 (socket says 10.20.193.93:35390) 2026-02-22T23:23:57.319 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.316+0000 7f430cc66640 1 -- 10.20.193.93:0/1223036215 learned_addr learned my addr 10.20.193.93:0/1223036215 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:23:57.319 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.316+0000 7f42ff7fe640 1 -- 10.20.193.93:0/1223036215 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2808761510 0 0) 0x7f43080ae2b0 con 0x7f43080ac1d0 2026-02-22T23:23:57.319 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.316+0000 7f42ff7fe640 1 -- 10.20.193.93:0/1223036215 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42f4003620 con 0x7f43080ac1d0 2026-02-22T23:23:57.319 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.316+0000 7f42ff7fe640 1 -- 10.20.193.93:0/1223036215 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2238835471 0 0) 0x7f43080abcb0 con 0x7f43080af930 2026-02-22T23:23:57.319 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.316+0000 7f42ff7fe640 1 -- 10.20.193.93:0/1223036215 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43080ae2b0 con 0x7f43080af930 2026-02-22T23:23:57.319 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.316+0000 7f42ff7fe640 1 -- 10.20.193.93:0/1223036215 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 433575083 0 0) 0x7f43080ae2b0 con 0x7f43080af930 2026-02-22T23:23:57.319 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.316+0000 7f42ff7fe640 1 -- 10.20.193.93:0/1223036215 >> v1:10.20.193.155:6789/0 conn(0x7f43080aede0 legacy=0x7f430814b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T23:23:57.319 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.316+0000 7f42ff7fe640 1 -- 10.20.193.93:0/1223036215 >> v1:10.20.193.93:6789/0 conn(0x7f43080ac1d0 legacy=0x7f43080ae6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:57.319 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.316+0000 7f42ff7fe640 1 -- 10.20.193.93:0/1223036215 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4308074610 con 0x7f43080af930 2026-02-22T23:23:57.319 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.316+0000 7f42ff7fe640 1 -- 10.20.193.93:0/1223036215 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f42f8002e80 con 0x7f43080af930 2026-02-22T23:23:57.319 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.316+0000 7f42ff7fe640 1 -- 10.20.193.93:0/1223036215 <== mon.2 v1:10.20.193.93:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f42f8003020 con 0x7f43080af930 2026-02-22T23:23:57.319 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.316+0000 7f42ff7fe640 1 -- 10.20.193.93:0/1223036215 <== mon.2 v1:10.20.193.93:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f42f8003430 con 0x7f43080af930 2026-02-22T23:23:57.319 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.316+0000 7f430eef1640 1 -- 10.20.193.93:0/1223036215 >> v1:10.20.193.93:6790/0 conn(0x7f43080af930 legacy=0x7f430813d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:57.319 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.316+0000 7f430eef1640 1 -- 10.20.193.93:0/1223036215 shutdown_connections 2026-02-22T23:23:57.319 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.316+0000 7f430eef1640 1 -- 10.20.193.93:0/1223036215 >> 10.20.193.93:0/1223036215 conn(0x7f430806d2e0 msgr2=0x7f43080b4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:23:57.319 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.316+0000 7f430eef1640 1 -- 10.20.193.93:0/1223036215 shutdown_connections 2026-02-22T23:23:57.320 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.316+0000 7f430eef1640 1 -- 10.20.193.93:0/1223036215 wait complete. 2026-02-22T23:23:57.320 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.317+0000 7f430eef1640 1 Processor -- start 2026-02-22T23:23:57.320 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.317+0000 7f430eef1640 1 -- start start 2026-02-22T23:23:57.320 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.317+0000 7f430eef1640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4308143080 con 0x7f43080ac1d0 2026-02-22T23:23:57.320 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.317+0000 7f430eef1640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4308143af0 con 0x7f43080af930 2026-02-22T23:23:57.320 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.317+0000 7f430eef1640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4308143dd0 con 0x7f43080aede0 2026-02-22T23:23:57.320 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.317+0000 7f430cc66640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7f43080ac1d0 0x7f4308138bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:41426/0 (socket says 10.20.193.93:41426) 2026-02-22T23:23:57.320 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.317+0000 7f430cc66640 1 -- 10.20.193.93:0/1578863712 learned_addr learned my addr 10.20.193.93:0/1578863712 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:23:57.321 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.317+0000 7f42fd7fa640 1 -- 10.20.193.93:0/1578863712 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3364180584 0 0) 0x7f4308143dd0 con 0x7f43080aede0 2026-02-22T23:23:57.321 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.317+0000 7f42fd7fa640 1 -- 10.20.193.93:0/1578863712 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42d8003620 con 0x7f43080aede0 2026-02-22T23:23:57.321 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.317+0000 7f42fd7fa640 1 -- 10.20.193.93:0/1578863712 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2891009605 0 0) 0x7f4308143080 con 0x7f43080ac1d0 2026-02-22T23:23:57.321 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.317+0000 7f42fd7fa640 1 -- 10.20.193.93:0/1578863712 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4308143dd0 con 0x7f43080ac1d0 2026-02-22T23:23:57.321 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.317+0000 7f42fd7fa640 1 -- 10.20.193.93:0/1578863712 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 150179151 0 0) 0x7f42d8003620 con 0x7f43080aede0 2026-02-22T23:23:57.321 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.317+0000 7f42fd7fa640 1 -- 10.20.193.93:0/1578863712 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4308143080 con 0x7f43080aede0 2026-02-22T23:23:57.321 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.317+0000 7f42fd7fa640 1 -- 10.20.193.93:0/1578863712 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3871433283 0 0) 0x7f4308143dd0 con 0x7f43080ac1d0 2026-02-22T23:23:57.321 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.317+0000 7f42fd7fa640 1 -- 10.20.193.93:0/1578863712 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f42d8003620 con 0x7f43080ac1d0 2026-02-22T23:23:57.321 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.317+0000 7f42fd7fa640 1 -- 10.20.193.93:0/1578863712 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f42f00032c0 con 0x7f43080aede0 2026-02-22T23:23:57.321 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.317+0000 7f42fd7fa640 1 -- 10.20.193.93:0/1578863712 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f42f8003430 con 0x7f43080ac1d0 2026-02-22T23:23:57.321 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.318+0000 7f42fd7fa640 1 -- 10.20.193.93:0/1578863712 <== mon.2 v1:10.20.193.93:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 981489540 0 0) 0x7f4308143080 con 0x7f43080aede0 2026-02-22T23:23:57.321 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.318+0000 7f42fd7fa640 1 -- 10.20.193.93:0/1578863712 >> v1:10.20.193.155:6789/0 conn(0x7f43080af930 legacy=0x7f43081e6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:57.321 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.318+0000 7f42fd7fa640 1 -- 10.20.193.93:0/1578863712 >> v1:10.20.193.93:6789/0 conn(0x7f43080ac1d0 legacy=0x7f4308138bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:57.321 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.318+0000 7f42fd7fa640 1 -- 10.20.193.93:0/1578863712 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43081440b0 con 0x7f43080aede0 2026-02-22T23:23:57.321 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.318+0000 7f430eef1640 1 -- 10.20.193.93:0/1578863712 --> v1:10.20.193.93:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f43081426d0 con 0x7f43080aede0 2026-02-22T23:23:57.321 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.318+0000 7f430eef1640 1 -- 10.20.193.93:0/1578863712 --> v1:10.20.193.93:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f4308142180 con 0x7f43080aede0 2026-02-22T23:23:57.321 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.318+0000 7f42fd7fa640 1 -- 10.20.193.93:0/1578863712 <== mon.2 v1:10.20.193.93:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f42f0003710 con 0x7f43080aede0 2026-02-22T23:23:57.321 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.318+0000 7f42fd7fa640 1 -- 10.20.193.93:0/1578863712 <== mon.2 v1:10.20.193.93:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f42f0003ae0 con 0x7f43080aede0 2026-02-22T23:23:57.321 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.318+0000 7f430eef1640 1 -- 10.20.193.93:0/1578863712 --> v1:10.20.193.93:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4308140020 con 0x7f43080aede0 2026-02-22T23:23:57.322 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.319+0000 7f42fd7fa640 1 -- 10.20.193.93:0/1578863712 <== mon.2 v1:10.20.193.93:6790/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7f42f001c2b0 con 0x7f43080aede0 2026-02-22T23:23:57.322 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.319+0000 7f42fd7fa640 1 -- 10.20.193.93:0/1578863712 <== mon.2 v1:10.20.193.93:6790/0 8 ==== osd_map(16..16 src has 1..16) ==== 3733+0+0 (unknown 3386004555 0 0) 0x7f42f0092e80 con 0x7f43080aede0 2026-02-22T23:23:57.324 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.321+0000 7f42fd7fa640 1 -- 10.20.193.93:0/1578863712 <== mon.2 v1:10.20.193.93:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f42f005c810 con 0x7f43080aede0 2026-02-22T23:23:57.407 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.404+0000 7f430eef1640 1 -- 10.20.193.93:0/1578863712 --> v1:10.20.193.93:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f43080b0c90 con 0x7f43080aede0 2026-02-22T23:23:57.408 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.404+0000 7f42fd7fa640 1 -- 10.20.193.93:0/1578863712 <== mon.2 v1:10.20.193.93:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+10960 (unknown 1054498076 0 4263705553) 0x7f42f005c110 con 0x7f43080aede0 2026-02-22T23:23:57.408 INFO:teuthology.misc.health.trial093.stdout: 2026-02-22T23:23:57.408 INFO:teuthology.misc.health.trial093.stdout:{"epoch":16,"fsid":"964c49d0-be38-4661-88a8-21893fbedc4f","created":"2026-02-22T23:23:40.901753+0000","modified":"2026-02-22T23:23:53.924826+0000","last_up_change":"2026-02-22T23:23:51.885433+0000","last_in_change":"2026-02-22T23:23:42.448665+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-22T23:23:51.047515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d1ce1e9f-bb70-4b7b-9dbc-e380de9324c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6806","nonce":3224090065}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6808","nonce":3224090065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6811","nonce":3224090065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6810","nonce":3224090065}]},"public_addr":"10.20.193.93:6806/3224090065","cluster_addr":"10.20.193.93:6808/3224090065","heartbeat_back_addr":"10.20.193.93:6811/3224090065","heartbeat_front_addr":"10.20.193.93:6810/3224090065","state":["exists","up"]},{"osd":1,"uuid":"e5ab5de3-2e0f-4f91-8dfe-c74bff8838d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6800","nonce":4002367425}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6801","nonce":4002367425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6803","nonce":4002367425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6802","nonce":4002367425}]},"public_addr":"10.20.193.93:6800/4002367425","cluster_addr":"10.20.193.93:6801/4002367425","heartbeat_back_addr":"10.20.193.93:6803/4002367425","heartbeat_front_addr":"10.20.193.93:6802/4002367425","state":["exists","up"]},{"osd":2,"uuid":"10d76c55-707a-43c8-b51e-0e5ae595f89e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6812","nonce":945702863}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6813","nonce":945702863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6815","nonce":945702863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6814","nonce":945702863}]},"public_addr":"10.20.193.93:6812/945702863","cluster_addr":"10.20.193.93:6813/945702863","heartbeat_back_addr":"10.20.193.93:6815/945702863","heartbeat_front_addr":"10.20.193.93:6814/945702863","state":["exists","up"]},{"osd":3,"uuid":"d7a29cea-4066-455f-8a32-f4cb5534ae32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6804","nonce":970700542}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6805","nonce":970700542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6809","nonce":970700542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6807","nonce":970700542}]},"public_addr":"10.20.193.93:6804/970700542","cluster_addr":"10.20.193.93:6805/970700542","heartbeat_back_addr":"10.20.193.93:6809/970700542","heartbeat_front_addr":"10.20.193.93:6807/970700542","state":["exists","up"]},{"osd":4,"uuid":"6a1874d8-3703-429f-839b-d3dc0f448b14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6813","nonce":3729844438}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6814","nonce":3729844438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6816","nonce":3729844438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6815","nonce":3729844438}]},"public_addr":"10.20.193.155:6813/3729844438","cluster_addr":"10.20.193.155:6814/3729844438","heartbeat_back_addr":"10.20.193.155:6816/3729844438","heartbeat_front_addr":"10.20.193.155:6815/3729844438","state":["exists","up"]},{"osd":5,"uuid":"447cea4f-f753-457e-b654-85ade052dc45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6806","nonce":887979704}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6808","nonce":887979704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6811","nonce":887979704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6810","nonce":887979704}]},"public_addr":"10.20.193.155:6806/887979704","cluster_addr":"10.20.193.155:6808/887979704","heartbeat_back_addr":"10.20.193.155:6811/887979704","heartbeat_front_addr":"10.20.193.155:6810/887979704","state":["exists","up"]},{"osd":6,"uuid":"dee8274e-5e87-4e06-a9aa-44439f7f5354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6805","nonce":4020397544}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6807","nonce":4020397544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6812","nonce":4020397544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6809","nonce":4020397544}]},"public_addr":"10.20.193.155:6805/4020397544","cluster_addr":"10.20.193.155:6807/4020397544","heartbeat_back_addr":"10.20.193.155:6812/4020397544","heartbeat_front_addr":"10.20.193.155:6809/4020397544","state":["exists","up"]},{"osd":7,"uuid":"c988ac9f-b5ed-48f5-aeb8-96968366722e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6801","nonce":2779097013}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6802","nonce":2779097013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6804","nonce":2779097013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6803","nonce":2779097013}]},"public_addr":"10.20.193.155:6801/2779097013","cluster_addr":"10.20.193.155:6802/2779097013","heartbeat_back_addr":"10.20.193.155:6804/2779097013","heartbeat_front_addr":"10.20.193.155:6803/2779097013","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:23:49.958344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:23:49.877163+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:23:49.987742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:23:49.866208+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:23:49.985851+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:23:50.007610+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:23:49.944652+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:23:49.883780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T23:23:57.408 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.405+0000 7f430eef1640 1 -- 10.20.193.93:0/1578863712 >> v1:10.20.193.155:6800/3108481844 conn(0x7f42d8077ff0 legacy=0x7f42d807a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:57.408 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.405+0000 7f430eef1640 1 -- 10.20.193.93:0/1578863712 >> v1:10.20.193.93:6790/0 conn(0x7f43080aede0 legacy=0x7f4308131060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:57.408 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.405+0000 7f430eef1640 1 -- 10.20.193.93:0/1578863712 shutdown_connections 2026-02-22T23:23:57.408 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.405+0000 7f430eef1640 1 -- 10.20.193.93:0/1578863712 >> 10.20.193.93:0/1578863712 conn(0x7f430806d2e0 msgr2=0x7f4308137220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:23:57.408 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.405+0000 7f430eef1640 1 -- 10.20.193.93:0/1578863712 shutdown_connections 2026-02-22T23:23:57.408 INFO:teuthology.misc.health.trial093.stderr:2026-02-22T23:23:57.405+0000 7f430eef1640 1 -- 10.20.193.93:0/1578863712 wait complete. 2026-02-22T23:23:57.414 DEBUG:teuthology.misc:8 of 8 OSDs are up 2026-02-22T23:23:57.414 INFO:tasks.ceph:Creating RBD pool 2026-02-22T23:23:57.414 DEBUG:teuthology.orchestra.run.trial093:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-22T23:23:57.478 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.475+0000 7fdfc9b11640 1 Processor -- start 2026-02-22T23:23:57.478 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.475+0000 7fdfc9b11640 1 -- start start 2026-02-22T23:23:57.482 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.475+0000 7fdfc9b11640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfc4071530 con 0x7fdfc4140d80 2026-02-22T23:23:57.482 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.475+0000 7fdfc9b11640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfc4070210 con 0x7fdfc40af060 2026-02-22T23:23:57.482 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.475+0000 7fdfc9b11640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfc40b18f0 con 0x7fdfc40704d0 2026-02-22T23:23:57.482 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.475+0000 7fdfc3fff640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7fdfc40704d0 0x7fdfc4143d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:35410/0 (socket says 10.20.193.93:35410) 2026-02-22T23:23:57.482 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.475+0000 7fdfc3fff640 1 -- 10.20.193.93:0/3159728805 learned_addr learned my addr 10.20.193.93:0/3159728805 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:23:57.483 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.476+0000 7fdfc27fc640 1 -- 10.20.193.93:0/3159728805 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 211770475 0 0) 0x7fdfc40b18f0 con 0x7fdfc40704d0 2026-02-22T23:23:57.483 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.476+0000 7fdfc27fc640 1 -- 10.20.193.93:0/3159728805 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdfa8003620 con 0x7fdfc40704d0 2026-02-22T23:23:57.483 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.476+0000 7fdfc27fc640 1 -- 10.20.193.93:0/3159728805 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2842471333 0 0) 0x7fdfc4071530 con 0x7fdfc4140d80 2026-02-22T23:23:57.483 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.476+0000 7fdfc27fc640 1 -- 10.20.193.93:0/3159728805 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdfc40b18f0 con 0x7fdfc4140d80 2026-02-22T23:23:57.483 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.476+0000 7fdfc27fc640 1 -- 10.20.193.93:0/3159728805 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 396199116 0 0) 0x7fdfc4070210 con 0x7fdfc40af060 2026-02-22T23:23:57.483 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.476+0000 7fdfc27fc640 1 -- 10.20.193.93:0/3159728805 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdfc4071530 con 0x7fdfc40af060 2026-02-22T23:23:57.483 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.476+0000 7fdfc27fc640 1 -- 10.20.193.93:0/3159728805 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3533915171 0 0) 0x7fdfc40b18f0 con 0x7fdfc4140d80 2026-02-22T23:23:57.483 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.476+0000 7fdfc27fc640 1 -- 10.20.193.93:0/3159728805 >> v1:10.20.193.93:6790/0 conn(0x7fdfc40704d0 legacy=0x7fdfc4143d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:57.483 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.476+0000 7fdfc27fc640 1 -- 10.20.193.93:0/3159728805 >> v1:10.20.193.155:6789/0 conn(0x7fdfc40af060 legacy=0x7fdfc4140670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:57.483 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.476+0000 7fdfc27fc640 1 -- 10.20.193.93:0/3159728805 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfc40b14e0 con 0x7fdfc4140d80 2026-02-22T23:23:57.483 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.476+0000 7fdfc27fc640 1 -- 10.20.193.93:0/3159728805 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fdfb4002e80 con 0x7fdfc4140d80 2026-02-22T23:23:57.483 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.476+0000 7fdfc27fc640 1 -- 10.20.193.93:0/3159728805 <== mon.0 v1:10.20.193.93:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdfb4003020 con 0x7fdfc4140d80 2026-02-22T23:23:57.483 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.476+0000 7fdfc27fc640 1 -- 10.20.193.93:0/3159728805 <== mon.0 v1:10.20.193.93:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fdfb40034b0 con 0x7fdfc4140d80 2026-02-22T23:23:57.483 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.476+0000 7fdfc9b11640 1 -- 10.20.193.93:0/3159728805 >> v1:10.20.193.93:6789/0 conn(0x7fdfc4140d80 legacy=0x7fdfc4143670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:57.483 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.476+0000 7fdfc9b11640 1 -- 10.20.193.93:0/3159728805 shutdown_connections 2026-02-22T23:23:57.484 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.476+0000 7fdfc9b11640 1 -- 10.20.193.93:0/3159728805 >> 10.20.193.93:0/3159728805 conn(0x7fdfc40b1d30 msgr2=0x7fdfc40b2140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:23:57.484 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.476+0000 7fdfc9b11640 1 -- 10.20.193.93:0/3159728805 shutdown_connections 2026-02-22T23:23:57.484 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.476+0000 7fdfc9b11640 1 -- 10.20.193.93:0/3159728805 wait complete. 2026-02-22T23:23:57.484 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.477+0000 7fdfc9b11640 1 Processor -- start 2026-02-22T23:23:57.484 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.477+0000 7fdfc9b11640 1 -- start start 2026-02-22T23:23:57.484 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.477+0000 7fdfc9b11640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfc41477e0 con 0x7fdfc40af060 2026-02-22T23:23:57.484 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.477+0000 7fdfc9b11640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfc413aaa0 con 0x7fdfc4140d80 2026-02-22T23:23:57.484 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.477+0000 7fdfc9b11640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfc4139090 con 0x7fdfc40704d0 2026-02-22T23:23:57.484 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.477+0000 7fdfc2ffd640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7fdfc40af060 0x7fdfc41da0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:41444/0 (socket says 10.20.193.93:41444) 2026-02-22T23:23:57.484 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.477+0000 7fdfc2ffd640 1 -- 10.20.193.93:0/466691970 learned_addr learned my addr 10.20.193.93:0/466691970 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:23:57.484 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.477+0000 7fdfc37fe640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7fdfc40704d0 0x7fdfc41d7120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:35416/0 (socket says 10.20.193.93:35416) 2026-02-22T23:23:57.484 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.477+0000 7fdf9ffff640 1 -- 10.20.193.93:0/466691970 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3736474048 0 0) 0x7fdfc41477e0 con 0x7fdfc40af060 2026-02-22T23:23:57.484 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.477+0000 7fdf9ffff640 1 -- 10.20.193.93:0/466691970 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf94003620 con 0x7fdfc40af060 2026-02-22T23:23:57.484 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.477+0000 7fdf9ffff640 1 -- 10.20.193.93:0/466691970 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4128685595 0 0) 0x7fdfc4139090 con 0x7fdfc40704d0 2026-02-22T23:23:57.484 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.477+0000 7fdf9ffff640 1 -- 10.20.193.93:0/466691970 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdfc41477e0 con 0x7fdfc40704d0 2026-02-22T23:23:57.484 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.477+0000 7fdf9ffff640 1 -- 10.20.193.93:0/466691970 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 741347767 0 0) 0x7fdf94003620 con 0x7fdfc40af060 2026-02-22T23:23:57.484 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.478+0000 7fdf9ffff640 1 -- 10.20.193.93:0/466691970 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdfc4139090 con 0x7fdfc40af060 2026-02-22T23:23:57.484 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.478+0000 7fdf9ffff640 1 -- 10.20.193.93:0/466691970 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fdfb4003810 con 0x7fdfc40af060 2026-02-22T23:23:57.484 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.478+0000 7fdf9ffff640 1 -- 10.20.193.93:0/466691970 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 173441186 0 0) 0x7fdfc41477e0 con 0x7fdfc40704d0 2026-02-22T23:23:57.484 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.478+0000 7fdf9ffff640 1 -- 10.20.193.93:0/466691970 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdf94003620 con 0x7fdfc40704d0 2026-02-22T23:23:57.484 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.478+0000 7fdf9ffff640 1 -- 10.20.193.93:0/466691970 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fdfb0003140 con 0x7fdfc40704d0 2026-02-22T23:23:57.484 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.478+0000 7fdf9ffff640 1 -- 10.20.193.93:0/466691970 <== mon.0 v1:10.20.193.93:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3536202594 0 0) 0x7fdfc4139090 con 0x7fdfc40af060 2026-02-22T23:23:57.484 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.478+0000 7fdf9ffff640 1 -- 10.20.193.93:0/466691970 >> v1:10.20.193.93:6790/0 conn(0x7fdfc40704d0 legacy=0x7fdfc41d7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:57.484 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.478+0000 7fdf9ffff640 1 -- 10.20.193.93:0/466691970 >> v1:10.20.193.155:6789/0 conn(0x7fdfc4140d80 legacy=0x7fdfc41da7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:57.484 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.478+0000 7fdf9ffff640 1 -- 10.20.193.93:0/466691970 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfc41daf00 con 0x7fdfc40af060 2026-02-22T23:23:57.484 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.478+0000 7fdfc9b11640 1 -- 10.20.193.93:0/466691970 --> v1:10.20.193.93:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdfc4139870 con 0x7fdfc40af060 2026-02-22T23:23:57.484 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.478+0000 7fdfc9b11640 1 -- 10.20.193.93:0/466691970 --> v1:10.20.193.93:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fdfc41d7830 con 0x7fdfc40af060 2026-02-22T23:23:57.484 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.478+0000 7fdf9ffff640 1 -- 10.20.193.93:0/466691970 <== mon.0 v1:10.20.193.93:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdfb4002de0 con 0x7fdfc40af060 2026-02-22T23:23:57.484 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.478+0000 7fdf9ffff640 1 -- 10.20.193.93:0/466691970 <== mon.0 v1:10.20.193.93:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fdfb4003e80 con 0x7fdfc40af060 2026-02-22T23:23:57.484 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.478+0000 7fdfc9b11640 1 -- 10.20.193.93:0/466691970 --> v1:10.20.193.93:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfc4139b90 con 0x7fdfc40af060 2026-02-22T23:23:57.484 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.479+0000 7fdf9ffff640 1 -- 10.20.193.93:0/466691970 <== mon.0 v1:10.20.193.93:6789/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7fdfb401d990 con 0x7fdfc40af060 2026-02-22T23:23:57.484 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.479+0000 7fdf9ffff640 1 -- 10.20.193.93:0/466691970 <== mon.0 v1:10.20.193.93:6789/0 8 ==== osd_map(16..16 src has 1..16) ==== 3733+0+0 (unknown 3386004555 0 0) 0x7fdfb4094200 con 0x7fdfc40af060 2026-02-22T23:23:57.485 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.482+0000 7fdf9ffff640 1 -- 10.20.193.93:0/466691970 <== mon.0 v1:10.20.193.93:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7fdfb405db90 con 0x7fdfc40af060 2026-02-22T23:23:57.570 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.567+0000 7fdfc9b11640 1 -- 10.20.193.93:0/466691970 --> v1:10.20.193.93:6789/0 -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7fdfc41473c0 con 0x7fdfc40af060 2026-02-22T23:23:57.936 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.932+0000 7fdf9ffff640 1 -- 10.20.193.93:0/466691970 <== mon.0 v1:10.20.193.93:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v17) ==== 109+0+0 (unknown 1910661782 0 0) 0x7fdfb405d490 con 0x7fdfc40af060 2026-02-22T23:23:57.936 INFO:teuthology.orchestra.run.trial093.stderr:pool 'rbd' created 2026-02-22T23:23:57.937 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.934+0000 7fdfc9b11640 1 -- 10.20.193.93:0/466691970 >> v1:10.20.193.155:6800/3108481844 conn(0x7fdf94077f90 legacy=0x7fdf9407a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:57.937 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.934+0000 7fdfc9b11640 1 -- 10.20.193.93:0/466691970 >> v1:10.20.193.93:6789/0 conn(0x7fdfc40af060 legacy=0x7fdfc41da0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:57.938 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.934+0000 7fdfc9b11640 1 -- 10.20.193.93:0/466691970 shutdown_connections 2026-02-22T23:23:57.938 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.934+0000 7fdfc9b11640 1 -- 10.20.193.93:0/466691970 >> 10.20.193.93:0/466691970 conn(0x7fdfc40b1d30 msgr2=0x7fdfc413fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:23:57.938 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.934+0000 7fdfc9b11640 1 -- 10.20.193.93:0/466691970 shutdown_connections 2026-02-22T23:23:57.938 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.934+0000 7fdfc9b11640 1 -- 10.20.193.93:0/466691970 wait complete. 2026-02-22T23:23:57.947 DEBUG:teuthology.orchestra.run.trial093:> rbd --cluster ceph pool init rbd 2026-02-22T23:23:57.981 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.974+0000 7ff3533ee0c0 1 Processor -- start 2026-02-22T23:23:57.981 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.974+0000 7ff3533ee0c0 1 -- start start 2026-02-22T23:23:57.981 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.974+0000 7ff3533ee0c0 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55d99783cd20 con 0x55d997a8faa0 2026-02-22T23:23:57.981 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.974+0000 7ff3533ee0c0 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55d9979fb010 con 0x55d9979f8dc0 2026-02-22T23:23:57.981 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.974+0000 7ff3533ee0c0 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55d9979f91a0 con 0x55d997a95fb0 2026-02-22T23:23:57.981 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.975+0000 7ff3516b3640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x55d997a8faa0 0x55d997a958a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:41452/0 (socket says 10.20.193.93:41452) 2026-02-22T23:23:57.981 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.975+0000 7ff3516b3640 1 -- 10.20.193.93:0/2029331502 learned_addr learned my addr 10.20.193.93:0/2029331502 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:23:57.981 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.975+0000 7ff35313d640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x55d997a95fb0 0x55d997a9da00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:35430/0 (socket says 10.20.193.93:35430) 2026-02-22T23:23:57.981 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.975+0000 7ff350eb2640 1 -- 10.20.193.93:0/2029331502 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 309408685 0 0) 0x55d9979f91a0 con 0x55d997a95fb0 2026-02-22T23:23:57.981 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.975+0000 7ff350eb2640 1 -- 10.20.193.93:0/2029331502 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff338001e10 con 0x55d997a95fb0 2026-02-22T23:23:57.981 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.975+0000 7ff350eb2640 1 -- 10.20.193.93:0/2029331502 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3223963894 0 0) 0x55d99783cd20 con 0x55d997a8faa0 2026-02-22T23:23:57.981 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.975+0000 7ff350eb2640 1 -- 10.20.193.93:0/2029331502 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x55d9979f91a0 con 0x55d997a8faa0 2026-02-22T23:23:57.981 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.975+0000 7ff350eb2640 1 -- 10.20.193.93:0/2029331502 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1358725608 0 0) 0x7ff338001e10 con 0x55d997a95fb0 2026-02-22T23:23:57.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.975+0000 7ff350eb2640 1 -- 10.20.193.93:0/2029331502 >> v1:10.20.193.155:6789/0 conn(0x55d9979f8dc0 legacy=0x55d997a8f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:57.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.975+0000 7ff350eb2640 1 -- 10.20.193.93:0/2029331502 >> v1:10.20.193.93:6789/0 conn(0x55d997a8faa0 legacy=0x55d997a958a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:57.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.975+0000 7ff350eb2640 1 -- 10.20.193.93:0/2029331502 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9979fb280 con 0x55d997a95fb0 2026-02-22T23:23:57.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.975+0000 7ff350eb2640 1 -- 10.20.193.93:0/2029331502 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7ff344001a60 con 0x55d997a95fb0 2026-02-22T23:23:57.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.975+0000 7ff350eb2640 1 -- 10.20.193.93:0/2029331502 <== mon.2 v1:10.20.193.93:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff344001c80 con 0x55d997a95fb0 2026-02-22T23:23:57.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.975+0000 7ff350eb2640 1 -- 10.20.193.93:0/2029331502 <== mon.2 v1:10.20.193.93:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7ff344002050 con 0x55d997a95fb0 2026-02-22T23:23:57.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.975+0000 7ff3533ee0c0 1 -- 10.20.193.93:0/2029331502 >> v1:10.20.193.93:6790/0 conn(0x55d997a95fb0 legacy=0x55d997a9da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:57.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.975+0000 7ff3533ee0c0 1 -- 10.20.193.93:0/2029331502 shutdown_connections 2026-02-22T23:23:57.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.975+0000 7ff3533ee0c0 1 -- 10.20.193.93:0/2029331502 >> 10.20.193.93:0/2029331502 conn(0x55d997a04a00 msgr2=0x55d997a04e10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:23:57.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.975+0000 7ff3533ee0c0 1 -- 10.20.193.93:0/2029331502 shutdown_connections 2026-02-22T23:23:57.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.975+0000 7ff3533ee0c0 1 -- 10.20.193.93:0/2029331502 wait complete. 2026-02-22T23:23:57.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.976+0000 7ff3533ee0c0 1 Processor -- start 2026-02-22T23:23:57.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.976+0000 7ff3533ee0c0 1 -- start start 2026-02-22T23:23:57.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.976+0000 7ff3533ee0c0 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55d997a99420 con 0x55d997a95fb0 2026-02-22T23:23:57.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.976+0000 7ff3533ee0c0 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55d997a90520 con 0x55d9979f8dc0 2026-02-22T23:23:57.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.976+0000 7ff3533ee0c0 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55d997a8ff60 con 0x55d997a8faa0 2026-02-22T23:23:57.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.976+0000 7ff3516b3640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x55d997a8faa0 0x55d997aa47d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:35432/0 (socket says 10.20.193.93:35432) 2026-02-22T23:23:57.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.976+0000 7ff3516b3640 1 -- 10.20.193.93:0/161406780 learned_addr learned my addr 10.20.193.93:0/161406780 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:23:57.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.976+0000 7ff35313d640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x55d997a95fb0 0x55d997aacb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:41460/0 (socket says 10.20.193.93:41460) 2026-02-22T23:23:57.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.976+0000 7ff341ffb640 1 -- 10.20.193.93:0/161406780 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2097957658 0 0) 0x55d997a99420 con 0x55d997a95fb0 2026-02-22T23:23:57.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.976+0000 7ff341ffb640 1 -- 10.20.193.93:0/161406780 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff330001e10 con 0x55d997a95fb0 2026-02-22T23:23:57.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.976+0000 7ff341ffb640 1 -- 10.20.193.93:0/161406780 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3118333283 0 0) 0x55d997a8ff60 con 0x55d997a8faa0 2026-02-22T23:23:57.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.976+0000 7ff341ffb640 1 -- 10.20.193.93:0/161406780 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x55d997a99420 con 0x55d997a8faa0 2026-02-22T23:23:57.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.976+0000 7ff341ffb640 1 -- 10.20.193.93:0/161406780 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1403762444 0 0) 0x7ff330001e10 con 0x55d997a95fb0 2026-02-22T23:23:57.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.976+0000 7ff341ffb640 1 -- 10.20.193.93:0/161406780 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x55d997a8ff60 con 0x55d997a95fb0 2026-02-22T23:23:57.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.976+0000 7ff341ffb640 1 -- 10.20.193.93:0/161406780 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7ff344001fd0 con 0x55d997a95fb0 2026-02-22T23:23:57.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.976+0000 7ff341ffb640 1 -- 10.20.193.93:0/161406780 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 157599229 0 0) 0x55d997a99420 con 0x55d997a8faa0 2026-02-22T23:23:57.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.976+0000 7ff341ffb640 1 -- 10.20.193.93:0/161406780 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff330001e10 con 0x55d997a8faa0 2026-02-22T23:23:57.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.976+0000 7ff341ffb640 1 -- 10.20.193.93:0/161406780 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7ff33c001830 con 0x55d997a8faa0 2026-02-22T23:23:57.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.977+0000 7ff341ffb640 1 -- 10.20.193.93:0/161406780 <== mon.0 v1:10.20.193.93:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2645897465 0 0) 0x55d997a8ff60 con 0x55d997a95fb0 2026-02-22T23:23:57.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.977+0000 7ff341ffb640 1 -- 10.20.193.93:0/161406780 >> v1:10.20.193.93:6790/0 conn(0x55d997a8faa0 legacy=0x55d997aa47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:57.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.977+0000 7ff341ffb640 1 -- 10.20.193.93:0/161406780 >> v1:10.20.193.155:6789/0 conn(0x55d9979f8dc0 legacy=0x55d997a87fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:23:57.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.977+0000 7ff341ffb640 1 -- 10.20.193.93:0/161406780 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d997a98f00 con 0x55d997a95fb0 2026-02-22T23:23:57.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.977+0000 7ff3533ee0c0 1 -- 10.20.193.93:0/161406780 --> v1:10.20.193.93:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x55d997a886e0 con 0x55d997a95fb0 2026-02-22T23:23:57.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.977+0000 7ff341ffb640 1 -- 10.20.193.93:0/161406780 <== mon.0 v1:10.20.193.93:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff344003750 con 0x55d997a95fb0 2026-02-22T23:23:57.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.977+0000 7ff341ffb640 1 -- 10.20.193.93:0/161406780 <== mon.0 v1:10.20.193.93:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7ff344003aa0 con 0x55d997a95fb0 2026-02-22T23:23:57.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.977+0000 7ff3533ee0c0 1 -- 10.20.193.93:0/161406780 --> v1:10.20.193.93:6789/0 -- mon_subscribe({osdmap=0}) -- 0x55d997a949a0 con 0x55d997a95fb0 2026-02-22T23:23:57.983 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.978+0000 7ff341ffb640 1 -- 10.20.193.93:0/161406780 <== mon.0 v1:10.20.193.93:6789/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7ff34401c270 con 0x55d997a95fb0 2026-02-22T23:23:57.983 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.979+0000 7ff341ffb640 1 -- 10.20.193.93:0/161406780 <== mon.0 v1:10.20.193.93:6789/0 8 ==== osd_map(17..17 src has 1..17) ==== 4075+0+0 (unknown 4139507564 0 0) 0x7ff344092fc0 con 0x55d997a95fb0 2026-02-22T23:23:57.983 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:57.979+0000 7ff3533ee0c0 1 -- 10.20.193.93:0/161406780 --> v1:10.20.193.93:6789/0 -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x55d997aa5210 con 0x55d997a95fb0 2026-02-22T23:23:58.937 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:58.933+0000 7ff341ffb640 1 -- 10.20.193.93:0/161406780 <== mon.0 v1:10.20.193.93:6789/0 9 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v18) ==== 141+0+0 (unknown 660702925 0 0) 0x7ff34405c800 con 0x55d997a95fb0 2026-02-22T23:23:58.937 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:58.933+0000 7ff3533ee0c0 1 -- 10.20.193.93:0/161406780 --> v1:10.20.193.93:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7ff344001c80 con 0x55d997a95fb0 2026-02-22T23:23:58.938 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:58.935+0000 7ff341ffb640 1 -- 10.20.193.93:0/161406780 <== mon.0 v1:10.20.193.93:6789/0 10 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (unknown 77724187 0 0) 0x7ff34405bed0 con 0x55d997a95fb0 2026-02-22T23:23:58.938 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:58.935+0000 7ff343fff640 1 -- 10.20.193.93:0/161406780 --> v1:10.20.193.93:6789/0 -- mon_subscribe({osdmap=18}) -- 0x7ff32c002ae0 con 0x55d997a95fb0 2026-02-22T23:23:58.938 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:58.935+0000 7ff341ffb640 1 -- 10.20.193.93:0/161406780 <== mon.0 v1:10.20.193.93:6789/0 11 ==== osd_map(18..18 src has 1..18) ==== 666+0+0 (unknown 3207775270 0 0) 0x7ff344058410 con 0x55d997a95fb0 2026-02-22T23:23:58.938 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:58.935+0000 7ff3533ee0c0 1 -- 10.20.193.93:0/161406780 --> v1:10.20.193.155:6806/887979704 -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18) -- 0x55d997ab23d0 con 0x55d997aae8c0 2026-02-22T23:23:58.940 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:58.937+0000 7ff3516b3640 1 -- 10.20.193.93:0/161406780 <== osd.5 v1:10.20.193.155:6806/887979704 1 ==== osd_op_reply(1 rbd_trash [create] v18'1 uv1 ondisk = 0) ==== 153+0+0 (unknown 785457554 0 0) 0x7ff33c004240 con 0x55d997aae8c0 2026-02-22T23:23:58.942 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:58.939+0000 7ff3533ee0c0 1 -- 10.20.193.93:0/161406780 --> v1:10.20.193.155:6806/887979704 -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e18) -- 0x55d997b04590 con 0x55d997aae8c0 2026-02-22T23:23:58.942 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:58.939+0000 7ff3516b3640 1 -- 10.20.193.93:0/161406780 <== osd.5 v1:10.20.193.155:6806/887979704 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (unknown 1898125418 0 0) 0x7ff33c004240 con 0x55d997aae8c0 2026-02-22T23:23:58.942 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:58.939+0000 7ff3533ee0c0 1 -- 10.20.193.93:0/161406780 --> v1:10.20.193.155:6806/887979704 -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e18) -- 0x55d997b03580 con 0x55d997aae8c0 2026-02-22T23:23:58.942 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:58.939+0000 7ff3516b3640 1 -- 10.20.193.93:0/161406780 <== osd.5 v1:10.20.193.155:6806/887979704 3 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (unknown 1886642790 0 0) 0x7ff33c004240 con 0x55d997aae8c0 2026-02-22T23:23:58.942 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:58.939+0000 7ff3437fe640 1 -- 10.20.193.93:0/161406780 --> v1:10.20.193.93:6789/0 -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7ff324001f00 con 0x55d997a95fb0 2026-02-22T23:23:59.943 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:59.939+0000 7ff341ffb640 1 -- 10.20.193.93:0/161406780 <== mon.0 v1:10.20.193.93:6789/0 12 ==== pool_op_reply(tid 4 (0) Success v19) ==== 55+0+0 (unknown 3223385560 0 0) 0x7ff34405c100 con 0x55d997a95fb0 2026-02-22T23:23:59.943 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:59.939+0000 7ff341ffb640 1 -- 10.20.193.93:0/161406780 --> v1:10.20.193.93:6789/0 -- mon_subscribe({osdmap=19}) -- 0x55d997a8ff60 con 0x55d997a95fb0 2026-02-22T23:23:59.943 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:59.939+0000 7ff341ffb640 1 -- 10.20.193.93:0/161406780 <== mon.0 v1:10.20.193.93:6789/0 13 ==== osd_map(19..19 src has 1..19) ==== 626+0+0 (unknown 1117229597 0 0) 0x7ff344091c00 con 0x55d997a95fb0 2026-02-22T23:23:59.944 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:59.939+0000 7ff343fff640 1 -- 10.20.193.93:0/161406780 --> v1:10.20.193.155:6806/887979704 -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19) -- 0x7ff32c005840 con 0x55d997aae8c0 2026-02-22T23:23:59.945 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:59.942+0000 7ff3516b3640 1 -- 10.20.193.93:0/161406780 <== osd.5 v1:10.20.193.155:6806/887979704 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v19'1 uv1 ondisk = 0) ==== 194+0+0 (unknown 1570664900 0 0) 0x7ff33c004240 con 0x55d997aae8c0 2026-02-22T23:23:59.945 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:23:59.942+0000 7ff3437fe640 1 -- 10.20.193.93:0/161406780 --> v1:10.20.193.93:6789/0 -- pool_op(delete unmanaged snap pool 2 tid 6 name v19) -- 0x7ff324003370 con 0x55d997a95fb0 2026-02-22T23:24:00.946 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:00.942+0000 7ff341ffb640 1 -- 10.20.193.93:0/161406780 <== mon.0 v1:10.20.193.93:6789/0 14 ==== pool_op_reply(tid 6 (0) Success v20) ==== 43+0+0 (unknown 18138073 0 0) 0x7ff3440604b0 con 0x55d997a95fb0 2026-02-22T23:24:00.946 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:00.942+0000 7ff341ffb640 1 -- 10.20.193.93:0/161406780 --> v1:10.20.193.93:6789/0 -- mon_subscribe({osdmap=20}) -- 0x7ff330001e10 con 0x55d997a95fb0 2026-02-22T23:24:00.946 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:00.942+0000 7ff341ffb640 1 -- 10.20.193.93:0/161406780 <== mon.0 v1:10.20.193.93:6789/0 15 ==== osd_map(20..20 src has 1..20) ==== 654+0+0 (unknown 1085366410 0 0) 0x7ff34405c360 con 0x55d997a95fb0 2026-02-22T23:24:00.946 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:00.942+0000 7ff343fff640 1 -- 10.20.193.93:0/161406780 --> v1:10.20.193.155:6806/887979704 -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20) -- 0x7ff32c005c20 con 0x55d997aae8c0 2026-02-22T23:24:00.948 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:00.943+0000 7ff3516b3640 1 -- 10.20.193.93:0/161406780 <== osd.5 v1:10.20.193.155:6806/887979704 5 ==== osd_op_reply(7 rbd_info [write 0~19] v20'2 uv2 ondisk = 0) ==== 152+0+0 (unknown 1721084249 0 0) 0x7ff33c004240 con 0x55d997aae8c0 2026-02-22T23:24:00.948 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:00.944+0000 7ff3533ee0c0 1 -- 10.20.193.93:0/161406780 >> v1:10.20.193.155:6806/887979704 conn(0x55d997aae8c0 legacy=0x55d997ab0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:00.948 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:00.944+0000 7ff3533ee0c0 1 -- 10.20.193.93:0/161406780 >> v1:10.20.193.155:6800/3108481844 conn(0x7ff330076840 legacy=0x7ff330078d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:00.948 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:00.944+0000 7ff3533ee0c0 1 -- 10.20.193.93:0/161406780 >> v1:10.20.193.93:6789/0 conn(0x55d997a95fb0 legacy=0x55d997aacb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:00.948 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:00.944+0000 7ff35313d640 1 -- 10.20.193.93:0/161406780 reap_dead start 2026-02-22T23:24:00.948 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:00.944+0000 7ff3533ee0c0 1 -- 10.20.193.93:0/161406780 shutdown_connections 2026-02-22T23:24:00.948 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:00.944+0000 7ff3533ee0c0 1 -- 10.20.193.93:0/161406780 >> 10.20.193.93:0/161406780 conn(0x55d997a04a00 msgr2=0x55d997a04de0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:00.948 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:00.944+0000 7ff3533ee0c0 1 -- 10.20.193.93:0/161406780 shutdown_connections 2026-02-22T23:24:00.948 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:00.944+0000 7ff3533ee0c0 1 -- 10.20.193.93:0/161406780 wait complete. 2026-02-22T23:24:00.951 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-22T23:24:00.952 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-22T23:24:00.952 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-22T23:24:00.952 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-22T23:24:00.952 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-22T23:24:01.060 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.057+0000 7f4cb7674640 1 Processor -- start 2026-02-22T23:24:01.060 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.057+0000 7f4cb7674640 1 -- start start 2026-02-22T23:24:01.060 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.057+0000 7f4cb7674640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cb0071530 con 0x7f4cb00704d0 2026-02-22T23:24:01.060 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.057+0000 7f4cb7674640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cb0070210 con 0x7f4cb0140d80 2026-02-22T23:24:01.060 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.057+0000 7f4cb7674640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cb00b18f0 con 0x7f4cb00af060 2026-02-22T23:24:01.060 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.057+0000 7f4cb53e9640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7f4cb00af060 0x7f4cb0140670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:33734/0 (socket says 10.20.193.93:33734) 2026-02-22T23:24:01.060 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.057+0000 7f4cb53e9640 1 -- 10.20.193.93:0/3548421086 learned_addr learned my addr 10.20.193.93:0/3548421086 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:01.061 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.058+0000 7f4c9ffff640 1 -- 10.20.193.93:0/3548421086 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2645696095 0 0) 0x7f4cb00b18f0 con 0x7f4cb00af060 2026-02-22T23:24:01.061 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.058+0000 7f4c9ffff640 1 -- 10.20.193.93:0/3548421086 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c98003620 con 0x7f4cb00af060 2026-02-22T23:24:01.061 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.058+0000 7f4c9ffff640 1 -- 10.20.193.93:0/3548421086 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 5478563 0 0) 0x7f4cb0071530 con 0x7f4cb00704d0 2026-02-22T23:24:01.061 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.058+0000 7f4c9ffff640 1 -- 10.20.193.93:0/3548421086 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cb00b18f0 con 0x7f4cb00704d0 2026-02-22T23:24:01.061 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.058+0000 7f4c9ffff640 1 -- 10.20.193.93:0/3548421086 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2472291277 0 0) 0x7f4cb0070210 con 0x7f4cb0140d80 2026-02-22T23:24:01.061 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.058+0000 7f4c9ffff640 1 -- 10.20.193.93:0/3548421086 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cb0071530 con 0x7f4cb0140d80 2026-02-22T23:24:01.061 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.058+0000 7f4c9ffff640 1 -- 10.20.193.93:0/3548421086 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2620954186 0 0) 0x7f4cb00b18f0 con 0x7f4cb00704d0 2026-02-22T23:24:01.061 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.058+0000 7f4c9ffff640 1 -- 10.20.193.93:0/3548421086 >> v1:10.20.193.93:6790/0 conn(0x7f4cb00af060 legacy=0x7f4cb0140670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.061 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.058+0000 7f4c9ffff640 1 -- 10.20.193.93:0/3548421086 >> v1:10.20.193.155:6789/0 conn(0x7f4cb0140d80 legacy=0x7f4cb0143670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.061 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.058+0000 7f4c9ffff640 1 -- 10.20.193.93:0/3548421086 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cb00b14e0 con 0x7f4cb00704d0 2026-02-22T23:24:01.061 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.058+0000 7f4c9ffff640 1 -- 10.20.193.93:0/3548421086 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f4cac003200 con 0x7f4cb00704d0 2026-02-22T23:24:01.061 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.058+0000 7f4c9ffff640 1 -- 10.20.193.93:0/3548421086 <== mon.0 v1:10.20.193.93:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4cac0033a0 con 0x7f4cb00704d0 2026-02-22T23:24:01.061 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.058+0000 7f4c9ffff640 1 -- 10.20.193.93:0/3548421086 <== mon.0 v1:10.20.193.93:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f4cac003830 con 0x7f4cb00704d0 2026-02-22T23:24:01.061 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.058+0000 7f4cb7674640 1 -- 10.20.193.93:0/3548421086 >> v1:10.20.193.93:6789/0 conn(0x7f4cb00704d0 legacy=0x7f4cb0143d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.061 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.058+0000 7f4cb7674640 1 -- 10.20.193.93:0/3548421086 shutdown_connections 2026-02-22T23:24:01.061 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.058+0000 7f4cb7674640 1 -- 10.20.193.93:0/3548421086 >> 10.20.193.93:0/3548421086 conn(0x7f4cb00b1d30 msgr2=0x7f4cb00b2140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:01.061 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.058+0000 7f4cb7674640 1 -- 10.20.193.93:0/3548421086 shutdown_connections 2026-02-22T23:24:01.061 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.058+0000 7f4cb7674640 1 -- 10.20.193.93:0/3548421086 wait complete. 2026-02-22T23:24:01.062 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.059+0000 7f4cb7674640 1 Processor -- start 2026-02-22T23:24:01.062 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.059+0000 7f4cb7674640 1 -- start start 2026-02-22T23:24:01.062 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.059+0000 7f4cb7674640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cb0144710 con 0x7f4cb00704d0 2026-02-22T23:24:01.062 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.059+0000 7f4cb7674640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cb0072f70 con 0x7f4cb00af060 2026-02-22T23:24:01.062 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.059+0000 7f4cb7674640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cb00b49c0 con 0x7f4cb0140d80 2026-02-22T23:24:01.062 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.059+0000 7f4cb53e9640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7f4cb00704d0 0x7f4cb0144f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:46564/0 (socket says 10.20.193.93:46564) 2026-02-22T23:24:01.062 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.059+0000 7f4cb53e9640 1 -- 10.20.193.93:0/842254261 learned_addr learned my addr 10.20.193.93:0/842254261 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:01.063 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.059+0000 7f4c9dffb640 1 -- 10.20.193.93:0/842254261 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2537481002 0 0) 0x7f4cb0144710 con 0x7f4cb00704d0 2026-02-22T23:24:01.063 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.059+0000 7f4c9dffb640 1 -- 10.20.193.93:0/842254261 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c80003620 con 0x7f4cb00704d0 2026-02-22T23:24:01.063 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.059+0000 7f4c9dffb640 1 -- 10.20.193.93:0/842254261 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1781132778 0 0) 0x7f4cb00b49c0 con 0x7f4cb0140d80 2026-02-22T23:24:01.063 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.059+0000 7f4c9dffb640 1 -- 10.20.193.93:0/842254261 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cb0144710 con 0x7f4cb0140d80 2026-02-22T23:24:01.063 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.060+0000 7f4c9dffb640 1 -- 10.20.193.93:0/842254261 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 510749626 0 0) 0x7f4c80003620 con 0x7f4cb00704d0 2026-02-22T23:24:01.063 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.060+0000 7f4c9dffb640 1 -- 10.20.193.93:0/842254261 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4cb00b49c0 con 0x7f4cb00704d0 2026-02-22T23:24:01.063 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.060+0000 7f4c9dffb640 1 -- 10.20.193.93:0/842254261 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f4ca0002bc0 con 0x7f4cb00704d0 2026-02-22T23:24:01.063 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.060+0000 7f4c9dffb640 1 -- 10.20.193.93:0/842254261 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 760164581 0 0) 0x7f4cb0144710 con 0x7f4cb0140d80 2026-02-22T23:24:01.063 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.060+0000 7f4c9dffb640 1 -- 10.20.193.93:0/842254261 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4c80003620 con 0x7f4cb0140d80 2026-02-22T23:24:01.063 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.060+0000 7f4c9dffb640 1 -- 10.20.193.93:0/842254261 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f4cac0036f0 con 0x7f4cb0140d80 2026-02-22T23:24:01.063 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.060+0000 7f4c9dffb640 1 -- 10.20.193.93:0/842254261 <== mon.0 v1:10.20.193.93:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 869773574 0 0) 0x7f4cb00b49c0 con 0x7f4cb00704d0 2026-02-22T23:24:01.063 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.060+0000 7f4c9dffb640 1 -- 10.20.193.93:0/842254261 >> v1:10.20.193.93:6790/0 conn(0x7f4cb0140d80 legacy=0x7f4cb01468a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.063 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.060+0000 7f4c9dffb640 1 -- 10.20.193.93:0/842254261 >> v1:10.20.193.155:6789/0 conn(0x7f4cb00af060 legacy=0x7f4cb01350e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.063 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.060+0000 7f4c9dffb640 1 -- 10.20.193.93:0/842254261 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cb00b4b90 con 0x7f4cb00704d0 2026-02-22T23:24:01.063 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.060+0000 7f4cb7674640 1 -- 10.20.193.93:0/842254261 --> v1:10.20.193.93:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4cb01357f0 con 0x7f4cb00704d0 2026-02-22T23:24:01.063 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.060+0000 7f4cb7674640 1 -- 10.20.193.93:0/842254261 --> v1:10.20.193.93:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4cb0146fb0 con 0x7f4cb00704d0 2026-02-22T23:24:01.063 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.060+0000 7f4c9dffb640 1 -- 10.20.193.93:0/842254261 <== mon.0 v1:10.20.193.93:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4ca00048e0 con 0x7f4cb00704d0 2026-02-22T23:24:01.063 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.060+0000 7f4c9dffb640 1 -- 10.20.193.93:0/842254261 <== mon.0 v1:10.20.193.93:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f4ca0004c30 con 0x7f4cb00704d0 2026-02-22T23:24:01.063 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.060+0000 7f4cb7674640 1 -- 10.20.193.93:0/842254261 --> v1:10.20.193.93:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cb0073140 con 0x7f4cb00704d0 2026-02-22T23:24:01.064 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.061+0000 7f4c9dffb640 1 -- 10.20.193.93:0/842254261 <== mon.0 v1:10.20.193.93:6789/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7f4ca001d400 con 0x7f4cb00704d0 2026-02-22T23:24:01.064 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.061+0000 7f4c9dffb640 1 -- 10.20.193.93:0/842254261 <== mon.0 v1:10.20.193.93:6789/0 8 ==== osd_map(20..20 src has 1..20) ==== 4142+0+0 (unknown 2994938210 0 0) 0x7f4ca0094240 con 0x7f4cb00704d0 2026-02-22T23:24:01.066 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.063+0000 7f4c9dffb640 1 -- 10.20.193.93:0/842254261 <== mon.0 v1:10.20.193.93:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f4ca005daa0 con 0x7f4cb00704d0 2026-02-22T23:24:01.169 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.166+0000 7f4cb7674640 1 -- 10.20.193.93:0/842254261 --> v1:10.20.193.93:6789/0 -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f4cb0076960 con 0x7f4cb00704d0 2026-02-22T23:24:01.171 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.168+0000 7f4c9dffb640 1 -- 10.20.193.93:0/842254261 <== mon.0 v1:10.20.193.93:6789/0 10 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+191835 (unknown 481731318 0 3467794548) 0x7f4ca005d3a0 con 0x7f4cb00704d0 2026-02-22T23:24:01.173 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:24:01.173 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.169+0000 7f4cb7674640 1 -- 10.20.193.93:0/842254261 >> v1:10.20.193.155:6800/3108481844 conn(0x7f4c80078030 legacy=0x7f4c8007a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.173 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.169+0000 7f4cb7674640 1 -- 10.20.193.93:0/842254261 >> v1:10.20.193.93:6789/0 conn(0x7f4cb00704d0 legacy=0x7f4cb0144f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.173 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.169+0000 7f4cb7674640 1 -- 10.20.193.93:0/842254261 shutdown_connections 2026-02-22T23:24:01.173 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.169+0000 7f4cb7674640 1 -- 10.20.193.93:0/842254261 >> 10.20.193.93:0/842254261 conn(0x7f4cb00b1d30 msgr2=0x7f4cb014f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:01.173 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.169+0000 7f4cb7674640 1 -- 10.20.193.93:0/842254261 shutdown_connections 2026-02-22T23:24:01.173 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.169+0000 7f4cb7674640 1 -- 10.20.193.93:0/842254261 wait complete. 2026-02-22T23:24:01.180 INFO:teuthology.orchestra.run.trial093.stdout:{"epoch":5,"flags":0,"active_gid":4108,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6800","nonce":3108481844}]},"active_addr":"10.20.193.155:6800/3108481844","active_change":"2026-02-22T23:23:43.032020+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.155:0","nonce":4167282578}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.155:0","nonce":1600235184}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.155:0","nonce":1377332445}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.155:0","nonce":3263804318}]}]} 2026-02-22T23:24:01.184 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-22T23:24:01.184 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-22T23:24:01.184 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-22T23:24:01.250 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.248+0000 7fd94ea0b640 1 Processor -- start 2026-02-22T23:24:01.251 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.248+0000 7fd94ea0b640 1 -- start start 2026-02-22T23:24:01.251 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.248+0000 7fd94ea0b640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd948071f40 con 0x7fd9480afcc0 2026-02-22T23:24:01.251 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.248+0000 7fd94ea0b640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd948071180 con 0x7fd94813d900 2026-02-22T23:24:01.251 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.248+0000 7fd94ea0b640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd948071350 con 0x7fd948072190 2026-02-22T23:24:01.251 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.248+0000 7fd9477fe640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7fd948072190 0x7fd9481439d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:33760/0 (socket says 10.20.193.93:33760) 2026-02-22T23:24:01.251 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.248+0000 7fd947fff640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7fd9480afcc0 0x7fd94813d1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:46576/0 (socket says 10.20.193.93:46576) 2026-02-22T23:24:01.251 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.248+0000 7fd9477fe640 1 -- 10.20.193.93:0/2810395657 learned_addr learned my addr 10.20.193.93:0/2810395657 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:01.252 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.249+0000 7fd946ffd640 1 -- 10.20.193.93:0/2810395657 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3556558932 0 0) 0x7fd948071f40 con 0x7fd9480afcc0 2026-02-22T23:24:01.252 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.249+0000 7fd946ffd640 1 -- 10.20.193.93:0/2810395657 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd92c003620 con 0x7fd9480afcc0 2026-02-22T23:24:01.252 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.249+0000 7fd946ffd640 1 -- 10.20.193.93:0/2810395657 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1039070862 0 0) 0x7fd948071350 con 0x7fd948072190 2026-02-22T23:24:01.252 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.249+0000 7fd946ffd640 1 -- 10.20.193.93:0/2810395657 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd948071f40 con 0x7fd948072190 2026-02-22T23:24:01.252 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.249+0000 7fd946ffd640 1 -- 10.20.193.93:0/2810395657 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1859191727 0 0) 0x7fd92c003620 con 0x7fd9480afcc0 2026-02-22T23:24:01.252 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.249+0000 7fd946ffd640 1 -- 10.20.193.93:0/2810395657 >> v1:10.20.193.93:6790/0 conn(0x7fd948072190 legacy=0x7fd9481439d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.252 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.249+0000 7fd946ffd640 1 -- 10.20.193.93:0/2810395657 >> v1:10.20.193.155:6789/0 conn(0x7fd94813d900 legacy=0x7fd94814b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.252 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.249+0000 7fd946ffd640 1 -- 10.20.193.93:0/2810395657 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd948071520 con 0x7fd9480afcc0 2026-02-22T23:24:01.252 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.249+0000 7fd946ffd640 1 -- 10.20.193.93:0/2810395657 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fd934002ea0 con 0x7fd9480afcc0 2026-02-22T23:24:01.252 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.249+0000 7fd946ffd640 1 -- 10.20.193.93:0/2810395657 <== mon.0 v1:10.20.193.93:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd934003040 con 0x7fd9480afcc0 2026-02-22T23:24:01.252 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.249+0000 7fd946ffd640 1 -- 10.20.193.93:0/2810395657 <== mon.0 v1:10.20.193.93:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fd934003490 con 0x7fd9480afcc0 2026-02-22T23:24:01.252 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.249+0000 7fd94ea0b640 1 -- 10.20.193.93:0/2810395657 >> v1:10.20.193.93:6789/0 conn(0x7fd9480afcc0 legacy=0x7fd94813d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.252 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.249+0000 7fd94ea0b640 1 -- 10.20.193.93:0/2810395657 shutdown_connections 2026-02-22T23:24:01.252 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.249+0000 7fd94ea0b640 1 -- 10.20.193.93:0/2810395657 >> 10.20.193.93:0/2810395657 conn(0x7fd9480b1d30 msgr2=0x7fd9480b2140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:01.252 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.249+0000 7fd94ea0b640 1 -- 10.20.193.93:0/2810395657 shutdown_connections 2026-02-22T23:24:01.252 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.249+0000 7fd94ea0b640 1 -- 10.20.193.93:0/2810395657 wait complete. 2026-02-22T23:24:01.253 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.250+0000 7fd94ea0b640 1 Processor -- start 2026-02-22T23:24:01.253 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.250+0000 7fd94ea0b640 1 -- start start 2026-02-22T23:24:01.256 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.250+0000 7fd94ea0b640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9481423c0 con 0x7fd9480afcc0 2026-02-22T23:24:01.256 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.250+0000 7fd94ea0b640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9481426a0 con 0x7fd948072190 2026-02-22T23:24:01.256 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.250+0000 7fd94ea0b640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9481dc100 con 0x7fd94813d900 2026-02-22T23:24:01.256 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.250+0000 7fd9477fe640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7fd9480afcc0 0x7fd94813ec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:46590/0 (socket says 10.20.193.93:46590) 2026-02-22T23:24:01.256 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.250+0000 7fd9477fe640 1 -- 10.20.193.93:0/3369245629 learned_addr learned my addr 10.20.193.93:0/3369245629 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:01.257 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.250+0000 7fd944ff9640 1 -- 10.20.193.93:0/3369245629 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1954734095 0 0) 0x7fd9481dc100 con 0x7fd94813d900 2026-02-22T23:24:01.257 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.250+0000 7fd944ff9640 1 -- 10.20.193.93:0/3369245629 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd918003620 con 0x7fd94813d900 2026-02-22T23:24:01.257 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.250+0000 7fd944ff9640 1 -- 10.20.193.93:0/3369245629 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3962648091 0 0) 0x7fd9481423c0 con 0x7fd9480afcc0 2026-02-22T23:24:01.257 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.250+0000 7fd944ff9640 1 -- 10.20.193.93:0/3369245629 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9481dc100 con 0x7fd9480afcc0 2026-02-22T23:24:01.257 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.250+0000 7fd944ff9640 1 -- 10.20.193.93:0/3369245629 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 857176543 0 0) 0x7fd918003620 con 0x7fd94813d900 2026-02-22T23:24:01.257 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.251+0000 7fd944ff9640 1 -- 10.20.193.93:0/3369245629 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd9481423c0 con 0x7fd94813d900 2026-02-22T23:24:01.257 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.251+0000 7fd944ff9640 1 -- 10.20.193.93:0/3369245629 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fd93c0033a0 con 0x7fd94813d900 2026-02-22T23:24:01.257 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.251+0000 7fd944ff9640 1 -- 10.20.193.93:0/3369245629 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4279017105 0 0) 0x7fd9481dc100 con 0x7fd9480afcc0 2026-02-22T23:24:01.257 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.251+0000 7fd944ff9640 1 -- 10.20.193.93:0/3369245629 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd918003620 con 0x7fd9480afcc0 2026-02-22T23:24:01.257 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.251+0000 7fd944ff9640 1 -- 10.20.193.93:0/3369245629 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fd938003100 con 0x7fd9480afcc0 2026-02-22T23:24:01.257 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.251+0000 7fd944ff9640 1 -- 10.20.193.93:0/3369245629 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2091645952 0 0) 0x7fd9481426a0 con 0x7fd948072190 2026-02-22T23:24:01.257 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.251+0000 7fd944ff9640 1 -- 10.20.193.93:0/3369245629 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9481dc100 con 0x7fd948072190 2026-02-22T23:24:01.258 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.251+0000 7fd944ff9640 1 -- 10.20.193.93:0/3369245629 <== mon.2 v1:10.20.193.93:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3385626653 0 0) 0x7fd9481423c0 con 0x7fd94813d900 2026-02-22T23:24:01.258 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.251+0000 7fd944ff9640 1 -- 10.20.193.93:0/3369245629 >> v1:10.20.193.155:6789/0 conn(0x7fd948072190 legacy=0x7fd948137740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.258 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.251+0000 7fd944ff9640 1 -- 10.20.193.93:0/3369245629 >> v1:10.20.193.93:6789/0 conn(0x7fd9480afcc0 legacy=0x7fd94813ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.258 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.251+0000 7fd944ff9640 1 -- 10.20.193.93:0/3369245629 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9481dbd60 con 0x7fd94813d900 2026-02-22T23:24:01.258 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.251+0000 7fd94ea0b640 1 -- 10.20.193.93:0/3369245629 --> v1:10.20.193.93:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd9481dc620 con 0x7fd94813d900 2026-02-22T23:24:01.258 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.251+0000 7fd94ea0b640 1 -- 10.20.193.93:0/3369245629 --> v1:10.20.193.93:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fd94813f330 con 0x7fd94813d900 2026-02-22T23:24:01.258 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.251+0000 7fd944ff9640 1 -- 10.20.193.93:0/3369245629 <== mon.2 v1:10.20.193.93:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd93c003950 con 0x7fd94813d900 2026-02-22T23:24:01.258 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.251+0000 7fd944ff9640 1 -- 10.20.193.93:0/3369245629 <== mon.2 v1:10.20.193.93:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fd93c003da0 con 0x7fd94813d900 2026-02-22T23:24:01.258 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.251+0000 7fd94ea0b640 1 -- 10.20.193.93:0/3369245629 --> v1:10.20.193.93:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd948070460 con 0x7fd94813d900 2026-02-22T23:24:01.258 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.252+0000 7fd944ff9640 1 -- 10.20.193.93:0/3369245629 <== mon.2 v1:10.20.193.93:6790/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7fd93c003f40 con 0x7fd94813d900 2026-02-22T23:24:01.258 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.252+0000 7fd944ff9640 1 -- 10.20.193.93:0/3369245629 <== mon.2 v1:10.20.193.93:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 4142+0+0 (unknown 2994938210 0 0) 0x7fd93c093360 con 0x7fd94813d900 2026-02-22T23:24:01.259 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.254+0000 7fd944ff9640 1 -- 10.20.193.93:0/3369245629 <== mon.2 v1:10.20.193.93:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7fd93c05cb60 con 0x7fd94813d900 2026-02-22T23:24:01.341 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.338+0000 7fd94ea0b640 1 -- 10.20.193.93:0/3369245629 --> v1:10.20.193.93:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd948076960 con 0x7fd94813d900 2026-02-22T23:24:01.342 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.339+0000 7fd944ff9640 1 -- 10.20.193.93:0/3369245629 <== mon.2 v1:10.20.193.93:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+12911 (unknown 3413328019 0 3382970872) 0x7fd93c05c460 con 0x7fd94813d900 2026-02-22T23:24:01.342 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:24:01.342 INFO:teuthology.orchestra.run.trial093.stdout:{"epoch":20,"fsid":"964c49d0-be38-4661-88a8-21893fbedc4f","created":"2026-02-22T23:23:40.901753+0000","modified":"2026-02-22T23:24:00.940267+0000","last_up_change":"2026-02-22T23:23:51.885433+0000","last_in_change":"2026-02-22T23:23:42.448665+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-22T23:23:51.047515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-22T23:23:57.573199+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d1ce1e9f-bb70-4b7b-9dbc-e380de9324c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6806","nonce":3224090065}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6808","nonce":3224090065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6811","nonce":3224090065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6810","nonce":3224090065}]},"public_addr":"10.20.193.93:6806/3224090065","cluster_addr":"10.20.193.93:6808/3224090065","heartbeat_back_addr":"10.20.193.93:6811/3224090065","heartbeat_front_addr":"10.20.193.93:6810/3224090065","state":["exists","up"]},{"osd":1,"uuid":"e5ab5de3-2e0f-4f91-8dfe-c74bff8838d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6800","nonce":4002367425}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6801","nonce":4002367425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6803","nonce":4002367425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6802","nonce":4002367425}]},"public_addr":"10.20.193.93:6800/4002367425","cluster_addr":"10.20.193.93:6801/4002367425","heartbeat_back_addr":"10.20.193.93:6803/4002367425","heartbeat_front_addr":"10.20.193.93:6802/4002367425","state":["exists","up"]},{"osd":2,"uuid":"10d76c55-707a-43c8-b51e-0e5ae595f89e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6812","nonce":945702863}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6813","nonce":945702863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6815","nonce":945702863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6814","nonce":945702863}]},"public_addr":"10.20.193.93:6812/945702863","cluster_addr":"10.20.193.93:6813/945702863","heartbeat_back_addr":"10.20.193.93:6815/945702863","heartbeat_front_addr":"10.20.193.93:6814/945702863","state":["exists","up"]},{"osd":3,"uuid":"d7a29cea-4066-455f-8a32-f4cb5534ae32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6804","nonce":970700542}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6805","nonce":970700542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6809","nonce":970700542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6807","nonce":970700542}]},"public_addr":"10.20.193.93:6804/970700542","cluster_addr":"10.20.193.93:6805/970700542","heartbeat_back_addr":"10.20.193.93:6809/970700542","heartbeat_front_addr":"10.20.193.93:6807/970700542","state":["exists","up"]},{"osd":4,"uuid":"6a1874d8-3703-429f-839b-d3dc0f448b14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6813","nonce":3729844438}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6814","nonce":3729844438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6816","nonce":3729844438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6815","nonce":3729844438}]},"public_addr":"10.20.193.155:6813/3729844438","cluster_addr":"10.20.193.155:6814/3729844438","heartbeat_back_addr":"10.20.193.155:6816/3729844438","heartbeat_front_addr":"10.20.193.155:6815/3729844438","state":["exists","up"]},{"osd":5,"uuid":"447cea4f-f753-457e-b654-85ade052dc45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6806","nonce":887979704}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6808","nonce":887979704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6811","nonce":887979704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6810","nonce":887979704}]},"public_addr":"10.20.193.155:6806/887979704","cluster_addr":"10.20.193.155:6808/887979704","heartbeat_back_addr":"10.20.193.155:6811/887979704","heartbeat_front_addr":"10.20.193.155:6810/887979704","state":["exists","up"]},{"osd":6,"uuid":"dee8274e-5e87-4e06-a9aa-44439f7f5354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6805","nonce":4020397544}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6807","nonce":4020397544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6812","nonce":4020397544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6809","nonce":4020397544}]},"public_addr":"10.20.193.155:6805/4020397544","cluster_addr":"10.20.193.155:6807/4020397544","heartbeat_back_addr":"10.20.193.155:6812/4020397544","heartbeat_front_addr":"10.20.193.155:6809/4020397544","state":["exists","up"]},{"osd":7,"uuid":"c988ac9f-b5ed-48f5-aeb8-96968366722e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6801","nonce":2779097013}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6802","nonce":2779097013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6804","nonce":2779097013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6803","nonce":2779097013}]},"public_addr":"10.20.193.155:6801/2779097013","cluster_addr":"10.20.193.155:6802/2779097013","heartbeat_back_addr":"10.20.193.155:6804/2779097013","heartbeat_front_addr":"10.20.193.155:6803/2779097013","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:23:49.958344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:23:49.877163+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:23:49.987742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:23:49.866208+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:23:49.985851+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:23:50.007610+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:23:49.944652+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:23:49.883780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T23:24:01.343 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.339+0000 7fd94ea0b640 1 -- 10.20.193.93:0/3369245629 >> v1:10.20.193.155:6800/3108481844 conn(0x7fd9180780b0 legacy=0x7fd91807a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.343 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.339+0000 7fd94ea0b640 1 -- 10.20.193.93:0/3369245629 >> v1:10.20.193.93:6790/0 conn(0x7fd94813d900 legacy=0x7fd948142ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.343 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.339+0000 7fd94ea0b640 1 -- 10.20.193.93:0/3369245629 shutdown_connections 2026-02-22T23:24:01.343 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.339+0000 7fd94ea0b640 1 -- 10.20.193.93:0/3369245629 >> 10.20.193.93:0/3369245629 conn(0x7fd9480b1d30 msgr2=0x7fd948075f70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:01.343 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.339+0000 7fd94ea0b640 1 -- 10.20.193.93:0/3369245629 shutdown_connections 2026-02-22T23:24:01.343 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.339+0000 7fd94ea0b640 1 -- 10.20.193.93:0/3369245629 wait complete. 2026-02-22T23:24:01.350 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-22T23:24:01.350 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-22T23:24:01.419 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.416+0000 7fca76e74640 1 Processor -- start 2026-02-22T23:24:01.419 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.416+0000 7fca76e74640 1 -- start start 2026-02-22T23:24:01.424 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.417+0000 7fca76e74640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca70072e40 con 0x7fca7013ec60 2026-02-22T23:24:01.424 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.417+0000 7fca76e74640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca700734e0 con 0x7fca70072240 2026-02-22T23:24:01.424 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.417+0000 7fca76e74640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca700b14a0 con 0x7fca70072620 2026-02-22T23:24:01.424 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.417+0000 7fca753ea640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7fca70072620 0x7fca70141b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:33784/0 (socket says 10.20.193.93:33784) 2026-02-22T23:24:01.424 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.417+0000 7fca753ea640 1 -- 10.20.193.93:0/2478074020 learned_addr learned my addr 10.20.193.93:0/2478074020 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:01.424 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.417+0000 7fca67fff640 1 --1- 10.20.193.93:0/2478074020 >> v1:10.20.193.93:6789/0 conn(0x7fca7013ec60 0x7fca70141440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:46592/0 (socket says 10.20.193.93:46592) 2026-02-22T23:24:01.424 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.417+0000 7fca677fe640 1 -- 10.20.193.93:0/2478074020 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2238868264 0 0) 0x7fca70072e40 con 0x7fca7013ec60 2026-02-22T23:24:01.425 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.417+0000 7fca677fe640 1 -- 10.20.193.93:0/2478074020 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca5c003620 con 0x7fca7013ec60 2026-02-22T23:24:01.425 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.417+0000 7fca677fe640 1 -- 10.20.193.93:0/2478074020 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1942450424 0 0) 0x7fca700b14a0 con 0x7fca70072620 2026-02-22T23:24:01.425 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.417+0000 7fca677fe640 1 -- 10.20.193.93:0/2478074020 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca70072e40 con 0x7fca70072620 2026-02-22T23:24:01.425 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.417+0000 7fca677fe640 1 -- 10.20.193.93:0/2478074020 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2451907976 0 0) 0x7fca700734e0 con 0x7fca70072240 2026-02-22T23:24:01.425 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.417+0000 7fca677fe640 1 -- 10.20.193.93:0/2478074020 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca700b14a0 con 0x7fca70072240 2026-02-22T23:24:01.425 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.417+0000 7fca677fe640 1 -- 10.20.193.93:0/2478074020 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4221402672 0 0) 0x7fca5c003620 con 0x7fca7013ec60 2026-02-22T23:24:01.425 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.417+0000 7fca677fe640 1 -- 10.20.193.93:0/2478074020 >> v1:10.20.193.93:6790/0 conn(0x7fca70072620 legacy=0x7fca70141b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.425 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.417+0000 7fca677fe640 1 -- 10.20.193.93:0/2478074020 >> v1:10.20.193.155:6789/0 conn(0x7fca70072240 legacy=0x7fca7013e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.425 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.417+0000 7fca677fe640 1 -- 10.20.193.93:0/2478074020 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca70150b70 con 0x7fca7013ec60 2026-02-22T23:24:01.425 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.417+0000 7fca677fe640 1 -- 10.20.193.93:0/2478074020 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fca58002ea0 con 0x7fca7013ec60 2026-02-22T23:24:01.425 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.417+0000 7fca677fe640 1 -- 10.20.193.93:0/2478074020 <== mon.0 v1:10.20.193.93:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fca58003040 con 0x7fca7013ec60 2026-02-22T23:24:01.425 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.417+0000 7fca677fe640 1 -- 10.20.193.93:0/2478074020 <== mon.0 v1:10.20.193.93:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fca58003490 con 0x7fca7013ec60 2026-02-22T23:24:01.426 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.417+0000 7fca76e74640 1 -- 10.20.193.93:0/2478074020 >> v1:10.20.193.93:6789/0 conn(0x7fca7013ec60 legacy=0x7fca70141440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.426 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.417+0000 7fca76e74640 1 -- 10.20.193.93:0/2478074020 shutdown_connections 2026-02-22T23:24:01.426 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.417+0000 7fca76e74640 1 -- 10.20.193.93:0/2478074020 >> 10.20.193.93:0/2478074020 conn(0x7fca700b7150 msgr2=0x7fca700b7530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:01.426 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.418+0000 7fca76e74640 1 -- 10.20.193.93:0/2478074020 shutdown_connections 2026-02-22T23:24:01.426 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.418+0000 7fca76e74640 1 -- 10.20.193.93:0/2478074020 wait complete. 2026-02-22T23:24:01.426 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.418+0000 7fca76e74640 1 Processor -- start 2026-02-22T23:24:01.426 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.418+0000 7fca76e74640 1 -- start start 2026-02-22T23:24:01.426 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.419+0000 7fca76e74640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca70143f00 con 0x7fca70072240 2026-02-22T23:24:01.426 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.419+0000 7fca76e74640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca701441e0 con 0x7fca70072620 2026-02-22T23:24:01.426 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.419+0000 7fca76e74640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca70144bf0 con 0x7fca7013ec60 2026-02-22T23:24:01.426 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.419+0000 7fca74be9640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7fca70072240 0x7fca7014e4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:46604/0 (socket says 10.20.193.93:46604) 2026-02-22T23:24:01.426 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.419+0000 7fca74be9640 1 -- 10.20.193.93:0/2133702541 learned_addr learned my addr 10.20.193.93:0/2133702541 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:01.427 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.419+0000 7fca657fa640 1 -- 10.20.193.93:0/2133702541 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2325014625 0 0) 0x7fca70143f00 con 0x7fca70072240 2026-02-22T23:24:01.427 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.419+0000 7fca657fa640 1 -- 10.20.193.93:0/2133702541 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca40003620 con 0x7fca70072240 2026-02-22T23:24:01.427 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.419+0000 7fca657fa640 1 -- 10.20.193.93:0/2133702541 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4116497756 0 0) 0x7fca70144bf0 con 0x7fca7013ec60 2026-02-22T23:24:01.427 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.419+0000 7fca657fa640 1 -- 10.20.193.93:0/2133702541 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca70143f00 con 0x7fca7013ec60 2026-02-22T23:24:01.427 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.419+0000 7fca657fa640 1 -- 10.20.193.93:0/2133702541 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3016191519 0 0) 0x7fca70143f00 con 0x7fca7013ec60 2026-02-22T23:24:01.427 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.419+0000 7fca657fa640 1 -- 10.20.193.93:0/2133702541 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fca70144bf0 con 0x7fca7013ec60 2026-02-22T23:24:01.427 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.419+0000 7fca657fa640 1 -- 10.20.193.93:0/2133702541 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fca6c0033b0 con 0x7fca7013ec60 2026-02-22T23:24:01.427 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.419+0000 7fca657fa640 1 -- 10.20.193.93:0/2133702541 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4178051594 0 0) 0x7fca40003620 con 0x7fca70072240 2026-02-22T23:24:01.427 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.419+0000 7fca657fa640 1 -- 10.20.193.93:0/2133702541 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fca70143f00 con 0x7fca70072240 2026-02-22T23:24:01.427 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.419+0000 7fca657fa640 1 -- 10.20.193.93:0/2133702541 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fca600031a0 con 0x7fca70072240 2026-02-22T23:24:01.427 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.419+0000 7fca657fa640 1 -- 10.20.193.93:0/2133702541 <== mon.2 v1:10.20.193.93:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3963374277 0 0) 0x7fca70144bf0 con 0x7fca7013ec60 2026-02-22T23:24:01.427 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.419+0000 7fca657fa640 1 -- 10.20.193.93:0/2133702541 >> v1:10.20.193.155:6789/0 conn(0x7fca70072620 legacy=0x7fca7013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.427 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.419+0000 7fca657fa640 1 -- 10.20.193.93:0/2133702541 >> v1:10.20.193.93:6789/0 conn(0x7fca70072240 legacy=0x7fca7014e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.428 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.419+0000 7fca657fa640 1 -- 10.20.193.93:0/2133702541 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca701448e0 con 0x7fca7013ec60 2026-02-22T23:24:01.428 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.419+0000 7fca76e74640 1 -- 10.20.193.93:0/2133702541 --> v1:10.20.193.93:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fca7014d120 con 0x7fca7013ec60 2026-02-22T23:24:01.428 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.419+0000 7fca76e74640 1 -- 10.20.193.93:0/2133702541 --> v1:10.20.193.93:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fca7013ba50 con 0x7fca7013ec60 2026-02-22T23:24:01.428 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.419+0000 7fca657fa640 1 -- 10.20.193.93:0/2133702541 <== mon.2 v1:10.20.193.93:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fca6c003880 con 0x7fca7013ec60 2026-02-22T23:24:01.428 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.419+0000 7fca657fa640 1 -- 10.20.193.93:0/2133702541 <== mon.2 v1:10.20.193.93:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fca6c004e40 con 0x7fca7013ec60 2026-02-22T23:24:01.428 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.419+0000 7fca76e74640 1 -- 10.20.193.93:0/2133702541 --> v1:10.20.193.93:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca7013e5c0 con 0x7fca7013ec60 2026-02-22T23:24:01.428 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.420+0000 7fca657fa640 1 -- 10.20.193.93:0/2133702541 <== mon.2 v1:10.20.193.93:6790/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7fca6c01d610 con 0x7fca7013ec60 2026-02-22T23:24:01.428 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.420+0000 7fca657fa640 1 -- 10.20.193.93:0/2133702541 <== mon.2 v1:10.20.193.93:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 4142+0+0 (unknown 2994938210 0 0) 0x7fca6c094510 con 0x7fca7013ec60 2026-02-22T23:24:01.429 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.422+0000 7fca657fa640 1 -- 10.20.193.93:0/2133702541 <== mon.2 v1:10.20.193.93:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7fca6c05dd10 con 0x7fca7013ec60 2026-02-22T23:24:01.508 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.505+0000 7fca76e74640 1 -- 10.20.193.93:0/2133702541 --> v1:10.20.193.93:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fca7013d470 con 0x7fca7013ec60 2026-02-22T23:24:01.509 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.505+0000 7fca657fa640 1 -- 10.20.193.93:0/2133702541 <== mon.2 v1:10.20.193.93:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+12911 (unknown 3413328019 0 3382970872) 0x7fca6c05d610 con 0x7fca7013ec60 2026-02-22T23:24:01.509 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:24:01.509 INFO:teuthology.orchestra.run.trial093.stdout:{"epoch":20,"fsid":"964c49d0-be38-4661-88a8-21893fbedc4f","created":"2026-02-22T23:23:40.901753+0000","modified":"2026-02-22T23:24:00.940267+0000","last_up_change":"2026-02-22T23:23:51.885433+0000","last_in_change":"2026-02-22T23:23:42.448665+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-22T23:23:51.047515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-22T23:23:57.573199+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d1ce1e9f-bb70-4b7b-9dbc-e380de9324c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6806","nonce":3224090065}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6808","nonce":3224090065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6811","nonce":3224090065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6810","nonce":3224090065}]},"public_addr":"10.20.193.93:6806/3224090065","cluster_addr":"10.20.193.93:6808/3224090065","heartbeat_back_addr":"10.20.193.93:6811/3224090065","heartbeat_front_addr":"10.20.193.93:6810/3224090065","state":["exists","up"]},{"osd":1,"uuid":"e5ab5de3-2e0f-4f91-8dfe-c74bff8838d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6800","nonce":4002367425}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6801","nonce":4002367425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6803","nonce":4002367425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6802","nonce":4002367425}]},"public_addr":"10.20.193.93:6800/4002367425","cluster_addr":"10.20.193.93:6801/4002367425","heartbeat_back_addr":"10.20.193.93:6803/4002367425","heartbeat_front_addr":"10.20.193.93:6802/4002367425","state":["exists","up"]},{"osd":2,"uuid":"10d76c55-707a-43c8-b51e-0e5ae595f89e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6812","nonce":945702863}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6813","nonce":945702863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6815","nonce":945702863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6814","nonce":945702863}]},"public_addr":"10.20.193.93:6812/945702863","cluster_addr":"10.20.193.93:6813/945702863","heartbeat_back_addr":"10.20.193.93:6815/945702863","heartbeat_front_addr":"10.20.193.93:6814/945702863","state":["exists","up"]},{"osd":3,"uuid":"d7a29cea-4066-455f-8a32-f4cb5534ae32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6804","nonce":970700542}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6805","nonce":970700542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6809","nonce":970700542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6807","nonce":970700542}]},"public_addr":"10.20.193.93:6804/970700542","cluster_addr":"10.20.193.93:6805/970700542","heartbeat_back_addr":"10.20.193.93:6809/970700542","heartbeat_front_addr":"10.20.193.93:6807/970700542","state":["exists","up"]},{"osd":4,"uuid":"6a1874d8-3703-429f-839b-d3dc0f448b14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6813","nonce":3729844438}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6814","nonce":3729844438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6816","nonce":3729844438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6815","nonce":3729844438}]},"public_addr":"10.20.193.155:6813/3729844438","cluster_addr":"10.20.193.155:6814/3729844438","heartbeat_back_addr":"10.20.193.155:6816/3729844438","heartbeat_front_addr":"10.20.193.155:6815/3729844438","state":["exists","up"]},{"osd":5,"uuid":"447cea4f-f753-457e-b654-85ade052dc45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6806","nonce":887979704}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6808","nonce":887979704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6811","nonce":887979704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6810","nonce":887979704}]},"public_addr":"10.20.193.155:6806/887979704","cluster_addr":"10.20.193.155:6808/887979704","heartbeat_back_addr":"10.20.193.155:6811/887979704","heartbeat_front_addr":"10.20.193.155:6810/887979704","state":["exists","up"]},{"osd":6,"uuid":"dee8274e-5e87-4e06-a9aa-44439f7f5354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6805","nonce":4020397544}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6807","nonce":4020397544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6812","nonce":4020397544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6809","nonce":4020397544}]},"public_addr":"10.20.193.155:6805/4020397544","cluster_addr":"10.20.193.155:6807/4020397544","heartbeat_back_addr":"10.20.193.155:6812/4020397544","heartbeat_front_addr":"10.20.193.155:6809/4020397544","state":["exists","up"]},{"osd":7,"uuid":"c988ac9f-b5ed-48f5-aeb8-96968366722e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6801","nonce":2779097013}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6802","nonce":2779097013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6804","nonce":2779097013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6803","nonce":2779097013}]},"public_addr":"10.20.193.155:6801/2779097013","cluster_addr":"10.20.193.155:6802/2779097013","heartbeat_back_addr":"10.20.193.155:6804/2779097013","heartbeat_front_addr":"10.20.193.155:6803/2779097013","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:23:49.958344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:23:49.877163+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:23:49.987742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:23:49.866208+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:23:49.985851+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:23:50.007610+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:23:49.944652+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:23:49.883780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T23:24:01.510 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.506+0000 7fca76e74640 1 -- 10.20.193.93:0/2133702541 >> v1:10.20.193.155:6800/3108481844 conn(0x7fca400780c0 legacy=0x7fca4007a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.510 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.506+0000 7fca76e74640 1 -- 10.20.193.93:0/2133702541 >> v1:10.20.193.93:6790/0 conn(0x7fca7013ec60 legacy=0x7fca701e6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.510 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.506+0000 7fca76e74640 1 -- 10.20.193.93:0/2133702541 shutdown_connections 2026-02-22T23:24:01.510 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.506+0000 7fca76e74640 1 -- 10.20.193.93:0/2133702541 >> 10.20.193.93:0/2133702541 conn(0x7fca700b7150 msgr2=0x7fca700b2490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:01.510 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.506+0000 7fca76e74640 1 -- 10.20.193.93:0/2133702541 shutdown_connections 2026-02-22T23:24:01.510 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.506+0000 7fca76e74640 1 -- 10.20.193.93:0/2133702541 wait complete. 2026-02-22T23:24:01.517 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-22T23:24:01.517 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-22T23:24:01.517 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-22T23:24:01.518 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-22T23:24:01.518 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2026-02-22T23:24:01.518 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2026-02-22T23:24:01.518 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2026-02-22T23:24:01.519 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2026-02-22T23:24:01.590 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.587+0000 7f4874553640 1 Processor -- start 2026-02-22T23:24:01.590 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.587+0000 7f4874553640 1 -- start start 2026-02-22T23:24:01.591 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.588+0000 7f549afb3640 1 Processor -- start 2026-02-22T23:24:01.591 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.588+0000 7f549afb3640 1 -- start start 2026-02-22T23:24:01.591 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.588+0000 7fbe1227c640 1 Processor -- start 2026-02-22T23:24:01.591 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.588+0000 7f4874553640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f486c074140 con 0x7f486c071f60 2026-02-22T23:24:01.591 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.588+0000 7f4874553640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f486c074420 con 0x7f486c0b1a00 2026-02-22T23:24:01.591 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.588+0000 7f4874553640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f486c074700 con 0x7f486c13ada0 2026-02-22T23:24:01.591 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.588+0000 7fbe1227c640 1 -- start start 2026-02-22T23:24:01.591 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.588+0000 7f4872ac9640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7f486c13ada0 0x7f486c14cb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:33802/0 (socket says 10.20.193.93:33802) 2026-02-22T23:24:01.592 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.588+0000 7f4872ac9640 1 -- 10.20.193.93:0/4101780410 learned_addr learned my addr 10.20.193.93:0/4101780410 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:01.592 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.588+0000 7f549afb3640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54940ab160 con 0x7f54940b6070 2026-02-22T23:24:01.592 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.588+0000 7f549afb3640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54940aa8e0 con 0x7f54940b5c90 2026-02-22T23:24:01.592 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.588+0000 7f549afb3640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54941474c0 con 0x7f5494140ec0 2026-02-22T23:24:01.592 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.588+0000 7f548bfff640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7f5494140ec0 0x7f5494146db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:33814/0 (socket says 10.20.193.93:33814) 2026-02-22T23:24:01.592 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.588+0000 7f548bfff640 1 -- 10.20.193.93:0/3723194170 learned_addr learned my addr 10.20.193.93:0/3723194170 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:01.592 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.588+0000 7f5dd5387640 1 Processor -- start 2026-02-22T23:24:01.592 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.588+0000 7f48712c6640 1 -- 10.20.193.93:0/4101780410 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1393169849 0 0) 0x7f486c074140 con 0x7f486c071f60 2026-02-22T23:24:01.592 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.588+0000 7f5dd5387640 1 -- start start 2026-02-22T23:24:01.593 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.588+0000 7f48712c6640 1 -- 10.20.193.93:0/4101780410 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4854003620 con 0x7f486c071f60 2026-02-22T23:24:01.593 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.588+0000 7f48712c6640 1 -- 10.20.193.93:0/4101780410 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 881102206 0 0) 0x7f486c074700 con 0x7f486c13ada0 2026-02-22T23:24:01.593 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.588+0000 7f48712c6640 1 -- 10.20.193.93:0/4101780410 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f486c074140 con 0x7f486c13ada0 2026-02-22T23:24:01.593 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.588+0000 7f548b7fe640 1 -- 10.20.193.93:0/3723194170 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2077933465 0 0) 0x7f54941474c0 con 0x7f5494140ec0 2026-02-22T23:24:01.593 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.588+0000 7fbe1227c640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe0c0b2990 con 0x7fbe0c0b0f50 2026-02-22T23:24:01.593 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.588+0000 7fbe1227c640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe0c074890 con 0x7fbe0c1419e0 2026-02-22T23:24:01.593 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.588+0000 7fbe1227c640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe0c13ed20 con 0x7fbe0c069ee0 2026-02-22T23:24:01.593 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.588+0000 7f548b7fe640 1 -- 10.20.193.93:0/3723194170 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5480003620 con 0x7f5494140ec0 2026-02-22T23:24:01.593 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.588+0000 7f48712c6640 1 -- 10.20.193.93:0/4101780410 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3717558880 0 0) 0x7f486c074140 con 0x7f486c13ada0 2026-02-22T23:24:01.593 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.588+0000 7f48712c6640 1 -- 10.20.193.93:0/4101780410 >> v1:10.20.193.155:6789/0 conn(0x7f486c0b1a00 legacy=0x7f486c1418f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.593 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.588+0000 7f48712c6640 1 -- 10.20.193.93:0/4101780410 >> v1:10.20.193.93:6789/0 conn(0x7f486c071f60 legacy=0x7f486c072340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.594 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.588+0000 7fbe0affd640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7fbe0c069ee0 0x7fbe0c1412d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:33822/0 (socket says 10.20.193.93:33822) 2026-02-22T23:24:01.594 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.588+0000 7fbe0b7fe640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7fbe0c0b0f50 0x7fbe0c13e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:46638/0 (socket says 10.20.193.93:46638) 2026-02-22T23:24:01.594 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.588+0000 7fbe0affd640 1 -- 10.20.193.93:0/1095672156 learned_addr learned my addr 10.20.193.93:0/1095672156 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:01.594 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.588+0000 7f548b7fe640 1 -- 10.20.193.93:0/3723194170 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1711716141 0 0) 0x7f54940ab160 con 0x7f54940b6070 2026-02-22T23:24:01.594 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.588+0000 7f48712c6640 1 -- 10.20.193.93:0/4101780410 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f486c1413d0 con 0x7f486c13ada0 2026-02-22T23:24:01.594 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.588+0000 7f548b7fe640 1 -- 10.20.193.93:0/3723194170 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54941474c0 con 0x7f54940b6070 2026-02-22T23:24:01.594 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.588+0000 7f548b7fe640 1 -- 10.20.193.93:0/3723194170 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4019865816 0 0) 0x7f5480003620 con 0x7f5494140ec0 2026-02-22T23:24:01.594 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.588+0000 7f48712c6640 1 -- 10.20.193.93:0/4101780410 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f4868003130 con 0x7f486c13ada0 2026-02-22T23:24:01.594 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.588+0000 7f548b7fe640 1 -- 10.20.193.93:0/3723194170 >> v1:10.20.193.155:6789/0 conn(0x7f54940b5c90 legacy=0x7f54941407b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T23:24:01.595 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.588+0000 7f548b7fe640 1 -- 10.20.193.93:0/3723194170 >> v1:10.20.193.93:6789/0 conn(0x7f54940b6070 legacy=0x7f549414ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.595 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.589+0000 7f548b7fe640 1 -- 10.20.193.93:0/3723194170 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5494147690 con 0x7f5494140ec0 2026-02-22T23:24:01.595 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.589+0000 7f548b7fe640 1 -- 10.20.193.93:0/3723194170 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f547c002ea0 con 0x7f5494140ec0 2026-02-22T23:24:01.595 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.589+0000 7f9b58e96640 1 Processor -- start 2026-02-22T23:24:01.595 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.589+0000 7f48712c6640 1 -- 10.20.193.93:0/4101780410 <== mon.2 v1:10.20.193.93:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f48680032d0 con 0x7f486c13ada0 2026-02-22T23:24:01.595 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.589+0000 7fbe0a7fc640 1 -- 10.20.193.93:0/1095672156 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3213630227 0 0) 0x7fbe0c0b2990 con 0x7fbe0c0b0f50 2026-02-22T23:24:01.595 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.589+0000 7f548b7fe640 1 -- 10.20.193.93:0/3723194170 <== mon.2 v1:10.20.193.93:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f547c003040 con 0x7f5494140ec0 2026-02-22T23:24:01.595 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.589+0000 7f548b7fe640 1 -- 10.20.193.93:0/3723194170 <== mon.2 v1:10.20.193.93:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f547c003490 con 0x7f5494140ec0 2026-02-22T23:24:01.595 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.589+0000 7f48712c6640 1 -- 10.20.193.93:0/4101780410 <== mon.2 v1:10.20.193.93:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f48680036e0 con 0x7f486c13ada0 2026-02-22T23:24:01.596 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.589+0000 7fbe0a7fc640 1 -- 10.20.193.93:0/1095672156 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbdf0003620 con 0x7fbe0c0b0f50 2026-02-22T23:24:01.596 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.589+0000 7fbe0a7fc640 1 -- 10.20.193.93:0/1095672156 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1347379381 0 0) 0x7fbe0c13ed20 con 0x7fbe0c069ee0 2026-02-22T23:24:01.596 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.589+0000 7fbe0a7fc640 1 -- 10.20.193.93:0/1095672156 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe0c0b2990 con 0x7fbe0c069ee0 2026-02-22T23:24:01.596 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.589+0000 7fbe0a7fc640 1 -- 10.20.193.93:0/1095672156 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1675015382 0 0) 0x7fbdf0003620 con 0x7fbe0c0b0f50 2026-02-22T23:24:01.596 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.589+0000 7fbe0a7fc640 1 -- 10.20.193.93:0/1095672156 >> v1:10.20.193.93:6790/0 conn(0x7fbe0c069ee0 legacy=0x7fbe0c1412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.596 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.589+0000 7fbe0a7fc640 1 -- 10.20.193.93:0/1095672156 >> v1:10.20.193.155:6789/0 conn(0x7fbe0c1419e0 legacy=0x7fbe0c14cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.596 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.589+0000 7fbe0a7fc640 1 -- 10.20.193.93:0/1095672156 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe0c0b1970 con 0x7fbe0c0b0f50 2026-02-22T23:24:01.596 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.589+0000 7fbe0a7fc640 1 -- 10.20.193.93:0/1095672156 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fbdf8002ea0 con 0x7fbe0c0b0f50 2026-02-22T23:24:01.596 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.589+0000 7f4874553640 1 -- 10.20.193.93:0/4101780410 >> v1:10.20.193.93:6790/0 conn(0x7f486c13ada0 legacy=0x7f486c14cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.596 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.589+0000 7f5dd5387640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dd013ee30 con 0x7f5dd0144a00 2026-02-22T23:24:01.596 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.589+0000 7f5dd5387640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dd0144de0 con 0x7f5dd013ea10 2026-02-22T23:24:01.596 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.589+0000 7f5dd5387640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dd0074040 con 0x7f5dd01452d0 2026-02-22T23:24:01.596 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.589+0000 7f9b58e96640 1 -- start start 2026-02-22T23:24:01.597 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.589+0000 7f5dce7fc640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7f5dd01452d0 0x7f5dd013e300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:33832/0 (socket says 10.20.193.93:33832) 2026-02-22T23:24:01.597 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.589+0000 7f5dce7fc640 1 -- 10.20.193.93:0/797453472 learned_addr learned my addr 10.20.193.93:0/797453472 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:01.597 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.589+0000 7f4874553640 1 -- 10.20.193.93:0/4101780410 shutdown_connections 2026-02-22T23:24:01.597 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.589+0000 7f4874553640 1 -- 10.20.193.93:0/4101780410 >> 10.20.193.93:0/4101780410 conn(0x7f486c0b7000 msgr2=0x7f486c0b73e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:01.597 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.589+0000 7f4874553640 1 -- 10.20.193.93:0/4101780410 shutdown_connections 2026-02-22T23:24:01.597 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.589+0000 7f4874553640 1 -- 10.20.193.93:0/4101780410 wait complete. 2026-02-22T23:24:01.597 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.589+0000 7fbe0a7fc640 1 -- 10.20.193.93:0/1095672156 <== mon.0 v1:10.20.193.93:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbdf8003040 con 0x7fbe0c0b0f50 2026-02-22T23:24:01.597 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.589+0000 7fbe0a7fc640 1 -- 10.20.193.93:0/1095672156 <== mon.0 v1:10.20.193.93:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fbdf80034d0 con 0x7fbe0c0b0f50 2026-02-22T23:24:01.597 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.589+0000 7f549afb3640 1 -- 10.20.193.93:0/3723194170 >> v1:10.20.193.93:6790/0 conn(0x7f5494140ec0 legacy=0x7f5494146db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.597 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.589+0000 7f5dcdffb640 1 -- 10.20.193.93:0/797453472 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2528709561 0 0) 0x7f5dc4002850 con 0x7f5dd0144a00 2026-02-22T23:24:01.597 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.589+0000 7f5dcdffb640 1 -- 10.20.193.93:0/797453472 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5dbc003620 con 0x7f5dd0144a00 2026-02-22T23:24:01.598 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.589+0000 7f549afb3640 1 -- 10.20.193.93:0/3723194170 shutdown_connections 2026-02-22T23:24:01.598 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.589+0000 7f549afb3640 1 -- 10.20.193.93:0/3723194170 >> 10.20.193.93:0/3723194170 conn(0x7f5494068410 msgr2=0x7f54940687f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:01.598 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.589+0000 7fbe1227c640 1 -- 10.20.193.93:0/1095672156 >> v1:10.20.193.93:6789/0 conn(0x7fbe0c0b0f50 legacy=0x7fbe0c13e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.598 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.589+0000 7f5dcdffb640 1 -- 10.20.193.93:0/797453472 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1691563881 0 0) 0x7f5dd0074040 con 0x7f5dd01452d0 2026-02-22T23:24:01.598 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.589+0000 7f5dcdffb640 1 -- 10.20.193.93:0/797453472 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5dc4002850 con 0x7f5dd01452d0 2026-02-22T23:24:01.598 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.589+0000 7f5dcdffb640 1 -- 10.20.193.93:0/797453472 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2562947651 0 0) 0x7f5dbc003620 con 0x7f5dd0144a00 2026-02-22T23:24:01.598 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.589+0000 7f5dcdffb640 1 -- 10.20.193.93:0/797453472 >> v1:10.20.193.93:6790/0 conn(0x7f5dd01452d0 legacy=0x7f5dd013e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.598 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.589+0000 7f5dcdffb640 1 -- 10.20.193.93:0/797453472 >> v1:10.20.193.155:6789/0 conn(0x7f5dd013ea10 legacy=0x7f5dd014cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.598 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.589+0000 7f5dcdffb640 1 -- 10.20.193.93:0/797453472 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dd0074320 con 0x7f5dd0144a00 2026-02-22T23:24:01.598 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.589+0000 7f5dcdffb640 1 -- 10.20.193.93:0/797453472 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f5dc4002fa0 con 0x7f5dd0144a00 2026-02-22T23:24:01.598 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.589+0000 7f5dcdffb640 1 -- 10.20.193.93:0/797453472 <== mon.0 v1:10.20.193.93:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5dc4003140 con 0x7f5dd0144a00 2026-02-22T23:24:01.598 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.589+0000 7f5dcdffb640 1 -- 10.20.193.93:0/797453472 <== mon.0 v1:10.20.193.93:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f5dc4003510 con 0x7f5dd0144a00 2026-02-22T23:24:01.599 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.589+0000 7fbe1227c640 1 -- 10.20.193.93:0/1095672156 shutdown_connections 2026-02-22T23:24:01.599 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.589+0000 7fbe1227c640 1 -- 10.20.193.93:0/1095672156 >> 10.20.193.93:0/1095672156 conn(0x7fbe0c0b1dd0 msgr2=0x7fbe0c0b21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:01.599 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.589+0000 7fbe1227c640 1 -- 10.20.193.93:0/1095672156 shutdown_connections 2026-02-22T23:24:01.599 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.589+0000 7fbe1227c640 1 -- 10.20.193.93:0/1095672156 wait complete. 2026-02-22T23:24:01.599 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.590+0000 7f549afb3640 1 -- 10.20.193.93:0/3723194170 shutdown_connections 2026-02-22T23:24:01.599 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.590+0000 7f9b58e96640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b54147180 con 0x7f9b540b36c0 2026-02-22T23:24:01.599 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.590+0000 7f9b58e96640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b540b5fc0 con 0x7f9b540b5be0 2026-02-22T23:24:01.599 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.590+0000 7f9b58e96640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b540b6190 con 0x7f9b540aa8e0 2026-02-22T23:24:01.599 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.590+0000 7f9b51d74640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7f9b540aa8e0 0x7f9b54140710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:33840/0 (socket says 10.20.193.93:33840) 2026-02-22T23:24:01.599 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.590+0000 7f9b51d74640 1 -- 10.20.193.93:0/987431339 learned_addr learned my addr 10.20.193.93:0/987431339 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:01.599 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.590+0000 7f549afb3640 1 -- 10.20.193.93:0/3723194170 wait complete. 2026-02-22T23:24:01.599 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.590+0000 7f5dd5387640 1 -- 10.20.193.93:0/797453472 >> v1:10.20.193.93:6789/0 conn(0x7f5dd0144a00 legacy=0x7f5dd00afa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.600 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.590+0000 7f4874553640 1 Processor -- start 2026-02-22T23:24:01.600 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.590+0000 7f9b51573640 1 -- 10.20.193.93:0/987431339 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2467754892 0 0) 0x7f9b540b6190 con 0x7f9b540aa8e0 2026-02-22T23:24:01.600 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.590+0000 7f9b51573640 1 -- 10.20.193.93:0/987431339 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b34003620 con 0x7f9b540aa8e0 2026-02-22T23:24:01.600 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.590+0000 7f5dd5387640 1 -- 10.20.193.93:0/797453472 shutdown_connections 2026-02-22T23:24:01.600 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.590+0000 7f5dd5387640 1 -- 10.20.193.93:0/797453472 >> 10.20.193.93:0/797453472 conn(0x7f5dd00b1d30 msgr2=0x7f5dd00b2140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:01.600 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.590+0000 7f5dd5387640 1 -- 10.20.193.93:0/797453472 shutdown_connections 2026-02-22T23:24:01.600 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.590+0000 7f5dd5387640 1 -- 10.20.193.93:0/797453472 wait complete. 2026-02-22T23:24:01.600 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.590+0000 7f9b51573640 1 -- 10.20.193.93:0/987431339 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2212644301 0 0) 0x7f9b54147180 con 0x7f9b540b36c0 2026-02-22T23:24:01.600 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.590+0000 7f9b51573640 1 -- 10.20.193.93:0/987431339 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b540b6190 con 0x7f9b540b36c0 2026-02-22T23:24:01.600 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.590+0000 7f4874553640 1 -- start start 2026-02-22T23:24:01.601 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.590+0000 7f9b51573640 1 -- 10.20.193.93:0/987431339 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3028053356 0 0) 0x7f9b34003620 con 0x7f9b540aa8e0 2026-02-22T23:24:01.601 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.590+0000 7f9b51573640 1 -- 10.20.193.93:0/987431339 >> v1:10.20.193.155:6789/0 conn(0x7f9b540b5be0 legacy=0x7f9b54146a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.601 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.590+0000 7f9b51573640 1 -- 10.20.193.93:0/987431339 >> v1:10.20.193.93:6789/0 conn(0x7f9b540b36c0 legacy=0x7f9b5414edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.601 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.590+0000 7f9b51573640 1 -- 10.20.193.93:0/987431339 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b540ab290 con 0x7f9b540aa8e0 2026-02-22T23:24:01.601 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.590+0000 7f9b51573640 1 -- 10.20.193.93:0/987431339 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f9b40002ea0 con 0x7f9b540aa8e0 2026-02-22T23:24:01.601 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.590+0000 7f9b51573640 1 -- 10.20.193.93:0/987431339 <== mon.2 v1:10.20.193.93:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9b400030c0 con 0x7f9b540aa8e0 2026-02-22T23:24:01.601 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.590+0000 7f9b51573640 1 -- 10.20.193.93:0/987431339 <== mon.2 v1:10.20.193.93:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f9b40003510 con 0x7f9b540aa8e0 2026-02-22T23:24:01.601 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.590+0000 7fbe1227c640 1 Processor -- start 2026-02-22T23:24:01.601 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.590+0000 7fbe1227c640 1 -- start start 2026-02-22T23:24:01.601 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.590+0000 7f549afb3640 1 Processor -- start 2026-02-22T23:24:01.601 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.590+0000 7f4874553640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f486c135b60 con 0x7f486c13ada0 2026-02-22T23:24:01.602 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.590+0000 7f4874553640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f486c13a0d0 con 0x7f486c0b1a00 2026-02-22T23:24:01.602 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.590+0000 7f549afb3640 1 -- start start 2026-02-22T23:24:01.602 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.590+0000 7f4874553640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f486c137a70 con 0x7f486c071f60 2026-02-22T23:24:01.602 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.590+0000 7f48722c8640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7f486c071f60 0x7f486c1d8200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:33848/0 (socket says 10.20.193.93:33848) 2026-02-22T23:24:01.602 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.590+0000 7f48722c8640 1 -- 10.20.193.93:0/2633852002 learned_addr learned my addr 10.20.193.93:0/2633852002 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:01.602 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.590+0000 7f4852ffd640 1 -- 10.20.193.93:0/2633852002 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1277402230 0 0) 0x7f486c137a70 con 0x7f486c071f60 2026-02-22T23:24:01.602 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.590+0000 7f9b58e96640 1 -- 10.20.193.93:0/987431339 >> v1:10.20.193.93:6790/0 conn(0x7f9b540aa8e0 legacy=0x7f9b54140710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.602 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.590+0000 7f4852ffd640 1 -- 10.20.193.93:0/2633852002 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f483c003620 con 0x7f486c071f60 2026-02-22T23:24:01.602 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.590+0000 7f4852ffd640 1 -- 10.20.193.93:0/2633852002 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 969926097 0 0) 0x7f486c135b60 con 0x7f486c13ada0 2026-02-22T23:24:01.602 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.590+0000 7f4852ffd640 1 -- 10.20.193.93:0/2633852002 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f486c137a70 con 0x7f486c13ada0 2026-02-22T23:24:01.603 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.590+0000 7f9b58e96640 1 -- 10.20.193.93:0/987431339 shutdown_connections 2026-02-22T23:24:01.603 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.590+0000 7f9b58e96640 1 -- 10.20.193.93:0/987431339 >> 10.20.193.93:0/987431339 conn(0x7f9b54068410 msgr2=0x7f9b54068820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:01.603 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.590+0000 7fc05a274640 1 Processor -- start 2026-02-22T23:24:01.603 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.590+0000 7f9b58e96640 1 -- 10.20.193.93:0/987431339 shutdown_connections 2026-02-22T23:24:01.603 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.590+0000 7f9b58e96640 1 -- 10.20.193.93:0/987431339 wait complete. 2026-02-22T23:24:01.603 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.590+0000 7fc05a274640 1 -- start start 2026-02-22T23:24:01.603 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f4852ffd640 1 -- 10.20.193.93:0/2633852002 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2431834962 0 0) 0x7f486c13a0d0 con 0x7f486c0b1a00 2026-02-22T23:24:01.603 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f5dd5387640 1 Processor -- start 2026-02-22T23:24:01.604 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f4852ffd640 1 -- 10.20.193.93:0/2633852002 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f486c135b60 con 0x7f486c0b1a00 2026-02-22T23:24:01.604 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f4852ffd640 1 -- 10.20.193.93:0/2633852002 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 688861239 0 0) 0x7f483c003620 con 0x7f486c071f60 2026-02-22T23:24:01.604 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f4852ffd640 1 -- 10.20.193.93:0/2633852002 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f486c13a0d0 con 0x7f486c071f60 2026-02-22T23:24:01.604 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f4852ffd640 1 -- 10.20.193.93:0/2633852002 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f485c0030c0 con 0x7f486c071f60 2026-02-22T23:24:01.604 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7fbe1227c640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe0c0abed0 con 0x7fbe0c0b0f50 2026-02-22T23:24:01.604 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7fbe1227c640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe0c1d8560 con 0x7fbe0c1419e0 2026-02-22T23:24:01.604 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7fbe1227c640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe0c1d9190 con 0x7fbe0c069ee0 2026-02-22T23:24:01.604 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f5dd5387640 1 -- start start 2026-02-22T23:24:01.604 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f549afb3640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f549413eab0 con 0x7f5494140ec0 2026-02-22T23:24:01.604 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f549afb3640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5494136f40 con 0x7f54940b5c90 2026-02-22T23:24:01.604 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f549afb3640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f549413d520 con 0x7f54940b6070 2026-02-22T23:24:01.604 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f4852ffd640 1 -- 10.20.193.93:0/2633852002 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1678473602 0 0) 0x7f486c137a70 con 0x7f486c13ada0 2026-02-22T23:24:01.605 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f4852ffd640 1 -- 10.20.193.93:0/2633852002 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f483c003620 con 0x7f486c13ada0 2026-02-22T23:24:01.605 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f4852ffd640 1 -- 10.20.193.93:0/2633852002 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f4868003620 con 0x7f486c13ada0 2026-02-22T23:24:01.605 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f4852ffd640 1 -- 10.20.193.93:0/2633852002 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 911850033 0 0) 0x7f486c135b60 con 0x7f486c0b1a00 2026-02-22T23:24:01.605 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f4852ffd640 1 -- 10.20.193.93:0/2633852002 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f486c137a70 con 0x7f486c0b1a00 2026-02-22T23:24:01.605 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f4852ffd640 1 -- 10.20.193.93:0/2633852002 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f4860003040 con 0x7f486c0b1a00 2026-02-22T23:24:01.605 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f5499529640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7f5494140ec0 0x7f5494136830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:46688/0 (socket says 10.20.193.93:46688) 2026-02-22T23:24:01.605 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f5499529640 1 -- 10.20.193.93:0/345825598 learned_addr learned my addr 10.20.193.93:0/345825598 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:01.605 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7fbe0affd640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7fbe0c0b0f50 0x7fbe0c1d8a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:46680/0 (socket says 10.20.193.93:46680) 2026-02-22T23:24:01.605 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f4852ffd640 1 -- 10.20.193.93:0/2633852002 <== mon.2 v1:10.20.193.93:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1012169857 0 0) 0x7f486c13a0d0 con 0x7f486c071f60 2026-02-22T23:24:01.605 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7fbe0affd640 1 -- 10.20.193.93:0/4125047184 learned_addr learned my addr 10.20.193.93:0/4125047184 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:01.606 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f4852ffd640 1 -- 10.20.193.93:0/2633852002 >> v1:10.20.193.155:6789/0 conn(0x7f486c0b1a00 legacy=0x7f486c134d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.606 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f4852ffd640 1 -- 10.20.193.93:0/2633852002 >> v1:10.20.193.93:6789/0 conn(0x7f486c13ada0 legacy=0x7f486c135450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.606 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f06be35c640 1 Processor -- start 2026-02-22T23:24:01.606 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f4852ffd640 1 -- 10.20.193.93:0/2633852002 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f486c137c40 con 0x7f486c071f60 2026-02-22T23:24:01.606 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f4874553640 1 -- 10.20.193.93:0/2633852002 --> v1:10.20.193.93:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f486c144b20 con 0x7f486c071f60 2026-02-22T23:24:01.606 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7fbde7fff640 1 -- 10.20.193.93:0/4125047184 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 137896965 0 0) 0x7fbe0c0abed0 con 0x7fbe0c0b0f50 2026-02-22T23:24:01.606 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f4852ffd640 1 -- 10.20.193.93:0/2633852002 <== mon.2 v1:10.20.193.93:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f485c003670 con 0x7f486c071f60 2026-02-22T23:24:01.606 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f4852ffd640 1 -- 10.20.193.93:0/2633852002 <== mon.2 v1:10.20.193.93:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f485c004db0 con 0x7f486c071f60 2026-02-22T23:24:01.606 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f4874553640 1 -- 10.20.193.93:0/2633852002 --> v1:10.20.193.93:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f486c138b60 con 0x7f486c071f60 2026-02-22T23:24:01.606 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f54897fa640 1 -- 10.20.193.93:0/345825598 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3728114264 0 0) 0x7f549413d520 con 0x7f54940b6070 2026-02-22T23:24:01.606 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f54897fa640 1 -- 10.20.193.93:0/345825598 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5464003620 con 0x7f54940b6070 2026-02-22T23:24:01.607 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f06be35c640 1 -- start start 2026-02-22T23:24:01.607 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7fbde7fff640 1 -- 10.20.193.93:0/4125047184 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbddc003620 con 0x7fbe0c0b0f50 2026-02-22T23:24:01.607 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7fbde7fff640 1 -- 10.20.193.93:0/4125047184 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3797468224 0 0) 0x7fbe0c1d9190 con 0x7fbe0c069ee0 2026-02-22T23:24:01.607 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7fbde7fff640 1 -- 10.20.193.93:0/4125047184 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe0c0abed0 con 0x7fbe0c069ee0 2026-02-22T23:24:01.607 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f54897fa640 1 -- 10.20.193.93:0/345825598 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3052361875 0 0) 0x7f549413eab0 con 0x7f5494140ec0 2026-02-22T23:24:01.607 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f54897fa640 1 -- 10.20.193.93:0/345825598 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f549413d520 con 0x7f5494140ec0 2026-02-22T23:24:01.607 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f5dd5387640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dd013f590 con 0x7f5dd013ea10 2026-02-22T23:24:01.607 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f5dd5387640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dd013f800 con 0x7f5dd0144a00 2026-02-22T23:24:01.607 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f5dd5387640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dd00b2ef0 con 0x7f5dd01452d0 2026-02-22T23:24:01.607 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f54897fa640 1 -- 10.20.193.93:0/345825598 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2593275589 0 0) 0x7f5494136f40 con 0x7f54940b5c90 2026-02-22T23:24:01.607 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f54897fa640 1 -- 10.20.193.93:0/345825598 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f549413eab0 con 0x7f54940b5c90 2026-02-22T23:24:01.608 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7fc05a274640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc054147180 con 0x7fc0540b5be0 2026-02-22T23:24:01.608 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7fc05a274640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0540b5fc0 con 0x7fc0540aa8e0 2026-02-22T23:24:01.608 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7fc05a274640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0540b6190 con 0x7fc0540b36c0 2026-02-22T23:24:01.608 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7fc0537fe640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7fc0540b5be0 0x7fc054146a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:46698/0 (socket says 10.20.193.93:46698) 2026-02-22T23:24:01.608 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7fc0537fe640 1 -- 10.20.193.93:0/2494129924 learned_addr learned my addr 10.20.193.93:0/2494129924 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:01.608 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f5dceffd640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7f5dd013ea10 0x7f5dd01d6690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:46704/0 (socket says 10.20.193.93:46704) 2026-02-22T23:24:01.608 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f5dceffd640 1 -- 10.20.193.93:0/2826536353 learned_addr learned my addr 10.20.193.93:0/2826536353 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:01.608 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7fbde7fff640 1 -- 10.20.193.93:0/4125047184 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 54115513 0 0) 0x7fbe0c1d8560 con 0x7fbe0c1419e0 2026-02-22T23:24:01.608 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7fbde7fff640 1 -- 10.20.193.93:0/4125047184 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe0c1d9190 con 0x7fbe0c1419e0 2026-02-22T23:24:01.608 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7fc0527fc640 1 -- 10.20.193.93:0/2494129924 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1517116479 0 0) 0x7fc054147180 con 0x7fc0540b5be0 2026-02-22T23:24:01.608 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f54897fa640 1 -- 10.20.193.93:0/345825598 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1501424560 0 0) 0x7f549413eab0 con 0x7f54940b5c90 2026-02-22T23:24:01.608 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f54897fa640 1 -- 10.20.193.93:0/345825598 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5494136f40 con 0x7f54940b5c90 2026-02-22T23:24:01.609 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f54897fa640 1 -- 10.20.193.93:0/345825598 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f5484002d20 con 0x7f54940b5c90 2026-02-22T23:24:01.609 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f5daf7fe640 1 -- 10.20.193.93:0/2826536353 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3216203753 0 0) 0x7f5dd013f590 con 0x7f5dd013ea10 2026-02-22T23:24:01.609 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f54897fa640 1 -- 10.20.193.93:0/345825598 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1904083040 0 0) 0x7f549413d520 con 0x7f5494140ec0 2026-02-22T23:24:01.609 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f54897fa640 1 -- 10.20.193.93:0/345825598 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f549413eab0 con 0x7f5494140ec0 2026-02-22T23:24:01.609 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f54897fa640 1 -- 10.20.193.93:0/345825598 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f5490003500 con 0x7f5494140ec0 2026-02-22T23:24:01.609 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7fc0527fc640 1 -- 10.20.193.93:0/2494129924 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc038003620 con 0x7fc0540b5be0 2026-02-22T23:24:01.609 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f5daf7fe640 1 -- 10.20.193.93:0/2826536353 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d9c003620 con 0x7f5dd013ea10 2026-02-22T23:24:01.609 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7fbde7fff640 1 -- 10.20.193.93:0/4125047184 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1239259401 0 0) 0x7fbe0c1d9190 con 0x7fbe0c1419e0 2026-02-22T23:24:01.609 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f9b58e96640 1 Processor -- start 2026-02-22T23:24:01.610 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7fbde7fff640 1 -- 10.20.193.93:0/4125047184 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbe0c1d8560 con 0x7fbe0c1419e0 2026-02-22T23:24:01.610 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f54897fa640 1 -- 10.20.193.93:0/345825598 <== mon.1 v1:10.20.193.155:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 389671171 0 0) 0x7f5494136f40 con 0x7f54940b5c90 2026-02-22T23:24:01.610 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f54897fa640 1 -- 10.20.193.93:0/345825598 >> v1:10.20.193.93:6790/0 conn(0x7f54940b6070 legacy=0x7f5494136120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.610 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7fbde7fff640 1 -- 10.20.193.93:0/4125047184 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fbe000032e0 con 0x7fbe0c1419e0 2026-02-22T23:24:01.610 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7fbde7fff640 1 -- 10.20.193.93:0/4125047184 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4071188643 0 0) 0x7fbe0c0abed0 con 0x7fbe0c069ee0 2026-02-22T23:24:01.610 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7fbde7fff640 1 -- 10.20.193.93:0/4125047184 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbe0c1d9190 con 0x7fbe0c069ee0 2026-02-22T23:24:01.610 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f9b58e96640 1 -- start start 2026-02-22T23:24:01.610 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f54897fa640 1 -- 10.20.193.93:0/345825598 >> v1:10.20.193.93:6789/0 conn(0x7f5494140ec0 legacy=0x7f5494136830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.610 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f54897fa640 1 -- 10.20.193.93:0/345825598 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f549413e590 con 0x7f54940b5c90 2026-02-22T23:24:01.610 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f5daf7fe640 1 -- 10.20.193.93:0/2826536353 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2167324033 0 0) 0x7f5dd00b2ef0 con 0x7f5dd01452d0 2026-02-22T23:24:01.610 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f5daf7fe640 1 -- 10.20.193.93:0/2826536353 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5dd013f590 con 0x7f5dd01452d0 2026-02-22T23:24:01.611 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f549afb3640 1 -- 10.20.193.93:0/345825598 --> v1:10.20.193.155:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f549413a7c0 con 0x7f54940b5c90 2026-02-22T23:24:01.611 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f4874553640 1 -- 10.20.193.93:0/2633852002 --> v1:10.20.193.93:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f486c13b250 con 0x7f486c071f60 2026-02-22T23:24:01.611 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7fbde7fff640 1 -- 10.20.193.93:0/4125047184 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fbdf8003390 con 0x7fbe0c069ee0 2026-02-22T23:24:01.611 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7fbde7fff640 1 -- 10.20.193.93:0/4125047184 <== mon.1 v1:10.20.193.155:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1216711392 0 0) 0x7fbe0c1d8560 con 0x7fbe0c1419e0 2026-02-22T23:24:01.611 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f06be35c640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06b8147180 con 0x7f06b80aa8e0 2026-02-22T23:24:01.611 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f06be35c640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06b80b5fc0 con 0x7f06b80b36c0 2026-02-22T23:24:01.611 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f06be35c640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06b80b6190 con 0x7f06b80b5be0 2026-02-22T23:24:01.611 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7fc0527fc640 1 -- 10.20.193.93:0/2494129924 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3621457144 0 0) 0x7fc038003620 con 0x7fc0540b5be0 2026-02-22T23:24:01.611 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7fc0527fc640 1 -- 10.20.193.93:0/2494129924 >> v1:10.20.193.93:6790/0 conn(0x7fc0540b36c0 legacy=0x7fc05414edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.611 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7fbde7fff640 1 -- 10.20.193.93:0/4125047184 >> v1:10.20.193.93:6790/0 conn(0x7fbe0c069ee0 legacy=0x7fbe0c144e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.612 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f5daf7fe640 1 -- 10.20.193.93:0/2826536353 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 587757719 0 0) 0x7f5d9c003620 con 0x7f5dd013ea10 2026-02-22T23:24:01.612 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7fc0527fc640 1 -- 10.20.193.93:0/2494129924 >> v1:10.20.193.155:6789/0 conn(0x7fc0540aa8e0 legacy=0x7fc054140710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.612 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7fc0527fc640 1 -- 10.20.193.93:0/2494129924 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0540ab290 con 0x7fc0540b5be0 2026-02-22T23:24:01.612 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f5daf7fe640 1 -- 10.20.193.93:0/2826536353 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5dd00b2ef0 con 0x7f5dd013ea10 2026-02-22T23:24:01.612 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f5daf7fe640 1 -- 10.20.193.93:0/2826536353 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f5dc4003550 con 0x7f5dd013ea10 2026-02-22T23:24:01.612 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f549afb3640 1 -- 10.20.193.93:0/345825598 --> v1:10.20.193.155:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f54941de330 con 0x7f54940b5c90 2026-02-22T23:24:01.612 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7fc0527fc640 1 -- 10.20.193.93:0/2494129924 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fc040002ea0 con 0x7fc0540b5be0 2026-02-22T23:24:01.612 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f06b77fe640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7f06b80aa8e0 0x7f06b8140710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:46708/0 (socket says 10.20.193.93:46708) 2026-02-22T23:24:01.612 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f06b77fe640 1 -- 10.20.193.93:0/1508233223 learned_addr learned my addr 10.20.193.93:0/1508233223 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:01.613 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.591+0000 7f06b7fff640 1 --1- 10.20.193.93:0/1508233223 >> v1:10.20.193.93:6790/0 conn(0x7f06b80b5be0 0x7f06b8146a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:33886/0 (socket says 10.20.193.93:33886) 2026-02-22T23:24:01.613 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7fbde7fff640 1 -- 10.20.193.93:0/4125047184 >> v1:10.20.193.93:6789/0 conn(0x7fbe0c0b0f50 legacy=0x7fbe0c1d8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.613 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7f5daf7fe640 1 -- 10.20.193.93:0/2826536353 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 674320779 0 0) 0x7f5dd013f800 con 0x7f5dd0144a00 2026-02-22T23:24:01.613 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7f5daf7fe640 1 -- 10.20.193.93:0/2826536353 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d9c003620 con 0x7f5dd0144a00 2026-02-22T23:24:01.613 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7fbde7fff640 1 -- 10.20.193.93:0/4125047184 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe0c1d4fc0 con 0x7fbe0c1419e0 2026-02-22T23:24:01.613 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7f54897fa640 1 -- 10.20.193.93:0/345825598 <== mon.1 v1:10.20.193.155:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5484003270 con 0x7f54940b5c90 2026-02-22T23:24:01.613 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7f54897fa640 1 -- 10.20.193.93:0/345825598 <== mon.1 v1:10.20.193.155:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f54840038d0 con 0x7f54940b5c90 2026-02-22T23:24:01.613 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7f06b6ffd640 1 -- 10.20.193.93:0/1508233223 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3584722432 0 0) 0x7f06b8147180 con 0x7f06b80aa8e0 2026-02-22T23:24:01.613 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7f06b6ffd640 1 -- 10.20.193.93:0/1508233223 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f069c003620 con 0x7f06b80aa8e0 2026-02-22T23:24:01.613 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7f06b6ffd640 1 -- 10.20.193.93:0/1508233223 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2199363792 0 0) 0x7f06b80b6190 con 0x7f06b80b5be0 2026-02-22T23:24:01.614 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7f06b6ffd640 1 -- 10.20.193.93:0/1508233223 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06b8147180 con 0x7f06b80b5be0 2026-02-22T23:24:01.614 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7fbe1227c640 1 -- 10.20.193.93:0/4125047184 --> v1:10.20.193.155:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbe0c1d5d50 con 0x7fbe0c1419e0 2026-02-22T23:24:01.614 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7f5daf7fe640 1 -- 10.20.193.93:0/2826536353 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 710160766 0 0) 0x7f5dd013f590 con 0x7f5dd01452d0 2026-02-22T23:24:01.614 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7f5daf7fe640 1 -- 10.20.193.93:0/2826536353 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5dd013f800 con 0x7f5dd01452d0 2026-02-22T23:24:01.614 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7f5daf7fe640 1 -- 10.20.193.93:0/2826536353 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f5dc0003400 con 0x7f5dd01452d0 2026-02-22T23:24:01.614 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7fbe1227c640 1 -- 10.20.193.93:0/4125047184 --> v1:10.20.193.155:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fbe0c0aad30 con 0x7fbe0c1419e0 2026-02-22T23:24:01.614 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7fbde7fff640 1 -- 10.20.193.93:0/4125047184 <== mon.1 v1:10.20.193.155:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbe00004820 con 0x7fbe0c1419e0 2026-02-22T23:24:01.614 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7fbde7fff640 1 -- 10.20.193.93:0/4125047184 <== mon.1 v1:10.20.193.155:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fbe00003620 con 0x7fbe0c1419e0 2026-02-22T23:24:01.614 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7f06b6ffd640 1 -- 10.20.193.93:0/1508233223 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 9318707 0 0) 0x7f069c003620 con 0x7f06b80aa8e0 2026-02-22T23:24:01.614 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7f06b6ffd640 1 -- 10.20.193.93:0/1508233223 >> v1:10.20.193.93:6790/0 conn(0x7f06b80b5be0 legacy=0x7f06b8146a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.614 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7f06b6ffd640 1 -- 10.20.193.93:0/1508233223 >> v1:10.20.193.155:6789/0 conn(0x7f06b80b36c0 legacy=0x7f06b814edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T23:24:01.615 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7fc0527fc640 1 -- 10.20.193.93:0/2494129924 <== mon.0 v1:10.20.193.93:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc040003040 con 0x7fc0540b5be0 2026-02-22T23:24:01.615 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7fc0527fc640 1 -- 10.20.193.93:0/2494129924 <== mon.0 v1:10.20.193.93:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fc0400034d0 con 0x7fc0540b5be0 2026-02-22T23:24:01.615 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7f06b6ffd640 1 -- 10.20.193.93:0/1508233223 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06b80ab290 con 0x7f06b80aa8e0 2026-02-22T23:24:01.615 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7f5daf7fe640 1 -- 10.20.193.93:0/2826536353 <== mon.2 v1:10.20.193.93:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 622419472 0 0) 0x7f5dd013f800 con 0x7f5dd01452d0 2026-02-22T23:24:01.615 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7f5daf7fe640 1 -- 10.20.193.93:0/2826536353 >> v1:10.20.193.155:6789/0 conn(0x7f5dd0144a00 legacy=0x7f5dd0070c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.615 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7f5daf7fe640 1 -- 10.20.193.93:0/2826536353 >> v1:10.20.193.93:6789/0 conn(0x7f5dd013ea10 legacy=0x7f5dd01d6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.615 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7f5daf7fe640 1 -- 10.20.193.93:0/2826536353 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dd01d6da0 con 0x7f5dd01452d0 2026-02-22T23:24:01.615 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7f06b6ffd640 1 -- 10.20.193.93:0/1508233223 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f06a8002ea0 con 0x7f06b80aa8e0 2026-02-22T23:24:01.615 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7f5dd5387640 1 -- 10.20.193.93:0/2826536353 --> v1:10.20.193.93:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5dd0071380 con 0x7f5dd01452d0 2026-02-22T23:24:01.615 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7f5dd5387640 1 -- 10.20.193.93:0/2826536353 --> v1:10.20.193.93:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f5dd01e2340 con 0x7f5dd01452d0 2026-02-22T23:24:01.616 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7f9b58e96640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b540af400 con 0x7f9b54142a30 2026-02-22T23:24:01.616 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7f9b58e96640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b540af6e0 con 0x7f9b540b5be0 2026-02-22T23:24:01.616 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7f06b6ffd640 1 -- 10.20.193.93:0/1508233223 <== mon.0 v1:10.20.193.93:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f06a8003040 con 0x7f06b80aa8e0 2026-02-22T23:24:01.616 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7f06b6ffd640 1 -- 10.20.193.93:0/1508233223 <== mon.0 v1:10.20.193.93:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f06a80034d0 con 0x7f06b80aa8e0 2026-02-22T23:24:01.616 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7f549afb3640 1 -- 10.20.193.93:0/345825598 --> v1:10.20.193.155:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f5494150710 con 0x7f54940b5c90 2026-02-22T23:24:01.616 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7f9b52575640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7f9b540b36c0 0x7f9b54142320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:33888/0 (socket says 10.20.193.93:33888) 2026-02-22T23:24:01.616 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7f9b52575640 1 -- 10.20.193.93:0/3161296874 learned_addr learned my addr 10.20.193.93:0/3161296874 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:01.616 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7f5daf7fe640 1 -- 10.20.193.93:0/2826536353 <== mon.2 v1:10.20.193.93:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5dc00035a0 con 0x7f5dd01452d0 2026-02-22T23:24:01.616 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7f5daf7fe640 1 -- 10.20.193.93:0/2826536353 <== mon.2 v1:10.20.193.93:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f5dc00039b0 con 0x7f5dd01452d0 2026-02-22T23:24:01.616 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7f4852ffd640 1 -- 10.20.193.93:0/2633852002 <== mon.2 v1:10.20.193.93:6790/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7f485c01d3e0 con 0x7f486c071f60 2026-02-22T23:24:01.617 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7f9b4affd640 1 -- 10.20.193.93:0/3161296874 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2049640459 0 0) 0x7f9b540af400 con 0x7f9b54142a30 2026-02-22T23:24:01.617 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7fc05a274640 1 -- 10.20.193.93:0/2494129924 >> v1:10.20.193.93:6789/0 conn(0x7fc0540b5be0 legacy=0x7fc054146a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.617 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7fc05a274640 1 -- 10.20.193.93:0/2494129924 shutdown_connections 2026-02-22T23:24:01.617 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7fc05a274640 1 -- 10.20.193.93:0/2494129924 >> 10.20.193.93:0/2494129924 conn(0x7fc054068410 msgr2=0x7fc054068820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:01.617 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7fc05a274640 1 -- 10.20.193.93:0/2494129924 shutdown_connections 2026-02-22T23:24:01.617 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7fc05a274640 1 -- 10.20.193.93:0/2494129924 wait complete. 2026-02-22T23:24:01.617 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7f9b58e96640 1 -- 10.20.193.93:0/3161296874 --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b540af9c0 con 0x7f9b540b36c0 2026-02-22T23:24:01.617 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7f9b4affd640 1 -- 10.20.193.93:0/3161296874 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b28003620 con 0x7f9b54142a30 2026-02-22T23:24:01.617 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7f9b4affd640 1 -- 10.20.193.93:0/3161296874 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3383938690 0 0) 0x7f9b540af6e0 con 0x7f9b540b5be0 2026-02-22T23:24:01.617 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7f06be35c640 1 -- 10.20.193.93:0/1508233223 >> v1:10.20.193.93:6789/0 conn(0x7f06b80aa8e0 legacy=0x7f06b8140710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.618 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7f9b4affd640 1 -- 10.20.193.93:0/3161296874 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b540af400 con 0x7f9b540b5be0 2026-02-22T23:24:01.618 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7f9b4affd640 1 -- 10.20.193.93:0/3161296874 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2339269042 0 0) 0x7f9b540af9c0 con 0x7f9b540b36c0 2026-02-22T23:24:01.618 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7f9b4affd640 1 -- 10.20.193.93:0/3161296874 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b540af6e0 con 0x7f9b540b36c0 2026-02-22T23:24:01.618 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7f9611f5c640 1 Processor -- start 2026-02-22T23:24:01.618 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7fbe1227c640 1 -- 10.20.193.93:0/4125047184 --> v1:10.20.193.155:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fbe0c074cb0 con 0x7fbe0c1419e0 2026-02-22T23:24:01.618 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7f9611f5c640 1 -- start start 2026-02-22T23:24:01.618 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7f9b4affd640 1 -- 10.20.193.93:0/3161296874 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 283200339 0 0) 0x7f9b540af6e0 con 0x7f9b540b36c0 2026-02-22T23:24:01.618 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7f9b4affd640 1 -- 10.20.193.93:0/3161296874 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9b540af9c0 con 0x7f9b540b36c0 2026-02-22T23:24:01.618 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7f9b4affd640 1 -- 10.20.193.93:0/3161296874 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f9b440033e0 con 0x7f9b540b36c0 2026-02-22T23:24:01.618 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7f9b4affd640 1 -- 10.20.193.93:0/3161296874 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2806141715 0 0) 0x7f9b540af400 con 0x7f9b540b5be0 2026-02-22T23:24:01.618 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7f9b4affd640 1 -- 10.20.193.93:0/3161296874 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9b540af6e0 con 0x7f9b540b5be0 2026-02-22T23:24:01.619 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.592+0000 7f4852ffd640 1 -- 10.20.193.93:0/2633852002 <== mon.2 v1:10.20.193.93:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 4142+0+0 (unknown 2994938210 0 0) 0x7f485c0940a0 con 0x7f486c071f60 2026-02-22T23:24:01.619 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7f9b4affd640 1 -- 10.20.193.93:0/3161296874 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f9b40003270 con 0x7f9b540b5be0 2026-02-22T23:24:01.619 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7f9b4affd640 1 -- 10.20.193.93:0/3161296874 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3840817400 0 0) 0x7f9b28003620 con 0x7f9b54142a30 2026-02-22T23:24:01.619 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7f9b4affd640 1 -- 10.20.193.93:0/3161296874 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9b540af400 con 0x7f9b54142a30 2026-02-22T23:24:01.619 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7f9b4affd640 1 -- 10.20.193.93:0/3161296874 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f9b3c003140 con 0x7f9b54142a30 2026-02-22T23:24:01.619 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7f9b4affd640 1 -- 10.20.193.93:0/3161296874 <== mon.2 v1:10.20.193.93:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 378033482 0 0) 0x7f9b540af9c0 con 0x7f9b540b36c0 2026-02-22T23:24:01.619 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7f9b4affd640 1 -- 10.20.193.93:0/3161296874 >> v1:10.20.193.155:6789/0 conn(0x7f9b540b5be0 legacy=0x7f9b5413a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.619 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7f4852ffd640 1 -- 10.20.193.93:0/2633852002 --> v1:10.20.193.155:6813/3729844438 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f483c082e90 con 0x7f483c07f280 2026-02-22T23:24:01.619 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7f4852ffd640 1 -- 10.20.193.93:0/2633852002 <== mon.2 v1:10.20.193.93:6790/0 9 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (unknown 592526333 0 0) 0x7f485c094430 con 0x7f486c071f60 2026-02-22T23:24:01.620 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7f9b4affd640 1 -- 10.20.193.93:0/3161296874 >> v1:10.20.193.93:6789/0 conn(0x7f9b54142a30 legacy=0x7f9b541e6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.620 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7f9b4affd640 1 -- 10.20.193.93:0/3161296874 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b540ae190 con 0x7f9b540b36c0 2026-02-22T23:24:01.620 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7f9b58e96640 1 -- 10.20.193.93:0/3161296874 --> v1:10.20.193.93:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9b540ae6b0 con 0x7f9b540b36c0 2026-02-22T23:24:01.620 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7f9b4affd640 1 -- 10.20.193.93:0/3161296874 <== mon.2 v1:10.20.193.93:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9b44003a90 con 0x7f9b540b36c0 2026-02-22T23:24:01.620 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7f9b4affd640 1 -- 10.20.193.93:0/3161296874 <== mon.2 v1:10.20.193.93:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f9b44003e20 con 0x7f9b540b36c0 2026-02-22T23:24:01.620 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7f9b58e96640 1 -- 10.20.193.93:0/3161296874 --> v1:10.20.193.93:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f9b540addc0 con 0x7f9b540b36c0 2026-02-22T23:24:01.620 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7f9611f5c640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f960c0b20e0 con 0x7f960c145110 2026-02-22T23:24:01.620 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7fc05a274640 1 Processor -- start 2026-02-22T23:24:01.620 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7f9611f5c640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f960c0b0720 con 0x7f960c06cc40 2026-02-22T23:24:01.620 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7f54897fa640 1 -- 10.20.193.93:0/345825598 <== mon.1 v1:10.20.193.155:6789/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7f548401c0a0 con 0x7f54940b5c90 2026-02-22T23:24:01.620 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7f9611f5c640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f960c0b2350 con 0x7f960c06c860 2026-02-22T23:24:01.620 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7f960bfff640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7f960c145110 0x7f960c14cba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:46732/0 (socket says 10.20.193.93:46732) 2026-02-22T23:24:01.621 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7fc05a274640 1 -- start start 2026-02-22T23:24:01.621 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7f5daf7fe640 1 -- 10.20.193.93:0/2826536353 <== mon.2 v1:10.20.193.93:6790/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7f5dc0003b50 con 0x7f5dd01452d0 2026-02-22T23:24:01.621 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7f960bfff640 1 -- 10.20.193.93:0/1427895758 learned_addr learned my addr 10.20.193.93:0/1427895758 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:01.621 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7f06be35c640 1 -- 10.20.193.93:0/1508233223 shutdown_connections 2026-02-22T23:24:01.621 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7f06be35c640 1 -- 10.20.193.93:0/1508233223 >> 10.20.193.93:0/1508233223 conn(0x7f06b8068410 msgr2=0x7f06b8068820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:01.621 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7f06be35c640 1 -- 10.20.193.93:0/1508233223 shutdown_connections 2026-02-22T23:24:01.621 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7f06be35c640 1 -- 10.20.193.93:0/1508233223 wait complete. 2026-02-22T23:24:01.621 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7f5dd5387640 1 -- 10.20.193.93:0/2826536353 --> v1:10.20.193.93:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f5dd013d8a0 con 0x7f5dd01452d0 2026-02-22T23:24:01.621 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7f54897fa640 1 -- 10.20.193.93:0/345825598 <== mon.1 v1:10.20.193.155:6789/0 8 ==== osd_map(20..20 src has 1..20) ==== 4142+0+0 (unknown 2994938210 0 0) 0x7f5484092ea0 con 0x7f54940b5c90 2026-02-22T23:24:01.621 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7f54897fa640 1 -- 10.20.193.93:0/345825598 --> v1:10.20.193.93:6812/945702863 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5464082df0 con 0x7f546407f1e0 2026-02-22T23:24:01.621 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7f54897fa640 1 -- 10.20.193.93:0/345825598 <== mon.1 v1:10.20.193.155:6789/0 9 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (unknown 592526333 0 0) 0x7f5484093300 con 0x7f54940b5c90 2026-02-22T23:24:01.622 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7f960a7fc640 1 -- 10.20.193.93:0/1427895758 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 6773295 0 0) 0x7f960c0b20e0 con 0x7f960c145110 2026-02-22T23:24:01.622 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7f960a7fc640 1 -- 10.20.193.93:0/1427895758 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95f0003620 con 0x7f960c145110 2026-02-22T23:24:01.622 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7f960a7fc640 1 -- 10.20.193.93:0/1427895758 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 928274047 0 0) 0x7f960c0b2350 con 0x7f960c06c860 2026-02-22T23:24:01.622 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7f960a7fc640 1 -- 10.20.193.93:0/1427895758 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f960c0b20e0 con 0x7f960c06c860 2026-02-22T23:24:01.622 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7f960a7fc640 1 -- 10.20.193.93:0/1427895758 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 577248292 0 0) 0x7f960c0b0720 con 0x7f960c06cc40 2026-02-22T23:24:01.622 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7fbde7fff640 1 -- 10.20.193.93:0/4125047184 <== mon.1 v1:10.20.193.155:6789/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7fbe00003620 con 0x7fbe0c1419e0 2026-02-22T23:24:01.622 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7f9b58e96640 1 -- 10.20.193.93:0/3161296874 --> v1:10.20.193.93:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f9b54141030 con 0x7f9b540b36c0 2026-02-22T23:24:01.622 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7f960a7fc640 1 -- 10.20.193.93:0/1427895758 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f960c0b2350 con 0x7f960c06cc40 2026-02-22T23:24:01.622 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7f5daf7fe640 1 -- 10.20.193.93:0/2826536353 <== mon.2 v1:10.20.193.93:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 4142+0+0 (unknown 2994938210 0 0) 0x7f5dc00933c0 con 0x7f5dd01452d0 2026-02-22T23:24:01.623 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7f960a7fc640 1 -- 10.20.193.93:0/1427895758 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2217777960 0 0) 0x7f95f0003620 con 0x7f960c145110 2026-02-22T23:24:01.623 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7f960a7fc640 1 -- 10.20.193.93:0/1427895758 >> v1:10.20.193.93:6790/0 conn(0x7f960c06c860 legacy=0x7f960c0b0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.623 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7f960a7fc640 1 -- 10.20.193.93:0/1427895758 >> v1:10.20.193.155:6789/0 conn(0x7f960c06cc40 legacy=0x7f960c144a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.623 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7f960a7fc640 1 -- 10.20.193.93:0/1427895758 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f960c0b2630 con 0x7f960c145110 2026-02-22T23:24:01.623 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7f960a7fc640 1 -- 10.20.193.93:0/1427895758 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f9600003220 con 0x7f960c145110 2026-02-22T23:24:01.623 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7f5daf7fe640 1 -- 10.20.193.93:0/2826536353 --> v1:10.20.193.93:6800/4002367425 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5d9c082e40 con 0x7f5d9c07f230 2026-02-22T23:24:01.623 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7f5daf7fe640 1 -- 10.20.193.93:0/2826536353 <== mon.2 v1:10.20.193.93:6790/0 9 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (unknown 592526333 0 0) 0x7f5dc00937c0 con 0x7f5dd01452d0 2026-02-22T23:24:01.623 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7fc05a274640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0540af530 con 0x7fc0540adf80 2026-02-22T23:24:01.623 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7fc05a274640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0540af810 con 0x7fc0540b5be0 2026-02-22T23:24:01.623 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7fc05a274640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0540afaf0 con 0x7fc0540b36c0 2026-02-22T23:24:01.623 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7f960a7fc640 1 -- 10.20.193.93:0/1427895758 <== mon.0 v1:10.20.193.93:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f96000033c0 con 0x7f960c145110 2026-02-22T23:24:01.623 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7f960a7fc640 1 -- 10.20.193.93:0/1427895758 <== mon.0 v1:10.20.193.93:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f9600003790 con 0x7f960c145110 2026-02-22T23:24:01.623 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7fc053fff640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7fc0540adf80 0x7fc0541e60e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:46746/0 (socket says 10.20.193.93:46746) 2026-02-22T23:24:01.623 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.593+0000 7fc053fff640 1 -- 10.20.193.93:0/1140435118 learned_addr learned my addr 10.20.193.93:0/1140435118 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:01.623 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.594+0000 7fc02ffff640 1 -- 10.20.193.93:0/1140435118 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1468893299 0 0) 0x7fc0540af530 con 0x7fc0540adf80 2026-02-22T23:24:01.624 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.594+0000 7f06be35c640 1 Processor -- start 2026-02-22T23:24:01.624 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.594+0000 7fbde7fff640 1 -- 10.20.193.93:0/4125047184 <== mon.1 v1:10.20.193.155:6789/0 8 ==== osd_map(20..20 src has 1..20) ==== 4142+0+0 (unknown 2994938210 0 0) 0x7fbe00093040 con 0x7fbe0c1419e0 2026-02-22T23:24:01.624 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.594+0000 7fc02ffff640 1 -- 10.20.193.93:0/1140435118 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc024003620 con 0x7fc0540adf80 2026-02-22T23:24:01.624 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.594+0000 7fc02ffff640 1 -- 10.20.193.93:0/1140435118 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 119247921 0 0) 0x7fc0540afaf0 con 0x7fc0540b36c0 2026-02-22T23:24:01.624 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.594+0000 7f06be35c640 1 -- start start 2026-02-22T23:24:01.624 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.594+0000 7fc02ffff640 1 -- 10.20.193.93:0/1140435118 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0540af530 con 0x7fc0540b36c0 2026-02-22T23:24:01.624 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.594+0000 7fbde7fff640 1 -- 10.20.193.93:0/4125047184 --> v1:10.20.193.93:6806/3224090065 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbddc082c80 con 0x7fbddc07f070 2026-02-22T23:24:01.624 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.594+0000 7fbde7fff640 1 -- 10.20.193.93:0/4125047184 <== mon.1 v1:10.20.193.155:6789/0 9 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (unknown 592526333 0 0) 0x7fbe00093410 con 0x7fbe0c1419e0 2026-02-22T23:24:01.624 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.594+0000 7f9611f5c640 1 -- 10.20.193.93:0/1427895758 >> v1:10.20.193.93:6789/0 conn(0x7f960c145110 legacy=0x7f960c14cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.625 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.594+0000 7fc02ffff640 1 -- 10.20.193.93:0/1140435118 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1811493703 0 0) 0x7fc024003620 con 0x7fc0540adf80 2026-02-22T23:24:01.625 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.594+0000 7f9611f5c640 1 -- 10.20.193.93:0/1427895758 shutdown_connections 2026-02-22T23:24:01.625 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.594+0000 7f9611f5c640 1 -- 10.20.193.93:0/1427895758 >> 10.20.193.93:0/1427895758 conn(0x7f960c0b2cd0 msgr2=0x7f960c0b30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:01.625 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.594+0000 7fc02ffff640 1 -- 10.20.193.93:0/1140435118 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc0540afaf0 con 0x7fc0540adf80 2026-02-22T23:24:01.625 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.594+0000 7fc02ffff640 1 -- 10.20.193.93:0/1140435118 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fc0480034e0 con 0x7fc0540adf80 2026-02-22T23:24:01.625 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.594+0000 7f54897fa640 1 -- 10.20.193.93:0/345825598 <== osd.2 v1:10.20.193.93:6812/945702863 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7f5464082df0 con 0x7f546407f1e0 2026-02-22T23:24:01.625 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.594+0000 7f4852ffd640 1 -- 10.20.193.93:0/2633852002 <== osd.4 v1:10.20.193.155:6813/3729844438 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7f483c082e90 con 0x7f483c07f280 2026-02-22T23:24:01.625 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.594+0000 7fc02ffff640 1 -- 10.20.193.93:0/1140435118 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3152675112 0 0) 0x7fc0540af530 con 0x7fc0540b36c0 2026-02-22T23:24:01.625 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.594+0000 7f9b4affd640 1 -- 10.20.193.93:0/3161296874 <== mon.2 v1:10.20.193.93:6790/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7f9b44004040 con 0x7f9b540b36c0 2026-02-22T23:24:01.625 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.594+0000 7fc02ffff640 1 -- 10.20.193.93:0/1140435118 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc024003620 con 0x7fc0540b36c0 2026-02-22T23:24:01.626 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.594+0000 7fc02ffff640 1 -- 10.20.193.93:0/1140435118 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fc040003390 con 0x7fc0540b36c0 2026-02-22T23:24:01.626 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.594+0000 7f9b4affd640 1 -- 10.20.193.93:0/3161296874 <== mon.2 v1:10.20.193.93:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 4142+0+0 (unknown 2994938210 0 0) 0x7f9b440943f0 con 0x7f9b540b36c0 2026-02-22T23:24:01.626 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.594+0000 7f9611f5c640 1 -- 10.20.193.93:0/1427895758 shutdown_connections 2026-02-22T23:24:01.626 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.594+0000 7f5daf7fe640 1 -- 10.20.193.93:0/2826536353 <== osd.1 v1:10.20.193.93:6800/4002367425 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7f5d9c082e40 con 0x7f5d9c07f230 2026-02-22T23:24:01.626 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.594+0000 7fc02ffff640 1 -- 10.20.193.93:0/1140435118 <== mon.0 v1:10.20.193.93:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3509493449 0 0) 0x7fc0540afaf0 con 0x7fc0540adf80 2026-02-22T23:24:01.626 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.594+0000 7f9b4affd640 1 -- 10.20.193.93:0/3161296874 --> v1:10.20.193.93:6804/970700542 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9b28083040 con 0x7f9b2807f390 2026-02-22T23:24:01.626 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.594+0000 7f9b4affd640 1 -- 10.20.193.93:0/3161296874 <== mon.2 v1:10.20.193.93:6790/0 9 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (unknown 592526333 0 0) 0x7f9b44094800 con 0x7f9b540b36c0 2026-02-22T23:24:01.626 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.594+0000 7fc02ffff640 1 -- 10.20.193.93:0/1140435118 >> v1:10.20.193.93:6790/0 conn(0x7fc0540b36c0 legacy=0x7fc054142770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.626 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.594+0000 7fc02ffff640 1 -- 10.20.193.93:0/1140435118 >> v1:10.20.193.155:6789/0 conn(0x7fc0540b5be0 legacy=0x7fc05413a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.626 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.594+0000 7fc02ffff640 1 -- 10.20.193.93:0/1140435118 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc054142e80 con 0x7fc0540adf80 2026-02-22T23:24:01.627 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.594+0000 7fc05a274640 1 -- 10.20.193.93:0/1140435118 --> v1:10.20.193.93:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc0540ae980 con 0x7fc0540adf80 2026-02-22T23:24:01.627 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.594+0000 7fc05a274640 1 -- 10.20.193.93:0/1140435118 --> v1:10.20.193.93:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc0540adbc0 con 0x7fc0540adf80 2026-02-22T23:24:01.627 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.594+0000 7fc02ffff640 1 -- 10.20.193.93:0/1140435118 <== mon.0 v1:10.20.193.93:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc048003a90 con 0x7fc0540adf80 2026-02-22T23:24:01.627 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.594+0000 7f06be35c640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06b80ae6f0 con 0x7f06b813abe0 2026-02-22T23:24:01.627 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.594+0000 7fc02ffff640 1 -- 10.20.193.93:0/1140435118 <== mon.0 v1:10.20.193.93:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fc048003e60 con 0x7fc0540adf80 2026-02-22T23:24:01.627 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.594+0000 7f06be35c640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06b80af650 con 0x7f06b80b36c0 2026-02-22T23:24:01.627 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.594+0000 7f06be35c640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06b80af930 con 0x7f06b80b5be0 2026-02-22T23:24:01.627 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.594+0000 7f06b77fe640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7f06b80b5be0 0x7f06b813a4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:33916/0 (socket says 10.20.193.93:33916) 2026-02-22T23:24:01.627 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.594+0000 7f06b77fe640 1 -- 10.20.193.93:0/4086123206 learned_addr learned my addr 10.20.193.93:0/4086123206 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:01.627 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.594+0000 7fbde7fff640 1 -- 10.20.193.93:0/4125047184 <== osd.0 v1:10.20.193.93:6806/3224090065 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7fbddc082c80 con 0x7fbddc07f070 2026-02-22T23:24:01.627 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.595+0000 7f06b4ff9640 1 -- 10.20.193.93:0/4086123206 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3427365176 0 0) 0x7f06b80af930 con 0x7f06b80b5be0 2026-02-22T23:24:01.627 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.595+0000 7f06b4ff9640 1 -- 10.20.193.93:0/4086123206 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0688003620 con 0x7f06b80b5be0 2026-02-22T23:24:01.628 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.595+0000 7f06b4ff9640 1 -- 10.20.193.93:0/4086123206 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2359875894 0 0) 0x7f06b80af650 con 0x7f06b80b36c0 2026-02-22T23:24:01.628 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.595+0000 7f06b4ff9640 1 -- 10.20.193.93:0/4086123206 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06b80af930 con 0x7f06b80b36c0 2026-02-22T23:24:01.628 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.595+0000 7fc05a274640 1 -- 10.20.193.93:0/1140435118 --> v1:10.20.193.93:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fc0540b2f70 con 0x7fc0540adf80 2026-02-22T23:24:01.628 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.595+0000 7f06b4ff9640 1 -- 10.20.193.93:0/4086123206 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3741264345 0 0) 0x7f06b80ae6f0 con 0x7f06b813abe0 2026-02-22T23:24:01.628 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.595+0000 7f06b4ff9640 1 -- 10.20.193.93:0/4086123206 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06b80af650 con 0x7f06b813abe0 2026-02-22T23:24:01.628 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.594+0000 7f9611f5c640 1 -- 10.20.193.93:0/1427895758 wait complete. 2026-02-22T23:24:01.628 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.595+0000 7f9b4affd640 1 -- 10.20.193.93:0/3161296874 <== osd.3 v1:10.20.193.93:6804/970700542 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7f9b28083040 con 0x7f9b2807f390 2026-02-22T23:24:01.628 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.595+0000 7f9611f5c640 1 Processor -- start 2026-02-22T23:24:01.628 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.595+0000 7f9611f5c640 1 -- start start 2026-02-22T23:24:01.628 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.595+0000 7f9611f5c640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f960c13a2b0 con 0x7f960c06c860 2026-02-22T23:24:01.628 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.595+0000 7f9611f5c640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f960c13a590 con 0x7f960c145110 2026-02-22T23:24:01.628 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.595+0000 7f9611f5c640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f960c13a870 con 0x7f960c141c40 2026-02-22T23:24:01.628 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.595+0000 7f960bfff640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7f960c141c40 0x7f960c1ea0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:33932/0 (socket says 10.20.193.93:33932) 2026-02-22T23:24:01.628 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.595+0000 7f960bfff640 1 -- 10.20.193.93:0/1516202237 learned_addr learned my addr 10.20.193.93:0/1516202237 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:01.629 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.596+0000 7fc02ffff640 1 -- 10.20.193.93:0/1140435118 <== mon.0 v1:10.20.193.93:6789/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7fc048004000 con 0x7fc0540adf80 2026-02-22T23:24:01.629 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.596+0000 7f95e7fff640 1 -- 10.20.193.93:0/1516202237 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3069085654 0 0) 0x7f960c13a870 con 0x7f960c141c40 2026-02-22T23:24:01.629 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.596+0000 7f95e7fff640 1 -- 10.20.193.93:0/1516202237 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95dc003620 con 0x7f960c141c40 2026-02-22T23:24:01.629 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.596+0000 7f95e7fff640 1 -- 10.20.193.93:0/1516202237 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3098688072 0 0) 0x7f960c13a2b0 con 0x7f960c06c860 2026-02-22T23:24:01.629 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.596+0000 7f95e7fff640 1 -- 10.20.193.93:0/1516202237 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f960c13a870 con 0x7f960c06c860 2026-02-22T23:24:01.629 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.596+0000 7f95e7fff640 1 -- 10.20.193.93:0/1516202237 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 309395359 0 0) 0x7f95dc003620 con 0x7f960c141c40 2026-02-22T23:24:01.629 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.596+0000 7f95e7fff640 1 -- 10.20.193.93:0/1516202237 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f960c13a2b0 con 0x7f960c141c40 2026-02-22T23:24:01.629 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.596+0000 7f95e7fff640 1 -- 10.20.193.93:0/1516202237 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f9600003710 con 0x7f960c141c40 2026-02-22T23:24:01.629 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.596+0000 7f95e7fff640 1 -- 10.20.193.93:0/1516202237 <== mon.2 v1:10.20.193.93:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2249124281 0 0) 0x7f960c13a2b0 con 0x7f960c141c40 2026-02-22T23:24:01.629 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.596+0000 7f95e7fff640 1 -- 10.20.193.93:0/1516202237 >> v1:10.20.193.155:6789/0 conn(0x7f960c145110 legacy=0x7f960c1373a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T23:24:01.629 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.596+0000 7f95e7fff640 1 -- 10.20.193.93:0/1516202237 >> v1:10.20.193.93:6789/0 conn(0x7f960c06c860 legacy=0x7f960c13dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.629 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.596+0000 7f95e7fff640 1 -- 10.20.193.93:0/1516202237 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f960c1396f0 con 0x7f960c141c40 2026-02-22T23:24:01.629 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.596+0000 7f9611f5c640 1 -- 10.20.193.93:0/1516202237 --> v1:10.20.193.93:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f960c137ab0 con 0x7f960c141c40 2026-02-22T23:24:01.629 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.596+0000 7f95e7fff640 1 -- 10.20.193.93:0/1516202237 <== mon.2 v1:10.20.193.93:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9600002c30 con 0x7f960c141c40 2026-02-22T23:24:01.629 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.596+0000 7f9611f5c640 1 -- 10.20.193.93:0/1516202237 --> v1:10.20.193.93:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f960c13b000 con 0x7f960c141c40 2026-02-22T23:24:01.629 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.596+0000 7f95e7fff640 1 -- 10.20.193.93:0/1516202237 <== mon.2 v1:10.20.193.93:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f9600005210 con 0x7f960c141c40 2026-02-22T23:24:01.630 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.596+0000 7fc02ffff640 1 -- 10.20.193.93:0/1140435118 <== mon.0 v1:10.20.193.93:6789/0 8 ==== osd_map(20..20 src has 1..20) ==== 4142+0+0 (unknown 2994938210 0 0) 0x7fc048094530 con 0x7fc0540adf80 2026-02-22T23:24:01.630 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.596+0000 7fc02ffff640 1 -- 10.20.193.93:0/1140435118 --> v1:10.20.193.155:6805/4020397544 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc024082ce0 con 0x7fc02407f0d0 2026-02-22T23:24:01.630 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.596+0000 7fc02ffff640 1 -- 10.20.193.93:0/1140435118 <== mon.0 v1:10.20.193.93:6789/0 9 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (unknown 592526333 0 0) 0x7fc048094940 con 0x7fc0540adf80 2026-02-22T23:24:01.630 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.596+0000 7f9611f5c640 1 -- 10.20.193.93:0/1516202237 --> v1:10.20.193.93:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f960c14e0a0 con 0x7f960c141c40 2026-02-22T23:24:01.630 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.597+0000 7fc02ffff640 1 -- 10.20.193.93:0/1140435118 <== osd.6 v1:10.20.193.155:6805/4020397544 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7fc024082ce0 con 0x7fc02407f0d0 2026-02-22T23:24:01.630 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.597+0000 7f95e7fff640 1 -- 10.20.193.93:0/1516202237 <== mon.2 v1:10.20.193.93:6790/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7f960001da60 con 0x7f960c141c40 2026-02-22T23:24:01.630 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.598+0000 7f95e7fff640 1 -- 10.20.193.93:0/1516202237 <== mon.2 v1:10.20.193.93:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 4142+0+0 (unknown 2994938210 0 0) 0x7f9600094670 con 0x7f960c141c40 2026-02-22T23:24:01.630 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.598+0000 7f95e7fff640 1 -- 10.20.193.93:0/1516202237 --> v1:10.20.193.155:6801/2779097013 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f96000033c0 con 0x7f95dc07f100 2026-02-22T23:24:01.630 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.598+0000 7f95e7fff640 1 -- 10.20.193.93:0/1516202237 <== mon.2 v1:10.20.193.93:6790/0 9 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (unknown 592526333 0 0) 0x7f9600094a00 con 0x7f960c141c40 2026-02-22T23:24:01.631 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.599+0000 7f06b4ff9640 1 -- 10.20.193.93:0/4086123206 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1310046099 0 0) 0x7f06b80af930 con 0x7f06b80b36c0 2026-02-22T23:24:01.631 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.599+0000 7f06b4ff9640 1 -- 10.20.193.93:0/4086123206 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f06b80ae6f0 con 0x7f06b80b36c0 2026-02-22T23:24:01.631 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.599+0000 7f06b4ff9640 1 -- 10.20.193.93:0/4086123206 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 849971356 0 0) 0x7f0688003620 con 0x7f06b80b5be0 2026-02-22T23:24:01.631 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.599+0000 7f06b4ff9640 1 -- 10.20.193.93:0/4086123206 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f06b80af930 con 0x7f06b80b5be0 2026-02-22T23:24:01.631 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.599+0000 7f06b4ff9640 1 -- 10.20.193.93:0/4086123206 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1172667762 0 0) 0x7f06b80af650 con 0x7f06b813abe0 2026-02-22T23:24:01.631 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.599+0000 7f06b4ff9640 1 -- 10.20.193.93:0/4086123206 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0688003620 con 0x7f06b813abe0 2026-02-22T23:24:01.631 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.599+0000 7f06b4ff9640 1 -- 10.20.193.93:0/4086123206 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f06a4002fe0 con 0x7f06b80b36c0 2026-02-22T23:24:01.631 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.599+0000 7f06b4ff9640 1 -- 10.20.193.93:0/4086123206 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f06a8003390 con 0x7f06b80b5be0 2026-02-22T23:24:01.631 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.599+0000 7f06b4ff9640 1 -- 10.20.193.93:0/4086123206 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f06ac003020 con 0x7f06b813abe0 2026-02-22T23:24:01.631 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.600+0000 7f06b4ff9640 1 -- 10.20.193.93:0/4086123206 <== mon.2 v1:10.20.193.93:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 374936380 0 0) 0x7f06b80af930 con 0x7f06b80b5be0 2026-02-22T23:24:01.631 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.600+0000 7f06b4ff9640 1 -- 10.20.193.93:0/4086123206 >> v1:10.20.193.155:6789/0 conn(0x7f06b80b36c0 legacy=0x7f06b80adfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.631 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.600+0000 7f06b4ff9640 1 -- 10.20.193.93:0/4086123206 >> v1:10.20.193.93:6789/0 conn(0x7f06b813abe0 legacy=0x7f06b81ddba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.631 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.600+0000 7f06b4ff9640 1 -- 10.20.193.93:0/4086123206 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06b80ad2d0 con 0x7f06b80b5be0 2026-02-22T23:24:01.631 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.600+0000 7f06be35c640 1 -- 10.20.193.93:0/4086123206 --> v1:10.20.193.93:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f06b81de2b0 con 0x7f06b80b5be0 2026-02-22T23:24:01.631 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.600+0000 7f06b4ff9640 1 -- 10.20.193.93:0/4086123206 <== mon.2 v1:10.20.193.93:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f06a8004cf0 con 0x7f06b80b5be0 2026-02-22T23:24:01.631 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.600+0000 7f06be35c640 1 -- 10.20.193.93:0/4086123206 --> v1:10.20.193.93:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f06b81e6b70 con 0x7f06b80b5be0 2026-02-22T23:24:01.631 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.600+0000 7f06b4ff9640 1 -- 10.20.193.93:0/4086123206 <== mon.2 v1:10.20.193.93:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f06a8005040 con 0x7f06b80b5be0 2026-02-22T23:24:01.631 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.600+0000 7f06be35c640 1 -- 10.20.193.93:0/4086123206 --> v1:10.20.193.93:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f06b80ad5c0 con 0x7f06b80b5be0 2026-02-22T23:24:01.631 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.601+0000 7f06b4ff9640 1 -- 10.20.193.93:0/4086123206 <== mon.2 v1:10.20.193.93:6790/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7f06a801d670 con 0x7f06b80b5be0 2026-02-22T23:24:01.631 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.601+0000 7f549afb3640 1 -- 10.20.193.93:0/345825598 --> v1:10.20.193.93:6812/945702863 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f549413e2a0 con 0x7f546407f1e0 2026-02-22T23:24:01.631 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.601+0000 7f95e7fff640 1 -- 10.20.193.93:0/1516202237 <== osd.7 v1:10.20.193.155:6801/2779097013 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7f96000033c0 con 0x7f95dc07f100 2026-02-22T23:24:01.631 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.601+0000 7f4874553640 1 -- 10.20.193.93:0/2633852002 --> v1:10.20.193.155:6813/3729844438 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f486c13a4f0 con 0x7f483c07f280 2026-02-22T23:24:01.632 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.601+0000 7f54897fa640 1 -- 10.20.193.93:0/345825598 <== osd.2 v1:10.20.193.93:6812/945702863 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 3423592458) 0x7f549413e2a0 con 0x7f546407f1e0 2026-02-22T23:24:01.632 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.601+0000 7f4852ffd640 1 -- 10.20.193.93:0/2633852002 <== osd.4 v1:10.20.193.155:6813/3729844438 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 3423592458) 0x7f486c13a4f0 con 0x7f483c07f280 2026-02-22T23:24:01.632 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.601+0000 7f06b4ff9640 1 -- 10.20.193.93:0/4086123206 <== mon.2 v1:10.20.193.93:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 4142+0+0 (unknown 2994938210 0 0) 0x7f06a8094060 con 0x7f06b80b5be0 2026-02-22T23:24:01.632 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.601+0000 7f06b4ff9640 1 -- 10.20.193.93:0/4086123206 --> v1:10.20.193.155:6806/887979704 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f06a8003040 con 0x7f068807f5e0 2026-02-22T23:24:01.632 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.601+0000 7f06b4ff9640 1 -- 10.20.193.93:0/4086123206 <== mon.2 v1:10.20.193.93:6790/0 9 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (unknown 592526333 0 0) 0x7f06a8094460 con 0x7f06b80b5be0 2026-02-22T23:24:01.632 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.601+0000 7f4874553640 1 -- 10.20.193.93:0/2633852002 >> v1:10.20.193.155:6813/3729844438 conn(0x7f483c07f280 legacy=0x7f483c0816c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.632 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.601+0000 7f4874553640 1 -- 10.20.193.93:0/2633852002 >> v1:10.20.193.155:6800/3108481844 conn(0x7f483c0781f0 legacy=0x7f483c07a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.632 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.601+0000 7f4874553640 1 -- 10.20.193.93:0/2633852002 >> v1:10.20.193.93:6790/0 conn(0x7f486c071f60 legacy=0x7f486c1d8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.632 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.601+0000 7f4872ac9640 1 -- 10.20.193.93:0/2633852002 reap_dead start 2026-02-22T23:24:01.632 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.601+0000 7f549afb3640 1 -- 10.20.193.93:0/345825598 >> v1:10.20.193.93:6812/945702863 conn(0x7f546407f1e0 legacy=0x7f5464081620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.633 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.601+0000 7f4874553640 1 -- 10.20.193.93:0/2633852002 shutdown_connections 2026-02-22T23:24:01.633 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.601+0000 7f4874553640 1 -- 10.20.193.93:0/2633852002 >> 10.20.193.93:0/2633852002 conn(0x7f486c0b7000 msgr2=0x7f486c073060 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:01.633 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.601+0000 7f4874553640 1 -- 10.20.193.93:0/2633852002 shutdown_connections 2026-02-22T23:24:01.633 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.601+0000 7f4874553640 1 -- 10.20.193.93:0/2633852002 wait complete. 2026-02-22T23:24:01.633 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.601+0000 7f5dd5387640 1 -- 10.20.193.93:0/2826536353 --> v1:10.20.193.93:6800/4002367425 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5dd0138a50 con 0x7f5d9c07f230 2026-02-22T23:24:01.633 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.602+0000 7f549afb3640 1 -- 10.20.193.93:0/345825598 >> v1:10.20.193.155:6800/3108481844 conn(0x7f5464078150 legacy=0x7f546407a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.633 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.602+0000 7f549afb3640 1 -- 10.20.193.93:0/345825598 >> v1:10.20.193.155:6789/0 conn(0x7f54940b5c90 legacy=0x7f54941dda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.633 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.602+0000 7f5499529640 1 -- 10.20.193.93:0/345825598 reap_dead start 2026-02-22T23:24:01.633 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.602+0000 7f5daf7fe640 1 -- 10.20.193.93:0/2826536353 <== osd.1 v1:10.20.193.93:6800/4002367425 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 700469118) 0x7f5dd0138a50 con 0x7f5d9c07f230 2026-02-22T23:24:01.633 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.602+0000 7f549afb3640 1 -- 10.20.193.93:0/345825598 shutdown_connections 2026-02-22T23:24:01.633 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.602+0000 7f549afb3640 1 -- 10.20.193.93:0/345825598 >> 10.20.193.93:0/345825598 conn(0x7f5494068410 msgr2=0x7f54940b4610 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:01.633 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.602+0000 7f549afb3640 1 -- 10.20.193.93:0/345825598 shutdown_connections 2026-02-22T23:24:01.634 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.602+0000 7f549afb3640 1 -- 10.20.193.93:0/345825598 wait complete. 2026-02-22T23:24:01.634 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.602+0000 7f06b4ff9640 1 -- 10.20.193.93:0/4086123206 <== osd.5 v1:10.20.193.155:6806/887979704 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7f06a8003040 con 0x7f068807f5e0 2026-02-22T23:24:01.634 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.602+0000 7f5dd5387640 1 -- 10.20.193.93:0/2826536353 >> v1:10.20.193.93:6800/4002367425 conn(0x7f5d9c07f230 legacy=0x7f5d9c081670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.634 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.602+0000 7f5dd5387640 1 -- 10.20.193.93:0/2826536353 >> v1:10.20.193.155:6800/3108481844 conn(0x7f5d9c0781a0 legacy=0x7f5d9c07a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.634 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.603+0000 7f5dd5387640 1 -- 10.20.193.93:0/2826536353 >> v1:10.20.193.93:6790/0 conn(0x7f5dd01452d0 legacy=0x7f5dd01e0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.634 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.603+0000 7f5dcf7fe640 1 -- 10.20.193.93:0/2826536353 reap_dead start 2026-02-22T23:24:01.634 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.603+0000 7fbe1227c640 1 -- 10.20.193.93:0/4125047184 --> v1:10.20.193.93:6806/3224090065 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbe0c134a60 con 0x7fbddc07f070 2026-02-22T23:24:01.634 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.603+0000 7f5dd5387640 1 -- 10.20.193.93:0/2826536353 shutdown_connections 2026-02-22T23:24:01.634 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.603+0000 7f5dd5387640 1 -- 10.20.193.93:0/2826536353 >> 10.20.193.93:0/2826536353 conn(0x7f5dd00b1d30 msgr2=0x7f5dd006cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:01.634 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.603+0000 7f5dd5387640 1 -- 10.20.193.93:0/2826536353 shutdown_connections 2026-02-22T23:24:01.634 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.603+0000 7f5dd5387640 1 -- 10.20.193.93:0/2826536353 wait complete. 2026-02-22T23:24:01.634 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.603+0000 7fbde7fff640 1 -- 10.20.193.93:0/4125047184 <== osd.0 v1:10.20.193.93:6806/3224090065 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 3423592458) 0x7fbe0c134a60 con 0x7fbddc07f070 2026-02-22T23:24:01.635 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.603+0000 7fbe1227c640 1 -- 10.20.193.93:0/4125047184 >> v1:10.20.193.93:6806/3224090065 conn(0x7fbddc07f070 legacy=0x7fbddc0814b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.635 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.603+0000 7f9b58e96640 1 -- 10.20.193.93:0/3161296874 --> v1:10.20.193.93:6804/970700542 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9b540ad5d0 con 0x7f9b2807f390 2026-02-22T23:24:01.635 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.603+0000 7f9b4affd640 1 -- 10.20.193.93:0/3161296874 <== osd.3 v1:10.20.193.93:6804/970700542 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 3423592458) 0x7f9b540ad5d0 con 0x7f9b2807f390 2026-02-22T23:24:01.635 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.604+0000 7fbe1227c640 1 -- 10.20.193.93:0/4125047184 >> v1:10.20.193.155:6800/3108481844 conn(0x7fbddc078000 legacy=0x7fbddc07a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.635 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.604+0000 7fbe1227c640 1 -- 10.20.193.93:0/4125047184 >> v1:10.20.193.155:6789/0 conn(0x7fbe0c1419e0 legacy=0x7fbe0c1d5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.635 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.604+0000 7fbe0bfff640 1 -- 10.20.193.93:0/4125047184 reap_dead start 2026-02-22T23:24:01.635 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.604+0000 7fbe1227c640 1 -- 10.20.193.93:0/4125047184 shutdown_connections 2026-02-22T23:24:01.635 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.604+0000 7fbe1227c640 1 -- 10.20.193.93:0/4125047184 >> 10.20.193.93:0/4125047184 conn(0x7fbe0c0b1dd0 msgr2=0x7fbe0c13e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:01.635 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.604+0000 7fbe1227c640 1 -- 10.20.193.93:0/4125047184 shutdown_connections 2026-02-22T23:24:01.635 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.604+0000 7fbe1227c640 1 -- 10.20.193.93:0/4125047184 wait complete. 2026-02-22T23:24:01.635 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.604+0000 7f9b58e96640 1 -- 10.20.193.93:0/3161296874 >> v1:10.20.193.93:6804/970700542 conn(0x7f9b2807f390 legacy=0x7f9b280817d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.635 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.604+0000 7f9b58e96640 1 -- 10.20.193.93:0/3161296874 >> v1:10.20.193.155:6800/3108481844 conn(0x7f9b28078320 legacy=0x7f9b2807a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.635 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.604+0000 7f9b58e96640 1 -- 10.20.193.93:0/3161296874 >> v1:10.20.193.93:6790/0 conn(0x7f9b540b36c0 legacy=0x7f9b54142320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.636 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.604+0000 7f9b52d76640 1 -- 10.20.193.93:0/3161296874 reap_dead start 2026-02-22T23:24:01.636 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.604+0000 7fc05a274640 1 -- 10.20.193.93:0/1140435118 --> v1:10.20.193.155:6805/4020397544 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc054141030 con 0x7fc02407f0d0 2026-02-22T23:24:01.636 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.605+0000 7fc02ffff640 1 -- 10.20.193.93:0/1140435118 <== osd.6 v1:10.20.193.155:6805/4020397544 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 3423592458) 0x7fc054141030 con 0x7fc02407f0d0 2026-02-22T23:24:01.636 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.605+0000 7fc02dffb640 1 -- 10.20.193.93:0/1140435118 >> v1:10.20.193.155:6805/4020397544 conn(0x7fc02407f0d0 legacy=0x7fc024081510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.636 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.605+0000 7fc02dffb640 1 -- 10.20.193.93:0/1140435118 >> v1:10.20.193.155:6800/3108481844 conn(0x7fc024078040 legacy=0x7fc02407a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.636 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.605+0000 7fc02dffb640 1 -- 10.20.193.93:0/1140435118 >> v1:10.20.193.93:6789/0 conn(0x7fc0540adf80 legacy=0x7fc0541e60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.636 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.605+0000 7fc053fff640 1 -- 10.20.193.93:0/1140435118 reap_dead start 2026-02-22T23:24:01.636 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.605+0000 7f9b58e96640 1 -- 10.20.193.93:0/3161296874 shutdown_connections 2026-02-22T23:24:01.636 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.605+0000 7f9b58e96640 1 -- 10.20.193.93:0/3161296874 >> 10.20.193.93:0/3161296874 conn(0x7f9b54068410 msgr2=0x7f9b540b9960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:01.636 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.606+0000 7f9b58e96640 1 -- 10.20.193.93:0/3161296874 shutdown_connections 2026-02-22T23:24:01.636 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.606+0000 7f9b58e96640 1 -- 10.20.193.93:0/3161296874 wait complete. 2026-02-22T23:24:01.636 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.606+0000 7fc02dffb640 1 -- 10.20.193.93:0/1140435118 shutdown_connections 2026-02-22T23:24:01.636 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.606+0000 7fc02dffb640 1 -- 10.20.193.93:0/1140435118 >> 10.20.193.93:0/1140435118 conn(0x7fc054068410 msgr2=0x7fc0540b9960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:01.636 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.606+0000 7fc02dffb640 1 -- 10.20.193.93:0/1140435118 shutdown_connections 2026-02-22T23:24:01.636 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.606+0000 7fc02dffb640 1 -- 10.20.193.93:0/1140435118 wait complete. 2026-02-22T23:24:01.637 INFO:teuthology.orchestra.run.trial093.stdout:60129542147 2026-02-22T23:24:01.637 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-22T23:24:01.637 INFO:teuthology.orchestra.run.trial093.stdout:60129542147 2026-02-22T23:24:01.637 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-22T23:24:01.638 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.609+0000 7f9611f5c640 1 -- 10.20.193.93:0/1516202237 --> v1:10.20.193.155:6801/2779097013 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f960c0b10d0 con 0x7f95dc07f100 2026-02-22T23:24:01.638 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.609+0000 7f95e7fff640 1 -- 10.20.193.93:0/1516202237 <== osd.7 v1:10.20.193.155:6801/2779097013 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 700469118) 0x7f960c0b10d0 con 0x7f95dc07f100 2026-02-22T23:24:01.638 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.610+0000 7f9611f5c640 1 -- 10.20.193.93:0/1516202237 >> v1:10.20.193.155:6801/2779097013 conn(0x7f95dc07f100 legacy=0x7f95dc081540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.638 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.610+0000 7f9611f5c640 1 -- 10.20.193.93:0/1516202237 >> v1:10.20.193.155:6800/3108481844 conn(0x7f95dc078070 legacy=0x7f95dc07a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.638 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.610+0000 7f9611f5c640 1 -- 10.20.193.93:0/1516202237 >> v1:10.20.193.93:6790/0 conn(0x7f960c141c40 legacy=0x7f960c1ea0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.638 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.610+0000 7f960bfff640 1 -- 10.20.193.93:0/1516202237 reap_dead start 2026-02-22T23:24:01.638 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.610+0000 7f9611f5c640 1 -- 10.20.193.93:0/1516202237 shutdown_connections 2026-02-22T23:24:01.638 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.610+0000 7f9611f5c640 1 -- 10.20.193.93:0/1516202237 >> 10.20.193.93:0/1516202237 conn(0x7f960c0b2cd0 msgr2=0x7f960c143820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:01.638 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.610+0000 7f9611f5c640 1 -- 10.20.193.93:0/1516202237 shutdown_connections 2026-02-22T23:24:01.638 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.610+0000 7f9611f5c640 1 -- 10.20.193.93:0/1516202237 wait complete. 2026-02-22T23:24:01.638 INFO:teuthology.orchestra.run.trial093.stdout:55834574852 2026-02-22T23:24:01.638 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.610+0000 7f06be35c640 1 -- 10.20.193.93:0/4086123206 --> v1:10.20.193.155:6806/887979704 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f06b81dd7c0 con 0x7f068807f5e0 2026-02-22T23:24:01.639 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-22T23:24:01.639 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.611+0000 7f06b4ff9640 1 -- 10.20.193.93:0/4086123206 <== osd.5 v1:10.20.193.155:6806/887979704 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 3423592458) 0x7f06b81dd7c0 con 0x7f068807f5e0 2026-02-22T23:24:01.639 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.611+0000 7f06be35c640 1 -- 10.20.193.93:0/4086123206 >> v1:10.20.193.155:6806/887979704 conn(0x7f068807f5e0 legacy=0x7f0688081a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.639 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.611+0000 7f06be35c640 1 -- 10.20.193.93:0/4086123206 >> v1:10.20.193.155:6800/3108481844 conn(0x7f0688078550 legacy=0x7f068807aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.639 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.611+0000 7f06be35c640 1 -- 10.20.193.93:0/4086123206 >> v1:10.20.193.93:6790/0 conn(0x7f06b80b5be0 legacy=0x7f06b813a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.639 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.611+0000 7f06bc8d2640 1 -- 10.20.193.93:0/4086123206 reap_dead start 2026-02-22T23:24:01.639 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.611+0000 7f06be35c640 1 -- 10.20.193.93:0/4086123206 shutdown_connections 2026-02-22T23:24:01.639 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.611+0000 7f06be35c640 1 -- 10.20.193.93:0/4086123206 >> 10.20.193.93:0/4086123206 conn(0x7f06b8068410 msgr2=0x7f06b80b9960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:01.639 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.611+0000 7f06be35c640 1 -- 10.20.193.93:0/4086123206 shutdown_connections 2026-02-22T23:24:01.639 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.611+0000 7f06be35c640 1 -- 10.20.193.93:0/4086123206 wait complete. 2026-02-22T23:24:01.639 INFO:teuthology.orchestra.run.trial093.stdout:60129542147 2026-02-22T23:24:01.640 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-22T23:24:01.640 INFO:teuthology.orchestra.run.trial093.stdout:60129542147 2026-02-22T23:24:01.640 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-22T23:24:01.640 INFO:teuthology.orchestra.run.trial093.stdout:60129542147 2026-02-22T23:24:01.640 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2026-02-22T23:24:01.641 INFO:teuthology.orchestra.run.trial093.stdout:60129542147 2026-02-22T23:24:01.641 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-22T23:24:01.641 INFO:teuthology.orchestra.run.trial093.stdout:55834574852 2026-02-22T23:24:01.641 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2026-02-22T23:24:01.750 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.747+0000 7fbd9de53640 1 Processor -- start 2026-02-22T23:24:01.751 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.747+0000 7fe387555640 1 Processor -- start 2026-02-22T23:24:01.751 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.747+0000 7fbd9de53640 1 -- start start 2026-02-22T23:24:01.751 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.747+0000 7fe387555640 1 -- start start 2026-02-22T23:24:01.751 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.747+0000 7fc6e40b9640 1 Processor -- start 2026-02-22T23:24:01.751 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.747+0000 7fc6e40b9640 1 -- start start 2026-02-22T23:24:01.751 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.747+0000 7f3d9de43640 1 Processor -- start 2026-02-22T23:24:01.752 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.747+0000 7fa714b40640 1 Processor -- start 2026-02-22T23:24:01.752 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.747+0000 7f3d9de43640 1 -- start start 2026-02-22T23:24:01.752 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.747+0000 7fa714b40640 1 -- start start 2026-02-22T23:24:01.752 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.747+0000 7fbd9de53640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd98073dd0 con 0x7fbd981450e0 2026-02-22T23:24:01.752 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.747+0000 7fbd9de53640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd98074040 con 0x7fbd9813e650 2026-02-22T23:24:01.752 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.747+0000 7fbd9de53640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd98074320 con 0x7fbd9806dae0 2026-02-22T23:24:01.753 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.747+0000 7f157d13b640 1 Processor -- start 2026-02-22T23:24:01.753 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.747+0000 7fe387555640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3800ab160 con 0x7fe380140ec0 2026-02-22T23:24:01.753 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.747+0000 7fe387555640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3800aa8e0 con 0x7fe3800b6070 2026-02-22T23:24:01.753 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.747+0000 7fe387555640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3801474c0 con 0x7fe3800b5c90 2026-02-22T23:24:01.753 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.747+0000 7f157d13b640 1 -- start start 2026-02-22T23:24:01.753 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.747+0000 7fbd977fe640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7fbd9806dae0 0x7fbd981449d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:33946/0 (socket says 10.20.193.93:33946) 2026-02-22T23:24:01.753 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.747+0000 7fbd977fe640 1 -- 10.20.193.93:0/1272807541 learned_addr learned my addr 10.20.193.93:0/1272807541 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:01.753 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.747+0000 7fbd96ffd640 1 --1- 10.20.193.93:0/1272807541 >> v1:10.20.193.93:6789/0 conn(0x7fbd981450e0 0x7fbd9813df40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:46772/0 (socket says 10.20.193.93:46772) 2026-02-22T23:24:01.753 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.747+0000 7fe384ac9640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7fe380140ec0 0x7fe380146db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:46778/0 (socket says 10.20.193.93:46778) 2026-02-22T23:24:01.753 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.747+0000 7fe384ac9640 1 -- 10.20.193.93:0/3482957697 learned_addr learned my addr 10.20.193.93:0/3482957697 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:01.754 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7fc6e40b9640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6dc13ee30 con 0x7fc6dc144a00 2026-02-22T23:24:01.754 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7fc6e40b9640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6dc144de0 con 0x7fc6dc1452d0 2026-02-22T23:24:01.754 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7fc6e40b9640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6dc074040 con 0x7fc6dc13ea10 2026-02-22T23:24:01.754 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7fc6e1e2e640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7fc6dc144a00 0x7fc6dc0afa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:46782/0 (socket says 10.20.193.93:46782) 2026-02-22T23:24:01.754 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7fbd967fc640 1 -- 10.20.193.93:0/1272807541 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 369769592 0 0) 0x7fbd98074320 con 0x7fbd9806dae0 2026-02-22T23:24:01.754 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7fc6e1e2e640 1 -- 10.20.193.93:0/1539399519 learned_addr learned my addr 10.20.193.93:0/1539399519 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:01.754 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7fbd967fc640 1 -- 10.20.193.93:0/1272807541 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd7c003620 con 0x7fbd9806dae0 2026-02-22T23:24:01.754 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7fe36ffff640 1 -- 10.20.193.93:0/3482957697 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 724599397 0 0) 0x7fe3800ab160 con 0x7fe380140ec0 2026-02-22T23:24:01.755 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7fbd967fc640 1 -- 10.20.193.93:0/1272807541 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3935952781 0 0) 0x7fbd98073dd0 con 0x7fbd981450e0 2026-02-22T23:24:01.755 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7fe36ffff640 1 -- 10.20.193.93:0/3482957697 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe368003620 con 0x7fe380140ec0 2026-02-22T23:24:01.755 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7fe36ffff640 1 -- 10.20.193.93:0/3482957697 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3832898505 0 0) 0x7fe3801474c0 con 0x7fe3800b5c90 2026-02-22T23:24:01.755 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7fbd967fc640 1 -- 10.20.193.93:0/1272807541 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd98074320 con 0x7fbd981450e0 2026-02-22T23:24:01.755 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7fe36ffff640 1 -- 10.20.193.93:0/3482957697 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3800ab160 con 0x7fe3800b5c90 2026-02-22T23:24:01.755 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7f3d9de43640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d98143cf0 con 0x7f3d980b5c00 2026-02-22T23:24:01.755 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7f3d9de43640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d980aa8e0 con 0x7f3d980ab0e0 2026-02-22T23:24:01.755 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7f62f8e0b640 1 Processor -- start 2026-02-22T23:24:01.756 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7f3d9de43640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d980aabc0 con 0x7f3d98140e90 2026-02-22T23:24:01.756 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7fe36ffff640 1 -- 10.20.193.93:0/3482957697 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2007303689 0 0) 0x7fe3800aa8e0 con 0x7fe3800b6070 2026-02-22T23:24:01.756 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7fe36ffff640 1 -- 10.20.193.93:0/3482957697 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3801474c0 con 0x7fe3800b6070 2026-02-22T23:24:01.756 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7fa714b40640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa710143cf0 con 0x7fa7100ab0e0 2026-02-22T23:24:01.756 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7fa714b40640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7100aa8e0 con 0x7fa710140e90 2026-02-22T23:24:01.756 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7fa714b40640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7100aabc0 con 0x7fa7100b5c00 2026-02-22T23:24:01.756 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7f62f8e0b640 1 -- start start 2026-02-22T23:24:01.756 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7fbd967fc640 1 -- 10.20.193.93:0/1272807541 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1327407967 0 0) 0x7fbd98074040 con 0x7fbd9813e650 2026-02-22T23:24:01.756 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7fbd967fc640 1 -- 10.20.193.93:0/1272807541 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd98073dd0 con 0x7fbd9813e650 2026-02-22T23:24:01.756 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7fc6e0e2c640 1 -- 10.20.193.93:0/1539399519 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 484291792 0 0) 0x7fc6cc002920 con 0x7fc6dc144a00 2026-02-22T23:24:01.757 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7fc6e0e2c640 1 -- 10.20.193.93:0/1539399519 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6c4003620 con 0x7fc6dc144a00 2026-02-22T23:24:01.757 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7fc6e0e2c640 1 -- 10.20.193.93:0/1539399519 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1728977265 0 0) 0x7fc6dc074040 con 0x7fc6dc13ea10 2026-02-22T23:24:01.757 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7fc6e0e2c640 1 -- 10.20.193.93:0/1539399519 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6cc002920 con 0x7fc6dc13ea10 2026-02-22T23:24:01.757 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7fe36ffff640 1 -- 10.20.193.93:0/3482957697 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1604120471 0 0) 0x7fe368003620 con 0x7fe380140ec0 2026-02-22T23:24:01.757 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7fe36ffff640 1 -- 10.20.193.93:0/3482957697 >> v1:10.20.193.93:6790/0 conn(0x7fe3800b5c90 legacy=0x7fe3801407b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.757 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7fa70e575640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7fa7100b5c00 0x7fa7101435e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:33972/0 (socket says 10.20.193.93:33972) 2026-02-22T23:24:01.757 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7fa70e575640 1 -- 10.20.193.93:0/1044918122 learned_addr learned my addr 10.20.193.93:0/1044918122 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:01.757 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7f157d13b640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1578147180 con 0x7f15780b5be0 2026-02-22T23:24:01.757 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7f157d13b640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15780b5fc0 con 0x7f15780aa8e0 2026-02-22T23:24:01.757 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7f157d13b640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15780b6190 con 0x7f15780b36c0 2026-02-22T23:24:01.757 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7fe36ffff640 1 -- 10.20.193.93:0/3482957697 >> v1:10.20.193.155:6789/0 conn(0x7fe3800b6070 legacy=0x7fe38014ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.757 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7fe36ffff640 1 -- 10.20.193.93:0/3482957697 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe380147690 con 0x7fe380140ec0 2026-02-22T23:24:01.758 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7f3d97fff640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7f3d98140e90 0x7f3d9814ee20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:33964/0 (socket says 10.20.193.93:33964) 2026-02-22T23:24:01.758 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7f3d96ffd640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7f3d980ab0e0 0x7f3d98140780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.93:45460/0 (socket says 10.20.193.93:45460) 2026-02-22T23:24:01.758 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7f3d97fff640 1 -- 10.20.193.93:0/256263522 learned_addr learned my addr 10.20.193.93:0/256263522 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:01.758 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7fbd967fc640 1 -- 10.20.193.93:0/1272807541 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 384970143 0 0) 0x7fbd7c003620 con 0x7fbd9806dae0 2026-02-22T23:24:01.758 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7fbd967fc640 1 -- 10.20.193.93:0/1272807541 >> v1:10.20.193.155:6789/0 conn(0x7fbd9813e650 legacy=0x7fbd9814cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.758 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7fe36ffff640 1 -- 10.20.193.93:0/3482957697 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fe374002ea0 con 0x7fe380140ec0 2026-02-22T23:24:01.758 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7fbd967fc640 1 -- 10.20.193.93:0/1272807541 >> v1:10.20.193.93:6789/0 conn(0x7fbd981450e0 legacy=0x7fbd9813df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.758 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7fbd967fc640 1 -- 10.20.193.93:0/1272807541 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd980724d0 con 0x7fbd9806dae0 2026-02-22T23:24:01.758 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7fbd967fc640 1 -- 10.20.193.93:0/1272807541 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fbd84002ea0 con 0x7fbd9806dae0 2026-02-22T23:24:01.758 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7f1576d76640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7f15780b5be0 0x7f1578146a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:46802/0 (socket says 10.20.193.93:46802) 2026-02-22T23:24:01.758 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7f1576d76640 1 -- 10.20.193.93:0/1448385642 learned_addr learned my addr 10.20.193.93:0/1448385642 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:01.759 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7fe36ffff640 1 -- 10.20.193.93:0/3482957697 <== mon.0 v1:10.20.193.93:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe3740030c0 con 0x7fe380140ec0 2026-02-22T23:24:01.759 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7fe36ffff640 1 -- 10.20.193.93:0/3482957697 <== mon.0 v1:10.20.193.93:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fe374003510 con 0x7fe380140ec0 2026-02-22T23:24:01.759 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7f1575d74640 1 -- 10.20.193.93:0/1448385642 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2332691168 0 0) 0x7f1578147180 con 0x7f15780b5be0 2026-02-22T23:24:01.759 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7f1575d74640 1 -- 10.20.193.93:0/1448385642 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1558003620 con 0x7f15780b5be0 2026-02-22T23:24:01.759 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7fc6e0e2c640 1 -- 10.20.193.93:0/1539399519 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3123518413 0 0) 0x7fc6c4003620 con 0x7fc6dc144a00 2026-02-22T23:24:01.759 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7fc6e0e2c640 1 -- 10.20.193.93:0/1539399519 >> v1:10.20.193.93:6790/0 conn(0x7fc6dc13ea10 legacy=0x7fc6dc14cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.759 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7fc6e0e2c640 1 -- 10.20.193.93:0/1539399519 >> v1:10.20.193.155:6789/0 conn(0x7fc6dc1452d0 legacy=0x7fc6dc13e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.759 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7fc6e0e2c640 1 -- 10.20.193.93:0/1539399519 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6dc074320 con 0x7fc6dc144a00 2026-02-22T23:24:01.759 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7fc6e0e2c640 1 -- 10.20.193.93:0/1539399519 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fc6cc003070 con 0x7fc6dc144a00 2026-02-22T23:24:01.759 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7f1575d74640 1 -- 10.20.193.93:0/1448385642 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2029042882 0 0) 0x7f15780b6190 con 0x7f15780b36c0 2026-02-22T23:24:01.760 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7fa70d573640 1 -- 10.20.193.93:0/1044918122 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 579921925 0 0) 0x7fa7100aabc0 con 0x7fa7100b5c00 2026-02-22T23:24:01.760 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7fa70d573640 1 -- 10.20.193.93:0/1044918122 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6fc003620 con 0x7fa7100b5c00 2026-02-22T23:24:01.760 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7fa70d573640 1 -- 10.20.193.93:0/1044918122 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3008809381 0 0) 0x7fa710143cf0 con 0x7fa7100ab0e0 2026-02-22T23:24:01.760 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7fbd967fc640 1 -- 10.20.193.93:0/1272807541 <== mon.2 v1:10.20.193.93:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbd84003040 con 0x7fbd9806dae0 2026-02-22T23:24:01.760 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7fbd967fc640 1 -- 10.20.193.93:0/1272807541 <== mon.2 v1:10.20.193.93:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fbd84003450 con 0x7fbd9806dae0 2026-02-22T23:24:01.760 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7f3d967fc640 1 -- 10.20.193.93:0/256263522 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 112191054 0 0) 0x7f3d980aa8e0 con 0x7f3d980ab0e0 2026-02-22T23:24:01.760 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7f1575d74640 1 -- 10.20.193.93:0/1448385642 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1578147180 con 0x7f15780b36c0 2026-02-22T23:24:01.760 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7f1575d74640 1 -- 10.20.193.93:0/1448385642 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1035605879 0 0) 0x7f15780b5fc0 con 0x7f15780aa8e0 2026-02-22T23:24:01.760 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7f1575d74640 1 -- 10.20.193.93:0/1448385642 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15780b6190 con 0x7f15780aa8e0 2026-02-22T23:24:01.760 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7f1575d74640 1 -- 10.20.193.93:0/1448385642 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 264285551 0 0) 0x7f1558003620 con 0x7f15780b5be0 2026-02-22T23:24:01.760 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7f1575d74640 1 -- 10.20.193.93:0/1448385642 >> v1:10.20.193.93:6790/0 conn(0x7f15780b36c0 legacy=0x7f157814edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.760 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7f1575d74640 1 -- 10.20.193.93:0/1448385642 >> v1:10.20.193.155:6789/0 conn(0x7f15780aa8e0 legacy=0x7f1578140710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.761 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7fa70d573640 1 -- 10.20.193.93:0/1044918122 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7100aabc0 con 0x7fa7100ab0e0 2026-02-22T23:24:01.761 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7f1575d74640 1 -- 10.20.193.93:0/1448385642 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15780ab290 con 0x7f15780b5be0 2026-02-22T23:24:01.761 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7f1575d74640 1 -- 10.20.193.93:0/1448385642 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f1568003220 con 0x7f15780b5be0 2026-02-22T23:24:01.761 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7f3d967fc640 1 -- 10.20.193.93:0/256263522 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d7c003620 con 0x7f3d980ab0e0 2026-02-22T23:24:01.761 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7f3d967fc640 1 -- 10.20.193.93:0/256263522 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3069735314 0 0) 0x7f3d980aabc0 con 0x7f3d98140e90 2026-02-22T23:24:01.761 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7f3d967fc640 1 -- 10.20.193.93:0/256263522 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d980aa8e0 con 0x7f3d98140e90 2026-02-22T23:24:01.761 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7f3d967fc640 1 -- 10.20.193.93:0/256263522 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4267927963 0 0) 0x7f3d98143cf0 con 0x7f3d980b5c00 2026-02-22T23:24:01.761 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7f3d967fc640 1 -- 10.20.193.93:0/256263522 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d980aabc0 con 0x7f3d980b5c00 2026-02-22T23:24:01.761 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7fa70d573640 1 -- 10.20.193.93:0/1044918122 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2889880121 0 0) 0x7fa7100aa8e0 con 0x7fa710140e90 2026-02-22T23:24:01.761 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7fa70d573640 1 -- 10.20.193.93:0/1044918122 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa710143cf0 con 0x7fa710140e90 2026-02-22T23:24:01.761 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7f62f8e0b640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62f40acdb0 con 0x7f62f40b1490 2026-02-22T23:24:01.761 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7f62f8e0b640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62f40abf00 con 0x7f62f40aadd0 2026-02-22T23:24:01.762 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7f62f8e0b640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62f40ad090 con 0x7f62f40b08f0 2026-02-22T23:24:01.762 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7f1575d74640 1 -- 10.20.193.93:0/1448385642 <== mon.0 v1:10.20.193.93:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f15680033c0 con 0x7f15780b5be0 2026-02-22T23:24:01.762 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7f1575d74640 1 -- 10.20.193.93:0/1448385642 <== mon.0 v1:10.20.193.93:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f1568003810 con 0x7f15780b5be0 2026-02-22T23:24:01.762 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.748+0000 7f62f2d76640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7f62f40b1490 0x7f62f40b1900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:46822/0 (socket says 10.20.193.93:46822) 2026-02-22T23:24:01.762 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7f62f2d76640 1 -- 10.20.193.93:0/3126916253 learned_addr learned my addr 10.20.193.93:0/3126916253 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:01.762 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7f3d967fc640 1 -- 10.20.193.93:0/256263522 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 63525410 0 0) 0x7f3d7c003620 con 0x7f3d980ab0e0 2026-02-22T23:24:01.762 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7fc6e0e2c640 1 -- 10.20.193.93:0/1539399519 <== mon.0 v1:10.20.193.93:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc6cc003210 con 0x7fc6dc144a00 2026-02-22T23:24:01.762 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7fc6e0e2c640 1 -- 10.20.193.93:0/1539399519 <== mon.0 v1:10.20.193.93:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fc6cc0049a0 con 0x7fc6dc144a00 2026-02-22T23:24:01.762 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7f3d967fc640 1 -- 10.20.193.93:0/256263522 >> v1:10.20.193.93:6790/0 conn(0x7f3d98140e90 legacy=0x7f3d9814ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.763 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7f3d967fc640 1 -- 10.20.193.93:0/256263522 >> v1:10.20.193.93:6789/0 conn(0x7f3d980b5c00 legacy=0x7f3d981435e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.763 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7f3d967fc640 1 -- 10.20.193.93:0/256263522 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d980b37e0 con 0x7f3d980ab0e0 2026-02-22T23:24:01.763 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7f3d967fc640 1 -- 10.20.193.93:0/256263522 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f3d88002ea0 con 0x7f3d980ab0e0 2026-02-22T23:24:01.763 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7fa70d573640 1 -- 10.20.193.93:0/1044918122 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 806213336 0 0) 0x7fa710143cf0 con 0x7fa710140e90 2026-02-22T23:24:01.763 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7fa70d573640 1 -- 10.20.193.93:0/1044918122 >> v1:10.20.193.93:6790/0 conn(0x7fa7100b5c00 legacy=0x7fa7101435e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.763 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7fa70d573640 1 -- 10.20.193.93:0/1044918122 >> v1:10.20.193.93:6789/0 conn(0x7fa7100ab0e0 legacy=0x7fa710140780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.763 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7fa70d573640 1 -- 10.20.193.93:0/1044918122 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7100b37e0 con 0x7fa710140e90 2026-02-22T23:24:01.763 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7fe387555640 1 -- 10.20.193.93:0/3482957697 >> v1:10.20.193.93:6789/0 conn(0x7fe380140ec0 legacy=0x7fe380146db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.763 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7fa70d573640 1 -- 10.20.193.93:0/1044918122 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fa700003140 con 0x7fa710140e90 2026-02-22T23:24:01.763 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7f62f1573640 1 -- 10.20.193.93:0/3126916253 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2393693626 0 0) 0x7f62f40acdb0 con 0x7f62f40b1490 2026-02-22T23:24:01.764 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7fbd9de53640 1 -- 10.20.193.93:0/1272807541 >> v1:10.20.193.93:6790/0 conn(0x7fbd9806dae0 legacy=0x7fbd981449d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.764 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7f3d967fc640 1 -- 10.20.193.93:0/256263522 <== mon.1 v1:10.20.193.155:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3d88003040 con 0x7f3d980ab0e0 2026-02-22T23:24:01.764 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7f3d967fc640 1 -- 10.20.193.93:0/256263522 <== mon.1 v1:10.20.193.155:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f3d88003490 con 0x7f3d980ab0e0 2026-02-22T23:24:01.764 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7f157d13b640 1 -- 10.20.193.93:0/1448385642 >> v1:10.20.193.93:6789/0 conn(0x7f15780b5be0 legacy=0x7f1578146a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.764 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7fe387555640 1 -- 10.20.193.93:0/3482957697 shutdown_connections 2026-02-22T23:24:01.764 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7fe387555640 1 -- 10.20.193.93:0/3482957697 >> 10.20.193.93:0/3482957697 conn(0x7fe380068410 msgr2=0x7fe3800687f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:01.764 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7f62f1573640 1 -- 10.20.193.93:0/3126916253 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62e0003620 con 0x7f62f40b1490 2026-02-22T23:24:01.764 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7f62f1573640 1 -- 10.20.193.93:0/3126916253 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 529220809 0 0) 0x7f62f40ad090 con 0x7f62f40b08f0 2026-02-22T23:24:01.764 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7f62f1573640 1 -- 10.20.193.93:0/3126916253 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62f40acdb0 con 0x7f62f40b08f0 2026-02-22T23:24:01.765 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7f157d13b640 1 -- 10.20.193.93:0/1448385642 shutdown_connections 2026-02-22T23:24:01.765 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7f157d13b640 1 -- 10.20.193.93:0/1448385642 >> 10.20.193.93:0/1448385642 conn(0x7f1578068410 msgr2=0x7f1578068820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:01.765 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7fe387555640 1 -- 10.20.193.93:0/3482957697 shutdown_connections 2026-02-22T23:24:01.765 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7fa70d573640 1 -- 10.20.193.93:0/1044918122 <== mon.1 v1:10.20.193.155:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa7000032e0 con 0x7fa710140e90 2026-02-22T23:24:01.765 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7fa70d573640 1 -- 10.20.193.93:0/1044918122 <== mon.1 v1:10.20.193.155:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fa7000036f0 con 0x7fa710140e90 2026-02-22T23:24:01.765 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7f157d13b640 1 -- 10.20.193.93:0/1448385642 shutdown_connections 2026-02-22T23:24:01.765 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7f157d13b640 1 -- 10.20.193.93:0/1448385642 wait complete. 2026-02-22T23:24:01.765 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7f62f1573640 1 -- 10.20.193.93:0/3126916253 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2682252266 0 0) 0x7f62e0003620 con 0x7f62f40b1490 2026-02-22T23:24:01.765 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7f62f1573640 1 -- 10.20.193.93:0/3126916253 >> v1:10.20.193.93:6790/0 conn(0x7f62f40b08f0 legacy=0x7f62f40b0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.765 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7f62f1573640 1 -- 10.20.193.93:0/3126916253 >> v1:10.20.193.155:6789/0 conn(0x7f62f40aadd0 legacy=0x7f62f40ab1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.766 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7f62f1573640 1 -- 10.20.193.93:0/3126916253 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62f40ad870 con 0x7f62f40b1490 2026-02-22T23:24:01.766 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7f62f1573640 1 -- 10.20.193.93:0/3126916253 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f62e4003150 con 0x7f62f40b1490 2026-02-22T23:24:01.766 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7f3d9de43640 1 -- 10.20.193.93:0/256263522 >> v1:10.20.193.155:6789/0 conn(0x7f3d980ab0e0 legacy=0x7f3d98140780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.766 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7fbd9de53640 1 -- 10.20.193.93:0/1272807541 shutdown_connections 2026-02-22T23:24:01.766 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7fbd9de53640 1 -- 10.20.193.93:0/1272807541 >> 10.20.193.93:0/1272807541 conn(0x7fbd980b1d30 msgr2=0x7fbd980b2140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:01.766 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7fbd9de53640 1 -- 10.20.193.93:0/1272807541 shutdown_connections 2026-02-22T23:24:01.766 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7fc6e40b9640 1 -- 10.20.193.93:0/1539399519 >> v1:10.20.193.93:6789/0 conn(0x7fc6dc144a00 legacy=0x7fc6dc0afa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.766 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7f3d9de43640 1 -- 10.20.193.93:0/256263522 shutdown_connections 2026-02-22T23:24:01.766 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7f3d9de43640 1 -- 10.20.193.93:0/256263522 >> 10.20.193.93:0/256263522 conn(0x7f3d98068410 msgr2=0x7f3d980687f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:01.767 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7f62f1573640 1 -- 10.20.193.93:0/3126916253 <== mon.0 v1:10.20.193.93:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f62e40032f0 con 0x7f62f40b1490 2026-02-22T23:24:01.767 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7f62f1573640 1 -- 10.20.193.93:0/3126916253 <== mon.0 v1:10.20.193.93:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f62e4003780 con 0x7f62f40b1490 2026-02-22T23:24:01.767 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7f3d9de43640 1 -- 10.20.193.93:0/256263522 shutdown_connections 2026-02-22T23:24:01.767 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7fbd9de53640 1 -- 10.20.193.93:0/1272807541 wait complete. 2026-02-22T23:24:01.767 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7f3d9de43640 1 -- 10.20.193.93:0/256263522 wait complete. 2026-02-22T23:24:01.767 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7fc6e40b9640 1 -- 10.20.193.93:0/1539399519 shutdown_connections 2026-02-22T23:24:01.767 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7fc6e40b9640 1 -- 10.20.193.93:0/1539399519 >> 10.20.193.93:0/1539399519 conn(0x7fc6dc0b1d30 msgr2=0x7fc6dc0b2140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:01.767 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7fe387555640 1 -- 10.20.193.93:0/3482957697 wait complete. 2026-02-22T23:24:01.767 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7fc6e40b9640 1 -- 10.20.193.93:0/1539399519 shutdown_connections 2026-02-22T23:24:01.768 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7fa714b40640 1 -- 10.20.193.93:0/1044918122 >> v1:10.20.193.155:6789/0 conn(0x7fa710140e90 legacy=0x7fa71014ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.768 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7fc6e40b9640 1 -- 10.20.193.93:0/1539399519 wait complete. 2026-02-22T23:24:01.768 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7f62f8e0b640 1 -- 10.20.193.93:0/3126916253 >> v1:10.20.193.93:6789/0 conn(0x7f62f40b1490 legacy=0x7f62f40b1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.768 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7f157d13b640 1 Processor -- start 2026-02-22T23:24:01.768 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7f62f8e0b640 1 -- 10.20.193.93:0/3126916253 shutdown_connections 2026-02-22T23:24:01.768 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7f62f8e0b640 1 -- 10.20.193.93:0/3126916253 >> 10.20.193.93:0/3126916253 conn(0x7f62f40b5ef0 msgr2=0x7f62f40b6300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:01.768 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7f62f8e0b640 1 -- 10.20.193.93:0/3126916253 shutdown_connections 2026-02-22T23:24:01.768 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7f62f8e0b640 1 -- 10.20.193.93:0/3126916253 wait complete. 2026-02-22T23:24:01.769 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.749+0000 7f157d13b640 1 -- start start 2026-02-22T23:24:01.769 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7fa714b40640 1 -- 10.20.193.93:0/1044918122 shutdown_connections 2026-02-22T23:24:01.769 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7fa714b40640 1 -- 10.20.193.93:0/1044918122 >> 10.20.193.93:0/1044918122 conn(0x7fa710068410 msgr2=0x7fa7100687f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:01.769 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7fa714b40640 1 -- 10.20.193.93:0/1044918122 shutdown_connections 2026-02-22T23:24:01.769 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7fa714b40640 1 -- 10.20.193.93:0/1044918122 wait complete. 2026-02-22T23:24:01.769 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7fbd9de53640 1 Processor -- start 2026-02-22T23:24:01.769 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7f3d9de43640 1 Processor -- start 2026-02-22T23:24:01.769 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7f157d13b640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15781d03f0 con 0x7f1578137ad0 2026-02-22T23:24:01.769 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7f157d13b640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15781d1210 con 0x7f15780b36c0 2026-02-22T23:24:01.770 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7fbd9de53640 1 -- start start 2026-02-22T23:24:01.770 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7f157d13b640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15781d14f0 con 0x7f15780b5be0 2026-02-22T23:24:01.770 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7f1576575640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7f15780b5be0 0x7f15781373c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:34000/0 (socket says 10.20.193.93:34000) 2026-02-22T23:24:01.770 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7f1576575640 1 -- 10.20.193.93:0/2474842024 learned_addr learned my addr 10.20.193.93:0/2474842024 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:01.770 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7f1577577640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7f1578137ad0 0x7f1578144cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:46838/0 (socket says 10.20.193.93:46838) 2026-02-22T23:24:01.770 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7f15677fe640 1 -- 10.20.193.93:0/2474842024 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 632323577 0 0) 0x7f1578147180 con 0x7f1578137ad0 2026-02-22T23:24:01.770 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7f15677fe640 1 -- 10.20.193.93:0/2474842024 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f154c003620 con 0x7f1578137ad0 2026-02-22T23:24:01.770 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7fc6e40b9640 1 Processor -- start 2026-02-22T23:24:01.770 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7fc6e40b9640 1 -- start start 2026-02-22T23:24:01.770 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7f62f8e0b640 1 Processor -- start 2026-02-22T23:24:01.771 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7fe387555640 1 Processor -- start 2026-02-22T23:24:01.771 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7f15677fe640 1 -- 10.20.193.93:0/2474842024 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1449238974 0 0) 0x7f15781d14f0 con 0x7f15780b5be0 2026-02-22T23:24:01.771 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7f62f8e0b640 1 -- start start 2026-02-22T23:24:01.771 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7f3d9de43640 1 -- start start 2026-02-22T23:24:01.771 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7f15677fe640 1 -- 10.20.193.93:0/2474842024 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1578147180 con 0x7f15780b5be0 2026-02-22T23:24:01.771 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7f3d9de43640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d981462f0 con 0x7f3d980ab0e0 2026-02-22T23:24:01.771 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7f3d9de43640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d981465d0 con 0x7f3d980b5c00 2026-02-22T23:24:01.771 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7f3d9de43640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d981448e0 con 0x7f3d98140e90 2026-02-22T23:24:01.771 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7f3d97fff640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7f3d98140e90 0x7f3d981472e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:34008/0 (socket says 10.20.193.93:34008) 2026-02-22T23:24:01.771 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7f3d97fff640 1 -- 10.20.193.93:0/1280830858 learned_addr learned my addr 10.20.193.93:0/1280830858 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:01.772 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7f3d977fe640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7f3d980ab0e0 0x7f3d98132610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:46840/0 (socket says 10.20.193.93:46840) 2026-02-22T23:24:01.772 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7f15677fe640 1 -- 10.20.193.93:0/2474842024 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3640238936 0 0) 0x7f154c003620 con 0x7f1578137ad0 2026-02-22T23:24:01.772 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7fd251f6f640 1 Processor -- start 2026-02-22T23:24:01.772 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7f15677fe640 1 -- 10.20.193.93:0/2474842024 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f15781d14f0 con 0x7f1578137ad0 2026-02-22T23:24:01.772 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7f15677fe640 1 -- 10.20.193.93:0/2474842024 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f15600030c0 con 0x7f1578137ad0 2026-02-22T23:24:01.772 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7fbd9de53640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd9811d290 con 0x7fbd9813e650 2026-02-22T23:24:01.772 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7fbd9de53640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd980ae040 con 0x7fbd9806dae0 2026-02-22T23:24:01.772 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7fa714b40640 1 Processor -- start 2026-02-22T23:24:01.772 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7fbd9de53640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd980add00 con 0x7fbd981450e0 2026-02-22T23:24:01.773 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7f15677fe640 1 -- 10.20.193.93:0/2474842024 <== mon.0 v1:10.20.193.93:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 481584747 0 0) 0x7f15781d14f0 con 0x7f1578137ad0 2026-02-22T23:24:01.773 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7f15677fe640 1 -- 10.20.193.93:0/2474842024 >> v1:10.20.193.93:6790/0 conn(0x7f15780b5be0 legacy=0x7f15781373c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.773 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7f15677fe640 1 -- 10.20.193.93:0/2474842024 >> v1:10.20.193.155:6789/0 conn(0x7f15780b36c0 legacy=0x7f15781cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.773 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7fa714b40640 1 -- start start 2026-02-22T23:24:01.773 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7fbd977fe640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7fbd9806dae0 0x7fbd980acfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.93:45506/0 (socket says 10.20.193.93:45506) 2026-02-22T23:24:01.773 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7fbd977fe640 1 -- 10.20.193.93:0/1713508183 learned_addr learned my addr 10.20.193.93:0/1713508183 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:01.773 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7f15677fe640 1 -- 10.20.193.93:0/2474842024 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15781d0de0 con 0x7f1578137ad0 2026-02-22T23:24:01.773 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7f157d13b640 1 -- 10.20.193.93:0/2474842024 --> v1:10.20.193.93:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1578145400 con 0x7f1578137ad0 2026-02-22T23:24:01.773 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7f3d73fff640 1 -- 10.20.193.93:0/1280830858 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2834093852 0 0) 0x7f3d981462f0 con 0x7f3d980ab0e0 2026-02-22T23:24:01.774 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7f3d73fff640 1 -- 10.20.193.93:0/1280830858 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d68003620 con 0x7f3d980ab0e0 2026-02-22T23:24:01.774 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7f3d73fff640 1 -- 10.20.193.93:0/1280830858 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3119804940 0 0) 0x7f3d68003620 con 0x7f3d980ab0e0 2026-02-22T23:24:01.774 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7f3d73fff640 1 -- 10.20.193.93:0/1280830858 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3d981462f0 con 0x7f3d980ab0e0 2026-02-22T23:24:01.774 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7f3d73fff640 1 -- 10.20.193.93:0/1280830858 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f3d84003090 con 0x7f3d980ab0e0 2026-02-22T23:24:01.774 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7f3d73fff640 1 -- 10.20.193.93:0/1280830858 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4205882158 0 0) 0x7f3d981448e0 con 0x7f3d98140e90 2026-02-22T23:24:01.774 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7f3d73fff640 1 -- 10.20.193.93:0/1280830858 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d68003620 con 0x7f3d98140e90 2026-02-22T23:24:01.774 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7f157d13b640 1 -- 10.20.193.93:0/2474842024 --> v1:10.20.193.93:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1578145920 con 0x7f1578137ad0 2026-02-22T23:24:01.774 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fc6e40b9640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6dc141b30 con 0x7fc6dc1452d0 2026-02-22T23:24:01.774 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7f3d73fff640 1 -- 10.20.193.93:0/1280830858 <== mon.0 v1:10.20.193.93:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 494285950 0 0) 0x7f3d981462f0 con 0x7f3d980ab0e0 2026-02-22T23:24:01.774 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fc6e40b9640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6dc142050 con 0x7fc6dc13ea10 2026-02-22T23:24:01.774 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7f3d73fff640 1 -- 10.20.193.93:0/1280830858 >> v1:10.20.193.93:6790/0 conn(0x7f3d98140e90 legacy=0x7f3d981472e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.774 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7f3d73fff640 1 -- 10.20.193.93:0/1280830858 >> v1:10.20.193.155:6789/0 conn(0x7f3d980b5c00 legacy=0x7f3d98146bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.775 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fc6e162d640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7fc6dc144a00 0x7fc6dc13f010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:34010/0 (socket says 10.20.193.93:34010) 2026-02-22T23:24:01.775 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fc6e162d640 1 -- 10.20.193.93:0/4262370553 learned_addr learned my addr 10.20.193.93:0/4262370553 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:01.775 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fc6e40b9640 1 -- 10.20.193.93:0/4262370553 --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6dc0719e0 con 0x7fc6dc144a00 2026-02-22T23:24:01.775 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7f3d73fff640 1 -- 10.20.193.93:0/1280830858 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d98132d20 con 0x7f3d980ab0e0 2026-02-22T23:24:01.775 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7f3d9de43640 1 -- 10.20.193.93:0/1280830858 --> v1:10.20.193.93:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3d98144fa0 con 0x7f3d980ab0e0 2026-02-22T23:24:01.775 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7f3d9de43640 1 -- 10.20.193.93:0/1280830858 --> v1:10.20.193.93:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3d981355d0 con 0x7f3d980ab0e0 2026-02-22T23:24:01.775 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7fe387555640 1 -- start start 2026-02-22T23:24:01.775 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7f62f2575640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7f62f40aadd0 0x7f62f40730e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:34028/0 (socket says 10.20.193.93:34028) 2026-02-22T23:24:01.776 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7f62f2575640 1 -- 10.20.193.93:0/3346069587 learned_addr learned my addr 10.20.193.93:0/3346069587 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:01.776 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7f62f8e0b640 1 -- 10.20.193.93:0/3346069587 --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62f414cd70 con 0x7f62f40b08f0 2026-02-22T23:24:01.776 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7f62f8e0b640 1 -- 10.20.193.93:0/3346069587 --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62f414d5a0 con 0x7f62f40b1490 2026-02-22T23:24:01.776 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.750+0000 7fd251f6f640 1 -- start start 2026-02-22T23:24:01.776 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fd251f6f640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd24c13de60 con 0x7fd24c072060 2026-02-22T23:24:01.776 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fd251f6f640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd24c071810 con 0x7fd24c073cd0 2026-02-22T23:24:01.776 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fd251f6f640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd24c0b05a0 con 0x7fd24c0744d0 2026-02-22T23:24:01.776 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fe387555640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe380072cd0 con 0x7fe3800b6070 2026-02-22T23:24:01.776 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fe387555640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe380072fb0 con 0x7fe380140ec0 2026-02-22T23:24:01.776 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7f62f8e0b640 1 -- 10.20.193.93:0/3346069587 --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62f414d880 con 0x7f62f40aadd0 2026-02-22T23:24:01.777 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fd24bfff640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7fd24c072060 0x7fd24c14ba70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:46870/0 (socket says 10.20.193.93:46870) 2026-02-22T23:24:01.777 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fd24bfff640 1 -- 10.20.193.93:0/1450281943 learned_addr learned my addr 10.20.193.93:0/1450281943 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:01.777 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fe387555640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe380070b30 con 0x7fe3800b5c90 2026-02-22T23:24:01.777 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fe384ac9640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7fe3800b6070 0x7fe3801ead00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:46874/0 (socket says 10.20.193.93:46874) 2026-02-22T23:24:01.777 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fe384ac9640 1 -- 10.20.193.93:0/643652353 learned_addr learned my addr 10.20.193.93:0/643652353 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:01.777 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fa714b40640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7101d80d0 con 0x7fa710140e90 2026-02-22T23:24:01.777 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fa714b40640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7101d82a0 con 0x7fa7100b5c00 2026-02-22T23:24:01.777 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fa714b40640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa71013a330 con 0x7fa7100ab0e0 2026-02-22T23:24:01.777 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fbd73fff640 1 -- 10.20.193.93:0/1713508183 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1955537076 0 0) 0x7fbd980ae040 con 0x7fbd9806dae0 2026-02-22T23:24:01.777 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fbd73fff640 1 -- 10.20.193.93:0/1713508183 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd68003620 con 0x7fbd9806dae0 2026-02-22T23:24:01.777 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7f3d73fff640 1 -- 10.20.193.93:0/1280830858 <== mon.0 v1:10.20.193.93:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3d84003710 con 0x7f3d980ab0e0 2026-02-22T23:24:01.777 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7f3d73fff640 1 -- 10.20.193.93:0/1280830858 <== mon.0 v1:10.20.193.93:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f3d84003b20 con 0x7f3d980ab0e0 2026-02-22T23:24:01.778 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fc6ca7fc640 1 -- 10.20.193.93:0/4262370553 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4166630970 0 0) 0x7fc6dc141b30 con 0x7fc6dc1452d0 2026-02-22T23:24:01.778 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fc6ca7fc640 1 -- 10.20.193.93:0/4262370553 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6ac003620 con 0x7fc6dc1452d0 2026-02-22T23:24:01.778 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fbd73fff640 1 -- 10.20.193.93:0/1713508183 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1438198000 0 0) 0x7fbd9811d290 con 0x7fbd9813e650 2026-02-22T23:24:01.778 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fbd73fff640 1 -- 10.20.193.93:0/1713508183 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd980ae040 con 0x7fbd9813e650 2026-02-22T23:24:01.778 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fa70ed76640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7fa710140e90 0x7fa7101d79c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:46878/0 (socket says 10.20.193.93:46878) 2026-02-22T23:24:01.778 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fa70ed76640 1 -- 10.20.193.93:0/3094075415 learned_addr learned my addr 10.20.193.93:0/3094075415 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:01.778 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fd24a7fc640 1 -- 10.20.193.93:0/1450281943 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 391364863 0 0) 0x7fd24c071810 con 0x7fd24c073cd0 2026-02-22T23:24:01.778 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fd24a7fc640 1 -- 10.20.193.93:0/1450281943 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2300058b0 con 0x7fd24c073cd0 2026-02-22T23:24:01.778 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fd24a7fc640 1 -- 10.20.193.93:0/1450281943 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1344207531 0 0) 0x7fd24c13de60 con 0x7fd24c072060 2026-02-22T23:24:01.778 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fc6ca7fc640 1 -- 10.20.193.93:0/4262370553 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2273725164 0 0) 0x7fc6dc142050 con 0x7fc6dc13ea10 2026-02-22T23:24:01.778 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fc6ca7fc640 1 -- 10.20.193.93:0/4262370553 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6dc141b30 con 0x7fc6dc13ea10 2026-02-22T23:24:01.779 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fd24a7fc640 1 -- 10.20.193.93:0/1450281943 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd24c071810 con 0x7fd24c072060 2026-02-22T23:24:01.779 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fc6ca7fc640 1 -- 10.20.193.93:0/4262370553 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2062075347 0 0) 0x7fc6dc0719e0 con 0x7fc6dc144a00 2026-02-22T23:24:01.779 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fc6ca7fc640 1 -- 10.20.193.93:0/4262370553 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6dc142050 con 0x7fc6dc144a00 2026-02-22T23:24:01.779 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fd24a7fc640 1 -- 10.20.193.93:0/1450281943 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3706010382 0 0) 0x7fd24c0b05a0 con 0x7fd24c0744d0 2026-02-22T23:24:01.779 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fd24a7fc640 1 -- 10.20.193.93:0/1450281943 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd24c13de60 con 0x7fd24c0744d0 2026-02-22T23:24:01.779 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fbd73fff640 1 -- 10.20.193.93:0/1713508183 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2410946111 0 0) 0x7fbd68003620 con 0x7fbd9806dae0 2026-02-22T23:24:01.779 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7f157d13b640 1 -- 10.20.193.93:0/2474842024 --> v1:10.20.193.93:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15780b2f70 con 0x7f1578137ad0 2026-02-22T23:24:01.779 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fd24a7fc640 1 -- 10.20.193.93:0/1450281943 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1396635068 0 0) 0x7fd2300058b0 con 0x7fd24c073cd0 2026-02-22T23:24:01.779 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fd24a7fc640 1 -- 10.20.193.93:0/1450281943 >> v1:10.20.193.93:6790/0 conn(0x7fd24c0744d0 legacy=0x7fd24c140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.780 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fbd73fff640 1 -- 10.20.193.93:0/1713508183 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbd9811d290 con 0x7fbd9806dae0 2026-02-22T23:24:01.780 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fbd73fff640 1 -- 10.20.193.93:0/1713508183 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fbd84003390 con 0x7fbd9806dae0 2026-02-22T23:24:01.780 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fd24a7fc640 1 -- 10.20.193.93:0/1450281943 >> v1:10.20.193.93:6789/0 conn(0x7fd24c072060 legacy=0x7fd24c14ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.780 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fd24a7fc640 1 -- 10.20.193.93:0/1450281943 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd24c073260 con 0x7fd24c073cd0 2026-02-22T23:24:01.780 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fd24a7fc640 1 -- 10.20.193.93:0/1450281943 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fd238002ea0 con 0x7fd24c073cd0 2026-02-22T23:24:01.780 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7f15677fe640 1 -- 10.20.193.93:0/2474842024 <== mon.0 v1:10.20.193.93:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1560003710 con 0x7f1578137ad0 2026-02-22T23:24:01.780 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fc6ca7fc640 1 -- 10.20.193.93:0/4262370553 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 193097292 0 0) 0x7fc6dc141b30 con 0x7fc6dc13ea10 2026-02-22T23:24:01.780 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fc6ca7fc640 1 -- 10.20.193.93:0/4262370553 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc6dc0719e0 con 0x7fc6dc13ea10 2026-02-22T23:24:01.780 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fa6f6ffd640 1 -- 10.20.193.93:0/3094075415 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4150546434 0 0) 0x7fa71013a330 con 0x7fa7100ab0e0 2026-02-22T23:24:01.781 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7f15677fe640 1 -- 10.20.193.93:0/2474842024 <== mon.0 v1:10.20.193.93:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f1560003ba0 con 0x7f1578137ad0 2026-02-22T23:24:01.781 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fa6f6ffd640 1 -- 10.20.193.93:0/3094075415 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6dc003620 con 0x7fa7100ab0e0 2026-02-22T23:24:01.781 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fc6ca7fc640 1 -- 10.20.193.93:0/4262370553 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fc6cc003560 con 0x7fc6dc13ea10 2026-02-22T23:24:01.781 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fa6f6ffd640 1 -- 10.20.193.93:0/3094075415 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2586504127 0 0) 0x7fa7101d82a0 con 0x7fa7100b5c00 2026-02-22T23:24:01.781 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fa6f6ffd640 1 -- 10.20.193.93:0/3094075415 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa71013a330 con 0x7fa7100b5c00 2026-02-22T23:24:01.781 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fd24a7fc640 1 -- 10.20.193.93:0/1450281943 <== mon.1 v1:10.20.193.155:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd238003040 con 0x7fd24c073cd0 2026-02-22T23:24:01.781 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fd24a7fc640 1 -- 10.20.193.93:0/1450281943 <== mon.1 v1:10.20.193.155:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fd238003410 con 0x7fd24c073cd0 2026-02-22T23:24:01.781 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fe36dffb640 1 -- 10.20.193.93:0/643652353 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1191413876 0 0) 0x7fe380070b30 con 0x7fe3800b5c90 2026-02-22T23:24:01.781 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fe36dffb640 1 -- 10.20.193.93:0/643652353 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe350003620 con 0x7fe3800b5c90 2026-02-22T23:24:01.782 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fc6ca7fc640 1 -- 10.20.193.93:0/4262370553 <== mon.1 v1:10.20.193.155:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4124396704 0 0) 0x7fc6dc0719e0 con 0x7fc6dc13ea10 2026-02-22T23:24:01.782 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fc6ca7fc640 1 -- 10.20.193.93:0/4262370553 >> v1:10.20.193.93:6790/0 conn(0x7fc6dc144a00 legacy=0x7fc6dc13f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.782 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fc6ca7fc640 1 -- 10.20.193.93:0/4262370553 >> v1:10.20.193.93:6789/0 conn(0x7fc6dc1452d0 legacy=0x7fc6dc136310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.782 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fc6ca7fc640 1 -- 10.20.193.93:0/4262370553 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6dc071bb0 con 0x7fc6dc13ea10 2026-02-22T23:24:01.782 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fc6e40b9640 1 -- 10.20.193.93:0/4262370553 --> v1:10.20.193.155:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc6dc13f720 con 0x7fc6dc13ea10 2026-02-22T23:24:01.782 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fa6f6ffd640 1 -- 10.20.193.93:0/3094075415 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 251420447 0 0) 0x7fa71013a330 con 0x7fa7100b5c00 2026-02-22T23:24:01.782 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fa6f6ffd640 1 -- 10.20.193.93:0/3094075415 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa7101d82a0 con 0x7fa7100b5c00 2026-02-22T23:24:01.782 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fa6f6ffd640 1 -- 10.20.193.93:0/3094075415 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fa6f8003100 con 0x7fa7100b5c00 2026-02-22T23:24:01.782 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fc6e40b9640 1 -- 10.20.193.93:0/4262370553 --> v1:10.20.193.155:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc6dc0b4660 con 0x7fc6dc13ea10 2026-02-22T23:24:01.783 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.752+0000 7fa6f6ffd640 1 -- 10.20.193.93:0/3094075415 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 412400727 0 0) 0x7fa6dc003620 con 0x7fa7100ab0e0 2026-02-22T23:24:01.783 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.752+0000 7fa6f6ffd640 1 -- 10.20.193.93:0/3094075415 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa71013a330 con 0x7fa7100ab0e0 2026-02-22T23:24:01.783 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.752+0000 7fa6f6ffd640 1 -- 10.20.193.93:0/3094075415 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fa704003160 con 0x7fa7100ab0e0 2026-02-22T23:24:01.783 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fbd73fff640 1 -- 10.20.193.93:0/1713508183 <== mon.1 v1:10.20.193.155:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2137523572 0 0) 0x7fbd9811d290 con 0x7fbd9806dae0 2026-02-22T23:24:01.783 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fbd73fff640 1 -- 10.20.193.93:0/1713508183 >> v1:10.20.193.93:6790/0 conn(0x7fbd981450e0 legacy=0x7fbd981db5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.783 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fbd73fff640 1 -- 10.20.193.93:0/1713508183 >> v1:10.20.193.93:6789/0 conn(0x7fbd9813e650 legacy=0x7fbd9813a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.783 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fbd73fff640 1 -- 10.20.193.93:0/1713508183 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd980aeb00 con 0x7fbd9806dae0 2026-02-22T23:24:01.783 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fbd9de53640 1 -- 10.20.193.93:0/1713508183 --> v1:10.20.193.155:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbd9813a800 con 0x7fbd9806dae0 2026-02-22T23:24:01.783 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fbd9de53640 1 -- 10.20.193.93:0/1713508183 --> v1:10.20.193.155:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fbd981dbee0 con 0x7fbd9806dae0 2026-02-22T23:24:01.783 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fbd73fff640 1 -- 10.20.193.93:0/1713508183 <== mon.1 v1:10.20.193.155:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbd84004cf0 con 0x7fbd9806dae0 2026-02-22T23:24:01.783 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.751+0000 7fbd73fff640 1 -- 10.20.193.93:0/1713508183 <== mon.1 v1:10.20.193.155:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fbd84005040 con 0x7fbd9806dae0 2026-02-22T23:24:01.783 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.752+0000 7f62daffd640 1 -- 10.20.193.93:0/3346069587 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3620160581 0 0) 0x7f62f414cd70 con 0x7f62f40b08f0 2026-02-22T23:24:01.783 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.752+0000 7f3d9de43640 1 -- 10.20.193.93:0/1280830858 --> v1:10.20.193.93:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d980b8e20 con 0x7f3d980ab0e0 2026-02-22T23:24:01.783 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.752+0000 7fd251f6f640 1 -- 10.20.193.93:0/1450281943 >> v1:10.20.193.155:6789/0 conn(0x7fd24c073cd0 legacy=0x7fd24c0afe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.784 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.752+0000 7f62daffd640 1 -- 10.20.193.93:0/3346069587 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62c0003620 con 0x7f62f40b08f0 2026-02-22T23:24:01.784 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.752+0000 7f62daffd640 1 -- 10.20.193.93:0/3346069587 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4189528336 0 0) 0x7f62f40abf00 con 0x7f62f40aadd0 2026-02-22T23:24:01.784 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.752+0000 7f62daffd640 1 -- 10.20.193.93:0/3346069587 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62f414cd70 con 0x7f62f40aadd0 2026-02-22T23:24:01.784 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.752+0000 7fe36dffb640 1 -- 10.20.193.93:0/643652353 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 815802174 0 0) 0x7fe350003620 con 0x7fe3800b5c90 2026-02-22T23:24:01.784 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.752+0000 7fe36dffb640 1 -- 10.20.193.93:0/643652353 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe380070b30 con 0x7fe3800b5c90 2026-02-22T23:24:01.784 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.752+0000 7fe36dffb640 1 -- 10.20.193.93:0/643652353 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fe3700030c0 con 0x7fe3800b5c90 2026-02-22T23:24:01.784 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.752+0000 7fd251f6f640 1 -- 10.20.193.93:0/1450281943 shutdown_connections 2026-02-22T23:24:01.784 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.752+0000 7fd251f6f640 1 -- 10.20.193.93:0/1450281943 >> 10.20.193.93:0/1450281943 conn(0x7fd24c0b5ef0 msgr2=0x7fd24c0b6300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:01.784 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.752+0000 7fd251f6f640 1 -- 10.20.193.93:0/1450281943 shutdown_connections 2026-02-22T23:24:01.784 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.752+0000 7fc6ca7fc640 1 -- 10.20.193.93:0/4262370553 <== mon.1 v1:10.20.193.155:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc6cc0030f0 con 0x7fc6dc13ea10 2026-02-22T23:24:01.784 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.752+0000 7fc6ca7fc640 1 -- 10.20.193.93:0/4262370553 <== mon.1 v1:10.20.193.155:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fc6cc004d80 con 0x7fc6dc13ea10 2026-02-22T23:24:01.785 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.752+0000 7fa6f6ffd640 1 -- 10.20.193.93:0/3094075415 <== mon.1 v1:10.20.193.155:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 948201620 0 0) 0x7fa7101d82a0 con 0x7fa7100b5c00 2026-02-22T23:24:01.785 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.752+0000 7fa6f6ffd640 1 -- 10.20.193.93:0/3094075415 >> v1:10.20.193.93:6790/0 conn(0x7fa7100ab0e0 legacy=0x7fa7101de4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.785 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.752+0000 7fa6f6ffd640 1 -- 10.20.193.93:0/3094075415 >> v1:10.20.193.93:6789/0 conn(0x7fa710140e90 legacy=0x7fa7101d79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.785 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.752+0000 7fa6f6ffd640 1 -- 10.20.193.93:0/3094075415 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa71013a500 con 0x7fa7100b5c00 2026-02-22T23:24:01.785 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.752+0000 7fa714b40640 1 -- 10.20.193.93:0/3094075415 --> v1:10.20.193.155:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa710139e00 con 0x7fa7100b5c00 2026-02-22T23:24:01.785 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.752+0000 7fa714b40640 1 -- 10.20.193.93:0/3094075415 --> v1:10.20.193.155:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa7101de090 con 0x7fa7100b5c00 2026-02-22T23:24:01.785 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.752+0000 7fa6f6ffd640 1 -- 10.20.193.93:0/3094075415 <== mon.1 v1:10.20.193.155:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa6f8003550 con 0x7fa7100b5c00 2026-02-22T23:24:01.785 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.752+0000 7fe36dffb640 1 -- 10.20.193.93:0/643652353 <== mon.2 v1:10.20.193.93:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 660686403 0 0) 0x7fe380070b30 con 0x7fe3800b5c90 2026-02-22T23:24:01.785 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.752+0000 7fe36dffb640 1 -- 10.20.193.93:0/643652353 >> v1:10.20.193.155:6789/0 conn(0x7fe380140ec0 legacy=0x7fe3801eb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.786 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.752+0000 7fe36dffb640 1 -- 10.20.193.93:0/643652353 >> v1:10.20.193.93:6789/0 conn(0x7fe3800b6070 legacy=0x7fe3801ead00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.786 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.752+0000 7fe36dffb640 1 -- 10.20.193.93:0/643652353 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe380073e50 con 0x7fe3800b5c90 2026-02-22T23:24:01.786 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.752+0000 7fa6f6ffd640 1 -- 10.20.193.93:0/3094075415 <== mon.1 v1:10.20.193.155:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fa6f80039a0 con 0x7fa7100b5c00 2026-02-22T23:24:01.786 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.752+0000 7fe387555640 1 -- 10.20.193.93:0/643652353 --> v1:10.20.193.93:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe3801f31c0 con 0x7fe3800b5c90 2026-02-22T23:24:01.786 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.752+0000 7fe387555640 1 -- 10.20.193.93:0/643652353 --> v1:10.20.193.93:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fe3801f3570 con 0x7fe3800b5c90 2026-02-22T23:24:01.786 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.752+0000 7fe36dffb640 1 -- 10.20.193.93:0/643652353 <== mon.2 v1:10.20.193.93:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe370003710 con 0x7fe3800b5c90 2026-02-22T23:24:01.786 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.752+0000 7fe36dffb640 1 -- 10.20.193.93:0/643652353 <== mon.2 v1:10.20.193.93:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fe370003a60 con 0x7fe3800b5c90 2026-02-22T23:24:01.786 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.752+0000 7fc6e40b9640 1 -- 10.20.193.93:0/4262370553 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6dc13f9f0 con 0x7fc6dc13ea10 2026-02-22T23:24:01.786 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.752+0000 7f62daffd640 1 -- 10.20.193.93:0/3346069587 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1526180260 0 0) 0x7f62f40ad870 con 0x7f62f40b1490 2026-02-22T23:24:01.786 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.752+0000 7f62daffd640 1 -- 10.20.193.93:0/3346069587 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62f40abf00 con 0x7f62f40b1490 2026-02-22T23:24:01.786 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.752+0000 7fbd9de53640 1 -- 10.20.193.93:0/1713508183 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd9811d090 con 0x7fbd9806dae0 2026-02-22T23:24:01.787 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.752+0000 7fd251f6f640 1 -- 10.20.193.93:0/1450281943 wait complete. 2026-02-22T23:24:01.787 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.752+0000 7fd251f6f640 1 Processor -- start 2026-02-22T23:24:01.787 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.752+0000 7fd251f6f640 1 -- start start 2026-02-22T23:24:01.787 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.752+0000 7fa714b40640 1 -- 10.20.193.93:0/3094075415 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7100b7240 con 0x7fa7100b5c00 2026-02-22T23:24:01.787 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.752+0000 7f15677fe640 1 -- 10.20.193.93:0/2474842024 <== mon.0 v1:10.20.193.93:6789/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7f1560003d40 con 0x7f1578137ad0 2026-02-22T23:24:01.787 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.753+0000 7fe387555640 1 -- 10.20.193.93:0/643652353 --> v1:10.20.193.93:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe380070940 con 0x7fe3800b5c90 2026-02-22T23:24:01.787 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.753+0000 7f3d73fff640 1 -- 10.20.193.93:0/1280830858 <== mon.0 v1:10.20.193.93:6789/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7f3d84003cc0 con 0x7f3d980ab0e0 2026-02-22T23:24:01.787 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.753+0000 7f15677fe640 1 -- 10.20.193.93:0/2474842024 <== mon.0 v1:10.20.193.93:6789/0 8 ==== osd_map(20..20 src has 1..20) ==== 4142+0+0 (unknown 2994938210 0 0) 0x7f1560094150 con 0x7f1578137ad0 2026-02-22T23:24:01.788 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.753+0000 7fc6ca7fc640 1 -- 10.20.193.93:0/4262370553 <== mon.1 v1:10.20.193.155:6789/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7fc6cc01d550 con 0x7fc6dc13ea10 2026-02-22T23:24:01.788 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.753+0000 7fbd73fff640 1 -- 10.20.193.93:0/1713508183 <== mon.1 v1:10.20.193.155:6789/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7fbd8401d810 con 0x7fbd9806dae0 2026-02-22T23:24:01.788 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.753+0000 7fd251f6f640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd24c0abb40 con 0x7fd24c073cd0 2026-02-22T23:24:01.788 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.753+0000 7fd251f6f640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd24c0abe20 con 0x7fd24c0744d0 2026-02-22T23:24:01.788 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.753+0000 7fd251f6f640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd24c0ac100 con 0x7fd24c072060 2026-02-22T23:24:01.788 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.753+0000 7fd24b7fe640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7fd24c072060 0x7fd24c0aae00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:34056/0 (socket says 10.20.193.93:34056) 2026-02-22T23:24:01.788 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.753+0000 7fd24b7fe640 1 -- 10.20.193.93:0/1030951037 learned_addr learned my addr 10.20.193.93:0/1030951037 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:01.788 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.753+0000 7fc6ca7fc640 1 -- 10.20.193.93:0/4262370553 <== mon.1 v1:10.20.193.155:6789/0 8 ==== osd_map(20..20 src has 1..20) ==== 4142+0+0 (unknown 2994938210 0 0) 0x7fc6cc094150 con 0x7fc6dc13ea10 2026-02-22T23:24:01.788 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.753+0000 7fd227fff640 1 -- 10.20.193.93:0/1030951037 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2103880130 0 0) 0x7fd24c0ac100 con 0x7fd24c072060 2026-02-22T23:24:01.788 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.753+0000 7f62daffd640 1 -- 10.20.193.93:0/3346069587 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3112302427 0 0) 0x7f62f414cd70 con 0x7f62f40aadd0 2026-02-22T23:24:01.789 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.753+0000 7f62daffd640 1 -- 10.20.193.93:0/3346069587 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f62f40ad870 con 0x7f62f40aadd0 2026-02-22T23:24:01.789 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.753+0000 7fe36dffb640 1 -- 10.20.193.93:0/643652353 <== mon.2 v1:10.20.193.93:6790/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7fe37001c230 con 0x7fe3800b5c90 2026-02-22T23:24:01.789 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.753+0000 7f62daffd640 1 -- 10.20.193.93:0/3346069587 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f62e8003180 con 0x7f62f40aadd0 2026-02-22T23:24:01.789 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.753+0000 7fd227fff640 1 -- 10.20.193.93:0/1030951037 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd21c003620 con 0x7fd24c072060 2026-02-22T23:24:01.789 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.753+0000 7fbd73fff640 1 -- 10.20.193.93:0/1713508183 <== mon.1 v1:10.20.193.155:6789/0 8 ==== osd_map(20..20 src has 1..20) ==== 4142+0+0 (unknown 2994938210 0 0) 0x7fbd840942f0 con 0x7fbd9806dae0 2026-02-22T23:24:01.789 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.753+0000 7f3d73fff640 1 -- 10.20.193.93:0/1280830858 <== mon.0 v1:10.20.193.93:6789/0 8 ==== osd_map(20..20 src has 1..20) ==== 4142+0+0 (unknown 2994938210 0 0) 0x7f3d84094270 con 0x7f3d980ab0e0 2026-02-22T23:24:01.789 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.753+0000 7fa6f6ffd640 1 -- 10.20.193.93:0/3094075415 <== mon.1 v1:10.20.193.155:6789/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7fa6f8003b40 con 0x7fa7100b5c00 2026-02-22T23:24:01.789 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.754+0000 7fe36dffb640 1 -- 10.20.193.93:0/643652353 <== mon.2 v1:10.20.193.93:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 4142+0+0 (unknown 2994938210 0 0) 0x7fe370093090 con 0x7fe3800b5c90 2026-02-22T23:24:01.789 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.754+0000 7fa6f6ffd640 1 -- 10.20.193.93:0/3094075415 <== mon.1 v1:10.20.193.155:6789/0 8 ==== osd_map(20..20 src has 1..20) ==== 4142+0+0 (unknown 2994938210 0 0) 0x7fa6f8092fd0 con 0x7fa7100b5c00 2026-02-22T23:24:01.790 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.754+0000 7f15677fe640 1 -- 10.20.193.93:0/2474842024 <== mon.0 v1:10.20.193.93:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f15781d03f0 con 0x7f1578137ad0 2026-02-22T23:24:01.790 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.755+0000 7fc6ca7fc640 1 -- 10.20.193.93:0/4262370553 <== mon.1 v1:10.20.193.155:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7fc6dc13ee30 con 0x7fc6dc13ea10 2026-02-22T23:24:01.790 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.755+0000 7f62daffd640 1 -- 10.20.193.93:0/3346069587 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 117274378 0 0) 0x7f62f40abf00 con 0x7f62f40b1490 2026-02-22T23:24:01.790 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.755+0000 7f62daffd640 1 -- 10.20.193.93:0/3346069587 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f62f414cd70 con 0x7f62f40b1490 2026-02-22T23:24:01.790 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.755+0000 7f62daffd640 1 -- 10.20.193.93:0/3346069587 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f62e4003640 con 0x7f62f40b1490 2026-02-22T23:24:01.790 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.756+0000 7f62daffd640 1 -- 10.20.193.93:0/3346069587 <== mon.2 v1:10.20.193.93:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3890509541 0 0) 0x7f62f40ad870 con 0x7f62f40aadd0 2026-02-22T23:24:01.790 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.756+0000 7f62daffd640 1 -- 10.20.193.93:0/3346069587 >> v1:10.20.193.155:6789/0 conn(0x7f62f40b1490 legacy=0x7f62f41e5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.790 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.756+0000 7f62daffd640 1 -- 10.20.193.93:0/3346069587 >> v1:10.20.193.93:6789/0 conn(0x7f62f40b08f0 legacy=0x7f62f414bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.790 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.756+0000 7f62daffd640 1 -- 10.20.193.93:0/3346069587 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62f414cfe0 con 0x7f62f40aadd0 2026-02-22T23:24:01.790 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.756+0000 7fe36dffb640 1 -- 10.20.193.93:0/643652353 <== mon.2 v1:10.20.193.93:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7fe37005c890 con 0x7fe3800b5c90 2026-02-22T23:24:01.791 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.756+0000 7fd227fff640 1 -- 10.20.193.93:0/1030951037 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1636680578 0 0) 0x7fd21c003620 con 0x7fd24c072060 2026-02-22T23:24:01.791 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.756+0000 7fd227fff640 1 -- 10.20.193.93:0/1030951037 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd24c0ac100 con 0x7fd24c072060 2026-02-22T23:24:01.791 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.756+0000 7fd227fff640 1 -- 10.20.193.93:0/1030951037 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fd238003390 con 0x7fd24c072060 2026-02-22T23:24:01.791 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.756+0000 7fd227fff640 1 -- 10.20.193.93:0/1030951037 <== mon.2 v1:10.20.193.93:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1111000660 0 0) 0x7fd24c0ac100 con 0x7fd24c072060 2026-02-22T23:24:01.791 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.756+0000 7fd227fff640 1 -- 10.20.193.93:0/1030951037 >> v1:10.20.193.155:6789/0 conn(0x7fd24c0744d0 legacy=0x7fd24c1f2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.791 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.756+0000 7fd227fff640 1 -- 10.20.193.93:0/1030951037 >> v1:10.20.193.93:6789/0 conn(0x7fd24c073cd0 legacy=0x7fd24c141530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.791 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.756+0000 7fd227fff640 1 -- 10.20.193.93:0/1030951037 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd24c0ac3e0 con 0x7fd24c072060 2026-02-22T23:24:01.791 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.756+0000 7fd251f6f640 1 -- 10.20.193.93:0/1030951037 --> v1:10.20.193.93:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd24c143e80 con 0x7fd24c072060 2026-02-22T23:24:01.791 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.756+0000 7fd251f6f640 1 -- 10.20.193.93:0/1030951037 --> v1:10.20.193.93:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fd24c1f3930 con 0x7fd24c072060 2026-02-22T23:24:01.791 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.756+0000 7fd227fff640 1 -- 10.20.193.93:0/1030951037 <== mon.2 v1:10.20.193.93:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd238003020 con 0x7fd24c072060 2026-02-22T23:24:01.791 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.756+0000 7fd227fff640 1 -- 10.20.193.93:0/1030951037 <== mon.2 v1:10.20.193.93:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fd238003a60 con 0x7fd24c072060 2026-02-22T23:24:01.791 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.756+0000 7fd251f6f640 1 -- 10.20.193.93:0/1030951037 --> v1:10.20.193.93:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd24c0b4800 con 0x7fd24c072060 2026-02-22T23:24:01.791 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.757+0000 7f62f8e0b640 1 -- 10.20.193.93:0/3346069587 --> v1:10.20.193.93:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f62f414d2c0 con 0x7f62f40aadd0 2026-02-22T23:24:01.791 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.757+0000 7f62f8e0b640 1 -- 10.20.193.93:0/3346069587 --> v1:10.20.193.93:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f62f414b8c0 con 0x7f62f40aadd0 2026-02-22T23:24:01.792 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.757+0000 7f3d73fff640 1 -- 10.20.193.93:0/1280830858 <== mon.0 v1:10.20.193.93:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f3d8405da70 con 0x7f3d980ab0e0 2026-02-22T23:24:01.792 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.757+0000 7f62daffd640 1 -- 10.20.193.93:0/3346069587 <== mon.2 v1:10.20.193.93:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f62e8003710 con 0x7f62f40aadd0 2026-02-22T23:24:01.792 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.757+0000 7f62daffd640 1 -- 10.20.193.93:0/3346069587 <== mon.2 v1:10.20.193.93:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f62e8003a60 con 0x7f62f40aadd0 2026-02-22T23:24:01.792 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.757+0000 7fd227fff640 1 -- 10.20.193.93:0/1030951037 <== mon.2 v1:10.20.193.93:6790/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7fd238003c00 con 0x7fd24c072060 2026-02-22T23:24:01.792 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.757+0000 7f62f8e0b640 1 -- 10.20.193.93:0/3346069587 --> v1:10.20.193.93:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62f414b4f0 con 0x7f62f40aadd0 2026-02-22T23:24:01.792 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.757+0000 7fa6f6ffd640 1 -- 10.20.193.93:0/3094075415 <== mon.1 v1:10.20.193.155:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7fa6f805c7d0 con 0x7fa7100b5c00 2026-02-22T23:24:01.792 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.758+0000 7fd227fff640 1 -- 10.20.193.93:0/1030951037 <== mon.2 v1:10.20.193.93:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 4142+0+0 (unknown 2994938210 0 0) 0x7fd238094210 con 0x7fd24c072060 2026-02-22T23:24:01.792 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.758+0000 7f62daffd640 1 -- 10.20.193.93:0/3346069587 <== mon.2 v1:10.20.193.93:6790/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7f62e8003c80 con 0x7f62f40aadd0 2026-02-22T23:24:01.793 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.758+0000 7f62daffd640 1 -- 10.20.193.93:0/3346069587 <== mon.2 v1:10.20.193.93:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 4142+0+0 (unknown 2994938210 0 0) 0x7f62e8094200 con 0x7f62f40aadd0 2026-02-22T23:24:01.793 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.759+0000 7fbd73fff640 1 -- 10.20.193.93:0/1713508183 <== mon.1 v1:10.20.193.155:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7fbd8405daf0 con 0x7fbd9806dae0 2026-02-22T23:24:01.793 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.760+0000 7fd227fff640 1 -- 10.20.193.93:0/1030951037 <== mon.2 v1:10.20.193.93:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7fd23805da10 con 0x7fd24c072060 2026-02-22T23:24:01.793 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.762+0000 7f62daffd640 1 -- 10.20.193.93:0/3346069587 <== mon.2 v1:10.20.193.93:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f62f414d880 con 0x7f62f40aadd0 2026-02-22T23:24:01.848 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.845+0000 7f157d13b640 1 -- 10.20.193.93:0/2474842024 --> v1:10.20.193.93:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f1578076790 con 0x7f1578137ad0 2026-02-22T23:24:01.848 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.845+0000 7f15677fe640 1 -- 10.20.193.93:0/2474842024 <== mon.0 v1:10.20.193.93:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (unknown 1274345170 0 326014871) 0x7f156005d950 con 0x7f1578137ad0 2026-02-22T23:24:01.849 INFO:teuthology.orchestra.run.trial093.stdout:60129542146 2026-02-22T23:24:01.849 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.846+0000 7fe387555640 1 -- 10.20.193.93:0/643652353 --> v1:10.20.193.93:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fe380076790 con 0x7fe3800b5c90 2026-02-22T23:24:01.850 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.846+0000 7fe36dffb640 1 -- 10.20.193.93:0/643652353 <== mon.2 v1:10.20.193.93:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (unknown 1823589948 0 326014871) 0x7fe37005c190 con 0x7fe3800b5c90 2026-02-22T23:24:01.850 INFO:teuthology.orchestra.run.trial093.stdout:60129542146 2026-02-22T23:24:01.850 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.847+0000 7f157d13b640 1 -- 10.20.193.93:0/2474842024 >> v1:10.20.193.155:6800/3108481844 conn(0x7f154c077da0 legacy=0x7f154c07a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.850 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.847+0000 7f157d13b640 1 -- 10.20.193.93:0/2474842024 >> v1:10.20.193.93:6789/0 conn(0x7f1578137ad0 legacy=0x7f1578144cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.850 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.847+0000 7f157d13b640 1 -- 10.20.193.93:0/2474842024 shutdown_connections 2026-02-22T23:24:01.850 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.847+0000 7f157d13b640 1 -- 10.20.193.93:0/2474842024 >> 10.20.193.93:0/2474842024 conn(0x7f1578068410 msgr2=0x7f15780b9960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:01.850 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.847+0000 7f157d13b640 1 -- 10.20.193.93:0/2474842024 shutdown_connections 2026-02-22T23:24:01.850 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.847+0000 7f157d13b640 1 -- 10.20.193.93:0/2474842024 wait complete. 2026-02-22T23:24:01.851 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.847+0000 7f3d9de43640 1 -- 10.20.193.93:0/1280830858 --> v1:10.20.193.93:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f3d98076790 con 0x7f3d980ab0e0 2026-02-22T23:24:01.851 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.847+0000 7f3d73fff640 1 -- 10.20.193.93:0/1280830858 <== mon.0 v1:10.20.193.93:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (unknown 383520633 0 326014871) 0x7f3d8405d370 con 0x7f3d980ab0e0 2026-02-22T23:24:01.851 INFO:teuthology.orchestra.run.trial093.stdout:60129542146 2026-02-22T23:24:01.852 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.849+0000 7fe387555640 1 -- 10.20.193.93:0/643652353 >> v1:10.20.193.155:6800/3108481844 conn(0x7fe350078160 legacy=0x7fe35007a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.852 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.849+0000 7fe387555640 1 -- 10.20.193.93:0/643652353 >> v1:10.20.193.93:6790/0 conn(0x7fe3800b5c90 legacy=0x7fe380073740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.852 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.849+0000 7fe387555640 1 -- 10.20.193.93:0/643652353 shutdown_connections 2026-02-22T23:24:01.852 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.849+0000 7fe387555640 1 -- 10.20.193.93:0/643652353 >> 10.20.193.93:0/643652353 conn(0x7fe380068410 msgr2=0x7fe3800b4610 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:01.852 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.849+0000 7fe387555640 1 -- 10.20.193.93:0/643652353 shutdown_connections 2026-02-22T23:24:01.852 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.849+0000 7fe387555640 1 -- 10.20.193.93:0/643652353 wait complete. 2026-02-22T23:24:01.852 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.849+0000 7fa714b40640 1 -- 10.20.193.93:0/3094075415 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fa71013fea0 con 0x7fa7100b5c00 2026-02-22T23:24:01.852 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.849+0000 7fc6e40b9640 1 -- 10.20.193.93:0/4262370553 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fc6dc076960 con 0x7fc6dc13ea10 2026-02-22T23:24:01.853 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.849+0000 7f3d9de43640 1 -- 10.20.193.93:0/1280830858 >> v1:10.20.193.155:6800/3108481844 conn(0x7f3d68078120 legacy=0x7f3d6807a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.853 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.849+0000 7f3d9de43640 1 -- 10.20.193.93:0/1280830858 >> v1:10.20.193.93:6789/0 conn(0x7f3d980ab0e0 legacy=0x7f3d98132610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.853 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.849+0000 7fa6f6ffd640 1 -- 10.20.193.93:0/3094075415 <== mon.1 v1:10.20.193.155:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (unknown 92182286 0 326014871) 0x7fa6f805c0d0 con 0x7fa7100b5c00 2026-02-22T23:24:01.853 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.849+0000 7f3d9de43640 1 -- 10.20.193.93:0/1280830858 shutdown_connections 2026-02-22T23:24:01.853 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.849+0000 7f3d9de43640 1 -- 10.20.193.93:0/1280830858 >> 10.20.193.93:0/1280830858 conn(0x7f3d98068410 msgr2=0x7f3d980b99d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:01.853 INFO:teuthology.orchestra.run.trial093.stdout:60129542146 2026-02-22T23:24:01.853 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.849+0000 7f3d9de43640 1 -- 10.20.193.93:0/1280830858 shutdown_connections 2026-02-22T23:24:01.853 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.849+0000 7f3d9de43640 1 -- 10.20.193.93:0/1280830858 wait complete. 2026-02-22T23:24:01.854 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.849+0000 7fc6ca7fc640 1 -- 10.20.193.93:0/4262370553 <== mon.1 v1:10.20.193.155:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (unknown 1482059429 0 2439918515) 0x7fc6cc05d950 con 0x7fc6dc13ea10 2026-02-22T23:24:01.854 INFO:teuthology.orchestra.run.trial093.stdout:55834574850 2026-02-22T23:24:01.854 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.851+0000 7fc6e40b9640 1 -- 10.20.193.93:0/4262370553 >> v1:10.20.193.155:6800/3108481844 conn(0x7fc6ac078400 legacy=0x7fc6ac07a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.854 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.851+0000 7fc6e40b9640 1 -- 10.20.193.93:0/4262370553 >> v1:10.20.193.155:6789/0 conn(0x7fc6dc13ea10 legacy=0x7fc6dc141380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.854 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.851+0000 7fc6e40b9640 1 -- 10.20.193.93:0/4262370553 shutdown_connections 2026-02-22T23:24:01.854 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.851+0000 7fc6e40b9640 1 -- 10.20.193.93:0/4262370553 >> 10.20.193.93:0/4262370553 conn(0x7fc6dc0b1d30 msgr2=0x7fc6dc0b2110 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:01.854 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.851+0000 7fc6e40b9640 1 -- 10.20.193.93:0/4262370553 shutdown_connections 2026-02-22T23:24:01.854 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.851+0000 7fc6e40b9640 1 -- 10.20.193.93:0/4262370553 wait complete. 2026-02-22T23:24:01.854 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.851+0000 7fd251f6f640 1 -- 10.20.193.93:0/1030951037 --> v1:10.20.193.93:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fd24c144540 con 0x7fd24c072060 2026-02-22T23:24:01.855 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.851+0000 7fd227fff640 1 -- 10.20.193.93:0/1030951037 <== mon.2 v1:10.20.193.93:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (unknown 2131975755 0 326014871) 0x7fd23805d310 con 0x7fd24c072060 2026-02-22T23:24:01.855 INFO:teuthology.orchestra.run.trial093.stdout:60129542146 2026-02-22T23:24:01.855 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.852+0000 7fa714b40640 1 -- 10.20.193.93:0/3094075415 >> v1:10.20.193.155:6800/3108481844 conn(0x7fa6dc078130 legacy=0x7fa6dc07a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.855 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.852+0000 7fa714b40640 1 -- 10.20.193.93:0/3094075415 >> v1:10.20.193.155:6789/0 conn(0x7fa7100b5c00 legacy=0x7fa7101d72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.855 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.852+0000 7fa714b40640 1 -- 10.20.193.93:0/3094075415 shutdown_connections 2026-02-22T23:24:01.855 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.852+0000 7fa714b40640 1 -- 10.20.193.93:0/3094075415 >> 10.20.193.93:0/3094075415 conn(0x7fa710068410 msgr2=0x7fa71013f540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:01.855 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.852+0000 7fa714b40640 1 -- 10.20.193.93:0/3094075415 shutdown_connections 2026-02-22T23:24:01.855 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.852+0000 7fa714b40640 1 -- 10.20.193.93:0/3094075415 wait complete. 2026-02-22T23:24:01.856 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.852+0000 7fbd9de53640 1 -- 10.20.193.93:0/1713508183 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fbd981dc220 con 0x7fbd9806dae0 2026-02-22T23:24:01.856 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.852+0000 7fbd73fff640 1 -- 10.20.193.93:0/1713508183 <== mon.1 v1:10.20.193.155:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (unknown 574334944 0 326014871) 0x7fbd8405d3f0 con 0x7fbd9806dae0 2026-02-22T23:24:01.856 INFO:teuthology.orchestra.run.trial093.stdout:60129542146 2026-02-22T23:24:01.857 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.854+0000 7fd251f6f640 1 -- 10.20.193.93:0/1030951037 >> v1:10.20.193.155:6800/3108481844 conn(0x7fd21c078010 legacy=0x7fd21c07a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.857 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.854+0000 7fd251f6f640 1 -- 10.20.193.93:0/1030951037 >> v1:10.20.193.93:6790/0 conn(0x7fd24c072060 legacy=0x7fd24c0aae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.857 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.854+0000 7fd251f6f640 1 -- 10.20.193.93:0/1030951037 shutdown_connections 2026-02-22T23:24:01.857 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.854+0000 7fd251f6f640 1 -- 10.20.193.93:0/1030951037 >> 10.20.193.93:0/1030951037 conn(0x7fd24c0b5ef0 msgr2=0x7fd24c0b52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:01.857 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.854+0000 7fd251f6f640 1 -- 10.20.193.93:0/1030951037 shutdown_connections 2026-02-22T23:24:01.857 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.854+0000 7fd251f6f640 1 -- 10.20.193.93:0/1030951037 wait complete. 2026-02-22T23:24:01.857 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.854+0000 7fbd9de53640 1 -- 10.20.193.93:0/1713508183 >> v1:10.20.193.155:6800/3108481844 conn(0x7fbd68078120 legacy=0x7fbd6807a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.857 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.854+0000 7fbd9de53640 1 -- 10.20.193.93:0/1713508183 >> v1:10.20.193.155:6789/0 conn(0x7fbd9806dae0 legacy=0x7fbd980acfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.857 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.854+0000 7fbd9de53640 1 -- 10.20.193.93:0/1713508183 shutdown_connections 2026-02-22T23:24:01.858 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.854+0000 7fbd9de53640 1 -- 10.20.193.93:0/1713508183 >> 10.20.193.93:0/1713508183 conn(0x7fbd980b1d30 msgr2=0x7fbd981432e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:01.858 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.854+0000 7fbd9de53640 1 -- 10.20.193.93:0/1713508183 shutdown_connections 2026-02-22T23:24:01.858 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.855+0000 7fbd9de53640 1 -- 10.20.193.93:0/1713508183 wait complete. 2026-02-22T23:24:01.858 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.855+0000 7f62f8e0b640 1 -- 10.20.193.93:0/3346069587 --> v1:10.20.193.93:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f62f4069c60 con 0x7f62f40aadd0 2026-02-22T23:24:01.858 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.855+0000 7f62daffd640 1 -- 10.20.193.93:0/3346069587 <== mon.2 v1:10.20.193.93:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (unknown 832126871 0 2439918515) 0x7f62e805da60 con 0x7f62f40aadd0 2026-02-22T23:24:01.858 INFO:teuthology.orchestra.run.trial093.stdout:55834574850 2026-02-22T23:24:01.859 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542146 for osd.6 2026-02-22T23:24:01.861 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.858+0000 7f62f8e0b640 1 -- 10.20.193.93:0/3346069587 >> v1:10.20.193.155:6800/3108481844 conn(0x7f62c0078180 legacy=0x7f62c007a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.861 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.858+0000 7f62f8e0b640 1 -- 10.20.193.93:0/3346069587 >> v1:10.20.193.93:6790/0 conn(0x7f62f40aadd0 legacy=0x7f62f40730e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:01.861 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542146 for osd.3 2026-02-22T23:24:01.861 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.858+0000 7f62f8e0b640 1 -- 10.20.193.93:0/3346069587 shutdown_connections 2026-02-22T23:24:01.861 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.858+0000 7f62f8e0b640 1 -- 10.20.193.93:0/3346069587 >> 10.20.193.93:0/3346069587 conn(0x7f62f40b5ef0 msgr2=0x7f62f40ae320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:01.861 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.858+0000 7f62f8e0b640 1 -- 10.20.193.93:0/3346069587 shutdown_connections 2026-02-22T23:24:01.861 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:01.858+0000 7f62f8e0b640 1 -- 10.20.193.93:0/3346069587 wait complete. 2026-02-22T23:24:01.863 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542146 for osd.4 2026-02-22T23:24:01.865 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574850 for osd.7 2026-02-22T23:24:01.865 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542146 for osd.2 2026-02-22T23:24:01.866 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542146 for osd.5 2026-02-22T23:24:01.866 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542146 for osd.0 2026-02-22T23:24:01.869 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574850 for osd.1 2026-02-22T23:24:02.860 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2026-02-22T23:24:02.862 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-22T23:24:02.864 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-22T23:24:02.865 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2026-02-22T23:24:02.867 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-22T23:24:02.867 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-22T23:24:02.867 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-22T23:24:02.870 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-22T23:24:02.932 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.929+0000 7faed0ff7640 1 Processor -- start 2026-02-22T23:24:02.933 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.929+0000 7faed0ff7640 1 -- start start 2026-02-22T23:24:02.934 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.930+0000 7f4c16fed640 1 Processor -- start 2026-02-22T23:24:02.934 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.930+0000 7f4c16fed640 1 -- start start 2026-02-22T23:24:02.935 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.929+0000 7fc667af5640 1 Processor -- start 2026-02-22T23:24:02.935 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.929+0000 7fc667af5640 1 -- start start 2026-02-22T23:24:02.935 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.930+0000 7fc667af5640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6600acdb0 con 0x7fc6600b1490 2026-02-22T23:24:02.935 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.930+0000 7fc667af5640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6600abf00 con 0x7fc6600b08f0 2026-02-22T23:24:02.935 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.930+0000 7fc667af5640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6600ad090 con 0x7fc6600aadd0 2026-02-22T23:24:02.936 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.930+0000 7fc66586a640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7fc6600aadd0 0x7fc6600ab1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:34080/0 (socket says 10.20.193.93:34080) 2026-02-22T23:24:02.936 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.930+0000 7fc66586a640 1 -- 10.20.193.93:0/3958486848 learned_addr learned my addr 10.20.193.93:0/3958486848 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:02.936 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.930+0000 7fc664868640 1 -- 10.20.193.93:0/3958486848 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2694761300 0 0) 0x7fc6600ad090 con 0x7fc6600aadd0 2026-02-22T23:24:02.936 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.930+0000 7fc664868640 1 -- 10.20.193.93:0/3958486848 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc648003620 con 0x7fc6600aadd0 2026-02-22T23:24:02.936 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.930+0000 7faed0ff7640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faecc0ab160 con 0x7faecc140ec0 2026-02-22T23:24:02.936 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.930+0000 7faed0ff7640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faecc0aa8e0 con 0x7faecc0b6070 2026-02-22T23:24:02.936 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.930+0000 7faed0ff7640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faecc1474c0 con 0x7faecc0b5c90 2026-02-22T23:24:02.936 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.930+0000 7faec9d74640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7faecc140ec0 0x7faecc146db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:46890/0 (socket says 10.20.193.93:46890) 2026-02-22T23:24:02.937 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.930+0000 7faec9d74640 1 -- 10.20.193.93:0/2029600160 learned_addr learned my addr 10.20.193.93:0/2029600160 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:02.937 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.930+0000 7faec9573640 1 -- 10.20.193.93:0/2029600160 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1246417900 0 0) 0x7faecc0ab160 con 0x7faecc140ec0 2026-02-22T23:24:02.937 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.930+0000 7faec9573640 1 -- 10.20.193.93:0/2029600160 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faeb8003620 con 0x7faecc140ec0 2026-02-22T23:24:02.937 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.930+0000 7faec9573640 1 -- 10.20.193.93:0/2029600160 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 854518714 0 0) 0x7faecc1474c0 con 0x7faecc0b5c90 2026-02-22T23:24:02.937 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.930+0000 7faec9573640 1 -- 10.20.193.93:0/2029600160 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faecc0ab160 con 0x7faecc0b5c90 2026-02-22T23:24:02.937 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.930+0000 7faec9573640 1 -- 10.20.193.93:0/2029600160 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1477876809 0 0) 0x7faeb8003620 con 0x7faecc140ec0 2026-02-22T23:24:02.937 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.930+0000 7faec9573640 1 -- 10.20.193.93:0/2029600160 >> v1:10.20.193.93:6790/0 conn(0x7faecc0b5c90 legacy=0x7faecc1407b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:02.937 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.930+0000 7faec9573640 1 -- 10.20.193.93:0/2029600160 >> v1:10.20.193.155:6789/0 conn(0x7faecc0b6070 legacy=0x7faecc14ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:02.937 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.930+0000 7faec9573640 1 -- 10.20.193.93:0/2029600160 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faecc147690 con 0x7faecc140ec0 2026-02-22T23:24:02.937 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.930+0000 7faec9573640 1 -- 10.20.193.93:0/2029600160 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7faeb4002ea0 con 0x7faecc140ec0 2026-02-22T23:24:02.938 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.930+0000 7fc664868640 1 -- 10.20.193.93:0/3958486848 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 214632484 0 0) 0x7fc6600acdb0 con 0x7fc6600b1490 2026-02-22T23:24:02.938 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.930+0000 7fc664868640 1 -- 10.20.193.93:0/3958486848 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6600ad090 con 0x7fc6600b1490 2026-02-22T23:24:02.938 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.930+0000 7faec9573640 1 -- 10.20.193.93:0/2029600160 <== mon.0 v1:10.20.193.93:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7faeb40030c0 con 0x7faecc140ec0 2026-02-22T23:24:02.938 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.930+0000 7faec9573640 1 -- 10.20.193.93:0/2029600160 <== mon.0 v1:10.20.193.93:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7faeb4003550 con 0x7faecc140ec0 2026-02-22T23:24:02.939 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.930+0000 7fc664868640 1 -- 10.20.193.93:0/3958486848 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2152779029 0 0) 0x7fc648003620 con 0x7fc6600aadd0 2026-02-22T23:24:02.939 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.930+0000 7fc664868640 1 -- 10.20.193.93:0/3958486848 >> v1:10.20.193.155:6789/0 conn(0x7fc6600b08f0 legacy=0x7fc6600b0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:02.939 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.930+0000 7fc664868640 1 -- 10.20.193.93:0/3958486848 >> v1:10.20.193.93:6789/0 conn(0x7fc6600b1490 legacy=0x7fc6600b1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:02.940 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.930+0000 7fc664868640 1 -- 10.20.193.93:0/3958486848 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6600ad870 con 0x7fc6600aadd0 2026-02-22T23:24:02.940 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.930+0000 7fc664868640 1 -- 10.20.193.93:0/3958486848 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fc650002ea0 con 0x7fc6600aadd0 2026-02-22T23:24:02.940 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.930+0000 7f4c16fed640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c100ab160 con 0x7f4c100b6070 2026-02-22T23:24:02.940 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.930+0000 7f4c16fed640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c100aa8e0 con 0x7f4c10140ec0 2026-02-22T23:24:02.940 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.930+0000 7f4c16fed640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c101474c0 con 0x7f4c100b5c90 2026-02-22T23:24:02.941 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.930+0000 7f4c14d62640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7f4c100b5c90 0x7f4c101407b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:34094/0 (socket says 10.20.193.93:34094) 2026-02-22T23:24:02.941 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.930+0000 7f4c14d62640 1 -- 10.20.193.93:0/2687238324 learned_addr learned my addr 10.20.193.93:0/2687238324 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:02.941 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.930+0000 7fc664868640 1 -- 10.20.193.93:0/3958486848 <== mon.2 v1:10.20.193.93:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc6500030c0 con 0x7fc6600aadd0 2026-02-22T23:24:02.941 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.930+0000 7fc664868640 1 -- 10.20.193.93:0/3958486848 <== mon.2 v1:10.20.193.93:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fc650003510 con 0x7fc6600aadd0 2026-02-22T23:24:02.941 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.930+0000 7faed0ff7640 1 -- 10.20.193.93:0/2029600160 >> v1:10.20.193.93:6789/0 conn(0x7faecc140ec0 legacy=0x7faecc146db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:02.942 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.930+0000 7f4c15563640 1 -- 10.20.193.93:0/2687238324 >> v1:10.20.193.93:6789/0 conn(0x7f4c100b6070 legacy=0x7f4c1014ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2026-02-22T23:24:02.942 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.930+0000 7f4c15563640 1 -- 10.20.193.93:0/2687238324 >> v1:10.20.193.93:6789/0 conn(0x7f4c100b6070 legacy=0x7f4c1014ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T23:24:02.942 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.930+0000 7f4c15563640 1 --1- 10.20.193.93:0/2687238324 >> v1:10.20.193.93:6789/0 conn(0x7f4c100b6070 0x7f4c1014ede0 :-1 s=OPENED pgs=129 cs=1 l=1).handle_message read tag failed 2026-02-22T23:24:02.942 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.930+0000 7f4c15563640 1 --1- 10.20.193.93:0/2687238324 >> v1:10.20.193.93:6789/0 conn(0x7f4c100b6070 0x7f4c1014ede0 :-1 s=OPENED pgs=129 cs=1 l=1).fault on lossy channel, failing 2026-02-22T23:24:02.942 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.931+0000 7f4c077fe640 1 -- 10.20.193.93:0/2687238324 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4106363502 0 0) 0x7f4c101474c0 con 0x7f4c100b5c90 2026-02-22T23:24:02.943 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.931+0000 7faed0ff7640 1 -- 10.20.193.93:0/2029600160 shutdown_connections 2026-02-22T23:24:02.943 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.931+0000 7faed0ff7640 1 -- 10.20.193.93:0/2029600160 >> 10.20.193.93:0/2029600160 conn(0x7faecc068410 msgr2=0x7faecc0687f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:02.943 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.931+0000 7f4c077fe640 1 -- 10.20.193.93:0/2687238324 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4bfc003620 con 0x7f4c100b5c90 2026-02-22T23:24:02.944 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.931+0000 7faed0ff7640 1 -- 10.20.193.93:0/2029600160 shutdown_connections 2026-02-22T23:24:02.944 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.931+0000 7faed0ff7640 1 -- 10.20.193.93:0/2029600160 wait complete. 2026-02-22T23:24:02.944 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.931+0000 7fc667af5640 1 -- 10.20.193.93:0/3958486848 >> v1:10.20.193.93:6790/0 conn(0x7fc6600aadd0 legacy=0x7fc6600ab1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:02.944 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.931+0000 7fc667af5640 1 -- 10.20.193.93:0/3958486848 shutdown_connections 2026-02-22T23:24:02.944 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.931+0000 7fc667af5640 1 -- 10.20.193.93:0/3958486848 >> 10.20.193.93:0/3958486848 conn(0x7fc6600b5ef0 msgr2=0x7fc6600b6300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:02.945 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.931+0000 7f4c077fe640 1 -- 10.20.193.93:0/2687238324 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1932679256 0 0) 0x7f4bfc003620 con 0x7f4c100b5c90 2026-02-22T23:24:02.945 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.931+0000 7f4c077fe640 1 -- 10.20.193.93:0/2687238324 >> v1:10.20.193.155:6789/0 conn(0x7f4c10140ec0 legacy=0x7f4c10146db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:02.945 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.931+0000 7fc667af5640 1 -- 10.20.193.93:0/3958486848 shutdown_connections 2026-02-22T23:24:02.946 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.931+0000 7f4c077fe640 1 -- 10.20.193.93:0/2687238324 >> v1:10.20.193.93:6789/0 conn(0x7f4c100b6070 legacy=0x7f4c1014ede0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:24:02.946 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.931+0000 7fc667af5640 1 -- 10.20.193.93:0/3958486848 wait complete. 2026-02-22T23:24:02.946 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.931+0000 7f4c077fe640 1 -- 10.20.193.93:0/2687238324 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c10147690 con 0x7f4c100b5c90 2026-02-22T23:24:02.947 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.931+0000 7f4c077fe640 1 -- 10.20.193.93:0/2687238324 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f4c00002ea0 con 0x7f4c100b5c90 2026-02-22T23:24:02.947 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.931+0000 7f4c077fe640 1 -- 10.20.193.93:0/2687238324 <== mon.2 v1:10.20.193.93:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4c00003040 con 0x7f4c100b5c90 2026-02-22T23:24:02.947 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.931+0000 7f4c077fe640 1 -- 10.20.193.93:0/2687238324 <== mon.2 v1:10.20.193.93:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f4c000034d0 con 0x7f4c100b5c90 2026-02-22T23:24:02.947 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.931+0000 7f8dfe9a0640 1 Processor -- start 2026-02-22T23:24:02.947 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.931+0000 7f4c16fed640 1 -- 10.20.193.93:0/2687238324 >> v1:10.20.193.93:6790/0 conn(0x7f4c100b5c90 legacy=0x7f4c101407b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:02.948 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.931+0000 7f8dfe9a0640 1 -- start start 2026-02-22T23:24:02.948 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.931+0000 7f4c16fed640 1 -- 10.20.193.93:0/2687238324 shutdown_connections 2026-02-22T23:24:02.948 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.931+0000 7f4c16fed640 1 -- 10.20.193.93:0/2687238324 >> 10.20.193.93:0/2687238324 conn(0x7f4c10068410 msgr2=0x7f4c100687f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:02.949 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.931+0000 7f4c16fed640 1 -- 10.20.193.93:0/2687238324 shutdown_connections 2026-02-22T23:24:02.949 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.931+0000 7f4c16fed640 1 -- 10.20.193.93:0/2687238324 wait complete. 2026-02-22T23:24:02.949 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.931+0000 7faed0ff7640 1 Processor -- start 2026-02-22T23:24:02.949 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.931+0000 7faed0ff7640 1 -- start start 2026-02-22T23:24:02.950 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.931+0000 7fc667af5640 1 Processor -- start 2026-02-22T23:24:02.950 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.931+0000 7fc667af5640 1 -- start start 2026-02-22T23:24:02.950 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7f8dfe9a0640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8df8147180 con 0x7f8df80b5be0 2026-02-22T23:24:02.950 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7f8dfe9a0640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8df80b5fc0 con 0x7f8df80b36c0 2026-02-22T23:24:02.951 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7f8dfe9a0640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8df80b6190 con 0x7f8df80aa8e0 2026-02-22T23:24:02.951 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7f8df77fe640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7f8df80aa8e0 0x7f8df8140710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:34108/0 (socket says 10.20.193.93:34108) 2026-02-22T23:24:02.951 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7f8df77fe640 1 -- 10.20.193.93:0/2701214440 learned_addr learned my addr 10.20.193.93:0/2701214440 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:02.951 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7faed0ff7640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faecc1db610 con 0x7faecc140ec0 2026-02-22T23:24:02.951 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7faed0ff7640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faecc13d640 con 0x7faecc0b5c90 2026-02-22T23:24:02.952 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7faed0ff7640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faecc13d920 con 0x7faecc0b6070 2026-02-22T23:24:02.952 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7faec9d74640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7faecc0b6070 0x7faecc1365e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:34124/0 (socket says 10.20.193.93:34124) 2026-02-22T23:24:02.952 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7faec9d74640 1 -- 10.20.193.93:0/1100010809 learned_addr learned my addr 10.20.193.93:0/1100010809 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:02.952 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7f8df6ffd640 1 -- 10.20.193.93:0/2701214440 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3155258190 0 0) 0x7f8df80b6190 con 0x7f8df80aa8e0 2026-02-22T23:24:02.953 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7f8df6ffd640 1 -- 10.20.193.93:0/2701214440 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ddc003620 con 0x7f8df80aa8e0 2026-02-22T23:24:02.953 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7f8df6ffd640 1 -- 10.20.193.93:0/2701214440 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3097759804 0 0) 0x7f8df8147180 con 0x7f8df80b5be0 2026-02-22T23:24:02.953 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7f8df6ffd640 1 -- 10.20.193.93:0/2701214440 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8df80b6190 con 0x7f8df80b5be0 2026-02-22T23:24:02.953 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7faeb2ffd640 1 -- 10.20.193.93:0/1100010809 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3542834296 0 0) 0x7faecc13d920 con 0x7faecc0b6070 2026-02-22T23:24:02.953 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7f4c16fed640 1 Processor -- start 2026-02-22T23:24:02.954 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7faeb2ffd640 1 -- 10.20.193.93:0/1100010809 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae98003620 con 0x7faecc0b6070 2026-02-22T23:24:02.954 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7fc667af5640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc660121e00 con 0x7fc6600b1490 2026-02-22T23:24:02.955 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7f8df6ffd640 1 -- 10.20.193.93:0/2701214440 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3486646471 0 0) 0x7f8ddc003620 con 0x7f8df80aa8e0 2026-02-22T23:24:02.955 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7f8df6ffd640 1 -- 10.20.193.93:0/2701214440 >> v1:10.20.193.155:6789/0 conn(0x7f8df80b36c0 legacy=0x7f8df814edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:02.955 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7f8df6ffd640 1 -- 10.20.193.93:0/2701214440 >> v1:10.20.193.93:6789/0 conn(0x7f8df80b5be0 legacy=0x7f8df8146a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:02.955 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7f8df6ffd640 1 -- 10.20.193.93:0/2701214440 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8df80ab290 con 0x7f8df80aa8e0 2026-02-22T23:24:02.955 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7fc667af5640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6601218b0 con 0x7fc6600b08f0 2026-02-22T23:24:02.955 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7fc66586a640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7fc6600aadd0 0x7fc660120b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:34126/0 (socket says 10.20.193.93:34126) 2026-02-22T23:24:02.956 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7fc66586a640 1 -- 10.20.193.93:0/4077221623 learned_addr learned my addr 10.20.193.93:0/4077221623 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:02.956 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7f8df6ffd640 1 -- 10.20.193.93:0/2701214440 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f8de8002ea0 con 0x7f8df80aa8e0 2026-02-22T23:24:02.956 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7f4c16fed640 1 -- start start 2026-02-22T23:24:02.956 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7fc667af5640 1 -- 10.20.193.93:0/4077221623 --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc660121a80 con 0x7fc6600aadd0 2026-02-22T23:24:02.957 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7faeb2ffd640 1 -- 10.20.193.93:0/1100010809 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 325382951 0 0) 0x7faecc0aa8e0 con 0x7faecc140ec0 2026-02-22T23:24:02.957 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7faeb2ffd640 1 -- 10.20.193.93:0/1100010809 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faecc13d920 con 0x7faecc140ec0 2026-02-22T23:24:02.957 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7fc64e7fc640 1 -- 10.20.193.93:0/4077221623 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3738266480 0 0) 0x7fc660121a80 con 0x7fc6600aadd0 2026-02-22T23:24:02.958 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7fc64e7fc640 1 -- 10.20.193.93:0/4077221623 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc630003620 con 0x7fc6600aadd0 2026-02-22T23:24:02.958 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7faeb2ffd640 1 -- 10.20.193.93:0/1100010809 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2100526534 0 0) 0x7faecc13d640 con 0x7faecc0b5c90 2026-02-22T23:24:02.958 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7faeb2ffd640 1 -- 10.20.193.93:0/1100010809 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faecc0aa8e0 con 0x7faecc0b5c90 2026-02-22T23:24:02.958 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7fc64e7fc640 1 -- 10.20.193.93:0/4077221623 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 766833861 0 0) 0x7fc660121e00 con 0x7fc6600b1490 2026-02-22T23:24:02.958 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7fc64e7fc640 1 -- 10.20.193.93:0/4077221623 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc660121a80 con 0x7fc6600b1490 2026-02-22T23:24:02.959 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7fc64e7fc640 1 -- 10.20.193.93:0/4077221623 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4064969813 0 0) 0x7fc630003620 con 0x7fc6600aadd0 2026-02-22T23:24:02.959 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7faeb2ffd640 1 -- 10.20.193.93:0/1100010809 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1810226809 0 0) 0x7faecc13d920 con 0x7faecc140ec0 2026-02-22T23:24:02.959 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7faeb2ffd640 1 -- 10.20.193.93:0/1100010809 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faecc13d640 con 0x7faecc140ec0 2026-02-22T23:24:02.959 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7faeb2ffd640 1 -- 10.20.193.93:0/1100010809 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7faebc003400 con 0x7faecc140ec0 2026-02-22T23:24:02.960 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7fc64e7fc640 1 -- 10.20.193.93:0/4077221623 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc660121e00 con 0x7fc6600aadd0 2026-02-22T23:24:02.960 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7fc64e7fc640 1 -- 10.20.193.93:0/4077221623 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fc650003410 con 0x7fc6600aadd0 2026-02-22T23:24:02.960 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7faeb2ffd640 1 -- 10.20.193.93:0/1100010809 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1187965299 0 0) 0x7faecc0aa8e0 con 0x7faecc0b5c90 2026-02-22T23:24:02.960 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7faeb2ffd640 1 -- 10.20.193.93:0/1100010809 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faecc13d920 con 0x7faecc0b5c90 2026-02-22T23:24:02.961 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7f4c16fed640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c1013d610 con 0x7f4c10140ec0 2026-02-22T23:24:02.961 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7f4c16fed640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c1013f430 con 0x7f4c100b6070 2026-02-22T23:24:02.961 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7f4c16fed640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c10138c60 con 0x7f4c100b5c90 2026-02-22T23:24:02.961 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7faeb2ffd640 1 -- 10.20.193.93:0/1100010809 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7faec0003100 con 0x7faecc0b5c90 2026-02-22T23:24:02.962 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7fc64e7fc640 1 -- 10.20.193.93:0/4077221623 <== mon.2 v1:10.20.193.93:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1338837934 0 0) 0x7fc660121e00 con 0x7fc6600aadd0 2026-02-22T23:24:02.962 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7fc64e7fc640 1 -- 10.20.193.93:0/4077221623 >> v1:10.20.193.155:6789/0 conn(0x7fc6600b08f0 legacy=0x7fc6601d9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:02.962 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7fc64e7fc640 1 -- 10.20.193.93:0/4077221623 >> v1:10.20.193.93:6789/0 conn(0x7fc6600b1490 legacy=0x7fc660140d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:02.962 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7faeb2ffd640 1 -- 10.20.193.93:0/1100010809 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3101009732 0 0) 0x7fae98003620 con 0x7faecc0b6070 2026-02-22T23:24:02.962 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7faeb2ffd640 1 -- 10.20.193.93:0/1100010809 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faecc0aa8e0 con 0x7faecc0b6070 2026-02-22T23:24:02.963 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7faeb2ffd640 1 -- 10.20.193.93:0/1100010809 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7faeb40034d0 con 0x7faecc0b6070 2026-02-22T23:24:02.963 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7fc64e7fc640 1 -- 10.20.193.93:0/4077221623 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6601da170 con 0x7fc6600aadd0 2026-02-22T23:24:02.963 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7f4c15563640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7f4c10140ec0 0x7f4c101e5d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:46942/0 (socket says 10.20.193.93:46942) 2026-02-22T23:24:02.963 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7f4c15563640 1 -- 10.20.193.93:0/2238508140 learned_addr learned my addr 10.20.193.93:0/2238508140 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:02.964 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7fc667af5640 1 -- 10.20.193.93:0/4077221623 --> v1:10.20.193.93:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc6601da400 con 0x7fc6600aadd0 2026-02-22T23:24:02.964 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7faeb2ffd640 1 -- 10.20.193.93:0/1100010809 <== mon.1 v1:10.20.193.155:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 41450033 0 0) 0x7faecc13d920 con 0x7faecc0b5c90 2026-02-22T23:24:02.964 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7faeb2ffd640 1 -- 10.20.193.93:0/1100010809 >> v1:10.20.193.93:6790/0 conn(0x7faecc0b6070 legacy=0x7faecc1365e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:02.964 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7faeb2ffd640 1 -- 10.20.193.93:0/1100010809 >> v1:10.20.193.93:6789/0 conn(0x7faecc140ec0 legacy=0x7faecc1e5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:02.965 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7faeb2ffd640 1 -- 10.20.193.93:0/1100010809 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faecc1da700 con 0x7faecc0b5c90 2026-02-22T23:24:02.965 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7faed0ff7640 1 -- 10.20.193.93:0/1100010809 --> v1:10.20.193.155:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7faecc13c8e0 con 0x7faecc0b5c90 2026-02-22T23:24:02.965 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7f8df6ffd640 1 -- 10.20.193.93:0/2701214440 <== mon.2 v1:10.20.193.93:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8de8003040 con 0x7f8df80aa8e0 2026-02-22T23:24:02.965 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7f8df6ffd640 1 -- 10.20.193.93:0/2701214440 <== mon.2 v1:10.20.193.93:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f8de8003490 con 0x7f8df80aa8e0 2026-02-22T23:24:02.965 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7fc667af5640 1 -- 10.20.193.93:0/4077221623 --> v1:10.20.193.93:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fc6601415f0 con 0x7fc6600aadd0 2026-02-22T23:24:02.965 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7fc64e7fc640 1 -- 10.20.193.93:0/4077221623 <== mon.2 v1:10.20.193.93:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc650004d70 con 0x7fc6600aadd0 2026-02-22T23:24:02.966 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.932+0000 7fc64e7fc640 1 -- 10.20.193.93:0/4077221623 <== mon.2 v1:10.20.193.93:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fc6500050c0 con 0x7fc6600aadd0 2026-02-22T23:24:02.966 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.933+0000 7faed0ff7640 1 -- 10.20.193.93:0/1100010809 --> v1:10.20.193.155:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7faecc136ed0 con 0x7faecc0b5c90 2026-02-22T23:24:02.966 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.933+0000 7faeb2ffd640 1 -- 10.20.193.93:0/1100010809 <== mon.1 v1:10.20.193.155:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7faec0003550 con 0x7faecc0b5c90 2026-02-22T23:24:02.966 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.933+0000 7faeb2ffd640 1 -- 10.20.193.93:0/1100010809 <== mon.1 v1:10.20.193.155:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7faec00038a0 con 0x7faecc0b5c90 2026-02-22T23:24:02.967 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.933+0000 7f4c057fa640 1 -- 10.20.193.93:0/2238508140 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 897986110 0 0) 0x7f4c1013d610 con 0x7f4c10140ec0 2026-02-22T23:24:02.967 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.933+0000 7f4c057fa640 1 -- 10.20.193.93:0/2238508140 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4be0003620 con 0x7f4c10140ec0 2026-02-22T23:24:02.967 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.933+0000 7f4c057fa640 1 -- 10.20.193.93:0/2238508140 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 755576149 0 0) 0x7f4c1013f430 con 0x7f4c100b6070 2026-02-22T23:24:02.967 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.933+0000 7f4c057fa640 1 -- 10.20.193.93:0/2238508140 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c1013d610 con 0x7f4c100b6070 2026-02-22T23:24:02.967 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.933+0000 7f4c057fa640 1 -- 10.20.193.93:0/2238508140 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 226009855 0 0) 0x7f4be0003620 con 0x7f4c10140ec0 2026-02-22T23:24:02.967 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.933+0000 7f4c057fa640 1 -- 10.20.193.93:0/2238508140 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4c1013f430 con 0x7f4c10140ec0 2026-02-22T23:24:02.967 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.933+0000 7f4c057fa640 1 -- 10.20.193.93:0/2238508140 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f4c0c003530 con 0x7f4c10140ec0 2026-02-22T23:24:02.968 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.933+0000 7f8dfe9a0640 1 -- 10.20.193.93:0/2701214440 >> v1:10.20.193.93:6790/0 conn(0x7f8df80aa8e0 legacy=0x7f8df8140710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:02.969 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.933+0000 7f4c057fa640 1 -- 10.20.193.93:0/2238508140 <== mon.0 v1:10.20.193.93:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3080968467 0 0) 0x7f4c1013f430 con 0x7f4c10140ec0 2026-02-22T23:24:02.969 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.933+0000 7f4c057fa640 1 -- 10.20.193.93:0/2238508140 >> v1:10.20.193.93:6790/0 conn(0x7f4c100b5c90 legacy=0x7f4c10138550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:02.969 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.933+0000 7f4c057fa640 1 -- 10.20.193.93:0/2238508140 >> v1:10.20.193.155:6789/0 conn(0x7f4c100b6070 legacy=0x7f4c101364e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:02.969 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.933+0000 7f4c057fa640 1 -- 10.20.193.93:0/2238508140 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c10138e30 con 0x7f4c10140ec0 2026-02-22T23:24:02.969 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.933+0000 7f4c16fed640 1 -- 10.20.193.93:0/2238508140 --> v1:10.20.193.93:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4c1013c600 con 0x7f4c10140ec0 2026-02-22T23:24:02.969 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.933+0000 7f4c057fa640 1 -- 10.20.193.93:0/2238508140 <== mon.0 v1:10.20.193.93:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4c0c0036d0 con 0x7f4c10140ec0 2026-02-22T23:24:02.969 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.933+0000 7f4c16fed640 1 -- 10.20.193.93:0/2238508140 --> v1:10.20.193.93:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4c10136dd0 con 0x7f4c10140ec0 2026-02-22T23:24:02.969 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.933+0000 7f4c057fa640 1 -- 10.20.193.93:0/2238508140 <== mon.0 v1:10.20.193.93:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f4c0c003a60 con 0x7f4c10140ec0 2026-02-22T23:24:02.970 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.933+0000 7fc667af5640 1 -- 10.20.193.93:0/4077221623 --> v1:10.20.193.93:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc660123000 con 0x7fc6600aadd0 2026-02-22T23:24:02.970 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.933+0000 7f8dfe9a0640 1 -- 10.20.193.93:0/2701214440 shutdown_connections 2026-02-22T23:24:02.970 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.933+0000 7f8dfe9a0640 1 -- 10.20.193.93:0/2701214440 >> 10.20.193.93:0/2701214440 conn(0x7f8df8068410 msgr2=0x7f8df8068820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:02.970 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.933+0000 7faed0ff7640 1 -- 10.20.193.93:0/1100010809 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae94005180 con 0x7faecc0b5c90 2026-02-22T23:24:02.970 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.933+0000 7f8dfe9a0640 1 -- 10.20.193.93:0/2701214440 shutdown_connections 2026-02-22T23:24:02.971 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.933+0000 7f8dfe9a0640 1 -- 10.20.193.93:0/2701214440 wait complete. 2026-02-22T23:24:02.971 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.934+0000 7f4c16fed640 1 -- 10.20.193.93:0/2238508140 --> v1:10.20.193.93:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c100008d0 con 0x7f4c10140ec0 2026-02-22T23:24:02.971 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.934+0000 7fc64e7fc640 1 -- 10.20.193.93:0/4077221623 <== mon.2 v1:10.20.193.93:6790/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7fc65001d890 con 0x7fc6600aadd0 2026-02-22T23:24:02.971 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.934+0000 7faeb2ffd640 1 -- 10.20.193.93:0/1100010809 <== mon.1 v1:10.20.193.155:6789/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7faec001bed0 con 0x7faecc0b5c90 2026-02-22T23:24:02.972 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.934+0000 7f8dfe9a0640 1 Processor -- start 2026-02-22T23:24:02.972 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.934+0000 7f8dfe9a0640 1 -- start start 2026-02-22T23:24:02.972 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.934+0000 7fc64e7fc640 1 -- 10.20.193.93:0/4077221623 <== mon.2 v1:10.20.193.93:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 4142+0+0 (unknown 2994938210 0 0) 0x7fc6500943e0 con 0x7fc6600aadd0 2026-02-22T23:24:02.972 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.934+0000 7faeb2ffd640 1 -- 10.20.193.93:0/1100010809 <== mon.1 v1:10.20.193.155:6789/0 8 ==== osd_map(20..20 src has 1..20) ==== 4142+0+0 (unknown 2994938210 0 0) 0x7faec0092d90 con 0x7faecc0b5c90 2026-02-22T23:24:02.972 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.934+0000 7f4c057fa640 1 -- 10.20.193.93:0/2238508140 <== mon.0 v1:10.20.193.93:6789/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7f4c0c003c00 con 0x7f4c10140ec0 2026-02-22T23:24:02.973 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.934+0000 7f8dfe9a0640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8df81d1340 con 0x7f8df8145410 2026-02-22T23:24:02.973 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.934+0000 7f8dfe9a0640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8df81d1620 con 0x7f8df80b5be0 2026-02-22T23:24:02.973 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.934+0000 7f8dfe9a0640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8df8141330 con 0x7f8df80b36c0 2026-02-22T23:24:02.973 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.934+0000 7f8df7fff640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7f8df80b36c0 0x7f8df81cf510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:34130/0 (socket says 10.20.193.93:34130) 2026-02-22T23:24:02.973 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.934+0000 7f8df7fff640 1 -- 10.20.193.93:0/1498993047 learned_addr learned my addr 10.20.193.93:0/1498993047 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:02.973 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.935+0000 7f4c057fa640 1 -- 10.20.193.93:0/2238508140 <== mon.0 v1:10.20.193.93:6789/0 8 ==== osd_map(20..20 src has 1..20) ==== 4142+0+0 (unknown 2994938210 0 0) 0x7f4c0c0945e0 con 0x7f4c10140ec0 2026-02-22T23:24:02.974 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.936+0000 7f8df4ff9640 1 -- 10.20.193.93:0/1498993047 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4166833596 0 0) 0x7f8df81d1620 con 0x7f8df80b5be0 2026-02-22T23:24:02.974 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.936+0000 7f8df4ff9640 1 -- 10.20.193.93:0/1498993047 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8dc8003620 con 0x7f8df80b5be0 2026-02-22T23:24:02.974 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.936+0000 7f8df4ff9640 1 -- 10.20.193.93:0/1498993047 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3548357233 0 0) 0x7f8dc8003620 con 0x7f8df80b5be0 2026-02-22T23:24:02.974 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.936+0000 7f8df4ff9640 1 -- 10.20.193.93:0/1498993047 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8df81d1620 con 0x7f8df80b5be0 2026-02-22T23:24:02.974 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.936+0000 7f8df4ff9640 1 -- 10.20.193.93:0/1498993047 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f8de8003390 con 0x7f8df80b5be0 2026-02-22T23:24:02.974 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.936+0000 7faeb2ffd640 1 -- 10.20.193.93:0/1100010809 <== mon.1 v1:10.20.193.155:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7faec005c590 con 0x7faecc0b5c90 2026-02-22T23:24:02.975 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.936+0000 7f8df4ff9640 1 -- 10.20.193.93:0/1498993047 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1936799129 0 0) 0x7f8df8141330 con 0x7f8df80b36c0 2026-02-22T23:24:02.975 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.936+0000 7f8df4ff9640 1 -- 10.20.193.93:0/1498993047 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8dc8003620 con 0x7f8df80b36c0 2026-02-22T23:24:02.975 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.936+0000 7f8df4ff9640 1 -- 10.20.193.93:0/1498993047 <== mon.1 v1:10.20.193.155:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4167080804 0 0) 0x7f8df81d1620 con 0x7f8df80b5be0 2026-02-22T23:24:02.975 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.936+0000 7f8df4ff9640 1 -- 10.20.193.93:0/1498993047 >> v1:10.20.193.93:6790/0 conn(0x7f8df80b36c0 legacy=0x7f8df81cf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:02.975 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.936+0000 7f8df4ff9640 1 -- 10.20.193.93:0/1498993047 >> v1:10.20.193.93:6789/0 conn(0x7f8df8145410 legacy=0x7f8df81e52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:02.975 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.936+0000 7f8df4ff9640 1 -- 10.20.193.93:0/1498993047 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8df8145830 con 0x7f8df80b5be0 2026-02-22T23:24:02.975 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.936+0000 7f8dfe9a0640 1 -- 10.20.193.93:0/1498993047 --> v1:10.20.193.155:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8df81e6a00 con 0x7f8df80b5be0 2026-02-22T23:24:02.975 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.936+0000 7f8dfe9a0640 1 -- 10.20.193.93:0/1498993047 --> v1:10.20.193.155:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8df81e6db0 con 0x7f8df80b5be0 2026-02-22T23:24:02.976 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.936+0000 7fc64e7fc640 1 -- 10.20.193.93:0/4077221623 <== mon.2 v1:10.20.193.93:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7fc65005dbe0 con 0x7fc6600aadd0 2026-02-22T23:24:02.976 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.936+0000 7f8df4ff9640 1 -- 10.20.193.93:0/1498993047 <== mon.1 v1:10.20.193.155:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8de8003550 con 0x7f8df80b5be0 2026-02-22T23:24:02.976 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.936+0000 7f8df4ff9640 1 -- 10.20.193.93:0/1498993047 <== mon.1 v1:10.20.193.155:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f8de8004cf0 con 0x7f8df80b5be0 2026-02-22T23:24:02.976 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.937+0000 7f4c057fa640 1 -- 10.20.193.93:0/2238508140 <== mon.0 v1:10.20.193.93:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f4c10138e30 con 0x7f4c10140ec0 2026-02-22T23:24:02.978 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.937+0000 7f8dfe9a0640 1 -- 10.20.193.93:0/1498993047 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8df81d02b0 con 0x7f8df80b5be0 2026-02-22T23:24:02.978 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.938+0000 7f8df4ff9640 1 -- 10.20.193.93:0/1498993047 <== mon.1 v1:10.20.193.155:6789/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7f8de801d4c0 con 0x7f8df80b5be0 2026-02-22T23:24:02.978 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.938+0000 7f8df77fe640 1 -- 10.20.193.93:0/1498993047 >> v1:10.20.193.155:6789/0 conn(0x7f8df80b5be0 legacy=0x7f8df8144d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-22T23:24:02.978 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.938+0000 7f8df77fe640 1 -- 10.20.193.93:0/1498993047 >> v1:10.20.193.155:6789/0 conn(0x7f8df80b5be0 legacy=0x7f8df8144d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T23:24:02.978 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.938+0000 7f8df77fe640 1 --1- 10.20.193.93:0/1498993047 >> v1:10.20.193.155:6789/0 conn(0x7f8df80b5be0 0x7f8df8144d00 :-1 s=OPENED pgs=133 cs=1 l=1).handle_message read tag failed 2026-02-22T23:24:02.978 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.938+0000 7f8df77fe640 1 --1- 10.20.193.93:0/1498993047 >> v1:10.20.193.155:6789/0 conn(0x7f8df80b5be0 0x7f8df8144d00 :-1 s=OPENED pgs=133 cs=1 l=1).fault on lossy channel, failing 2026-02-22T23:24:02.978 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.938+0000 7f8df4ff9640 1 -- 10.20.193.93:0/1498993047 >> v1:10.20.193.155:6789/0 conn(0x7f8df80b5be0 legacy=0x7f8df8144d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:24:02.978 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.938+0000 7f8df4ff9640 1 -- 10.20.193.93:0/1498993047 --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f8df81d1620 con 0x7f8df8145410 2026-02-22T23:24:02.978 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.938+0000 7f8df4ff9640 1 -- 10.20.193.93:0/1498993047 --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f8df8141330 con 0x7f8dc807bdb0 2026-02-22T23:24:02.978 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.938+0000 7f8df4ff9640 1 -- 10.20.193.93:0/1498993047 --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f8dc8089310 con 0x7f8df80b36c0 2026-02-22T23:24:02.978 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.939+0000 7f8df4ff9640 1 -- 10.20.193.93:0/1498993047 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4258756044 0 0) 0x7f8dc8089310 con 0x7f8df80b36c0 2026-02-22T23:24:02.978 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.939+0000 7f8df4ff9640 1 -- 10.20.193.93:0/1498993047 --> v1:10.20.193.93:6790/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7f8dc80872b0 con 0x7f8df80b36c0 2026-02-22T23:24:02.978 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.939+0000 7f8df4ff9640 1 -- 10.20.193.93:0/1498993047 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4249425933 0 0) 0x7f8df81d1620 con 0x7f8df8145410 2026-02-22T23:24:02.978 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.939+0000 7f8df4ff9640 1 -- 10.20.193.93:0/1498993047 --> v1:10.20.193.93:6789/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7f8dc8089310 con 0x7f8df8145410 2026-02-22T23:24:02.978 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.939+0000 7f8df4ff9640 1 -- 10.20.193.93:0/1498993047 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (unknown 2007691735 0 0) 0x7f8dc80872b0 con 0x7f8df80b36c0 2026-02-22T23:24:02.978 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.939+0000 7f8df4ff9640 1 -- 10.20.193.93:0/1498993047 >> v1:10.20.193.155:6789/0 conn(0x7f8dc807bdb0 legacy=0x7f8dc807e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:02.978 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.939+0000 7f8df4ff9640 1 -- 10.20.193.93:0/1498993047 >> v1:10.20.193.93:6789/0 conn(0x7f8df8145410 legacy=0x7f8dc8081b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:02.979 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.939+0000 7f8df4ff9640 1 -- 10.20.193.93:0/1498993047 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+,osdmap=0}) -- 0x7f8dc808a510 con 0x7f8df80b36c0 2026-02-22T23:24:02.979 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.939+0000 7f8df4ff9640 1 -- 10.20.193.93:0/1498993047 --> v1:10.20.193.93:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8df8141330 con 0x7f8df80b36c0 2026-02-22T23:24:02.979 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.939+0000 7f8df4ff9640 1 -- 10.20.193.93:0/1498993047 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f8de4003230 con 0x7f8df80b36c0 2026-02-22T23:24:02.979 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.939+0000 7f8df4ff9640 1 -- 10.20.193.93:0/1498993047 <== mon.2 v1:10.20.193.93:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8de4002fd0 con 0x7f8df80b36c0 2026-02-22T23:24:02.979 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.940+0000 7f8df4ff9640 1 -- 10.20.193.93:0/1498993047 <== mon.2 v1:10.20.193.93:6790/0 5 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7f8de4003280 con 0x7f8df80b36c0 2026-02-22T23:24:02.979 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.940+0000 7f8df4ff9640 1 -- 10.20.193.93:0/1498993047 <== mon.2 v1:10.20.193.93:6790/0 6 ==== osd_map(20..20 src has 1..20) ==== 4142+0+0 (unknown 2994938210 0 0) 0x7f8de40958d0 con 0x7f8df80b36c0 2026-02-22T23:24:02.979 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.941+0000 7f8df4ff9640 1 -- 10.20.193.93:0/1498993047 <== mon.2 v1:10.20.193.93:6790/0 7 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f8de405f0d0 con 0x7f8df80b36c0 2026-02-22T23:24:02.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.979+0000 7fc993f6f640 1 Processor -- start 2026-02-22T23:24:02.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.979+0000 7fd60da61640 1 Processor -- start 2026-02-22T23:24:02.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.979+0000 7fd60da61640 1 -- start start 2026-02-22T23:24:02.983 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.979+0000 7fc993f6f640 1 -- start start 2026-02-22T23:24:02.983 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.979+0000 7fd60da61640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6081443b0 con 0x7fd6080b3d10 2026-02-22T23:24:02.983 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.979+0000 7fd60da61640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6081434a0 con 0x7fd6080aab50 2026-02-22T23:24:02.983 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.980+0000 7fd60da61640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd608143780 con 0x7fd6080b5930 2026-02-22T23:24:02.983 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.980+0000 7fc993f6f640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc98c071ef0 con 0x7fc98c0afcc0 2026-02-22T23:24:02.984 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.980+0000 7fc993f6f640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc98c13db30 con 0x7fc98c071180 2026-02-22T23:24:02.984 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.980+0000 7fc993f6f640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc98c144040 con 0x7fc98c0721b0 2026-02-22T23:24:02.984 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.980+0000 7fd6067fc640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7fd6080b5930 0x7fd60813d0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:34160/0 (socket says 10.20.193.93:34160) 2026-02-22T23:24:02.984 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.980+0000 7fd6067fc640 1 -- 10.20.193.93:0/2517216942 learned_addr learned my addr 10.20.193.93:0/2517216942 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:02.984 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.980+0000 7fc9914e3640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7fc98c0721b0 0x7fc98c143930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:34168/0 (socket says 10.20.193.93:34168) 2026-02-22T23:24:02.984 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.980+0000 7fc9914e3640 1 -- 10.20.193.93:0/3589538839 learned_addr learned my addr 10.20.193.93:0/3589538839 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:02.985 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.980+0000 7fef6fdfe640 1 Processor -- start 2026-02-22T23:24:02.985 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.980+0000 7fef6fdfe640 1 -- start start 2026-02-22T23:24:02.985 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.980+0000 7fd605ffb640 1 -- 10.20.193.93:0/2517216942 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1603740404 0 0) 0x7fd6081443b0 con 0x7fd6080b3d10 2026-02-22T23:24:02.985 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.980+0000 7fd605ffb640 1 -- 10.20.193.93:0/2517216942 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5f4003620 con 0x7fd6080b3d10 2026-02-22T23:24:02.985 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.980+0000 7fd605ffb640 1 -- 10.20.193.93:0/2517216942 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3865599832 0 0) 0x7fd608143780 con 0x7fd6080b5930 2026-02-22T23:24:02.985 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.980+0000 7fd605ffb640 1 -- 10.20.193.93:0/2517216942 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6081443b0 con 0x7fd6080b5930 2026-02-22T23:24:02.986 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.980+0000 7fc990ce2640 1 -- 10.20.193.93:0/3589538839 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1607146527 0 0) 0x7fc98c071ef0 con 0x7fc98c0afcc0 2026-02-22T23:24:02.986 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.980+0000 7fc990ce2640 1 -- 10.20.193.93:0/3589538839 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9740058b0 con 0x7fc98c0afcc0 2026-02-22T23:24:02.986 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.980+0000 7fc990ce2640 1 -- 10.20.193.93:0/3589538839 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1418044094 0 0) 0x7fc98c144040 con 0x7fc98c0721b0 2026-02-22T23:24:02.986 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.980+0000 7fc990ce2640 1 -- 10.20.193.93:0/3589538839 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc98c071ef0 con 0x7fc98c0721b0 2026-02-22T23:24:02.986 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.980+0000 7fc9924e5640 1 -- 10.20.193.93:0/3589538839 >> v1:10.20.193.155:6789/0 conn(0x7fc98c071180 legacy=0x7fc98c14b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2026-02-22T23:24:02.986 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.980+0000 7fc9924e5640 1 -- 10.20.193.93:0/3589538839 >> v1:10.20.193.155:6789/0 conn(0x7fc98c071180 legacy=0x7fc98c14b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T23:24:02.986 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.980+0000 7fc9924e5640 1 --1- 10.20.193.93:0/3589538839 >> v1:10.20.193.155:6789/0 conn(0x7fc98c071180 0x7fc98c14b910 :-1 s=OPENED pgs=135 cs=1 l=1).handle_message read tag failed 2026-02-22T23:24:02.986 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.980+0000 7fc9924e5640 1 --1- 10.20.193.93:0/3589538839 >> v1:10.20.193.155:6789/0 conn(0x7fc98c071180 0x7fc98c14b910 :-1 s=OPENED pgs=135 cs=1 l=1).fault on lossy channel, failing 2026-02-22T23:24:02.987 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.980+0000 7fd605ffb640 1 -- 10.20.193.93:0/2517216942 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2804749702 0 0) 0x7fd5f4003620 con 0x7fd6080b3d10 2026-02-22T23:24:02.987 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.980+0000 7fd605ffb640 1 -- 10.20.193.93:0/2517216942 >> v1:10.20.193.93:6790/0 conn(0x7fd6080b5930 legacy=0x7fd60813d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:02.987 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.980+0000 7fd605ffb640 1 -- 10.20.193.93:0/2517216942 >> v1:10.20.193.155:6789/0 conn(0x7fd6080aab50 legacy=0x7fd608143ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T23:24:02.987 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.980+0000 7fd605ffb640 1 -- 10.20.193.93:0/2517216942 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6080ab5c0 con 0x7fd6080b3d10 2026-02-22T23:24:02.987 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.980+0000 7fd605ffb640 1 -- 10.20.193.93:0/2517216942 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fd5f8003220 con 0x7fd6080b3d10 2026-02-22T23:24:02.987 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.980+0000 7fc990ce2640 1 -- 10.20.193.93:0/3589538839 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1049611011 0 0) 0x7fc9740058b0 con 0x7fc98c0afcc0 2026-02-22T23:24:02.987 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.980+0000 7fc990ce2640 1 -- 10.20.193.93:0/3589538839 >> v1:10.20.193.93:6790/0 conn(0x7fc98c0721b0 legacy=0x7fc98c143930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:02.987 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.980+0000 7fc990ce2640 1 -- 10.20.193.93:0/3589538839 >> v1:10.20.193.155:6789/0 conn(0x7fc98c071180 legacy=0x7fc98c14b910 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:24:02.987 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.980+0000 7fc990ce2640 1 -- 10.20.193.93:0/3589538839 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc98c144210 con 0x7fc98c0afcc0 2026-02-22T23:24:02.987 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.980+0000 7fc990ce2640 1 -- 10.20.193.93:0/3589538839 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fc97c002ea0 con 0x7fc98c0afcc0 2026-02-22T23:24:02.988 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.980+0000 7fd605ffb640 1 -- 10.20.193.93:0/2517216942 <== mon.0 v1:10.20.193.93:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd5f8003440 con 0x7fd6080b3d10 2026-02-22T23:24:02.988 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.980+0000 7fd605ffb640 1 -- 10.20.193.93:0/2517216942 <== mon.0 v1:10.20.193.93:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fd5f8003890 con 0x7fd6080b3d10 2026-02-22T23:24:02.988 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.980+0000 7fc990ce2640 1 -- 10.20.193.93:0/3589538839 <== mon.0 v1:10.20.193.93:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc97c003040 con 0x7fc98c0afcc0 2026-02-22T23:24:02.988 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.980+0000 7fc990ce2640 1 -- 10.20.193.93:0/3589538839 <== mon.0 v1:10.20.193.93:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fc97c003490 con 0x7fc98c0afcc0 2026-02-22T23:24:02.988 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.980+0000 7fef6fdfe640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef68147b40 con 0x7fef680b10d0 2026-02-22T23:24:02.989 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.980+0000 7fef6fdfe640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef680aedf0 con 0x7fef680b1970 2026-02-22T23:24:02.989 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.980+0000 7fef6fdfe640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef680af0d0 con 0x7fef6806df80 2026-02-22T23:24:02.989 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.980+0000 7fef6db73640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7fef6806df80 0x7fef68146d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:34180/0 (socket says 10.20.193.93:34180) 2026-02-22T23:24:02.989 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.980+0000 7fef6db73640 1 -- 10.20.193.93:0/547843596 learned_addr learned my addr 10.20.193.93:0/547843596 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:02.989 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.980+0000 7fd60da61640 1 -- 10.20.193.93:0/2517216942 >> v1:10.20.193.93:6789/0 conn(0x7fd6080b3d10 legacy=0x7fd60814edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:02.989 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.980+0000 7fd60da61640 1 -- 10.20.193.93:0/2517216942 shutdown_connections 2026-02-22T23:24:02.989 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.980+0000 7fd60da61640 1 -- 10.20.193.93:0/2517216942 >> 10.20.193.93:0/2517216942 conn(0x7fd6080b9310 msgr2=0x7fd6080b96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:02.989 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.980+0000 7fd60da61640 1 -- 10.20.193.93:0/2517216942 shutdown_connections 2026-02-22T23:24:02.989 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.980+0000 7fd60da61640 1 -- 10.20.193.93:0/2517216942 wait complete. 2026-02-22T23:24:02.990 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.980+0000 7fef6cb71640 1 -- 10.20.193.93:0/547843596 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1499753904 0 0) 0x7fef680af0d0 con 0x7fef6806df80 2026-02-22T23:24:02.990 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.980+0000 7fef6cb71640 1 -- 10.20.193.93:0/547843596 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef50003620 con 0x7fef6806df80 2026-02-22T23:24:02.990 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.980+0000 7fef6cb71640 1 -- 10.20.193.93:0/547843596 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3087804543 0 0) 0x7fef68147b40 con 0x7fef680b10d0 2026-02-22T23:24:02.990 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.980+0000 7fef6cb71640 1 -- 10.20.193.93:0/547843596 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef680af0d0 con 0x7fef680b10d0 2026-02-22T23:24:02.990 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.981+0000 7fc993f6f640 1 -- 10.20.193.93:0/3589538839 >> v1:10.20.193.93:6789/0 conn(0x7fc98c0afcc0 legacy=0x7fc98c13d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:02.991 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.981+0000 7fef6cb71640 1 -- 10.20.193.93:0/547843596 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 70612923 0 0) 0x7fef50003620 con 0x7fef6806df80 2026-02-22T23:24:02.991 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.981+0000 7fef6cb71640 1 -- 10.20.193.93:0/547843596 >> v1:10.20.193.155:6789/0 conn(0x7fef680b1970 legacy=0x7fef68147430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:02.991 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.981+0000 7fef6cb71640 1 -- 10.20.193.93:0/547843596 >> v1:10.20.193.93:6789/0 conn(0x7fef680b10d0 legacy=0x7fef6814f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:02.991 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.981+0000 7fef6cb71640 1 -- 10.20.193.93:0/547843596 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef680af3b0 con 0x7fef6806df80 2026-02-22T23:24:02.991 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.981+0000 7fc993f6f640 1 -- 10.20.193.93:0/3589538839 shutdown_connections 2026-02-22T23:24:02.991 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.981+0000 7fc993f6f640 1 -- 10.20.193.93:0/3589538839 >> 10.20.193.93:0/3589538839 conn(0x7fc98c0b1d30 msgr2=0x7fc98c0b2140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:02.992 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.981+0000 7fef6cb71640 1 -- 10.20.193.93:0/547843596 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fef58002ea0 con 0x7fef6806df80 2026-02-22T23:24:02.992 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.981+0000 7fc993f6f640 1 -- 10.20.193.93:0/3589538839 shutdown_connections 2026-02-22T23:24:02.992 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.981+0000 7fc993f6f640 1 -- 10.20.193.93:0/3589538839 wait complete. 2026-02-22T23:24:02.992 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.981+0000 7fef6cb71640 1 -- 10.20.193.93:0/547843596 <== mon.2 v1:10.20.193.93:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fef58003040 con 0x7fef6806df80 2026-02-22T23:24:02.993 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.981+0000 7fef6cb71640 1 -- 10.20.193.93:0/547843596 <== mon.2 v1:10.20.193.93:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fef58003450 con 0x7fef6806df80 2026-02-22T23:24:02.993 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.981+0000 7fef6fdfe640 1 -- 10.20.193.93:0/547843596 >> v1:10.20.193.93:6790/0 conn(0x7fef6806df80 legacy=0x7fef68146d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:02.993 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.981+0000 7fef6fdfe640 1 -- 10.20.193.93:0/547843596 shutdown_connections 2026-02-22T23:24:02.993 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.981+0000 7fef6fdfe640 1 -- 10.20.193.93:0/547843596 >> 10.20.193.93:0/547843596 conn(0x7fef680b7150 msgr2=0x7fef680b7530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:02.993 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.981+0000 7fef6fdfe640 1 -- 10.20.193.93:0/547843596 shutdown_connections 2026-02-22T23:24:02.993 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.981+0000 7fef6fdfe640 1 -- 10.20.193.93:0/547843596 wait complete. 2026-02-22T23:24:02.993 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.981+0000 7fd60da61640 1 Processor -- start 2026-02-22T23:24:02.993 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.981+0000 7fd60da61640 1 -- start start 2026-02-22T23:24:02.994 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.981+0000 7fc993f6f640 1 Processor -- start 2026-02-22T23:24:02.994 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.981+0000 7fc993f6f640 1 -- start start 2026-02-22T23:24:02.994 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.981+0000 7fd60da61640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6080b1480 con 0x7fd6080b5930 2026-02-22T23:24:02.994 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fd60da61640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6080b1b80 con 0x7fd6080aab50 2026-02-22T23:24:02.994 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fd60da61640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6080b0420 con 0x7fd6080b3d10 2026-02-22T23:24:02.994 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fef6fdfe640 1 Processor -- start 2026-02-22T23:24:02.994 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fd6077fe640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7fd6080b5930 0x7fd60813c720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:46980/0 (socket says 10.20.193.93:46980) 2026-02-22T23:24:02.995 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fd6077fe640 1 -- 10.20.193.93:0/635674473 learned_addr learned my addr 10.20.193.93:0/635674473 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:02.995 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fef6fdfe640 1 -- start start 2026-02-22T23:24:02.995 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fd5dffff640 1 -- 10.20.193.93:0/635674473 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3859324524 0 0) 0x7fd6080b1480 con 0x7fd6080b5930 2026-02-22T23:24:02.995 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fd5dffff640 1 -- 10.20.193.93:0/635674473 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5d8003620 con 0x7fd6080b5930 2026-02-22T23:24:02.995 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fd5dffff640 1 -- 10.20.193.93:0/635674473 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2481972173 0 0) 0x7fd6080b0420 con 0x7fd6080b3d10 2026-02-22T23:24:02.995 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fd5dffff640 1 -- 10.20.193.93:0/635674473 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6080b1480 con 0x7fd6080b3d10 2026-02-22T23:24:02.996 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fc993f6f640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc98c11e610 con 0x7fc98c0afcc0 2026-02-22T23:24:02.996 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fc993f6f640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc98c11e8f0 con 0x7fc98c0721b0 2026-02-22T23:24:02.996 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fc993f6f640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc98c11ebd0 con 0x7fc98c071180 2026-02-22T23:24:02.996 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fc991ce4640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7fc98c071180 0x7fc98c11cfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:34204/0 (socket says 10.20.193.93:34204) 2026-02-22T23:24:02.996 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fc991ce4640 1 -- 10.20.193.93:0/4191371005 learned_addr learned my addr 10.20.193.93:0/4191371005 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:02.997 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fd5dffff640 1 -- 10.20.193.93:0/635674473 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3311992325 0 0) 0x7fd5d8003620 con 0x7fd6080b5930 2026-02-22T23:24:02.997 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fd5dffff640 1 -- 10.20.193.93:0/635674473 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd6080b0420 con 0x7fd6080b5930 2026-02-22T23:24:02.997 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fd5dffff640 1 -- 10.20.193.93:0/635674473 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fd5f8003790 con 0x7fd6080b5930 2026-02-22T23:24:02.997 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fd5dffff640 1 -- 10.20.193.93:0/635674473 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 186486457 0 0) 0x7fd6080b1480 con 0x7fd6080b3d10 2026-02-22T23:24:02.997 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fd5dffff640 1 -- 10.20.193.93:0/635674473 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd5d8003620 con 0x7fd6080b3d10 2026-02-22T23:24:02.997 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fd5dffff640 1 -- 10.20.193.93:0/635674473 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fd5f0002fe0 con 0x7fd6080b3d10 2026-02-22T23:24:02.997 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fd5dffff640 1 -- 10.20.193.93:0/635674473 <== mon.0 v1:10.20.193.93:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1731509950 0 0) 0x7fd6080b0420 con 0x7fd6080b5930 2026-02-22T23:24:02.997 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fd5dffff640 1 -- 10.20.193.93:0/635674473 >> v1:10.20.193.93:6790/0 conn(0x7fd6080b3d10 legacy=0x7fd6081ddbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:02.997 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fd5dffff640 1 -- 10.20.193.93:0/635674473 >> v1:10.20.193.155:6789/0 conn(0x7fd6080aab50 legacy=0x7fd6080afd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:02.997 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fd5dffff640 1 -- 10.20.193.93:0/635674473 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6080af090 con 0x7fd6080b5930 2026-02-22T23:24:02.998 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fc97a7fc640 1 -- 10.20.193.93:0/4191371005 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 888962994 0 0) 0x7fc98c11e610 con 0x7fc98c0afcc0 2026-02-22T23:24:02.998 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fc97a7fc640 1 -- 10.20.193.93:0/4191371005 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc95c003620 con 0x7fc98c0afcc0 2026-02-22T23:24:02.998 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fd60da61640 1 -- 10.20.193.93:0/635674473 --> v1:10.20.193.93:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd6080af320 con 0x7fd6080b5930 2026-02-22T23:24:02.998 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fc97a7fc640 1 -- 10.20.193.93:0/4191371005 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 650630954 0 0) 0x7fc98c11ebd0 con 0x7fc98c071180 2026-02-22T23:24:02.998 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fc97a7fc640 1 -- 10.20.193.93:0/4191371005 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc98c11e610 con 0x7fc98c071180 2026-02-22T23:24:02.998 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fef6fdfe640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef68143dd0 con 0x7fef680b1970 2026-02-22T23:24:02.999 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fd60da61640 1 -- 10.20.193.93:0/635674473 --> v1:10.20.193.93:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd6081de4a0 con 0x7fd6080b5930 2026-02-22T23:24:02.999 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fef6fdfe640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef681440b0 con 0x7fef680b10d0 2026-02-22T23:24:02.999 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fef6fdfe640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef68072830 con 0x7fef6806df80 2026-02-22T23:24:02.999 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fef6db73640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7fef6806df80 0x7fef68072120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:34206/0 (socket says 10.20.193.93:34206) 2026-02-22T23:24:02.999 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fd5dffff640 1 -- 10.20.193.93:0/635674473 <== mon.0 v1:10.20.193.93:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd5f8003e60 con 0x7fd6080b5930 2026-02-22T23:24:02.999 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fd5dffff640 1 -- 10.20.193.93:0/635674473 <== mon.0 v1:10.20.193.93:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fd5f80041f0 con 0x7fd6080b5930 2026-02-22T23:24:03.000 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fef6db73640 1 -- 10.20.193.93:0/145207946 learned_addr learned my addr 10.20.193.93:0/145207946 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:03.000 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fef567fc640 1 -- 10.20.193.93:0/145207946 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2037367816 0 0) 0x7fef68072830 con 0x7fef6806df80 2026-02-22T23:24:03.000 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fc97a7fc640 1 -- 10.20.193.93:0/4191371005 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3814118568 0 0) 0x7fc98c11e610 con 0x7fc98c071180 2026-02-22T23:24:03.000 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fc97a7fc640 1 -- 10.20.193.93:0/4191371005 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc98c11ebd0 con 0x7fc98c071180 2026-02-22T23:24:03.000 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fef567fc640 1 -- 10.20.193.93:0/145207946 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef38003620 con 0x7fef6806df80 2026-02-22T23:24:03.000 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fc97a7fc640 1 -- 10.20.193.93:0/4191371005 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fc97c003450 con 0x7fc98c071180 2026-02-22T23:24:03.001 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fef567fc640 1 -- 10.20.193.93:0/145207946 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1101654624 0 0) 0x7fef38003620 con 0x7fef6806df80 2026-02-22T23:24:03.001 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fc97a7fc640 1 -- 10.20.193.93:0/4191371005 <== mon.2 v1:10.20.193.93:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 529856732 0 0) 0x7fc98c11ebd0 con 0x7fc98c071180 2026-02-22T23:24:03.001 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fc97a7fc640 1 -- 10.20.193.93:0/4191371005 >> v1:10.20.193.155:6789/0 conn(0x7fc98c0721b0 legacy=0x7fc98c137980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:03.001 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fef567fc640 1 -- 10.20.193.93:0/145207946 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fef68072830 con 0x7fef6806df80 2026-02-22T23:24:03.001 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fef567fc640 1 -- 10.20.193.93:0/145207946 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fef58003390 con 0x7fef6806df80 2026-02-22T23:24:03.002 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fc97a7fc640 1 -- 10.20.193.93:0/4191371005 >> v1:10.20.193.93:6789/0 conn(0x7fc98c0afcc0 legacy=0x7fc98c1e5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:03.002 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fc97a7fc640 1 -- 10.20.193.93:0/4191371005 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc98c1ddb10 con 0x7fc98c071180 2026-02-22T23:24:03.002 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fef567fc640 1 -- 10.20.193.93:0/145207946 <== mon.2 v1:10.20.193.93:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2384785338 0 0) 0x7fef68072830 con 0x7fef6806df80 2026-02-22T23:24:03.002 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fef567fc640 1 -- 10.20.193.93:0/145207946 >> v1:10.20.193.155:6789/0 conn(0x7fef680b10d0 legacy=0x7fef68142010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:03.002 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fef567fc640 1 -- 10.20.193.93:0/145207946 >> v1:10.20.193.93:6789/0 conn(0x7fef680b1970 legacy=0x7fef68142720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:03.002 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fc993f6f640 1 -- 10.20.193.93:0/4191371005 --> v1:10.20.193.93:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc98c13fd90 con 0x7fc98c071180 2026-02-22T23:24:03.002 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fc993f6f640 1 -- 10.20.193.93:0/4191371005 --> v1:10.20.193.93:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fc98c11d890 con 0x7fc98c071180 2026-02-22T23:24:03.003 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fef567fc640 1 -- 10.20.193.93:0/145207946 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef681de5d0 con 0x7fef6806df80 2026-02-22T23:24:03.003 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fc97a7fc640 1 -- 10.20.193.93:0/4191371005 <== mon.2 v1:10.20.193.93:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc97c002fa0 con 0x7fc98c071180 2026-02-22T23:24:03.003 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fc97a7fc640 1 -- 10.20.193.93:0/4191371005 <== mon.2 v1:10.20.193.93:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fc97c003ac0 con 0x7fc98c071180 2026-02-22T23:24:03.003 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fef6fdfe640 1 -- 10.20.193.93:0/145207946 --> v1:10.20.193.93:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fef681ddbe0 con 0x7fef6806df80 2026-02-22T23:24:03.003 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.982+0000 7fef6fdfe640 1 -- 10.20.193.93:0/145207946 --> v1:10.20.193.93:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fef68142e30 con 0x7fef6806df80 2026-02-22T23:24:03.003 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.983+0000 7fd60da61640 1 -- 10.20.193.93:0/635674473 --> v1:10.20.193.93:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6080008d0 con 0x7fd6080b5930 2026-02-22T23:24:03.004 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.983+0000 7fef567fc640 1 -- 10.20.193.93:0/145207946 <== mon.2 v1:10.20.193.93:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fef58003020 con 0x7fef6806df80 2026-02-22T23:24:03.004 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.983+0000 7fef567fc640 1 -- 10.20.193.93:0/145207946 <== mon.2 v1:10.20.193.93:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fef58004d30 con 0x7fef6806df80 2026-02-22T23:24:03.004 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.983+0000 7fc993f6f640 1 -- 10.20.193.93:0/4191371005 --> v1:10.20.193.93:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc98c140120 con 0x7fc98c071180 2026-02-22T23:24:03.004 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.983+0000 7fef6fdfe640 1 -- 10.20.193.93:0/145207946 --> v1:10.20.193.93:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef681de880 con 0x7fef6806df80 2026-02-22T23:24:03.004 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.983+0000 7fd5dffff640 1 -- 10.20.193.93:0/635674473 <== mon.0 v1:10.20.193.93:6789/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7fd5f8004410 con 0x7fd6080b5930 2026-02-22T23:24:03.004 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.984+0000 7fd5dffff640 1 -- 10.20.193.93:0/635674473 <== mon.0 v1:10.20.193.93:6789/0 8 ==== osd_map(20..20 src has 1..20) ==== 4142+0+0 (unknown 2994938210 0 0) 0x7fd5f80946d0 con 0x7fd6080b5930 2026-02-22T23:24:03.005 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.984+0000 7fc97a7fc640 1 -- 10.20.193.93:0/4191371005 <== mon.2 v1:10.20.193.93:6790/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7fc97c003c60 con 0x7fc98c071180 2026-02-22T23:24:03.005 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.984+0000 7fef567fc640 1 -- 10.20.193.93:0/145207946 <== mon.2 v1:10.20.193.93:6790/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7fef5801d500 con 0x7fef6806df80 2026-02-22T23:24:03.005 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.984+0000 7fc97a7fc640 1 -- 10.20.193.93:0/4191371005 <== mon.2 v1:10.20.193.93:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 4142+0+0 (unknown 2994938210 0 0) 0x7fc97c094130 con 0x7fc98c071180 2026-02-22T23:24:03.005 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.984+0000 7fef567fc640 1 -- 10.20.193.93:0/145207946 <== mon.2 v1:10.20.193.93:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 4142+0+0 (unknown 2994938210 0 0) 0x7fef580941e0 con 0x7fef6806df80 2026-02-22T23:24:03.006 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.986+0000 7fd5dffff640 1 -- 10.20.193.93:0/635674473 <== mon.0 v1:10.20.193.93:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7fd5f805ded0 con 0x7fd6080b5930 2026-02-22T23:24:03.006 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.986+0000 7fc97a7fc640 1 -- 10.20.193.93:0/4191371005 <== mon.2 v1:10.20.193.93:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7fc97c05d930 con 0x7fc98c071180 2026-02-22T23:24:03.006 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:02.988+0000 7fef567fc640 1 -- 10.20.193.93:0/145207946 <== mon.2 v1:10.20.193.93:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7fef681de880 con 0x7fef6806df80 2026-02-22T23:24:03.008 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.001+0000 7f269aaa9640 1 Processor -- start 2026-02-22T23:24:03.008 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.001+0000 7f269aaa9640 1 -- start start 2026-02-22T23:24:03.008 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.002+0000 7f269aaa9640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2694071530 con 0x7f26940af060 2026-02-22T23:24:03.008 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.002+0000 7f269aaa9640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2694070210 con 0x7f2694140d80 2026-02-22T23:24:03.008 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.002+0000 7f269aaa9640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26940b18f0 con 0x7f26940704d0 2026-02-22T23:24:03.008 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.002+0000 7f269901f640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7f26940704d0 0x7f2694143d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:34214/0 (socket says 10.20.193.93:34214) 2026-02-22T23:24:03.008 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.002+0000 7f269901f640 1 -- 10.20.193.93:0/337662018 learned_addr learned my addr 10.20.193.93:0/337662018 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:03.009 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.002+0000 7f269881e640 1 --1- 10.20.193.93:0/337662018 >> v1:10.20.193.93:6789/0 conn(0x7f26940af060 0x7f2694140670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:47022/0 (socket says 10.20.193.93:47022) 2026-02-22T23:24:03.009 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.002+0000 7f268b7fe640 1 -- 10.20.193.93:0/337662018 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2434413817 0 0) 0x7f26940b18f0 con 0x7f26940704d0 2026-02-22T23:24:03.009 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.002+0000 7f268b7fe640 1 -- 10.20.193.93:0/337662018 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2680003620 con 0x7f26940704d0 2026-02-22T23:24:03.009 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.002+0000 7f268b7fe640 1 -- 10.20.193.93:0/337662018 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2589718040 0 0) 0x7f2694071530 con 0x7f26940af060 2026-02-22T23:24:03.009 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.002+0000 7f268b7fe640 1 -- 10.20.193.93:0/337662018 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26940b18f0 con 0x7f26940af060 2026-02-22T23:24:03.009 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.002+0000 7f268b7fe640 1 -- 10.20.193.93:0/337662018 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 885840469 0 0) 0x7f2680003620 con 0x7f26940704d0 2026-02-22T23:24:03.009 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.002+0000 7f268b7fe640 1 -- 10.20.193.93:0/337662018 >> v1:10.20.193.155:6789/0 conn(0x7f2694140d80 legacy=0x7f2694143670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T23:24:03.009 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.002+0000 7f268b7fe640 1 -- 10.20.193.93:0/337662018 >> v1:10.20.193.93:6789/0 conn(0x7f26940af060 legacy=0x7f2694140670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:03.009 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.002+0000 7f268b7fe640 1 -- 10.20.193.93:0/337662018 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26940b14e0 con 0x7f26940704d0 2026-02-22T23:24:03.009 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.002+0000 7f268b7fe640 1 -- 10.20.193.93:0/337662018 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f2690003220 con 0x7f26940704d0 2026-02-22T23:24:03.009 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.002+0000 7f268b7fe640 1 -- 10.20.193.93:0/337662018 <== mon.2 v1:10.20.193.93:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f26900033c0 con 0x7f26940704d0 2026-02-22T23:24:03.009 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.002+0000 7f268b7fe640 1 -- 10.20.193.93:0/337662018 <== mon.2 v1:10.20.193.93:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f2690003810 con 0x7f26940704d0 2026-02-22T23:24:03.009 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.002+0000 7f269aaa9640 1 -- 10.20.193.93:0/337662018 >> v1:10.20.193.93:6790/0 conn(0x7f26940704d0 legacy=0x7f2694143d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:03.009 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.003+0000 7f269aaa9640 1 -- 10.20.193.93:0/337662018 shutdown_connections 2026-02-22T23:24:03.009 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.003+0000 7f269aaa9640 1 -- 10.20.193.93:0/337662018 >> 10.20.193.93:0/337662018 conn(0x7f26940b1d30 msgr2=0x7f26940b2140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:03.009 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.003+0000 7f269aaa9640 1 -- 10.20.193.93:0/337662018 shutdown_connections 2026-02-22T23:24:03.009 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.003+0000 7f269aaa9640 1 -- 10.20.193.93:0/337662018 wait complete. 2026-02-22T23:24:03.009 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.003+0000 7f269aaa9640 1 Processor -- start 2026-02-22T23:24:03.009 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.003+0000 7f269aaa9640 1 -- start start 2026-02-22T23:24:03.009 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.003+0000 7f269aaa9640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2694145200 con 0x7f26940af060 2026-02-22T23:24:03.009 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.003+0000 7f269aaa9640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26941454e0 con 0x7f2694140d80 2026-02-22T23:24:03.010 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.003+0000 7f269aaa9640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26941457c0 con 0x7f26940704d0 2026-02-22T23:24:03.010 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.003+0000 7f269881e640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7f26940704d0 0x7f26940b4810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:34228/0 (socket says 10.20.193.93:34228) 2026-02-22T23:24:03.010 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.003+0000 7f269881e640 1 -- 10.20.193.93:0/2465976491 learned_addr learned my addr 10.20.193.93:0/2465976491 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:03.010 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.004+0000 7f26897fa640 1 -- 10.20.193.93:0/2465976491 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 314876728 0 0) 0x7f26941457c0 con 0x7f26940704d0 2026-02-22T23:24:03.010 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.004+0000 7f26897fa640 1 -- 10.20.193.93:0/2465976491 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2664003620 con 0x7f26940704d0 2026-02-22T23:24:03.010 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.004+0000 7f26897fa640 1 -- 10.20.193.93:0/2465976491 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4288832632 0 0) 0x7f2694145200 con 0x7f26940af060 2026-02-22T23:24:03.010 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.004+0000 7f26897fa640 1 -- 10.20.193.93:0/2465976491 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26941457c0 con 0x7f26940af060 2026-02-22T23:24:03.010 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.004+0000 7f26897fa640 1 -- 10.20.193.93:0/2465976491 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2826679789 0 0) 0x7f2664003620 con 0x7f26940704d0 2026-02-22T23:24:03.010 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.004+0000 7f26897fa640 1 -- 10.20.193.93:0/2465976491 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2694145200 con 0x7f26940704d0 2026-02-22T23:24:03.010 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.004+0000 7f26897fa640 1 -- 10.20.193.93:0/2465976491 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f2684003200 con 0x7f26940704d0 2026-02-22T23:24:03.010 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.004+0000 7f26897fa640 1 -- 10.20.193.93:0/2465976491 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1815390526 0 0) 0x7f26941457c0 con 0x7f26940af060 2026-02-22T23:24:03.010 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.004+0000 7f26897fa640 1 -- 10.20.193.93:0/2465976491 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2664003620 con 0x7f26940af060 2026-02-22T23:24:03.010 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.004+0000 7f26897fa640 1 -- 10.20.193.93:0/2465976491 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f267c004050 con 0x7f26940af060 2026-02-22T23:24:03.010 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.004+0000 7f26897fa640 1 -- 10.20.193.93:0/2465976491 <== mon.2 v1:10.20.193.93:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1000303962 0 0) 0x7f2694145200 con 0x7f26940704d0 2026-02-22T23:24:03.010 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.004+0000 7f26897fa640 1 -- 10.20.193.93:0/2465976491 >> v1:10.20.193.155:6789/0 conn(0x7f2694140d80 legacy=0x7f2694072ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:03.010 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.004+0000 7f26897fa640 1 -- 10.20.193.93:0/2465976491 >> v1:10.20.193.93:6789/0 conn(0x7f26940af060 legacy=0x7f26940727e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:03.010 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.004+0000 7f26897fa640 1 -- 10.20.193.93:0/2465976491 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2694147740 con 0x7f26940704d0 2026-02-22T23:24:03.010 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.004+0000 7f269aaa9640 1 -- 10.20.193.93:0/2465976491 --> v1:10.20.193.93:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f26940722c0 con 0x7f26940704d0 2026-02-22T23:24:03.010 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.004+0000 7f269aaa9640 1 -- 10.20.193.93:0/2465976491 --> v1:10.20.193.93:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f26941e63f0 con 0x7f26940704d0 2026-02-22T23:24:03.010 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.004+0000 7f26897fa640 1 -- 10.20.193.93:0/2465976491 <== mon.2 v1:10.20.193.93:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2684003480 con 0x7f26940704d0 2026-02-22T23:24:03.010 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.004+0000 7f26897fa640 1 -- 10.20.193.93:0/2465976491 <== mon.2 v1:10.20.193.93:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f2684004d30 con 0x7f26940704d0 2026-02-22T23:24:03.010 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.004+0000 7f269aaa9640 1 -- 10.20.193.93:0/2465976491 --> v1:10.20.193.93:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2694140930 con 0x7f26940704d0 2026-02-22T23:24:03.011 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.005+0000 7f26897fa640 1 -- 10.20.193.93:0/2465976491 <== mon.2 v1:10.20.193.93:6790/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7f268401d500 con 0x7f26940704d0 2026-02-22T23:24:03.011 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.006+0000 7f26897fa640 1 -- 10.20.193.93:0/2465976491 <== mon.2 v1:10.20.193.93:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 4142+0+0 (unknown 2994938210 0 0) 0x7f26840942e0 con 0x7f26940704d0 2026-02-22T23:24:03.011 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.007+0000 7f26897fa640 1 -- 10.20.193.93:0/2465976491 <== mon.2 v1:10.20.193.93:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f268405db40 con 0x7f26940704d0 2026-02-22T23:24:03.031 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.028+0000 7faed0ff7640 1 -- 10.20.193.93:0/1100010809 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fae94005470 con 0x7faecc0b5c90 2026-02-22T23:24:03.031 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.028+0000 7faeb2ffd640 1 -- 10.20.193.93:0/1100010809 <== mon.1 v1:10.20.193.155:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (unknown 1823589948 0 326014871) 0x7faec005be90 con 0x7faecc0b5c90 2026-02-22T23:24:03.031 INFO:teuthology.orchestra.run.trial093.stdout:60129542146 2026-02-22T23:24:03.032 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.029+0000 7fc667af5640 1 -- 10.20.193.93:0/4077221623 --> v1:10.20.193.93:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fc660069c60 con 0x7fc6600aadd0 2026-02-22T23:24:03.032 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.029+0000 7fc64e7fc640 1 -- 10.20.193.93:0/4077221623 <== mon.2 v1:10.20.193.93:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (unknown 383520633 0 326014871) 0x7fc65005d4e0 con 0x7fc6600aadd0 2026-02-22T23:24:03.032 INFO:teuthology.orchestra.run.trial093.stdout:60129542146 2026-02-22T23:24:03.034 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.030+0000 7f4c16fed640 1 -- 10.20.193.93:0/2238508140 --> v1:10.20.193.93:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f4c1013c170 con 0x7f4c10140ec0 2026-02-22T23:24:03.034 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.030+0000 7faed0ff7640 1 -- 10.20.193.93:0/1100010809 >> v1:10.20.193.155:6800/3108481844 conn(0x7fae980782a0 legacy=0x7fae9807a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:03.034 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.030+0000 7faed0ff7640 1 -- 10.20.193.93:0/1100010809 >> v1:10.20.193.155:6789/0 conn(0x7faecc0b5c90 legacy=0x7faecc1daf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:03.034 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.031+0000 7faed0ff7640 1 -- 10.20.193.93:0/1100010809 shutdown_connections 2026-02-22T23:24:03.035 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.031+0000 7faed0ff7640 1 -- 10.20.193.93:0/1100010809 >> 10.20.193.93:0/1100010809 conn(0x7faecc068410 msgr2=0x7faecc0b4610 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:03.035 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.031+0000 7faed0ff7640 1 -- 10.20.193.93:0/1100010809 shutdown_connections 2026-02-22T23:24:03.035 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.031+0000 7faed0ff7640 1 -- 10.20.193.93:0/1100010809 wait complete. 2026-02-22T23:24:03.035 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.031+0000 7f4c057fa640 1 -- 10.20.193.93:0/2238508140 <== mon.0 v1:10.20.193.93:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (unknown 1274345170 0 326014871) 0x7f4c0c05dde0 con 0x7f4c10140ec0 2026-02-22T23:24:03.035 INFO:teuthology.orchestra.run.trial093.stdout:60129542146 2026-02-22T23:24:03.036 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.031+0000 7fc667af5640 1 -- 10.20.193.93:0/4077221623 >> v1:10.20.193.155:6800/3108481844 conn(0x7fc630077c80 legacy=0x7fc63007a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:03.036 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.031+0000 7fc667af5640 1 -- 10.20.193.93:0/4077221623 >> v1:10.20.193.93:6790/0 conn(0x7fc6600aadd0 legacy=0x7fc660120b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:03.036 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.031+0000 7fc667af5640 1 -- 10.20.193.93:0/4077221623 shutdown_connections 2026-02-22T23:24:03.036 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.031+0000 7fc667af5640 1 -- 10.20.193.93:0/4077221623 >> 10.20.193.93:0/4077221623 conn(0x7fc6600b5ef0 msgr2=0x7fc6600b62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:03.036 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.032+0000 7fc667af5640 1 -- 10.20.193.93:0/4077221623 shutdown_connections 2026-02-22T23:24:03.036 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.032+0000 7fc667af5640 1 -- 10.20.193.93:0/4077221623 wait complete. 2026-02-22T23:24:03.036 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.033+0000 7f8dfe9a0640 1 -- 10.20.193.93:0/1498993047 --> v1:10.20.193.93:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f8df8076790 con 0x7f8df80b36c0 2026-02-22T23:24:03.036 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.033+0000 7f8df4ff9640 1 -- 10.20.193.93:0/1498993047 <== mon.2 v1:10.20.193.93:6790/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (unknown 1482059429 0 2194451396) 0x7f8de4062d80 con 0x7f8df80b36c0 2026-02-22T23:24:03.037 INFO:teuthology.orchestra.run.trial093.stdout:55834574851 2026-02-22T23:24:03.037 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.033+0000 7f4c16fed640 1 -- 10.20.193.93:0/2238508140 >> v1:10.20.193.155:6800/3108481844 conn(0x7f4be0077d20 legacy=0x7f4be007a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:03.037 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.033+0000 7f4c16fed640 1 -- 10.20.193.93:0/2238508140 >> v1:10.20.193.93:6789/0 conn(0x7f4c10140ec0 legacy=0x7f4c101e5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:03.037 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.033+0000 7f4c16fed640 1 -- 10.20.193.93:0/2238508140 shutdown_connections 2026-02-22T23:24:03.037 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.033+0000 7f4c16fed640 1 -- 10.20.193.93:0/2238508140 >> 10.20.193.93:0/2238508140 conn(0x7f4c10068410 msgr2=0x7f4c100b4610 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:03.037 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.033+0000 7f4c16fed640 1 -- 10.20.193.93:0/2238508140 shutdown_connections 2026-02-22T23:24:03.038 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.033+0000 7f4c16fed640 1 -- 10.20.193.93:0/2238508140 wait complete. 2026-02-22T23:24:03.038 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.035+0000 7f8dfe9a0640 1 -- 10.20.193.93:0/1498993047 >> v1:10.20.193.155:6800/3108481844 conn(0x7f8dc80780e0 legacy=0x7f8dc807a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:03.039 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.035+0000 7f8dfe9a0640 1 -- 10.20.193.93:0/1498993047 >> v1:10.20.193.93:6790/0 conn(0x7f8df80b36c0 legacy=0x7f8dc8085750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:03.039 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.035+0000 7f8dfe9a0640 1 -- 10.20.193.93:0/1498993047 shutdown_connections 2026-02-22T23:24:03.039 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.035+0000 7f8dfe9a0640 1 -- 10.20.193.93:0/1498993047 >> 10.20.193.93:0/1498993047 conn(0x7f8df8068410 msgr2=0x7f8df80b9960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:03.039 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.035+0000 7f8dfe9a0640 1 -- 10.20.193.93:0/1498993047 shutdown_connections 2026-02-22T23:24:03.039 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.035+0000 7f8dfe9a0640 1 -- 10.20.193.93:0/1498993047 wait complete. 2026-02-22T23:24:03.045 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542146 for osd.4 2026-02-22T23:24:03.045 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542146 for osd.3 2026-02-22T23:24:03.046 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542146 for osd.6 2026-02-22T23:24:03.047 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.7 2026-02-22T23:24:03.079 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.076+0000 7fc993f6f640 1 -- 10.20.193.93:0/4191371005 --> v1:10.20.193.93:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fc98c076960 con 0x7fc98c071180 2026-02-22T23:24:03.079 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.076+0000 7fc97a7fc640 1 -- 10.20.193.93:0/4191371005 <== mon.2 v1:10.20.193.93:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (unknown 2131975755 0 326014871) 0x7fc97c05d230 con 0x7fc98c071180 2026-02-22T23:24:03.080 INFO:teuthology.orchestra.run.trial093.stdout:60129542146 2026-02-22T23:24:03.080 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.077+0000 7fd60da61640 1 -- 10.20.193.93:0/635674473 --> v1:10.20.193.93:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fd60813d7c0 con 0x7fd6080b5930 2026-02-22T23:24:03.080 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.077+0000 7fd5dffff640 1 -- 10.20.193.93:0/635674473 <== mon.0 v1:10.20.193.93:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (unknown 92182286 0 326014871) 0x7fd5f805d7d0 con 0x7fd6080b5930 2026-02-22T23:24:03.081 INFO:teuthology.orchestra.run.trial093.stdout:60129542146 2026-02-22T23:24:03.081 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.078+0000 7fc993f6f640 1 -- 10.20.193.93:0/4191371005 >> v1:10.20.193.155:6800/3108481844 conn(0x7fc95c078080 legacy=0x7fc95c07a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:03.082 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.078+0000 7fc993f6f640 1 -- 10.20.193.93:0/4191371005 >> v1:10.20.193.93:6790/0 conn(0x7fc98c071180 legacy=0x7fc98c11cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:03.082 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.078+0000 7fc993f6f640 1 -- 10.20.193.93:0/4191371005 shutdown_connections 2026-02-22T23:24:03.082 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.078+0000 7fc993f6f640 1 -- 10.20.193.93:0/4191371005 >> 10.20.193.93:0/4191371005 conn(0x7fc98c0b1d30 msgr2=0x7fc98c071750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:03.082 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.078+0000 7fc993f6f640 1 -- 10.20.193.93:0/4191371005 shutdown_connections 2026-02-22T23:24:03.082 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.078+0000 7fc993f6f640 1 -- 10.20.193.93:0/4191371005 wait complete. 2026-02-22T23:24:03.082 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.078+0000 7fef6fdfe640 1 -- 10.20.193.93:0/145207946 --> v1:10.20.193.93:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fef68076790 con 0x7fef6806df80 2026-02-22T23:24:03.082 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.078+0000 7fef567fc640 1 -- 10.20.193.93:0/145207946 <== mon.2 v1:10.20.193.93:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (unknown 574334944 0 326014871) 0x7fef5805d9e0 con 0x7fef6806df80 2026-02-22T23:24:03.083 INFO:teuthology.orchestra.run.trial093.stdout:60129542146 2026-02-22T23:24:03.084 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.079+0000 7fd60da61640 1 -- 10.20.193.93:0/635674473 >> v1:10.20.193.155:6800/3108481844 conn(0x7fd5d8078080 legacy=0x7fd5d807a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:03.084 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.079+0000 7fd60da61640 1 -- 10.20.193.93:0/635674473 >> v1:10.20.193.93:6789/0 conn(0x7fd6080b5930 legacy=0x7fd60813c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:03.084 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.079+0000 7fd60da61640 1 -- 10.20.193.93:0/635674473 shutdown_connections 2026-02-22T23:24:03.084 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.079+0000 7fd60da61640 1 -- 10.20.193.93:0/635674473 >> 10.20.193.93:0/635674473 conn(0x7fd6080b9310 msgr2=0x7fd6080b96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:03.084 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.079+0000 7fd60da61640 1 -- 10.20.193.93:0/635674473 shutdown_connections 2026-02-22T23:24:03.084 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.079+0000 7fd60da61640 1 -- 10.20.193.93:0/635674473 wait complete. 2026-02-22T23:24:03.085 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.080+0000 7fef6fdfe640 1 -- 10.20.193.93:0/145207946 >> v1:10.20.193.155:6800/3108481844 conn(0x7fef38077f90 legacy=0x7fef3807a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:03.085 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.080+0000 7fef6fdfe640 1 -- 10.20.193.93:0/145207946 >> v1:10.20.193.93:6790/0 conn(0x7fef6806df80 legacy=0x7fef68072120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:03.085 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.080+0000 7fef6fdfe640 1 -- 10.20.193.93:0/145207946 shutdown_connections 2026-02-22T23:24:03.085 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.080+0000 7fef6fdfe640 1 -- 10.20.193.93:0/145207946 >> 10.20.193.93:0/145207946 conn(0x7fef680b7150 msgr2=0x7fef68140aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:03.085 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.080+0000 7fef6fdfe640 1 -- 10.20.193.93:0/145207946 shutdown_connections 2026-02-22T23:24:03.085 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.080+0000 7fef6fdfe640 1 -- 10.20.193.93:0/145207946 wait complete. 2026-02-22T23:24:03.089 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542146 for osd.5 2026-02-22T23:24:03.090 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542146 for osd.2 2026-02-22T23:24:03.092 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542146 for osd.0 2026-02-22T23:24:03.098 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.095+0000 7f269aaa9640 1 -- 10.20.193.93:0/2465976491 --> v1:10.20.193.93:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f2694076960 con 0x7f26940704d0 2026-02-22T23:24:03.098 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.095+0000 7f26897fa640 1 -- 10.20.193.93:0/2465976491 <== mon.2 v1:10.20.193.93:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (unknown 832126871 0 2194451396) 0x7f268405d440 con 0x7f26940704d0 2026-02-22T23:24:03.098 INFO:teuthology.orchestra.run.trial093.stdout:55834574851 2026-02-22T23:24:03.099 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.097+0000 7f269aaa9640 1 -- 10.20.193.93:0/2465976491 >> v1:10.20.193.155:6800/3108481844 conn(0x7f2664077fd0 legacy=0x7f266407a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:03.099 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.097+0000 7f269aaa9640 1 -- 10.20.193.93:0/2465976491 >> v1:10.20.193.93:6790/0 conn(0x7f26940704d0 legacy=0x7f26940b4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:03.100 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.097+0000 7f269aaa9640 1 -- 10.20.193.93:0/2465976491 shutdown_connections 2026-02-22T23:24:03.100 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.097+0000 7f269aaa9640 1 -- 10.20.193.93:0/2465976491 >> 10.20.193.93:0/2465976491 conn(0x7f26940b1d30 msgr2=0x7f269414f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:03.100 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.097+0000 7f269aaa9640 1 -- 10.20.193.93:0/2465976491 shutdown_connections 2026-02-22T23:24:03.100 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:03.097+0000 7f269aaa9640 1 -- 10.20.193.93:0/2465976491 wait complete. 2026-02-22T23:24:03.107 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.1 2026-02-22T23:24:04.046 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-22T23:24:04.046 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-22T23:24:04.047 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2026-02-22T23:24:04.048 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2026-02-22T23:24:04.090 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-22T23:24:04.091 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-22T23:24:04.093 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-22T23:24:04.108 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-22T23:24:04.117 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.114+0000 7f9d53f7e640 1 Processor -- start 2026-02-22T23:24:04.117 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.114+0000 7f9d53f7e640 1 -- start start 2026-02-22T23:24:04.117 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.114+0000 7fbff117e640 1 Processor -- start 2026-02-22T23:24:04.117 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.114+0000 7fbff117e640 1 -- start start 2026-02-22T23:24:04.117 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.114+0000 7f397f155640 1 Processor -- start 2026-02-22T23:24:04.117 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.114+0000 7f397f155640 1 -- start start 2026-02-22T23:24:04.118 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.114+0000 7f9d53f7e640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d4c147180 con 0x7f9d4c0b36c0 2026-02-22T23:24:04.118 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.114+0000 7f9d53f7e640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d4c0b5fc0 con 0x7f9d4c0aa8e0 2026-02-22T23:24:04.118 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.114+0000 7f9d53f7e640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d4c0b6190 con 0x7f9d4c0b5be0 2026-02-22T23:24:04.119 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.115+0000 7fbff117e640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfec147180 con 0x7fbfec0b36c0 2026-02-22T23:24:04.119 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.115+0000 7fbff117e640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfec0b5fc0 con 0x7fbfec0b5be0 2026-02-22T23:24:04.119 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.115+0000 7fbff117e640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfec0b6190 con 0x7fbfec0aa8e0 2026-02-22T23:24:04.119 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.115+0000 7fbfea575640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7fbfec0aa8e0 0x7fbfec140710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:34244/0 (socket says 10.20.193.93:34244) 2026-02-22T23:24:04.119 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.115+0000 7fbfea575640 1 -- 10.20.193.93:0/2215841937 learned_addr learned my addr 10.20.193.93:0/2215841937 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:04.119 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.115+0000 7fbfe9d74640 1 -- 10.20.193.93:0/2215841937 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3248694060 0 0) 0x7fbfec0b6190 con 0x7fbfec0aa8e0 2026-02-22T23:24:04.119 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.115+0000 7fbfe9d74640 1 -- 10.20.193.93:0/2215841937 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbfd8003620 con 0x7fbfec0aa8e0 2026-02-22T23:24:04.119 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.115+0000 7fbfe9d74640 1 -- 10.20.193.93:0/2215841937 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3913768102 0 0) 0x7fbfec147180 con 0x7fbfec0b36c0 2026-02-22T23:24:04.119 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.115+0000 7fbfe9d74640 1 -- 10.20.193.93:0/2215841937 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbfec0b6190 con 0x7fbfec0b36c0 2026-02-22T23:24:04.119 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.115+0000 7fbfe9d74640 1 -- 10.20.193.93:0/2215841937 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1567494494 0 0) 0x7fbfd8003620 con 0x7fbfec0aa8e0 2026-02-22T23:24:04.119 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.115+0000 7fbfe9d74640 1 -- 10.20.193.93:0/2215841937 >> v1:10.20.193.155:6789/0 conn(0x7fbfec0b5be0 legacy=0x7fbfec146a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.119 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.115+0000 7fbfe9d74640 1 -- 10.20.193.93:0/2215841937 >> v1:10.20.193.93:6789/0 conn(0x7fbfec0b36c0 legacy=0x7fbfec14edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.119 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.115+0000 7fbfe9d74640 1 -- 10.20.193.93:0/2215841937 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfec0ab290 con 0x7fbfec0aa8e0 2026-02-22T23:24:04.119 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.115+0000 7fbfe9d74640 1 -- 10.20.193.93:0/2215841937 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fbfd4002ea0 con 0x7fbfec0aa8e0 2026-02-22T23:24:04.119 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.115+0000 7fbfe9d74640 1 -- 10.20.193.93:0/2215841937 <== mon.2 v1:10.20.193.93:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbfd4003040 con 0x7fbfec0aa8e0 2026-02-22T23:24:04.119 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.115+0000 7fbfe9d74640 1 -- 10.20.193.93:0/2215841937 <== mon.2 v1:10.20.193.93:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fbfd4003490 con 0x7fbfec0aa8e0 2026-02-22T23:24:04.119 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.115+0000 7f397f155640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3978147180 con 0x7f39780b5be0 2026-02-22T23:24:04.119 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.115+0000 7f397f155640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39780b5fc0 con 0x7f39780b36c0 2026-02-22T23:24:04.119 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.115+0000 7f397f155640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39780b6190 con 0x7f39780aa8e0 2026-02-22T23:24:04.119 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.115+0000 7f397ceca640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7f39780b5be0 0x7f3978146a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:47056/0 (socket says 10.20.193.93:47056) 2026-02-22T23:24:04.119 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.115+0000 7f397ceca640 1 -- 10.20.193.93:0/1341348848 learned_addr learned my addr 10.20.193.93:0/1341348848 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:04.119 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.115+0000 7f396f7fe640 1 -- 10.20.193.93:0/1341348848 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 791350136 0 0) 0x7f3978147180 con 0x7f39780b5be0 2026-02-22T23:24:04.119 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.115+0000 7f396f7fe640 1 -- 10.20.193.93:0/1341348848 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3964003620 con 0x7f39780b5be0 2026-02-22T23:24:04.119 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.115+0000 7f396f7fe640 1 -- 10.20.193.93:0/1341348848 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 534986816 0 0) 0x7f39780b6190 con 0x7f39780aa8e0 2026-02-22T23:24:04.119 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.115+0000 7f396f7fe640 1 -- 10.20.193.93:0/1341348848 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3978147180 con 0x7f39780aa8e0 2026-02-22T23:24:04.119 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.115+0000 7f396f7fe640 1 -- 10.20.193.93:0/1341348848 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 668409250 0 0) 0x7f3964003620 con 0x7f39780b5be0 2026-02-22T23:24:04.120 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.115+0000 7f396f7fe640 1 -- 10.20.193.93:0/1341348848 >> v1:10.20.193.93:6790/0 conn(0x7f39780aa8e0 legacy=0x7f3978140710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.120 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.115+0000 7f396f7fe640 1 -- 10.20.193.93:0/1341348848 >> v1:10.20.193.155:6789/0 conn(0x7f39780b36c0 legacy=0x7f397814edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T23:24:04.120 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.115+0000 7f396f7fe640 1 -- 10.20.193.93:0/1341348848 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39780ab290 con 0x7f39780b5be0 2026-02-22T23:24:04.120 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.115+0000 7f396f7fe640 1 -- 10.20.193.93:0/1341348848 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f3968002ea0 con 0x7f39780b5be0 2026-02-22T23:24:04.120 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.115+0000 7f396f7fe640 1 -- 10.20.193.93:0/1341348848 <== mon.0 v1:10.20.193.93:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3968003040 con 0x7f39780b5be0 2026-02-22T23:24:04.120 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.115+0000 7f396f7fe640 1 -- 10.20.193.93:0/1341348848 <== mon.0 v1:10.20.193.93:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f3968003490 con 0x7f39780b5be0 2026-02-22T23:24:04.120 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.114+0000 7f9d51cf3640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7f9d4c0b5be0 0x7f9d4c146a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:34232/0 (socket says 10.20.193.93:34232) 2026-02-22T23:24:04.120 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.114+0000 7f9d51cf3640 1 -- 10.20.193.93:0/704350207 learned_addr learned my addr 10.20.193.93:0/704350207 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:04.120 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.115+0000 7f9d50cf1640 1 -- 10.20.193.93:0/704350207 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3008272748 0 0) 0x7f9d4c147180 con 0x7f9d4c0b36c0 2026-02-22T23:24:04.120 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.115+0000 7f9d50cf1640 1 -- 10.20.193.93:0/704350207 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d34003620 con 0x7f9d4c0b36c0 2026-02-22T23:24:04.120 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.115+0000 7f9d50cf1640 1 -- 10.20.193.93:0/704350207 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1922127111 0 0) 0x7f9d4c0b6190 con 0x7f9d4c0b5be0 2026-02-22T23:24:04.120 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.115+0000 7f9d50cf1640 1 -- 10.20.193.93:0/704350207 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d4c147180 con 0x7f9d4c0b5be0 2026-02-22T23:24:04.120 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.115+0000 7f9d50cf1640 1 -- 10.20.193.93:0/704350207 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2241196421 0 0) 0x7f9d34003620 con 0x7f9d4c0b36c0 2026-02-22T23:24:04.120 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.115+0000 7f9d50cf1640 1 -- 10.20.193.93:0/704350207 >> v1:10.20.193.93:6790/0 conn(0x7f9d4c0b5be0 legacy=0x7f9d4c146a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.120 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.115+0000 7f9d50cf1640 1 -- 10.20.193.93:0/704350207 >> v1:10.20.193.155:6789/0 conn(0x7f9d4c0aa8e0 legacy=0x7f9d4c140710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.120 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.115+0000 7f9d50cf1640 1 -- 10.20.193.93:0/704350207 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d4c0ab290 con 0x7f9d4c0b36c0 2026-02-22T23:24:04.120 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.115+0000 7f9d50cf1640 1 -- 10.20.193.93:0/704350207 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f9d48003220 con 0x7f9d4c0b36c0 2026-02-22T23:24:04.120 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.115+0000 7f9d50cf1640 1 -- 10.20.193.93:0/704350207 <== mon.0 v1:10.20.193.93:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9d480033c0 con 0x7f9d4c0b36c0 2026-02-22T23:24:04.120 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.115+0000 7f9d50cf1640 1 -- 10.20.193.93:0/704350207 <== mon.0 v1:10.20.193.93:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f9d48003810 con 0x7f9d4c0b36c0 2026-02-22T23:24:04.120 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.115+0000 7f9d53f7e640 1 -- 10.20.193.93:0/704350207 >> v1:10.20.193.93:6789/0 conn(0x7f9d4c0b36c0 legacy=0x7f9d4c14edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.120 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.115+0000 7f9d53f7e640 1 -- 10.20.193.93:0/704350207 shutdown_connections 2026-02-22T23:24:04.120 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.115+0000 7f9d53f7e640 1 -- 10.20.193.93:0/704350207 >> 10.20.193.93:0/704350207 conn(0x7f9d4c068410 msgr2=0x7f9d4c068820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:04.120 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.115+0000 7f9d53f7e640 1 -- 10.20.193.93:0/704350207 shutdown_connections 2026-02-22T23:24:04.120 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.115+0000 7f9d53f7e640 1 -- 10.20.193.93:0/704350207 wait complete. 2026-02-22T23:24:04.121 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.115+0000 7f397f155640 1 -- 10.20.193.93:0/1341348848 >> v1:10.20.193.93:6789/0 conn(0x7f39780b5be0 legacy=0x7f3978146a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.121 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.116+0000 7f397f155640 1 -- 10.20.193.93:0/1341348848 shutdown_connections 2026-02-22T23:24:04.121 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.116+0000 7f397f155640 1 -- 10.20.193.93:0/1341348848 >> 10.20.193.93:0/1341348848 conn(0x7f3978068410 msgr2=0x7f3978068820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:04.121 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.116+0000 7f397f155640 1 -- 10.20.193.93:0/1341348848 shutdown_connections 2026-02-22T23:24:04.121 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.116+0000 7f397f155640 1 -- 10.20.193.93:0/1341348848 wait complete. 2026-02-22T23:24:04.121 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.116+0000 7fbff117e640 1 -- 10.20.193.93:0/2215841937 >> v1:10.20.193.93:6790/0 conn(0x7fbfec0aa8e0 legacy=0x7fbfec140710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.121 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.116+0000 7fbff117e640 1 -- 10.20.193.93:0/2215841937 shutdown_connections 2026-02-22T23:24:04.121 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.116+0000 7fbff117e640 1 -- 10.20.193.93:0/2215841937 >> 10.20.193.93:0/2215841937 conn(0x7fbfec068410 msgr2=0x7fbfec068820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:04.121 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.116+0000 7fbff117e640 1 -- 10.20.193.93:0/2215841937 shutdown_connections 2026-02-22T23:24:04.121 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.116+0000 7fbff117e640 1 -- 10.20.193.93:0/2215841937 wait complete. 2026-02-22T23:24:04.121 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.116+0000 7f9d53f7e640 1 Processor -- start 2026-02-22T23:24:04.121 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.116+0000 7f397f155640 1 Processor -- start 2026-02-22T23:24:04.121 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.116+0000 7f397f155640 1 -- start start 2026-02-22T23:24:04.121 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.116+0000 7f9d53f7e640 1 -- start start 2026-02-22T23:24:04.122 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.116+0000 7fbff117e640 1 Processor -- start 2026-02-22T23:24:04.122 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.116+0000 7fbff117e640 1 -- start start 2026-02-22T23:24:04.122 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.116+0000 7f397f155640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39780af370 con 0x7f39780b5be0 2026-02-22T23:24:04.122 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.116+0000 7f397f155640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39780af5e0 con 0x7f39780b36c0 2026-02-22T23:24:04.122 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.116+0000 7f397f155640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39780af8c0 con 0x7f39780ad740 2026-02-22T23:24:04.122 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7f396ffff640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7f39780b5be0 0x7f39781de2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:47066/0 (socket says 10.20.193.93:47066) 2026-02-22T23:24:04.122 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7f396ffff640 1 -- 10.20.193.93:0/2058045818 learned_addr learned my addr 10.20.193.93:0/2058045818 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:04.122 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7f396d7fa640 1 -- 10.20.193.93:0/2058045818 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 427929310 0 0) 0x7f39780af370 con 0x7f39780b5be0 2026-02-22T23:24:04.122 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7f9d53f7e640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d4c0af790 con 0x7f9d4c0b36c0 2026-02-22T23:24:04.122 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7f396d7fa640 1 -- 10.20.193.93:0/2058045818 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3948003620 con 0x7f39780b5be0 2026-02-22T23:24:04.122 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7f9d53f7e640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d4c0afa70 con 0x7f9d4c0b5be0 2026-02-22T23:24:04.122 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7f9d53f7e640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d4c0aea30 con 0x7f9d4c0b2c60 2026-02-22T23:24:04.122 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7f9d51cf3640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7f9d4c0b36c0 0x7f9d4c0ae160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:47082/0 (socket says 10.20.193.93:47082) 2026-02-22T23:24:04.123 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7f9d51cf3640 1 -- 10.20.193.93:0/1116474261 learned_addr learned my addr 10.20.193.93:0/1116474261 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:04.123 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7f396d7fa640 1 -- 10.20.193.93:0/2058045818 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1535444453 0 0) 0x7f3948003620 con 0x7f39780b5be0 2026-02-22T23:24:04.123 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7f396d7fa640 1 -- 10.20.193.93:0/2058045818 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f39780af370 con 0x7f39780b5be0 2026-02-22T23:24:04.123 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7fbff117e640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfec1d1350 con 0x7fbfec1deb40 2026-02-22T23:24:04.123 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7f396d7fa640 1 -- 10.20.193.93:0/2058045818 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f3960003220 con 0x7f39780b5be0 2026-02-22T23:24:04.123 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7fbff117e640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfec1d15c0 con 0x7fbfec0b36c0 2026-02-22T23:24:04.123 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7fbff117e640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfec141610 con 0x7fbfec0b5be0 2026-02-22T23:24:04.123 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7f396d7fa640 1 -- 10.20.193.93:0/2058045818 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2821276613 0 0) 0x7f39780af8c0 con 0x7f39780ad740 2026-02-22T23:24:04.123 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7f396d7fa640 1 -- 10.20.193.93:0/2058045818 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3948003620 con 0x7f39780ad740 2026-02-22T23:24:04.123 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7fbfeb577640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7fbfec1deb40 0x7fbfec1459a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:47088/0 (socket says 10.20.193.93:47088) 2026-02-22T23:24:04.123 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7fbfea575640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7fbfec0b5be0 0x7fbfec144e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:34284/0 (socket says 10.20.193.93:34284) 2026-02-22T23:24:04.123 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7fbfeb577640 1 -- 10.20.193.93:0/3067665307 learned_addr learned my addr 10.20.193.93:0/3067665307 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:04.124 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7f396d7fa640 1 -- 10.20.193.93:0/2058045818 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3641592525 0 0) 0x7f39780af5e0 con 0x7f39780b36c0 2026-02-22T23:24:04.124 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7f396d7fa640 1 -- 10.20.193.93:0/2058045818 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f39780af8c0 con 0x7f39780b36c0 2026-02-22T23:24:04.124 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7f9d3a7fc640 1 -- 10.20.193.93:0/1116474261 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2829888412 0 0) 0x7f9d4c0af790 con 0x7f9d4c0b36c0 2026-02-22T23:24:04.124 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7f396d7fa640 1 -- 10.20.193.93:0/2058045818 <== mon.0 v1:10.20.193.93:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 754717444 0 0) 0x7f39780af370 con 0x7f39780b5be0 2026-02-22T23:24:04.124 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7f396d7fa640 1 -- 10.20.193.93:0/2058045818 >> v1:10.20.193.93:6790/0 conn(0x7f39780ad740 legacy=0x7f39781e4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.124 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7f396d7fa640 1 -- 10.20.193.93:0/2058045818 >> v1:10.20.193.155:6789/0 conn(0x7f39780b36c0 legacy=0x7f39781ddbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.124 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7f9d3a7fc640 1 -- 10.20.193.93:0/1116474261 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d1c003620 con 0x7f9d4c0b36c0 2026-02-22T23:24:04.124 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7f396d7fa640 1 -- 10.20.193.93:0/2058045818 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39780ae1c0 con 0x7f39780b5be0 2026-02-22T23:24:04.124 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7f9d3a7fc640 1 -- 10.20.193.93:0/1116474261 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 517447866 0 0) 0x7f9d4c0aea30 con 0x7f9d4c0b2c60 2026-02-22T23:24:04.124 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7f9d3a7fc640 1 -- 10.20.193.93:0/1116474261 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d4c0af790 con 0x7f9d4c0b2c60 2026-02-22T23:24:04.124 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7f397f155640 1 -- 10.20.193.93:0/2058045818 --> v1:10.20.193.93:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f39780ae4b0 con 0x7f39780b5be0 2026-02-22T23:24:04.124 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7f397f155640 1 -- 10.20.193.93:0/2058045818 --> v1:10.20.193.93:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f39781e6890 con 0x7f39780b5be0 2026-02-22T23:24:04.125 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7fbfcb7fe640 1 -- 10.20.193.93:0/3067665307 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2356598572 0 0) 0x7fbfec1d1350 con 0x7fbfec1deb40 2026-02-22T23:24:04.125 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7f9d3a7fc640 1 -- 10.20.193.93:0/1116474261 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 742126277 0 0) 0x7f9d4c0af790 con 0x7f9d4c0b2c60 2026-02-22T23:24:04.125 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7f9d3a7fc640 1 -- 10.20.193.93:0/1116474261 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9d4c0aea30 con 0x7f9d4c0b2c60 2026-02-22T23:24:04.125 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7f9d3a7fc640 1 -- 10.20.193.93:0/1116474261 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f9d48003710 con 0x7f9d4c0b2c60 2026-02-22T23:24:04.125 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7fbfcb7fe640 1 -- 10.20.193.93:0/3067665307 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbfb8003620 con 0x7fbfec1deb40 2026-02-22T23:24:04.125 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7f9d3a7fc640 1 -- 10.20.193.93:0/1116474261 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 122033703 0 0) 0x7f9d4c0afa70 con 0x7f9d4c0b5be0 2026-02-22T23:24:04.125 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7f9d3a7fc640 1 -- 10.20.193.93:0/1116474261 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d4c0af790 con 0x7f9d4c0b5be0 2026-02-22T23:24:04.125 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7f9d3a7fc640 1 -- 10.20.193.93:0/1116474261 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1187064113 0 0) 0x7f9d1c003620 con 0x7f9d4c0b36c0 2026-02-22T23:24:04.125 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7f396d7fa640 1 -- 10.20.193.93:0/2058045818 <== mon.0 v1:10.20.193.93:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3960003560 con 0x7f39780b5be0 2026-02-22T23:24:04.125 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7f9d3a7fc640 1 -- 10.20.193.93:0/1116474261 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9d4c0afa70 con 0x7f9d4c0b36c0 2026-02-22T23:24:04.126 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7f9d3a7fc640 1 -- 10.20.193.93:0/1116474261 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f9d3c0030a0 con 0x7f9d4c0b36c0 2026-02-22T23:24:04.126 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7f9d3a7fc640 1 -- 10.20.193.93:0/1116474261 <== mon.2 v1:10.20.193.93:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 935016577 0 0) 0x7f9d4c0aea30 con 0x7f9d4c0b2c60 2026-02-22T23:24:04.126 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7f9d3a7fc640 1 -- 10.20.193.93:0/1116474261 >> v1:10.20.193.155:6789/0 conn(0x7f9d4c0b5be0 legacy=0x7f9d4c0b2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.126 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7f9d3a7fc640 1 -- 10.20.193.93:0/1116474261 >> v1:10.20.193.93:6789/0 conn(0x7f9d4c0b36c0 legacy=0x7f9d4c0ae160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.126 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7f9d3a7fc640 1 -- 10.20.193.93:0/1116474261 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d4c13b040 con 0x7f9d4c0b2c60 2026-02-22T23:24:04.126 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7f9d53f7e640 1 -- 10.20.193.93:0/1116474261 --> v1:10.20.193.93:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9d4c1dad00 con 0x7f9d4c0b2c60 2026-02-22T23:24:04.126 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7f9d3a7fc640 1 -- 10.20.193.93:0/1116474261 <== mon.2 v1:10.20.193.93:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9d480038b0 con 0x7f9d4c0b2c60 2026-02-22T23:24:04.126 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7f9d3a7fc640 1 -- 10.20.193.93:0/1116474261 <== mon.2 v1:10.20.193.93:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f9d48003f80 con 0x7f9d4c0b2c60 2026-02-22T23:24:04.126 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7f9d53f7e640 1 -- 10.20.193.93:0/1116474261 --> v1:10.20.193.93:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f9d4c1db2c0 con 0x7f9d4c0b2c60 2026-02-22T23:24:04.126 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7fbfcb7fe640 1 -- 10.20.193.93:0/3067665307 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4071803281 0 0) 0x7fbfec1d15c0 con 0x7fbfec0b36c0 2026-02-22T23:24:04.126 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7fbfcb7fe640 1 -- 10.20.193.93:0/3067665307 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbfec1d1350 con 0x7fbfec0b36c0 2026-02-22T23:24:04.126 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7f396d7fa640 1 -- 10.20.193.93:0/2058045818 <== mon.0 v1:10.20.193.93:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f3960003b60 con 0x7f39780b5be0 2026-02-22T23:24:04.126 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7fbfcb7fe640 1 -- 10.20.193.93:0/3067665307 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2639536380 0 0) 0x7fbfec141610 con 0x7fbfec0b5be0 2026-02-22T23:24:04.126 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.117+0000 7fbfcb7fe640 1 -- 10.20.193.93:0/3067665307 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbfec1d15c0 con 0x7fbfec0b5be0 2026-02-22T23:24:04.126 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.118+0000 7fbfcb7fe640 1 -- 10.20.193.93:0/3067665307 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1176466057 0 0) 0x7fbfb8003620 con 0x7fbfec1deb40 2026-02-22T23:24:04.126 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.118+0000 7fbfcb7fe640 1 -- 10.20.193.93:0/3067665307 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbfec141610 con 0x7fbfec1deb40 2026-02-22T23:24:04.126 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.118+0000 7fbfcb7fe640 1 -- 10.20.193.93:0/3067665307 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fbfdc0034c0 con 0x7fbfec1deb40 2026-02-22T23:24:04.126 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.118+0000 7fbfcb7fe640 1 -- 10.20.193.93:0/3067665307 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1956959175 0 0) 0x7fbfec1d1350 con 0x7fbfec0b36c0 2026-02-22T23:24:04.126 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.118+0000 7fbfcb7fe640 1 -- 10.20.193.93:0/3067665307 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbfb8003620 con 0x7fbfec0b36c0 2026-02-22T23:24:04.127 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.118+0000 7fbfcb7fe640 1 -- 10.20.193.93:0/3067665307 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fbfe0003020 con 0x7fbfec0b36c0 2026-02-22T23:24:04.127 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.118+0000 7f397f155640 1 -- 10.20.193.93:0/2058045818 --> v1:10.20.193.93:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39780008d0 con 0x7f39780b5be0 2026-02-22T23:24:04.127 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.118+0000 7fbfcb7fe640 1 -- 10.20.193.93:0/3067665307 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3492417671 0 0) 0x7fbfec1d15c0 con 0x7fbfec0b5be0 2026-02-22T23:24:04.127 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.118+0000 7fbfcb7fe640 1 -- 10.20.193.93:0/3067665307 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbfec1d1350 con 0x7fbfec0b5be0 2026-02-22T23:24:04.127 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.118+0000 7fbfcb7fe640 1 -- 10.20.193.93:0/3067665307 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fbfd4003390 con 0x7fbfec0b5be0 2026-02-22T23:24:04.127 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.118+0000 7fbfcb7fe640 1 -- 10.20.193.93:0/3067665307 <== mon.2 v1:10.20.193.93:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 765413779 0 0) 0x7fbfec1d1350 con 0x7fbfec0b5be0 2026-02-22T23:24:04.127 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.118+0000 7fbfcb7fe640 1 -- 10.20.193.93:0/3067665307 >> v1:10.20.193.155:6789/0 conn(0x7fbfec0b36c0 legacy=0x7fbfec1ddfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.127 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.118+0000 7fbfcb7fe640 1 -- 10.20.193.93:0/3067665307 >> v1:10.20.193.93:6789/0 conn(0x7fbfec1deb40 legacy=0x7fbfec1459a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.127 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.118+0000 7fbfcb7fe640 1 -- 10.20.193.93:0/3067665307 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfec145530 con 0x7fbfec0b5be0 2026-02-22T23:24:04.127 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.118+0000 7fbff117e640 1 -- 10.20.193.93:0/3067665307 --> v1:10.20.193.93:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbfec1d0530 con 0x7fbfec0b5be0 2026-02-22T23:24:04.127 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.118+0000 7fbff117e640 1 -- 10.20.193.93:0/3067665307 --> v1:10.20.193.93:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fbfec1460b0 con 0x7fbfec0b5be0 2026-02-22T23:24:04.127 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.118+0000 7f9d53f7e640 1 -- 10.20.193.93:0/1116474261 --> v1:10.20.193.93:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d4c0008d0 con 0x7f9d4c0b2c60 2026-02-22T23:24:04.127 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.118+0000 7fbfcb7fe640 1 -- 10.20.193.93:0/3067665307 <== mon.2 v1:10.20.193.93:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbfd4003530 con 0x7fbfec0b5be0 2026-02-22T23:24:04.127 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.118+0000 7fbfcb7fe640 1 -- 10.20.193.93:0/3067665307 <== mon.2 v1:10.20.193.93:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fbfd4004cf0 con 0x7fbfec0b5be0 2026-02-22T23:24:04.127 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.118+0000 7fbff117e640 1 -- 10.20.193.93:0/3067665307 --> v1:10.20.193.93:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfec0b2f70 con 0x7fbfec0b5be0 2026-02-22T23:24:04.128 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.118+0000 7f396d7fa640 1 -- 10.20.193.93:0/2058045818 <== mon.0 v1:10.20.193.93:6789/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7f3960003d00 con 0x7f39780b5be0 2026-02-22T23:24:04.128 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.118+0000 7f9d3a7fc640 1 -- 10.20.193.93:0/1116474261 <== mon.2 v1:10.20.193.93:6790/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7f9d4801c750 con 0x7f9d4c0b2c60 2026-02-22T23:24:04.128 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.119+0000 7f396d7fa640 1 -- 10.20.193.93:0/2058045818 <== mon.0 v1:10.20.193.93:6789/0 8 ==== osd_map(20..20 src has 1..20) ==== 4142+0+0 (unknown 2994938210 0 0) 0x7f3960094450 con 0x7f39780b5be0 2026-02-22T23:24:04.128 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.119+0000 7f9d3a7fc640 1 -- 10.20.193.93:0/1116474261 <== mon.2 v1:10.20.193.93:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 4142+0+0 (unknown 2994938210 0 0) 0x7f9d48093240 con 0x7f9d4c0b2c60 2026-02-22T23:24:04.128 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.119+0000 7fbfcb7fe640 1 -- 10.20.193.93:0/3067665307 <== mon.2 v1:10.20.193.93:6790/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7fbfd401d320 con 0x7fbfec0b5be0 2026-02-22T23:24:04.128 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.120+0000 7fbfcb7fe640 1 -- 10.20.193.93:0/3067665307 <== mon.2 v1:10.20.193.93:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 4142+0+0 (unknown 2994938210 0 0) 0x7fbfd4093fd0 con 0x7fbfec0b5be0 2026-02-22T23:24:04.128 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.121+0000 7f396d7fa640 1 -- 10.20.193.93:0/2058045818 <== mon.0 v1:10.20.193.93:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f396005dc50 con 0x7f39780b5be0 2026-02-22T23:24:04.128 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.121+0000 7f9d3a7fc640 1 -- 10.20.193.93:0/1116474261 <== mon.2 v1:10.20.193.93:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f9d4c1db2c0 con 0x7f9d4c0b2c60 2026-02-22T23:24:04.128 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.123+0000 7fbfcb7fe640 1 -- 10.20.193.93:0/3067665307 <== mon.2 v1:10.20.193.93:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7fbfd405d7d0 con 0x7fbfec0b5be0 2026-02-22T23:24:04.162 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.159+0000 7ff68e6c9640 1 Processor -- start 2026-02-22T23:24:04.162 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.159+0000 7ff68e6c9640 1 -- start start 2026-02-22T23:24:04.163 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.159+0000 7ff68e6c9640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6880abba0 con 0x7ff688068680 2026-02-22T23:24:04.163 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.159+0000 7ff68e6c9640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6880abe80 con 0x7ff6880afa20 2026-02-22T23:24:04.163 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.159+0000 7ff68e6c9640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff68813edf0 con 0x7ff6880ac580 2026-02-22T23:24:04.163 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.160+0000 7ff687fff640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7ff688068680 0x7ff68813e6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:47090/0 (socket says 10.20.193.93:47090) 2026-02-22T23:24:04.163 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.160+0000 7ff687fff640 1 -- 10.20.193.93:0/3364436893 learned_addr learned my addr 10.20.193.93:0/3364436893 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:04.163 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.160+0000 7ff6877fe640 1 --1- 10.20.193.93:0/3364436893 >> v1:10.20.193.93:6790/0 conn(0x7ff6880ac580 0x7ff6881449f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:34292/0 (socket says 10.20.193.93:34292) 2026-02-22T23:24:04.163 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.160+0000 7ff686ffd640 1 -- 10.20.193.93:0/3364436893 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 274408619 0 0) 0x7ff68813edf0 con 0x7ff6880ac580 2026-02-22T23:24:04.163 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.160+0000 7ff686ffd640 1 -- 10.20.193.93:0/3364436893 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff66c003620 con 0x7ff6880ac580 2026-02-22T23:24:04.164 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.160+0000 7ff686ffd640 1 -- 10.20.193.93:0/3364436893 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3077491925 0 0) 0x7ff6880abba0 con 0x7ff688068680 2026-02-22T23:24:04.164 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.160+0000 7ff686ffd640 1 -- 10.20.193.93:0/3364436893 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff68813edf0 con 0x7ff688068680 2026-02-22T23:24:04.164 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.160+0000 7ff686ffd640 1 -- 10.20.193.93:0/3364436893 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1397846238 0 0) 0x7ff66c003620 con 0x7ff6880ac580 2026-02-22T23:24:04.164 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.160+0000 7ff686ffd640 1 -- 10.20.193.93:0/3364436893 >> v1:10.20.193.155:6789/0 conn(0x7ff6880afa20 legacy=0x7ff68814cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.164 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.160+0000 7ff686ffd640 1 -- 10.20.193.93:0/3364436893 >> v1:10.20.193.93:6789/0 conn(0x7ff688068680 legacy=0x7ff68813e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.164 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.160+0000 7ff686ffd640 1 -- 10.20.193.93:0/3364436893 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6880af000 con 0x7ff6880ac580 2026-02-22T23:24:04.164 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.160+0000 7ff686ffd640 1 -- 10.20.193.93:0/3364436893 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7ff678002ea0 con 0x7ff6880ac580 2026-02-22T23:24:04.164 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.160+0000 7ff686ffd640 1 -- 10.20.193.93:0/3364436893 <== mon.2 v1:10.20.193.93:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff6780030c0 con 0x7ff6880ac580 2026-02-22T23:24:04.164 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.160+0000 7ff686ffd640 1 -- 10.20.193.93:0/3364436893 <== mon.2 v1:10.20.193.93:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7ff678003510 con 0x7ff6880ac580 2026-02-22T23:24:04.164 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.160+0000 7ff68e6c9640 1 -- 10.20.193.93:0/3364436893 >> v1:10.20.193.93:6790/0 conn(0x7ff6880ac580 legacy=0x7ff6881449f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.164 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.160+0000 7ff68e6c9640 1 -- 10.20.193.93:0/3364436893 shutdown_connections 2026-02-22T23:24:04.164 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.160+0000 7ff68e6c9640 1 -- 10.20.193.93:0/3364436893 >> 10.20.193.93:0/3364436893 conn(0x7ff68806c860 msgr2=0x7ff68806cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:04.164 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.160+0000 7ff68e6c9640 1 -- 10.20.193.93:0/3364436893 shutdown_connections 2026-02-22T23:24:04.164 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.160+0000 7ff68e6c9640 1 -- 10.20.193.93:0/3364436893 wait complete. 2026-02-22T23:24:04.164 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.161+0000 7f57f4d8f640 1 Processor -- start 2026-02-22T23:24:04.164 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.161+0000 7f57f4d8f640 1 -- start start 2026-02-22T23:24:04.164 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.161+0000 7f7ed8144640 1 Processor -- start 2026-02-22T23:24:04.165 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.161+0000 7f7ed8144640 1 -- start start 2026-02-22T23:24:04.165 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.161+0000 7ff68e6c9640 1 Processor -- start 2026-02-22T23:24:04.165 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.161+0000 7ff68e6c9640 1 -- start start 2026-02-22T23:24:04.165 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.161+0000 7f57f4d8f640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57f0143cf0 con 0x7f57f0140e90 2026-02-22T23:24:04.165 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.161+0000 7f57f4d8f640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57f00aa8e0 con 0x7f57f00b5c00 2026-02-22T23:24:04.165 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.161+0000 7f57f4d8f640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57f00aabc0 con 0x7f57f00ab0e0 2026-02-22T23:24:04.165 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.161+0000 7f57edd74640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7f57f00ab0e0 0x7f57f0140780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:34304/0 (socket says 10.20.193.93:34304) 2026-02-22T23:24:04.165 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.161+0000 7f57edd74640 1 -- 10.20.193.93:0/3675726948 learned_addr learned my addr 10.20.193.93:0/3675726948 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:04.165 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.161+0000 7f7ed8144640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ed0074380 con 0x7f7ed00723a0 2026-02-22T23:24:04.165 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.161+0000 7f7ed8144640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ed00745f0 con 0x7f7ed00b1580 2026-02-22T23:24:04.165 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.161+0000 7f7ed8144640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ed01420b0 con 0x7f7ed0072780 2026-02-22T23:24:04.165 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7f7ed56b8640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7f7ed0072780 0x7f7ed00b0e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:34318/0 (socket says 10.20.193.93:34318) 2026-02-22T23:24:04.166 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7f7ed56b8640 1 -- 10.20.193.93:0/3354482978 learned_addr learned my addr 10.20.193.93:0/3354482978 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:04.166 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7f7ed5eb9640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7f7ed00723a0 0x7f7ed01419a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:47108/0 (socket says 10.20.193.93:47108) 2026-02-22T23:24:04.166 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7ff68e6c9640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6881351a0 con 0x7ff6880afa20 2026-02-22T23:24:04.166 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7ff68e6c9640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff688070a40 con 0x7ff688068680 2026-02-22T23:24:04.166 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7ff68e6c9640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff688070d20 con 0x7ff6880ac580 2026-02-22T23:24:04.166 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7f57ed573640 1 -- 10.20.193.93:0/3675726948 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 38257297 0 0) 0x7f57f00aabc0 con 0x7f57f00ab0e0 2026-02-22T23:24:04.166 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7ff6877fe640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7ff6880ac580 0x7ff688134380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:34326/0 (socket says 10.20.193.93:34326) 2026-02-22T23:24:04.166 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7ff6877fe640 1 -- 10.20.193.93:0/3211087110 learned_addr learned my addr 10.20.193.93:0/3211087110 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:04.166 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7ff6877fe640 1 -- 10.20.193.93:0/3211087110 >> v1:10.20.193.93:6790/0 conn(0x7ff6880ac580 legacy=0x7ff688134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-22T23:24:04.166 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7ff6877fe640 1 -- 10.20.193.93:0/3211087110 >> v1:10.20.193.93:6790/0 conn(0x7ff6880ac580 legacy=0x7ff688134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T23:24:04.166 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7ff6877fe640 1 --1- 10.20.193.93:0/3211087110 >> v1:10.20.193.93:6790/0 conn(0x7ff6880ac580 0x7ff688134380 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).handle_connect_reply_1 read connect reply failed 2026-02-22T23:24:04.166 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7f57ed573640 1 -- 10.20.193.93:0/3675726948 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57dc003620 con 0x7f57f00ab0e0 2026-02-22T23:24:04.167 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7ff6877fe640 1 --1- 10.20.193.93:0/3211087110 >> v1:10.20.193.93:6790/0 conn(0x7ff6880ac580 0x7ff688134380 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).fault on lossy channel, failing 2026-02-22T23:24:04.167 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7f57ed573640 1 -- 10.20.193.93:0/3675726948 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3793251650 0 0) 0x7f57f0143cf0 con 0x7f57f0140e90 2026-02-22T23:24:04.167 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7f7ed4eb7640 1 -- 10.20.193.93:0/3354482978 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 980120663 0 0) 0x7f7ed0074380 con 0x7f7ed00723a0 2026-02-22T23:24:04.167 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7f7ed4eb7640 1 -- 10.20.193.93:0/3354482978 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7eb8003620 con 0x7f7ed00723a0 2026-02-22T23:24:04.167 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7f57ed573640 1 -- 10.20.193.93:0/3675726948 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57f00aabc0 con 0x7f57f0140e90 2026-02-22T23:24:04.167 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7f7ed4eb7640 1 -- 10.20.193.93:0/3354482978 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 11411905 0 0) 0x7f7ed01420b0 con 0x7f7ed0072780 2026-02-22T23:24:04.167 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7f7ed4eb7640 1 -- 10.20.193.93:0/3354482978 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ed0074380 con 0x7f7ed0072780 2026-02-22T23:24:04.167 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7f57ed573640 1 -- 10.20.193.93:0/3675726948 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2147580588 0 0) 0x7f57dc003620 con 0x7f57f00ab0e0 2026-02-22T23:24:04.167 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7f57ed573640 1 -- 10.20.193.93:0/3675726948 >> v1:10.20.193.155:6789/0 conn(0x7f57f00b5c00 legacy=0x7f57f01435e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T23:24:04.168 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7f57ed573640 1 -- 10.20.193.93:0/3675726948 >> v1:10.20.193.93:6789/0 conn(0x7f57f0140e90 legacy=0x7f57f014ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.168 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7f57ed573640 1 -- 10.20.193.93:0/3675726948 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57f00b37e0 con 0x7f57f00ab0e0 2026-02-22T23:24:04.168 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7f57ed573640 1 -- 10.20.193.93:0/3675726948 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f57d8002ea0 con 0x7f57f00ab0e0 2026-02-22T23:24:04.168 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7ff684ff9640 1 -- 10.20.193.93:0/3211087110 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1620688369 0 0) 0x7ff6881351a0 con 0x7ff6880afa20 2026-02-22T23:24:04.168 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7ff684ff9640 1 -- 10.20.193.93:0/3211087110 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff658003620 con 0x7ff6880afa20 2026-02-22T23:24:04.168 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7f7ed4eb7640 1 -- 10.20.193.93:0/3354482978 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2385565077 0 0) 0x7f7eb8003620 con 0x7f7ed00723a0 2026-02-22T23:24:04.168 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7f7ed4eb7640 1 -- 10.20.193.93:0/3354482978 >> v1:10.20.193.93:6790/0 conn(0x7f7ed0072780 legacy=0x7f7ed00b0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.168 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7f7ed4eb7640 1 -- 10.20.193.93:0/3354482978 >> v1:10.20.193.155:6789/0 conn(0x7f7ed00b1580 legacy=0x7f7ed014cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.168 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7f7ed4eb7640 1 -- 10.20.193.93:0/3354482978 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ed00748d0 con 0x7f7ed00723a0 2026-02-22T23:24:04.168 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7f7ed4eb7640 1 -- 10.20.193.93:0/3354482978 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f7ec0002dd0 con 0x7f7ed00723a0 2026-02-22T23:24:04.168 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7f57ed573640 1 -- 10.20.193.93:0/3675726948 <== mon.2 v1:10.20.193.93:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f57d80030c0 con 0x7f57f00ab0e0 2026-02-22T23:24:04.168 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7f57ed573640 1 -- 10.20.193.93:0/3675726948 <== mon.2 v1:10.20.193.93:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f57d8003550 con 0x7f57f00ab0e0 2026-02-22T23:24:04.169 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7ff684ff9640 1 -- 10.20.193.93:0/3211087110 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2801198252 0 0) 0x7ff658003620 con 0x7ff6880afa20 2026-02-22T23:24:04.169 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7f7ed4eb7640 1 -- 10.20.193.93:0/3354482978 <== mon.0 v1:10.20.193.93:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7ec0002ff0 con 0x7f7ed00723a0 2026-02-22T23:24:04.169 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7f7ed4eb7640 1 -- 10.20.193.93:0/3354482978 <== mon.0 v1:10.20.193.93:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f7ec0003400 con 0x7f7ed00723a0 2026-02-22T23:24:04.169 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7ff684ff9640 1 -- 10.20.193.93:0/3211087110 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff6881351a0 con 0x7ff6880afa20 2026-02-22T23:24:04.169 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7ff684ff9640 1 -- 10.20.193.93:0/3211087110 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7ff67c003330 con 0x7ff6880afa20 2026-02-22T23:24:04.169 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7ff684ff9640 1 -- 10.20.193.93:0/3211087110 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 446478593 0 0) 0x7ff688070a40 con 0x7ff688068680 2026-02-22T23:24:04.169 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7ff684ff9640 1 -- 10.20.193.93:0/3211087110 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff658003620 con 0x7ff688068680 2026-02-22T23:24:04.169 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7ff684ff9640 1 -- 10.20.193.93:0/3211087110 <== mon.0 v1:10.20.193.93:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3064871470 0 0) 0x7ff6881351a0 con 0x7ff6880afa20 2026-02-22T23:24:04.169 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7ff684ff9640 1 -- 10.20.193.93:0/3211087110 >> v1:10.20.193.93:6790/0 conn(0x7ff6880ac580 legacy=0x7ff688134380 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:24:04.169 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7ff684ff9640 1 -- 10.20.193.93:0/3211087110 >> v1:10.20.193.155:6789/0 conn(0x7ff688068680 legacy=0x7ff6880ae4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.169 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7ff684ff9640 1 -- 10.20.193.93:0/3211087110 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff688071000 con 0x7ff6880afa20 2026-02-22T23:24:04.169 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7ff68e6c9640 1 -- 10.20.193.93:0/3211087110 --> v1:10.20.193.93:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff6880712e0 con 0x7ff6880afa20 2026-02-22T23:24:04.170 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7ff68e6c9640 1 -- 10.20.193.93:0/3211087110 --> v1:10.20.193.93:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff688070650 con 0x7ff6880afa20 2026-02-22T23:24:04.170 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7ff684ff9640 1 -- 10.20.193.93:0/3211087110 <== mon.0 v1:10.20.193.93:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff67c003550 con 0x7ff6880afa20 2026-02-22T23:24:04.170 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7ff684ff9640 1 -- 10.20.193.93:0/3211087110 <== mon.0 v1:10.20.193.93:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7ff67c003960 con 0x7ff6880afa20 2026-02-22T23:24:04.170 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7f57f4d8f640 1 -- 10.20.193.93:0/3675726948 >> v1:10.20.193.93:6790/0 conn(0x7f57f00ab0e0 legacy=0x7f57f0140780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.170 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7f711a586640 1 Processor -- start 2026-02-22T23:24:04.171 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7f57f4d8f640 1 -- 10.20.193.93:0/3675726948 shutdown_connections 2026-02-22T23:24:04.171 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7f57f4d8f640 1 -- 10.20.193.93:0/3675726948 >> 10.20.193.93:0/3675726948 conn(0x7f57f0068410 msgr2=0x7f57f00687f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:04.171 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7f57f4d8f640 1 -- 10.20.193.93:0/3675726948 shutdown_connections 2026-02-22T23:24:04.171 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7f57f4d8f640 1 -- 10.20.193.93:0/3675726948 wait complete. 2026-02-22T23:24:04.171 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7f711a586640 1 -- start start 2026-02-22T23:24:04.172 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7f7ed8144640 1 -- 10.20.193.93:0/3354482978 >> v1:10.20.193.93:6789/0 conn(0x7f7ed00723a0 legacy=0x7f7ed01419a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.172 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7f7ed8144640 1 -- 10.20.193.93:0/3354482978 shutdown_connections 2026-02-22T23:24:04.172 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7f7ed8144640 1 -- 10.20.193.93:0/3354482978 >> 10.20.193.93:0/3354482978 conn(0x7f7ed00b7110 msgr2=0x7f7ed00b7520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:04.172 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.162+0000 7f7ed8144640 1 -- 10.20.193.93:0/3354482978 shutdown_connections 2026-02-22T23:24:04.172 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.163+0000 7f7ed8144640 1 -- 10.20.193.93:0/3354482978 wait complete. 2026-02-22T23:24:04.172 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.163+0000 7f711a586640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7114147180 con 0x7f71140aa8e0 2026-02-22T23:24:04.173 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.163+0000 7f711a586640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71140b5fc0 con 0x7f71140b36c0 2026-02-22T23:24:04.173 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.163+0000 7f711a586640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71140b6190 con 0x7f71140b5be0 2026-02-22T23:24:04.173 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.163+0000 7f7113fff640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7f71140b5be0 0x7f7114146a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:34334/0 (socket says 10.20.193.93:34334) 2026-02-22T23:24:04.173 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.163+0000 7f7113fff640 1 -- 10.20.193.93:0/4269668589 learned_addr learned my addr 10.20.193.93:0/4269668589 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:04.173 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.163+0000 7ff68e6c9640 1 -- 10.20.193.93:0/3211087110 --> v1:10.20.193.93:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff688075080 con 0x7ff6880afa20 2026-02-22T23:24:04.173 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.163+0000 7f57f4d8f640 1 Processor -- start 2026-02-22T23:24:04.174 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.163+0000 7f7112ffd640 1 -- 10.20.193.93:0/4269668589 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3516283915 0 0) 0x7f71140b6190 con 0x7f71140b5be0 2026-02-22T23:24:04.174 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.163+0000 7f57f4d8f640 1 -- start start 2026-02-22T23:24:04.175 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.163+0000 7f7112ffd640 1 -- 10.20.193.93:0/4269668589 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70f8003620 con 0x7f71140b5be0 2026-02-22T23:24:04.175 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.163+0000 7f7112ffd640 1 -- 10.20.193.93:0/4269668589 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2592013918 0 0) 0x7f7114147180 con 0x7f71140aa8e0 2026-02-22T23:24:04.175 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.163+0000 7f7112ffd640 1 -- 10.20.193.93:0/4269668589 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71140b6190 con 0x7f71140aa8e0 2026-02-22T23:24:04.175 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.163+0000 7f7112ffd640 1 -- 10.20.193.93:0/4269668589 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 858004724 0 0) 0x7f70f8003620 con 0x7f71140b5be0 2026-02-22T23:24:04.175 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.163+0000 7f7112ffd640 1 -- 10.20.193.93:0/4269668589 >> v1:10.20.193.155:6789/0 conn(0x7f71140b36c0 legacy=0x7f711414edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T23:24:04.175 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.163+0000 7f7112ffd640 1 -- 10.20.193.93:0/4269668589 >> v1:10.20.193.93:6789/0 conn(0x7f71140aa8e0 legacy=0x7f7114140710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.175 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.163+0000 7f7112ffd640 1 -- 10.20.193.93:0/4269668589 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71140ab290 con 0x7f71140b5be0 2026-02-22T23:24:04.175 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.163+0000 7f7112ffd640 1 -- 10.20.193.93:0/4269668589 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f7100002ea0 con 0x7f71140b5be0 2026-02-22T23:24:04.175 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.163+0000 7f7112ffd640 1 -- 10.20.193.93:0/4269668589 <== mon.2 v1:10.20.193.93:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f71000030c0 con 0x7f71140b5be0 2026-02-22T23:24:04.175 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.163+0000 7f7112ffd640 1 -- 10.20.193.93:0/4269668589 <== mon.2 v1:10.20.193.93:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f7100003510 con 0x7f71140b5be0 2026-02-22T23:24:04.176 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.163+0000 7f57f4d8f640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57f013c990 con 0x7f57f00b5c00 2026-02-22T23:24:04.176 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.163+0000 7f57f4d8f640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57f013dd30 con 0x7f57f00ab0e0 2026-02-22T23:24:04.176 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.163+0000 7f57f4d8f640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57f013e010 con 0x7f57f0140e90 2026-02-22T23:24:04.176 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.163+0000 7ff684ff9640 1 -- 10.20.193.93:0/3211087110 <== mon.0 v1:10.20.193.93:6789/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7ff67c003b00 con 0x7ff6880afa20 2026-02-22T23:24:04.176 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.163+0000 7f57edd74640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7f57f00b5c00 0x7f57f01392a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:47132/0 (socket says 10.20.193.93:47132) 2026-02-22T23:24:04.177 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.163+0000 7f57edd74640 1 -- 10.20.193.93:0/3388063868 learned_addr learned my addr 10.20.193.93:0/3388063868 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:04.177 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.163+0000 7f7ed8144640 1 Processor -- start 2026-02-22T23:24:04.177 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.163+0000 7f7ed8144640 1 -- start start 2026-02-22T23:24:04.177 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.163+0000 7f711a586640 1 -- 10.20.193.93:0/4269668589 >> v1:10.20.193.93:6790/0 conn(0x7f71140b5be0 legacy=0x7f7114146a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.177 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.163+0000 7f57d6ffd640 1 -- 10.20.193.93:0/3388063868 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3047722607 0 0) 0x7f57f013e010 con 0x7f57f0140e90 2026-02-22T23:24:04.178 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.163+0000 7f57d6ffd640 1 -- 10.20.193.93:0/3388063868 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57bc003620 con 0x7f57f0140e90 2026-02-22T23:24:04.178 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.164+0000 7f711a586640 1 -- 10.20.193.93:0/4269668589 shutdown_connections 2026-02-22T23:24:04.178 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.164+0000 7f711a586640 1 -- 10.20.193.93:0/4269668589 >> 10.20.193.93:0/4269668589 conn(0x7f7114068410 msgr2=0x7f7114068820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:04.178 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.164+0000 7f711a586640 1 -- 10.20.193.93:0/4269668589 shutdown_connections 2026-02-22T23:24:04.178 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.164+0000 7f711a586640 1 -- 10.20.193.93:0/4269668589 wait complete. 2026-02-22T23:24:04.179 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.164+0000 7f57d6ffd640 1 -- 10.20.193.93:0/3388063868 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2465819161 0 0) 0x7f57bc003620 con 0x7f57f0140e90 2026-02-22T23:24:04.179 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.164+0000 7f57d6ffd640 1 -- 10.20.193.93:0/3388063868 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f57f013e010 con 0x7f57f0140e90 2026-02-22T23:24:04.179 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.164+0000 7f57d6ffd640 1 -- 10.20.193.93:0/3388063868 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f57e00033a0 con 0x7f57f0140e90 2026-02-22T23:24:04.179 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.164+0000 7f57d6ffd640 1 -- 10.20.193.93:0/3388063868 <== mon.2 v1:10.20.193.93:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 969412212 0 0) 0x7f57f013e010 con 0x7f57f0140e90 2026-02-22T23:24:04.179 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.164+0000 7f57d6ffd640 1 -- 10.20.193.93:0/3388063868 >> v1:10.20.193.155:6789/0 conn(0x7f57f00ab0e0 legacy=0x7f57f013bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.179 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.164+0000 7f57d6ffd640 1 -- 10.20.193.93:0/3388063868 >> v1:10.20.193.93:6789/0 conn(0x7f57f00b5c00 legacy=0x7f57f01392a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.179 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.164+0000 7f57d6ffd640 1 -- 10.20.193.93:0/3388063868 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57f013ce70 con 0x7f57f0140e90 2026-02-22T23:24:04.179 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.164+0000 7f57f4d8f640 1 -- 10.20.193.93:0/3388063868 --> v1:10.20.193.93:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f57f01399b0 con 0x7f57f0140e90 2026-02-22T23:24:04.180 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.164+0000 7f57f4d8f640 1 -- 10.20.193.93:0/3388063868 --> v1:10.20.193.93:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f57f00b2480 con 0x7f57f0140e90 2026-02-22T23:24:04.180 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.164+0000 7f57d6ffd640 1 -- 10.20.193.93:0/3388063868 <== mon.2 v1:10.20.193.93:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f57e0003870 con 0x7f57f0140e90 2026-02-22T23:24:04.180 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.164+0000 7f57d6ffd640 1 -- 10.20.193.93:0/3388063868 <== mon.2 v1:10.20.193.93:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f57e0003c80 con 0x7f57f0140e90 2026-02-22T23:24:04.180 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.164+0000 7ff684ff9640 1 -- 10.20.193.93:0/3211087110 <== mon.0 v1:10.20.193.93:6789/0 8 ==== osd_map(20..20 src has 1..20) ==== 4142+0+0 (unknown 2994938210 0 0) 0x7ff67c093370 con 0x7ff6880afa20 2026-02-22T23:24:04.180 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.164+0000 7f7ed5eb9640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7f7ed00723a0 0x7f7ed013e260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:34354/0 (socket says 10.20.193.93:34354) 2026-02-22T23:24:04.180 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.164+0000 7f7ed5eb9640 1 -- 10.20.193.93:0/871525669 learned_addr learned my addr 10.20.193.93:0/871525669 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:04.180 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.164+0000 7f7ed8144640 1 -- 10.20.193.93:0/871525669 --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ed013dac0 con 0x7f7ed00b1580 2026-02-22T23:24:04.181 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.164+0000 7f7ed8144640 1 -- 10.20.193.93:0/871525669 --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ed013d6a0 con 0x7f7ed0072780 2026-02-22T23:24:04.181 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.164+0000 7f7ed8144640 1 -- 10.20.193.93:0/871525669 --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ed013dd40 con 0x7f7ed00723a0 2026-02-22T23:24:04.181 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.164+0000 7f711a586640 1 Processor -- start 2026-02-22T23:24:04.181 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.164+0000 7f7ebe7fc640 1 -- 10.20.193.93:0/871525669 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 870030404 0 0) 0x7f7ed013dd40 con 0x7f7ed00723a0 2026-02-22T23:24:04.181 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.164+0000 7f711a586640 1 -- start start 2026-02-22T23:24:04.182 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.164+0000 7f7ebe7fc640 1 -- 10.20.193.93:0/871525669 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ea0003620 con 0x7f7ed00723a0 2026-02-22T23:24:04.182 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.164+0000 7f7ebe7fc640 1 -- 10.20.193.93:0/871525669 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4216341511 0 0) 0x7f7ea0003620 con 0x7f7ed00723a0 2026-02-22T23:24:04.182 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.164+0000 7f7ebe7fc640 1 -- 10.20.193.93:0/871525669 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7ed013dd40 con 0x7f7ed00723a0 2026-02-22T23:24:04.182 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.164+0000 7f7ebe7fc640 1 -- 10.20.193.93:0/871525669 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f7ec0003400 con 0x7f7ed00723a0 2026-02-22T23:24:04.182 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.164+0000 7f7ebe7fc640 1 -- 10.20.193.93:0/871525669 <== mon.2 v1:10.20.193.93:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3598570312 0 0) 0x7f7ed013dd40 con 0x7f7ed00723a0 2026-02-22T23:24:04.182 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.164+0000 7f7ebe7fc640 1 -- 10.20.193.93:0/871525669 >> v1:10.20.193.155:6789/0 conn(0x7f7ed0072780 legacy=0x7f7ed013b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.182 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.164+0000 7f57f4d8f640 1 -- 10.20.193.93:0/3388063868 --> v1:10.20.193.93:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57f00008d0 con 0x7f57f0140e90 2026-02-22T23:24:04.183 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.164+0000 7f7ebe7fc640 1 -- 10.20.193.93:0/871525669 >> v1:10.20.193.93:6789/0 conn(0x7f7ed00b1580 legacy=0x7f7ed01e2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.183 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.164+0000 7f7ebe7fc640 1 -- 10.20.193.93:0/871525669 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ed013c340 con 0x7f7ed00723a0 2026-02-22T23:24:04.183 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.164+0000 7f7ed8144640 1 -- 10.20.193.93:0/871525669 --> v1:10.20.193.93:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7ed0145330 con 0x7f7ed00723a0 2026-02-22T23:24:04.183 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.164+0000 7f7ed8144640 1 -- 10.20.193.93:0/871525669 --> v1:10.20.193.93:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f7ed01e43c0 con 0x7f7ed00723a0 2026-02-22T23:24:04.183 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.165+0000 7f711a586640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71140af230 con 0x7f71141de2d0 2026-02-22T23:24:04.183 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.165+0000 7f711a586640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71140af4a0 con 0x7f71140b36c0 2026-02-22T23:24:04.183 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.165+0000 7f711a586640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71141dd6c0 con 0x7f71140b5be0 2026-02-22T23:24:04.183 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.165+0000 7f7118afc640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7f71141de2d0 0x7f71141e4c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:47148/0 (socket says 10.20.193.93:47148) 2026-02-22T23:24:04.184 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.165+0000 7f7118afc640 1 -- 10.20.193.93:0/1744863374 learned_addr learned my addr 10.20.193.93:0/1744863374 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:04.184 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.165+0000 7f7110ff9640 1 -- 10.20.193.93:0/1744863374 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 76202634 0 0) 0x7f71141dd6c0 con 0x7f71140b5be0 2026-02-22T23:24:04.184 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.165+0000 7f7110ff9640 1 -- 10.20.193.93:0/1744863374 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70e4003620 con 0x7f71140b5be0 2026-02-22T23:24:04.184 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.165+0000 7f7ebe7fc640 1 -- 10.20.193.93:0/871525669 <== mon.2 v1:10.20.193.93:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7ec0004c10 con 0x7f7ed00723a0 2026-02-22T23:24:04.184 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.165+0000 7f7ebe7fc640 1 -- 10.20.193.93:0/871525669 <== mon.2 v1:10.20.193.93:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f7ec0004e80 con 0x7f7ed00723a0 2026-02-22T23:24:04.184 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.165+0000 7f7ed8144640 1 -- 10.20.193.93:0/871525669 --> v1:10.20.193.93:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ed01411b0 con 0x7f7ed00723a0 2026-02-22T23:24:04.184 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.165+0000 7f7110ff9640 1 -- 10.20.193.93:0/1744863374 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1506828834 0 0) 0x7f70e4003620 con 0x7f71140b5be0 2026-02-22T23:24:04.184 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.165+0000 7f7110ff9640 1 -- 10.20.193.93:0/1744863374 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f71141dd6c0 con 0x7f71140b5be0 2026-02-22T23:24:04.184 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.165+0000 7f7110ff9640 1 -- 10.20.193.93:0/1744863374 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f71040032a0 con 0x7f71140b5be0 2026-02-22T23:24:04.185 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.165+0000 7f57d6ffd640 1 -- 10.20.193.93:0/3388063868 <== mon.2 v1:10.20.193.93:6790/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7f57e0003e20 con 0x7f57f0140e90 2026-02-22T23:24:04.185 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.165+0000 7f7110ff9640 1 -- 10.20.193.93:0/1744863374 <== mon.2 v1:10.20.193.93:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3554865168 0 0) 0x7f71141dd6c0 con 0x7f71140b5be0 2026-02-22T23:24:04.185 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.165+0000 7f7110ff9640 1 -- 10.20.193.93:0/1744863374 >> v1:10.20.193.155:6789/0 conn(0x7f71140b36c0 legacy=0x7f71140ada50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.185 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.165+0000 7f7110ff9640 1 -- 10.20.193.93:0/1744863374 >> v1:10.20.193.93:6789/0 conn(0x7f71141de2d0 legacy=0x7f71141e4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.185 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.165+0000 7f7110ff9640 1 -- 10.20.193.93:0/1744863374 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71140ae160 con 0x7f71140b5be0 2026-02-22T23:24:04.185 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.165+0000 7f711a586640 1 -- 10.20.193.93:0/1744863374 --> v1:10.20.193.93:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f71141424c0 con 0x7f71140b5be0 2026-02-22T23:24:04.185 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.165+0000 7f711a586640 1 -- 10.20.193.93:0/1744863374 --> v1:10.20.193.93:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f71141e6380 con 0x7f71140b5be0 2026-02-22T23:24:04.186 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.166+0000 7f57d6ffd640 1 -- 10.20.193.93:0/3388063868 <== mon.2 v1:10.20.193.93:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 4142+0+0 (unknown 2994938210 0 0) 0x7f57e00933e0 con 0x7f57f0140e90 2026-02-22T23:24:04.186 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.166+0000 7f7ebe7fc640 1 -- 10.20.193.93:0/871525669 <== mon.2 v1:10.20.193.93:6790/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7f7ec0005020 con 0x7f7ed00723a0 2026-02-22T23:24:04.186 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.166+0000 7f711a586640 1 -- 10.20.193.93:0/1744863374 --> v1:10.20.193.93:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71140008d0 con 0x7f71140b5be0 2026-02-22T23:24:04.186 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.166+0000 7f7ebe7fc640 1 -- 10.20.193.93:0/871525669 <== mon.2 v1:10.20.193.93:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 4142+0+0 (unknown 2994938210 0 0) 0x7f7ec0094400 con 0x7f7ed00723a0 2026-02-22T23:24:04.186 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.166+0000 7ff684ff9640 1 -- 10.20.193.93:0/3211087110 <== mon.0 v1:10.20.193.93:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7ff67c05cb70 con 0x7ff6880afa20 2026-02-22T23:24:04.187 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.168+0000 7f7110ff9640 1 -- 10.20.193.93:0/1744863374 <== mon.2 v1:10.20.193.93:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f71040036f0 con 0x7f71140b5be0 2026-02-22T23:24:04.187 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.168+0000 7f7110ff9640 1 -- 10.20.193.93:0/1744863374 <== mon.2 v1:10.20.193.93:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f7104003ac0 con 0x7f71140b5be0 2026-02-22T23:24:04.187 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.168+0000 7f57d6ffd640 1 -- 10.20.193.93:0/3388063868 <== mon.2 v1:10.20.193.93:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f57e005cbe0 con 0x7f57f0140e90 2026-02-22T23:24:04.187 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.170+0000 7f7ebe7fc640 1 -- 10.20.193.93:0/871525669 <== mon.2 v1:10.20.193.93:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f7ec005dc00 con 0x7f7ed00723a0 2026-02-22T23:24:04.187 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.171+0000 7f7110ff9640 1 -- 10.20.193.93:0/1744863374 <== mon.2 v1:10.20.193.93:6790/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7f7104003c60 con 0x7f71140b5be0 2026-02-22T23:24:04.187 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.172+0000 7f7110ff9640 1 -- 10.20.193.93:0/1744863374 <== mon.2 v1:10.20.193.93:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 4142+0+0 (unknown 2994938210 0 0) 0x7f7104093110 con 0x7f71140b5be0 2026-02-22T23:24:04.187 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.173+0000 7f7110ff9640 1 -- 10.20.193.93:0/1744863374 <== mon.2 v1:10.20.193.93:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f710405c910 con 0x7f71140b5be0 2026-02-22T23:24:04.188 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.185+0000 7f02ebbeb640 1 Processor -- start 2026-02-22T23:24:04.188 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.185+0000 7f02ebbeb640 1 -- start start 2026-02-22T23:24:04.189 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.185+0000 7f02ebbeb640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02e413ee30 con 0x7f02e4144a00 2026-02-22T23:24:04.189 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.185+0000 7f02ebbeb640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02e4144de0 con 0x7f02e41452d0 2026-02-22T23:24:04.189 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.185+0000 7f02ebbeb640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02e4074040 con 0x7f02e413ea10 2026-02-22T23:24:04.189 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.185+0000 7f02ea161640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7f02e413ea10 0x7f02e414cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:34370/0 (socket says 10.20.193.93:34370) 2026-02-22T23:24:04.189 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.185+0000 7f02ea161640 1 -- 10.20.193.93:0/1279969477 learned_addr learned my addr 10.20.193.93:0/1279969477 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:04.189 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.185+0000 7f02e9960640 1 --1- 10.20.193.93:0/1279969477 >> v1:10.20.193.93:6789/0 conn(0x7f02e4144a00 0x7f02e40afa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:47158/0 (socket says 10.20.193.93:47158) 2026-02-22T23:24:04.189 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.186+0000 7f02e895e640 1 -- 10.20.193.93:0/1279969477 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2931182230 0 0) 0x7f02e4074040 con 0x7f02e413ea10 2026-02-22T23:24:04.189 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.186+0000 7f02e895e640 1 -- 10.20.193.93:0/1279969477 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02d0003620 con 0x7f02e413ea10 2026-02-22T23:24:04.189 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.186+0000 7f02e895e640 1 -- 10.20.193.93:0/1279969477 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2232206728 0 0) 0x7f02d4002920 con 0x7f02e4144a00 2026-02-22T23:24:04.189 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.186+0000 7f02e895e640 1 -- 10.20.193.93:0/1279969477 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02e4074040 con 0x7f02e4144a00 2026-02-22T23:24:04.189 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.186+0000 7f02e895e640 1 -- 10.20.193.93:0/1279969477 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 862546989 0 0) 0x7f02e4144de0 con 0x7f02e41452d0 2026-02-22T23:24:04.189 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.186+0000 7f02e895e640 1 -- 10.20.193.93:0/1279969477 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02d4002920 con 0x7f02e41452d0 2026-02-22T23:24:04.190 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.186+0000 7f02e895e640 1 -- 10.20.193.93:0/1279969477 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3485339352 0 0) 0x7f02e4074040 con 0x7f02e4144a00 2026-02-22T23:24:04.190 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.186+0000 7f02e895e640 1 -- 10.20.193.93:0/1279969477 >> v1:10.20.193.93:6790/0 conn(0x7f02e413ea10 legacy=0x7f02e414cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.190 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.186+0000 7f02e895e640 1 -- 10.20.193.93:0/1279969477 >> v1:10.20.193.155:6789/0 conn(0x7f02e41452d0 legacy=0x7f02e413e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.190 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.186+0000 7f02e895e640 1 -- 10.20.193.93:0/1279969477 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02e4074320 con 0x7f02e4144a00 2026-02-22T23:24:04.190 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.186+0000 7f02e895e640 1 -- 10.20.193.93:0/1279969477 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f02d4003050 con 0x7f02e4144a00 2026-02-22T23:24:04.190 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.186+0000 7f02e895e640 1 -- 10.20.193.93:0/1279969477 <== mon.0 v1:10.20.193.93:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f02d40031f0 con 0x7f02e4144a00 2026-02-22T23:24:04.190 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.186+0000 7f02e895e640 1 -- 10.20.193.93:0/1279969477 <== mon.0 v1:10.20.193.93:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f02d40048e0 con 0x7f02e4144a00 2026-02-22T23:24:04.192 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.186+0000 7f02ebbeb640 1 -- 10.20.193.93:0/1279969477 >> v1:10.20.193.93:6789/0 conn(0x7f02e4144a00 legacy=0x7f02e40afa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.192 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.186+0000 7f02ebbeb640 1 -- 10.20.193.93:0/1279969477 shutdown_connections 2026-02-22T23:24:04.192 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.186+0000 7f02ebbeb640 1 -- 10.20.193.93:0/1279969477 >> 10.20.193.93:0/1279969477 conn(0x7f02e40b1d30 msgr2=0x7f02e40b2140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:04.192 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.186+0000 7f02ebbeb640 1 -- 10.20.193.93:0/1279969477 shutdown_connections 2026-02-22T23:24:04.192 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.187+0000 7f02ebbeb640 1 -- 10.20.193.93:0/1279969477 wait complete. 2026-02-22T23:24:04.192 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.187+0000 7f02ebbeb640 1 Processor -- start 2026-02-22T23:24:04.192 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.187+0000 7f02ebbeb640 1 -- start start 2026-02-22T23:24:04.192 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.188+0000 7f02ebbeb640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02e41412d0 con 0x7f02e41452d0 2026-02-22T23:24:04.192 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.188+0000 7f02ebbeb640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02e4140f80 con 0x7f02e4144a00 2026-02-22T23:24:04.192 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.188+0000 7f02ebbeb640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02e41d87c0 con 0x7f02e413ea10 2026-02-22T23:24:04.192 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.188+0000 7f02e9960640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7f02e413ea10 0x7f02e41d80b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:34380/0 (socket says 10.20.193.93:34380) 2026-02-22T23:24:04.192 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.188+0000 7f02e9960640 1 -- 10.20.193.93:0/1663113882 learned_addr learned my addr 10.20.193.93:0/1663113882 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:04.192 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.188+0000 7f02da7fc640 1 -- 10.20.193.93:0/1663113882 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3034972726 0 0) 0x7f02e41d87c0 con 0x7f02e413ea10 2026-02-22T23:24:04.192 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.188+0000 7f02da7fc640 1 -- 10.20.193.93:0/1663113882 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02b4003620 con 0x7f02e413ea10 2026-02-22T23:24:04.192 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.188+0000 7f02da7fc640 1 -- 10.20.193.93:0/1663113882 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3727678416 0 0) 0x7f02e41412d0 con 0x7f02e41452d0 2026-02-22T23:24:04.192 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.188+0000 7f02da7fc640 1 -- 10.20.193.93:0/1663113882 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02e41d87c0 con 0x7f02e41452d0 2026-02-22T23:24:04.192 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.188+0000 7f02da7fc640 1 -- 10.20.193.93:0/1663113882 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1263167585 0 0) 0x7f02b4003620 con 0x7f02e413ea10 2026-02-22T23:24:04.192 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.188+0000 7f02da7fc640 1 -- 10.20.193.93:0/1663113882 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f02e41412d0 con 0x7f02e413ea10 2026-02-22T23:24:04.193 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.188+0000 7f02da7fc640 1 -- 10.20.193.93:0/1663113882 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f02d4002f10 con 0x7f02e413ea10 2026-02-22T23:24:04.193 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.188+0000 7f02da7fc640 1 -- 10.20.193.93:0/1663113882 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 336204707 0 0) 0x7f02e41d87c0 con 0x7f02e41452d0 2026-02-22T23:24:04.193 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.188+0000 7f02da7fc640 1 -- 10.20.193.93:0/1663113882 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f02b4003620 con 0x7f02e41452d0 2026-02-22T23:24:04.193 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.188+0000 7f02da7fc640 1 -- 10.20.193.93:0/1663113882 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 309922936 0 0) 0x7f02e4140f80 con 0x7f02e4144a00 2026-02-22T23:24:04.193 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.188+0000 7f02da7fc640 1 -- 10.20.193.93:0/1663113882 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02e41d87c0 con 0x7f02e4144a00 2026-02-22T23:24:04.193 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.188+0000 7f02da7fc640 1 -- 10.20.193.93:0/1663113882 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f02e0002ce0 con 0x7f02e41452d0 2026-02-22T23:24:04.193 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.188+0000 7f02da7fc640 1 -- 10.20.193.93:0/1663113882 <== mon.2 v1:10.20.193.93:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1998848075 0 0) 0x7f02e41412d0 con 0x7f02e413ea10 2026-02-22T23:24:04.193 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.188+0000 7f02da7fc640 1 -- 10.20.193.93:0/1663113882 >> v1:10.20.193.155:6789/0 conn(0x7f02e4144a00 legacy=0x7f02e40adb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.193 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.188+0000 7f02da7fc640 1 -- 10.20.193.93:0/1663113882 >> v1:10.20.193.93:6789/0 conn(0x7f02e41452d0 legacy=0x7f02e40ae260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.193 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.188+0000 7f02da7fc640 1 -- 10.20.193.93:0/1663113882 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02e41417f0 con 0x7f02e413ea10 2026-02-22T23:24:04.193 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.188+0000 7f02ebbeb640 1 -- 10.20.193.93:0/1663113882 --> v1:10.20.193.93:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f02e4141a80 con 0x7f02e413ea10 2026-02-22T23:24:04.193 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.188+0000 7f02ebbeb640 1 -- 10.20.193.93:0/1663113882 --> v1:10.20.193.93:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f02e41406d0 con 0x7f02e413ea10 2026-02-22T23:24:04.193 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.188+0000 7f02da7fc640 1 -- 10.20.193.93:0/1663113882 <== mon.2 v1:10.20.193.93:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f02d4004e50 con 0x7f02e413ea10 2026-02-22T23:24:04.193 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.188+0000 7f02da7fc640 1 -- 10.20.193.93:0/1663113882 <== mon.2 v1:10.20.193.93:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f02d40051a0 con 0x7f02e413ea10 2026-02-22T23:24:04.193 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.189+0000 7f02ebbeb640 1 -- 10.20.193.93:0/1663113882 --> v1:10.20.193.93:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02e40ab370 con 0x7f02e413ea10 2026-02-22T23:24:04.193 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.189+0000 7f02da7fc640 1 -- 10.20.193.93:0/1663113882 <== mon.2 v1:10.20.193.93:6790/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7f02d401d970 con 0x7f02e413ea10 2026-02-22T23:24:04.194 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.190+0000 7f02da7fc640 1 -- 10.20.193.93:0/1663113882 <== mon.2 v1:10.20.193.93:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 4142+0+0 (unknown 2994938210 0 0) 0x7f02d40944e0 con 0x7f02e413ea10 2026-02-22T23:24:04.194 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.191+0000 7f02da7fc640 1 -- 10.20.193.93:0/1663113882 <== mon.2 v1:10.20.193.93:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f02e413ee30 con 0x7f02e413ea10 2026-02-22T23:24:04.215 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.212+0000 7f9d53f7e640 1 -- 10.20.193.93:0/1116474261 --> v1:10.20.193.93:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f9d4c141030 con 0x7f9d4c0b2c60 2026-02-22T23:24:04.216 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.212+0000 7f397f155640 1 -- 10.20.193.93:0/2058045818 --> v1:10.20.193.93:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f3978141030 con 0x7f39780b5be0 2026-02-22T23:24:04.216 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.213+0000 7f9d3a7fc640 1 -- 10.20.193.93:0/1116474261 <== mon.2 v1:10.20.193.93:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (unknown 1274345170 0 3887400221) 0x7f9d48093020 con 0x7f9d4c0b2c60 2026-02-22T23:24:04.216 INFO:teuthology.orchestra.run.trial093.stdout:60129542148 2026-02-22T23:24:04.217 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.213+0000 7f396d7fa640 1 -- 10.20.193.93:0/2058045818 <== mon.0 v1:10.20.193.93:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (unknown 383520633 0 3887400221) 0x7f396005d550 con 0x7f39780b5be0 2026-02-22T23:24:04.217 INFO:teuthology.orchestra.run.trial093.stdout:60129542148 2026-02-22T23:24:04.218 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.215+0000 7f9d53f7e640 1 -- 10.20.193.93:0/1116474261 >> v1:10.20.193.155:6800/3108481844 conn(0x7f9d1c078240 legacy=0x7f9d1c07a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.218 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.215+0000 7f9d53f7e640 1 -- 10.20.193.93:0/1116474261 >> v1:10.20.193.93:6790/0 conn(0x7f9d4c0b2c60 legacy=0x7f9d4c1da5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.218 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.215+0000 7f397f155640 1 -- 10.20.193.93:0/2058045818 >> v1:10.20.193.155:6800/3108481844 conn(0x7f39480781f0 legacy=0x7f394807a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.218 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.215+0000 7f397f155640 1 -- 10.20.193.93:0/2058045818 >> v1:10.20.193.93:6789/0 conn(0x7f39780b5be0 legacy=0x7f39781de2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.218 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.215+0000 7f9d53f7e640 1 -- 10.20.193.93:0/1116474261 shutdown_connections 2026-02-22T23:24:04.219 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.215+0000 7f397f155640 1 -- 10.20.193.93:0/2058045818 shutdown_connections 2026-02-22T23:24:04.219 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.215+0000 7f9d53f7e640 1 -- 10.20.193.93:0/1116474261 >> 10.20.193.93:0/1116474261 conn(0x7f9d4c068410 msgr2=0x7f9d4c0b9960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:04.219 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.215+0000 7f9d53f7e640 1 -- 10.20.193.93:0/1116474261 shutdown_connections 2026-02-22T23:24:04.219 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.215+0000 7f397f155640 1 -- 10.20.193.93:0/2058045818 >> 10.20.193.93:0/2058045818 conn(0x7f3978068410 msgr2=0x7f39780687f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:04.219 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.215+0000 7f9d53f7e640 1 -- 10.20.193.93:0/1116474261 wait complete. 2026-02-22T23:24:04.220 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.215+0000 7f397f155640 1 -- 10.20.193.93:0/2058045818 shutdown_connections 2026-02-22T23:24:04.220 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.215+0000 7f397f155640 1 -- 10.20.193.93:0/2058045818 wait complete. 2026-02-22T23:24:04.220 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.217+0000 7fbff117e640 1 -- 10.20.193.93:0/3067665307 --> v1:10.20.193.93:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fbfec076790 con 0x7fbfec0b5be0 2026-02-22T23:24:04.220 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.217+0000 7fbfcb7fe640 1 -- 10.20.193.93:0/3067665307 <== mon.2 v1:10.20.193.93:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (unknown 1823589948 0 3887400221) 0x7fbfd405d0d0 con 0x7fbfec0b5be0 2026-02-22T23:24:04.220 INFO:teuthology.orchestra.run.trial093.stdout:60129542148 2026-02-22T23:24:04.222 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.219+0000 7fbff117e640 1 -- 10.20.193.93:0/3067665307 >> v1:10.20.193.155:6800/3108481844 conn(0x7fbfb8078280 legacy=0x7fbfb807a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.222 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.219+0000 7fbff117e640 1 -- 10.20.193.93:0/3067665307 >> v1:10.20.193.93:6790/0 conn(0x7fbfec0b5be0 legacy=0x7fbfec144e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.222 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.219+0000 7fbff117e640 1 -- 10.20.193.93:0/3067665307 shutdown_connections 2026-02-22T23:24:04.222 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.219+0000 7fbff117e640 1 -- 10.20.193.93:0/3067665307 >> 10.20.193.93:0/3067665307 conn(0x7fbfec068410 msgr2=0x7fbfec0b9910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:04.222 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.219+0000 7fbff117e640 1 -- 10.20.193.93:0/3067665307 shutdown_connections 2026-02-22T23:24:04.222 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.219+0000 7fbff117e640 1 -- 10.20.193.93:0/3067665307 wait complete. 2026-02-22T23:24:04.228 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542148 for osd.6 2026-02-22T23:24:04.228 DEBUG:teuthology.parallel:result is None 2026-02-22T23:24:04.229 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542148 for osd.3 2026-02-22T23:24:04.229 DEBUG:teuthology.parallel:result is None 2026-02-22T23:24:04.231 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542148 for osd.4 2026-02-22T23:24:04.231 DEBUG:teuthology.parallel:result is None 2026-02-22T23:24:04.259 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.256+0000 7ff68e6c9640 1 -- 10.20.193.93:0/3211087110 --> v1:10.20.193.93:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7ff6880ad8f0 con 0x7ff6880afa20 2026-02-22T23:24:04.259 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.256+0000 7ff684ff9640 1 -- 10.20.193.93:0/3211087110 <== mon.0 v1:10.20.193.93:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (unknown 1482059429 0 3056272221) 0x7ff67c05c470 con 0x7ff6880afa20 2026-02-22T23:24:04.260 INFO:teuthology.orchestra.run.trial093.stdout:55834574852 2026-02-22T23:24:04.260 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.257+0000 7f57f4d8f640 1 -- 10.20.193.93:0/3388063868 --> v1:10.20.193.93:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f57f00b61f0 con 0x7f57f0140e90 2026-02-22T23:24:04.261 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.257+0000 7f57d6ffd640 1 -- 10.20.193.93:0/3388063868 <== mon.2 v1:10.20.193.93:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (unknown 2131975755 0 3887400221) 0x7f57e005c4e0 con 0x7f57f0140e90 2026-02-22T23:24:04.261 INFO:teuthology.orchestra.run.trial093.stdout:60129542148 2026-02-22T23:24:04.263 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.258+0000 7ff68e6c9640 1 -- 10.20.193.93:0/3211087110 >> v1:10.20.193.155:6800/3108481844 conn(0x7ff658078160 legacy=0x7ff65807a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.263 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.258+0000 7ff68e6c9640 1 -- 10.20.193.93:0/3211087110 >> v1:10.20.193.93:6789/0 conn(0x7ff6880afa20 legacy=0x7ff688134a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.263 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.258+0000 7ff68e6c9640 1 -- 10.20.193.93:0/3211087110 shutdown_connections 2026-02-22T23:24:04.263 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.258+0000 7ff68e6c9640 1 -- 10.20.193.93:0/3211087110 >> 10.20.193.93:0/3211087110 conn(0x7ff68806c860 msgr2=0x7ff68806cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:04.263 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.258+0000 7ff68e6c9640 1 -- 10.20.193.93:0/3211087110 shutdown_connections 2026-02-22T23:24:04.263 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.258+0000 7ff68e6c9640 1 -- 10.20.193.93:0/3211087110 wait complete. 2026-02-22T23:24:04.264 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.259+0000 7f57f4d8f640 1 -- 10.20.193.93:0/3388063868 >> v1:10.20.193.155:6800/3108481844 conn(0x7f57bc077ff0 legacy=0x7f57bc07a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.264 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.259+0000 7f57f4d8f640 1 -- 10.20.193.93:0/3388063868 >> v1:10.20.193.93:6790/0 conn(0x7f57f0140e90 legacy=0x7f57f01383b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.264 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.259+0000 7f57f4d8f640 1 -- 10.20.193.93:0/3388063868 shutdown_connections 2026-02-22T23:24:04.264 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.259+0000 7f57f4d8f640 1 -- 10.20.193.93:0/3388063868 >> 10.20.193.93:0/3388063868 conn(0x7f57f0068410 msgr2=0x7f57f00687f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:04.264 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.259+0000 7f57f4d8f640 1 -- 10.20.193.93:0/3388063868 shutdown_connections 2026-02-22T23:24:04.265 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.259+0000 7f57f4d8f640 1 -- 10.20.193.93:0/3388063868 wait complete. 2026-02-22T23:24:04.265 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.262+0000 7f7ed8144640 1 -- 10.20.193.93:0/871525669 --> v1:10.20.193.93:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f7ed0076790 con 0x7f7ed00723a0 2026-02-22T23:24:04.265 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.262+0000 7f7ebe7fc640 1 -- 10.20.193.93:0/871525669 <== mon.2 v1:10.20.193.93:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (unknown 92182286 0 3887400221) 0x7f7ec005d500 con 0x7f7ed00723a0 2026-02-22T23:24:04.266 INFO:teuthology.orchestra.run.trial093.stdout:60129542148 2026-02-22T23:24:04.267 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.264+0000 7f711a586640 1 -- 10.20.193.93:0/1744863374 --> v1:10.20.193.93:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f7114141030 con 0x7f71140b5be0 2026-02-22T23:24:04.267 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.264+0000 7f7110ff9640 1 -- 10.20.193.93:0/1744863374 <== mon.2 v1:10.20.193.93:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (unknown 574334944 0 3887400221) 0x7f710405c210 con 0x7f71140b5be0 2026-02-22T23:24:04.267 INFO:teuthology.orchestra.run.trial093.stdout:60129542148 2026-02-22T23:24:04.268 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.264+0000 7f7ed8144640 1 -- 10.20.193.93:0/871525669 >> v1:10.20.193.155:6800/3108481844 conn(0x7f7ea0078020 legacy=0x7f7ea007a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.268 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.264+0000 7f7ed8144640 1 -- 10.20.193.93:0/871525669 >> v1:10.20.193.93:6790/0 conn(0x7f7ed00723a0 legacy=0x7f7ed013e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.268 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.264+0000 7f7ed8144640 1 -- 10.20.193.93:0/871525669 shutdown_connections 2026-02-22T23:24:04.268 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.264+0000 7f7ed8144640 1 -- 10.20.193.93:0/871525669 >> 10.20.193.93:0/871525669 conn(0x7f7ed00b7110 msgr2=0x7f7ed0075f70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:04.268 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.264+0000 7f7ed8144640 1 -- 10.20.193.93:0/871525669 shutdown_connections 2026-02-22T23:24:04.269 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.264+0000 7f7ed8144640 1 -- 10.20.193.93:0/871525669 wait complete. 2026-02-22T23:24:04.270 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.266+0000 7f711a586640 1 -- 10.20.193.93:0/1744863374 >> v1:10.20.193.155:6800/3108481844 conn(0x7f70e4078110 legacy=0x7f70e407a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.270 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.266+0000 7f711a586640 1 -- 10.20.193.93:0/1744863374 >> v1:10.20.193.93:6790/0 conn(0x7f71140b5be0 legacy=0x7f71141ddbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.270 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.266+0000 7f711a586640 1 -- 10.20.193.93:0/1744863374 shutdown_connections 2026-02-22T23:24:04.270 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.266+0000 7f711a586640 1 -- 10.20.193.93:0/1744863374 >> 10.20.193.93:0/1744863374 conn(0x7f7114068410 msgr2=0x7f71140b9910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:04.270 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.266+0000 7f711a586640 1 -- 10.20.193.93:0/1744863374 shutdown_connections 2026-02-22T23:24:04.270 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.266+0000 7f711a586640 1 -- 10.20.193.93:0/1744863374 wait complete. 2026-02-22T23:24:04.271 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.7 2026-02-22T23:24:04.272 DEBUG:teuthology.parallel:result is None 2026-02-22T23:24:04.272 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542148 for osd.5 2026-02-22T23:24:04.273 DEBUG:teuthology.parallel:result is None 2026-02-22T23:24:04.275 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542148 for osd.2 2026-02-22T23:24:04.276 DEBUG:teuthology.parallel:result is None 2026-02-22T23:24:04.277 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542148 for osd.0 2026-02-22T23:24:04.278 DEBUG:teuthology.parallel:result is None 2026-02-22T23:24:04.284 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.281+0000 7f02ebbeb640 1 -- 10.20.193.93:0/1663113882 --> v1:10.20.193.93:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f02e4076960 con 0x7f02e413ea10 2026-02-22T23:24:04.284 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.281+0000 7f02da7fc640 1 -- 10.20.193.93:0/1663113882 <== mon.2 v1:10.20.193.93:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (unknown 832126871 0 3056272221) 0x7f02d405dce0 con 0x7f02e413ea10 2026-02-22T23:24:04.285 INFO:teuthology.orchestra.run.trial093.stdout:55834574852 2026-02-22T23:24:04.286 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.283+0000 7f02ebbeb640 1 -- 10.20.193.93:0/1663113882 >> v1:10.20.193.155:6800/3108481844 conn(0x7f02b40781a0 legacy=0x7f02b407a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.286 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.283+0000 7f02ebbeb640 1 -- 10.20.193.93:0/1663113882 >> v1:10.20.193.93:6790/0 conn(0x7f02e413ea10 legacy=0x7f02e41d80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.286 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.283+0000 7f02ebbeb640 1 -- 10.20.193.93:0/1663113882 shutdown_connections 2026-02-22T23:24:04.287 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.283+0000 7f02ebbeb640 1 -- 10.20.193.93:0/1663113882 >> 10.20.193.93:0/1663113882 conn(0x7f02e40b1d30 msgr2=0x7f02e406cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:04.287 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.283+0000 7f02ebbeb640 1 -- 10.20.193.93:0/1663113882 shutdown_connections 2026-02-22T23:24:04.287 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.283+0000 7f02ebbeb640 1 -- 10.20.193.93:0/1663113882 wait complete. 2026-02-22T23:24:04.294 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.1 2026-02-22T23:24:04.295 DEBUG:teuthology.parallel:result is None 2026-02-22T23:24:04.295 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-22T23:24:04.295 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T23:24:04.407 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.398+0000 7f6e75bd5640 1 Processor -- start 2026-02-22T23:24:04.407 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.398+0000 7f6e75bd5640 1 -- start start 2026-02-22T23:24:04.407 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.398+0000 7f6e75bd5640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e7013ee30 con 0x7f6e70144a00 2026-02-22T23:24:04.407 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.398+0000 7f6e75bd5640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e70144de0 con 0x7f6e7013ea10 2026-02-22T23:24:04.407 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.398+0000 7f6e75bd5640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e70074040 con 0x7f6e701452d0 2026-02-22T23:24:04.407 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.398+0000 7f6e6f7fe640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7f6e70144a00 0x7f6e700afa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:47172/0 (socket says 10.20.193.93:47172) 2026-02-22T23:24:04.407 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.398+0000 7f6e6f7fe640 1 -- 10.20.193.93:0/2978060580 learned_addr learned my addr 10.20.193.93:0/2978060580 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:04.407 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.398+0000 7f6e6e7fc640 1 -- 10.20.193.93:0/2978060580 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 153532885 0 0) 0x7f6e5c002920 con 0x7f6e70144a00 2026-02-22T23:24:04.408 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.399+0000 7f6e6e7fc640 1 -- 10.20.193.93:0/2978060580 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e54003620 con 0x7f6e70144a00 2026-02-22T23:24:04.408 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.399+0000 7f6e6e7fc640 1 -- 10.20.193.93:0/2978060580 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4019417442 0 0) 0x7f6e70074040 con 0x7f6e701452d0 2026-02-22T23:24:04.408 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.399+0000 7f6e6e7fc640 1 -- 10.20.193.93:0/2978060580 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e5c002920 con 0x7f6e701452d0 2026-02-22T23:24:04.408 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.399+0000 7f6e6e7fc640 1 -- 10.20.193.93:0/2978060580 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3547417932 0 0) 0x7f6e54003620 con 0x7f6e70144a00 2026-02-22T23:24:04.408 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.399+0000 7f6e6e7fc640 1 -- 10.20.193.93:0/2978060580 >> v1:10.20.193.93:6790/0 conn(0x7f6e701452d0 legacy=0x7f6e7013e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.408 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.399+0000 7f6e6e7fc640 1 -- 10.20.193.93:0/2978060580 >> v1:10.20.193.155:6789/0 conn(0x7f6e7013ea10 legacy=0x7f6e7014cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T23:24:04.408 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.399+0000 7f6e6e7fc640 1 -- 10.20.193.93:0/2978060580 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e70074320 con 0x7f6e70144a00 2026-02-22T23:24:04.408 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.399+0000 7f6e6e7fc640 1 -- 10.20.193.93:0/2978060580 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f6e5c003070 con 0x7f6e70144a00 2026-02-22T23:24:04.408 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.399+0000 7f6e6e7fc640 1 -- 10.20.193.93:0/2978060580 <== mon.0 v1:10.20.193.93:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6e5c003290 con 0x7f6e70144a00 2026-02-22T23:24:04.408 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.399+0000 7f6e6e7fc640 1 -- 10.20.193.93:0/2978060580 <== mon.0 v1:10.20.193.93:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f6e5c0049a0 con 0x7f6e70144a00 2026-02-22T23:24:04.408 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.399+0000 7f6e75bd5640 1 -- 10.20.193.93:0/2978060580 >> v1:10.20.193.93:6789/0 conn(0x7f6e70144a00 legacy=0x7f6e700afa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.409 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.399+0000 7f6e75bd5640 1 -- 10.20.193.93:0/2978060580 shutdown_connections 2026-02-22T23:24:04.409 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.399+0000 7f6e75bd5640 1 -- 10.20.193.93:0/2978060580 >> 10.20.193.93:0/2978060580 conn(0x7f6e700b1d30 msgr2=0x7f6e700b2140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:04.409 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.399+0000 7f6e75bd5640 1 -- 10.20.193.93:0/2978060580 shutdown_connections 2026-02-22T23:24:04.409 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.399+0000 7f6e75bd5640 1 -- 10.20.193.93:0/2978060580 wait complete. 2026-02-22T23:24:04.409 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.400+0000 7f6e75bd5640 1 Processor -- start 2026-02-22T23:24:04.409 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.400+0000 7f6e75bd5640 1 -- start start 2026-02-22T23:24:04.409 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.400+0000 7f6e75bd5640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e70071960 con 0x7f6e7013ea10 2026-02-22T23:24:04.409 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.400+0000 7f6e75bd5640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e70071b30 con 0x7f6e70144a00 2026-02-22T23:24:04.409 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.400+0000 7f6e75bd5640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e70141fa0 con 0x7f6e701452d0 2026-02-22T23:24:04.409 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.400+0000 7f6e6f7fe640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7f6e7013ea10 0x7f6e7013f010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:47178/0 (socket says 10.20.193.93:47178) 2026-02-22T23:24:04.409 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.400+0000 7f6e6f7fe640 1 -- 10.20.193.93:0/1670721386 learned_addr learned my addr 10.20.193.93:0/1670721386 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:04.410 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.400+0000 7f6e4bfff640 1 -- 10.20.193.93:0/1670721386 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3391386037 0 0) 0x7f6e70071960 con 0x7f6e7013ea10 2026-02-22T23:24:04.410 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.400+0000 7f6e4bfff640 1 -- 10.20.193.93:0/1670721386 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e40003620 con 0x7f6e7013ea10 2026-02-22T23:24:04.410 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.400+0000 7f6e4bfff640 1 -- 10.20.193.93:0/1670721386 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 602595389 0 0) 0x7f6e70141fa0 con 0x7f6e701452d0 2026-02-22T23:24:04.410 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.400+0000 7f6e4bfff640 1 -- 10.20.193.93:0/1670721386 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e70071960 con 0x7f6e701452d0 2026-02-22T23:24:04.410 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.400+0000 7f6e4bfff640 1 -- 10.20.193.93:0/1670721386 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3412021902 0 0) 0x7f6e40003620 con 0x7f6e7013ea10 2026-02-22T23:24:04.410 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.400+0000 7f6e4bfff640 1 -- 10.20.193.93:0/1670721386 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6e70141fa0 con 0x7f6e7013ea10 2026-02-22T23:24:04.410 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.400+0000 7f6e4bfff640 1 -- 10.20.193.93:0/1670721386 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f6e5c0048e0 con 0x7f6e7013ea10 2026-02-22T23:24:04.410 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.400+0000 7f6e4bfff640 1 -- 10.20.193.93:0/1670721386 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 624630657 0 0) 0x7f6e70071960 con 0x7f6e701452d0 2026-02-22T23:24:04.410 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.400+0000 7f6e4bfff640 1 -- 10.20.193.93:0/1670721386 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6e40003620 con 0x7f6e701452d0 2026-02-22T23:24:04.410 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.400+0000 7f6e4bfff640 1 -- 10.20.193.93:0/1670721386 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3949227795 0 0) 0x7f6e5c002920 con 0x7f6e70144a00 2026-02-22T23:24:04.410 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.400+0000 7f6e4bfff640 1 -- 10.20.193.93:0/1670721386 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e70071960 con 0x7f6e70144a00 2026-02-22T23:24:04.410 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.400+0000 7f6e4bfff640 1 -- 10.20.193.93:0/1670721386 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f6e640030a0 con 0x7f6e701452d0 2026-02-22T23:24:04.411 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.401+0000 7f6e4bfff640 1 -- 10.20.193.93:0/1670721386 <== mon.0 v1:10.20.193.93:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1352633190 0 0) 0x7f6e70141fa0 con 0x7f6e7013ea10 2026-02-22T23:24:04.411 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.401+0000 7f6e4bfff640 1 -- 10.20.193.93:0/1670721386 >> v1:10.20.193.93:6790/0 conn(0x7f6e701452d0 legacy=0x7f6e701320d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.411 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.401+0000 7f6e4bfff640 1 -- 10.20.193.93:0/1670721386 >> v1:10.20.193.155:6789/0 conn(0x7f6e70144a00 legacy=0x7f6e701da3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.411 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.401+0000 7f6e4bfff640 1 -- 10.20.193.93:0/1670721386 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e70142170 con 0x7f6e7013ea10 2026-02-22T23:24:04.411 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.401+0000 7f6e75bd5640 1 -- 10.20.193.93:0/1670721386 --> v1:10.20.193.93:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6e701daaf0 con 0x7f6e7013ea10 2026-02-22T23:24:04.411 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.401+0000 7f6e6f7fe640 1 -- 10.20.193.93:0/1670721386 >> v1:10.20.193.93:6789/0 conn(0x7f6e7013ea10 legacy=0x7f6e7013f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-22T23:24:04.411 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.401+0000 7f6e6f7fe640 1 -- 10.20.193.93:0/1670721386 >> v1:10.20.193.93:6789/0 conn(0x7f6e7013ea10 legacy=0x7f6e7013f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T23:24:04.411 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.401+0000 7f6e6f7fe640 1 --1- 10.20.193.93:0/1670721386 >> v1:10.20.193.93:6789/0 conn(0x7f6e7013ea10 0x7f6e7013f010 :-1 s=OPENED pgs=162 cs=1 l=1).handle_message read tag failed 2026-02-22T23:24:04.411 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.401+0000 7f6e6f7fe640 1 --1- 10.20.193.93:0/1670721386 >> v1:10.20.193.93:6789/0 conn(0x7f6e7013ea10 0x7f6e7013f010 :-1 s=OPENED pgs=162 cs=1 l=1).fault on lossy channel, failing 2026-02-22T23:24:04.411 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.401+0000 7f6e4bfff640 1 -- 10.20.193.93:0/1670721386 >> v1:10.20.193.93:6789/0 conn(0x7f6e7013ea10 legacy=0x7f6e7013f010 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:24:04.411 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.401+0000 7f6e4bfff640 1 -- 10.20.193.93:0/1670721386 --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6e70141fa0 con 0x7f6e4000c420 2026-02-22T23:24:04.412 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.401+0000 7f6e4bfff640 1 -- 10.20.193.93:0/1670721386 --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6e5c002920 con 0x7f6e70144a00 2026-02-22T23:24:04.412 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.401+0000 7f6e4bfff640 1 -- 10.20.193.93:0/1670721386 --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6e400125a0 con 0x7f6e701452d0 2026-02-22T23:24:04.412 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.401+0000 7f6e4bfff640 1 -- 10.20.193.93:0/1670721386 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1279444374 0 0) 0x7f6e400125a0 con 0x7f6e701452d0 2026-02-22T23:24:04.412 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.401+0000 7f6e4bfff640 1 -- 10.20.193.93:0/1670721386 --> v1:10.20.193.93:6790/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7f6e400104a0 con 0x7f6e701452d0 2026-02-22T23:24:04.412 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.401+0000 7f6e4bfff640 1 -- 10.20.193.93:0/1670721386 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2348226511 0 0) 0x7f6e70141fa0 con 0x7f6e4000c420 2026-02-22T23:24:04.412 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.401+0000 7f6e4bfff640 1 -- 10.20.193.93:0/1670721386 --> v1:10.20.193.93:6789/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7f6e400125a0 con 0x7f6e4000c420 2026-02-22T23:24:04.412 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.401+0000 7f6e4bfff640 1 -- 10.20.193.93:0/1670721386 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (unknown 794391145 0 0) 0x7f6e400104a0 con 0x7f6e701452d0 2026-02-22T23:24:04.412 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.401+0000 7f6e4bfff640 1 -- 10.20.193.93:0/1670721386 >> v1:10.20.193.155:6789/0 conn(0x7f6e70144a00 legacy=0x7f6e40003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.412 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.401+0000 7f6e4bfff640 1 -- 10.20.193.93:0/1670721386 >> v1:10.20.193.93:6789/0 conn(0x7f6e4000c420 legacy=0x7f6e4000e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.412 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.401+0000 7f6e4bfff640 1 -- 10.20.193.93:0/1670721386 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+}) -- 0x7f6e40013960 con 0x7f6e701452d0 2026-02-22T23:24:04.412 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.401+0000 7f6e4bfff640 1 -- 10.20.193.93:0/1670721386 --> v1:10.20.193.93:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f6e7013ad20 con 0x7f6e701452d0 2026-02-22T23:24:04.412 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.401+0000 7f6e4bfff640 1 -- 10.20.193.93:0/1670721386 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f6e60002e50 con 0x7f6e701452d0 2026-02-22T23:24:04.412 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.401+0000 7f6e4bfff640 1 -- 10.20.193.93:0/1670721386 <== mon.2 v1:10.20.193.93:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6e60002e50 con 0x7f6e701452d0 2026-02-22T23:24:04.413 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.401+0000 7f6e75bd5640 1 -- 10.20.193.93:0/1670721386 --> v1:10.20.193.93:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e700712a0 con 0x7f6e701452d0 2026-02-22T23:24:04.413 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.402+0000 7f6e4bfff640 1 -- 10.20.193.93:0/1670721386 <== mon.2 v1:10.20.193.93:6790/0 5 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7f6e6001b630 con 0x7f6e701452d0 2026-02-22T23:24:04.413 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.402+0000 7f6e4bfff640 1 -- 10.20.193.93:0/1670721386 <== mon.2 v1:10.20.193.93:6790/0 6 ==== osd_map(20..20 src has 1..20) ==== 4142+0+0 (unknown 2994938210 0 0) 0x7f6e60092420 con 0x7f6e701452d0 2026-02-22T23:24:04.413 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.404+0000 7f6e4bfff640 1 -- 10.20.193.93:0/1670721386 <== mon.2 v1:10.20.193.93:6790/0 7 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f6e70071b30 con 0x7f6e701452d0 2026-02-22T23:24:04.488 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.485+0000 7f6e75bd5640 1 -- 10.20.193.93:0/1670721386 --> v1:10.20.193.155:6800/3108481844 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6e70076960 con 0x7f6e7013ea10 2026-02-22T23:24:04.489 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.486+0000 7f6e4bfff640 1 -- 10.20.193.93:0/1670721386 <== mgr.4108 v1:10.20.193.155:6800/3108481844 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+35786 (unknown 2965378022 0 2941660292) 0x7f6e70076960 con 0x7f6e7013ea10 2026-02-22T23:24:04.489 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:24:04.490 INFO:teuthology.orchestra.run.trial093.stderr:dumped all 2026-02-22T23:24:04.490 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.487+0000 7f6e75bd5640 1 -- 10.20.193.93:0/1670721386 >> v1:10.20.193.155:6800/3108481844 conn(0x7f6e7013ea10 legacy=0x7f6e40085870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.490 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.487+0000 7f6e75bd5640 1 -- 10.20.193.93:0/1670721386 >> v1:10.20.193.93:6790/0 conn(0x7f6e701452d0 legacy=0x7f6e4000aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.490 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.487+0000 7f6e75bd5640 1 -- 10.20.193.93:0/1670721386 shutdown_connections 2026-02-22T23:24:04.490 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.487+0000 7f6e75bd5640 1 -- 10.20.193.93:0/1670721386 >> 10.20.193.93:0/1670721386 conn(0x7f6e700b1d30 msgr2=0x7f6e7006cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:04.490 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.487+0000 7f6e75bd5640 1 -- 10.20.193.93:0/1670721386 shutdown_connections 2026-02-22T23:24:04.490 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.487+0000 7f6e75bd5640 1 -- 10.20.193.93:0/1670721386 wait complete. 2026-02-22T23:24:04.497 INFO:teuthology.orchestra.run.trial093.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2026-02-22T23:24:03.057665+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218140,"kb_used_data":2400,"kb_used_omap":12,"kb_used_meta":215539,"kb_avail":754756580,"statfs":{"total":773094113280,"available":772870737920,"internally_reserved":0,"allocated":2457600,"data_stored":1515939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":220712504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.102587"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T23:24:00.993186+0000","last_change":"2026-02-22T23:24:00.993186+0000","last_active":"2026-02-22T23:24:00.993186+0000","last_peered":"2026-02-22T23:24:00.993186+0000","last_clean":"2026-02-22T23:24:00.993186+0000","last_became_active":"2026-02-22T23:23:58.958814+0000","last_became_peered":"2026-02-22T23:23:58.958814+0000","last_unstale":"2026-02-22T23:24:00.993186+0000","last_undegraded":"2026-02-22T23:24:00.993186+0000","last_fullsized":"2026-02-22T23:24:00.993186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_clean_scrub_stamp":"2026-02-22T23:23:57.931636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:57:54.120290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00022938900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T23:24:00.945989+0000","last_change":"2026-02-22T23:24:00.946318+0000","last_active":"2026-02-22T23:24:00.945989+0000","last_peered":"2026-02-22T23:24:00.945989+0000","last_clean":"2026-02-22T23:24:00.945989+0000","last_became_active":"2026-02-22T23:23:58.938089+0000","last_became_peered":"2026-02-22T23:23:58.938089+0000","last_unstale":"2026-02-22T23:24:00.945989+0000","last_undegraded":"2026-02-22T23:24:00.945989+0000","last_fullsized":"2026-02-22T23:24:00.945989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_clean_scrub_stamp":"2026-02-22T23:23:57.931636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:57:44.956161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056227399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T23:24:01.168896+0000","last_change":"2026-02-22T23:24:01.168991+0000","last_active":"2026-02-22T23:24:01.168896+0000","last_peered":"2026-02-22T23:24:01.168896+0000","last_clean":"2026-02-22T23:24:01.168896+0000","last_became_active":"2026-02-22T23:23:59.257807+0000","last_became_peered":"2026-02-22T23:23:59.257807+0000","last_unstale":"2026-02-22T23:24:01.168896+0000","last_undegraded":"2026-02-22T23:24:01.168896+0000","last_fullsized":"2026-02-22T23:24:01.168896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_clean_scrub_stamp":"2026-02-22T23:23:57.931636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:41:56.557451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000177021,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T23:24:00.945937+0000","last_change":"2026-02-22T23:24:00.946170+0000","last_active":"2026-02-22T23:24:00.945937+0000","last_peered":"2026-02-22T23:24:00.945937+0000","last_clean":"2026-02-22T23:24:00.945937+0000","last_became_active":"2026-02-22T23:23:59.237046+0000","last_became_peered":"2026-02-22T23:23:59.237046+0000","last_unstale":"2026-02-22T23:24:00.945937+0000","last_undegraded":"2026-02-22T23:24:00.945937+0000","last_fullsized":"2026-02-22T23:24:00.945937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_clean_scrub_stamp":"2026-02-22T23:23:57.931636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:24:35.277604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000445938,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T23:24:00.965905+0000","last_change":"2026-02-22T23:24:00.965007+0000","last_active":"2026-02-22T23:24:00.965905+0000","last_peered":"2026-02-22T23:24:00.965905+0000","last_clean":"2026-02-22T23:24:00.965905+0000","last_became_active":"2026-02-22T23:23:58.958840+0000","last_became_peered":"2026-02-22T23:23:58.958840+0000","last_unstale":"2026-02-22T23:24:00.965905+0000","last_undegraded":"2026-02-22T23:24:00.965905+0000","last_fullsized":"2026-02-22T23:24:00.965905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_clean_scrub_stamp":"2026-02-22T23:23:57.931636+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:58:17.312579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00022545200000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T23:24:01.027919+0000","last_change":"2026-02-22T23:24:01.027919+0000","last_active":"2026-02-22T23:24:01.027919+0000","last_peered":"2026-02-22T23:24:01.027919+0000","last_clean":"2026-02-22T23:24:01.027919+0000","last_became_active":"2026-02-22T23:23:59.236692+0000","last_became_peered":"2026-02-22T23:23:59.236692+0000","last_unstale":"2026-02-22T23:24:01.027919+0000","last_undegraded":"2026-02-22T23:24:01.027919+0000","last_fullsized":"2026-02-22T23:24:01.027919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_clean_scrub_stamp":"2026-02-22T23:23:57.931636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:54:26.153298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017529500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T23:24:01.168928+0000","last_change":"2026-02-22T23:24:01.168995+0000","last_active":"2026-02-22T23:24:01.168928+0000","last_peered":"2026-02-22T23:24:01.168928+0000","last_clean":"2026-02-22T23:24:01.168928+0000","last_became_active":"2026-02-22T23:23:58.958969+0000","last_became_peered":"2026-02-22T23:23:58.958969+0000","last_unstale":"2026-02-22T23:24:01.168928+0000","last_undegraded":"2026-02-22T23:24:01.168928+0000","last_fullsized":"2026-02-22T23:24:01.168928+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_clean_scrub_stamp":"2026-02-22T23:23:57.931636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:55:46.818746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000181831,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T23:24:00.965025+0000","last_change":"2026-02-22T23:24:00.965025+0000","last_active":"2026-02-22T23:24:00.965025+0000","last_peered":"2026-02-22T23:24:00.965025+0000","last_clean":"2026-02-22T23:24:00.965025+0000","last_became_active":"2026-02-22T23:23:58.958830+0000","last_became_peered":"2026-02-22T23:23:58.958830+0000","last_unstale":"2026-02-22T23:24:00.965025+0000","last_undegraded":"2026-02-22T23:24:00.965025+0000","last_fullsized":"2026-02-22T23:24:00.965025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_clean_scrub_stamp":"2026-02-22T23:23:57.931636+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:18:15.715586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000241392,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'112","reported_seq":156,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T23:24:01.168770+0000","last_change":"2026-02-22T23:23:53.549952+0000","last_active":"2026-02-22T23:24:01.168770+0000","last_peered":"2026-02-22T23:24:01.168770+0000","last_clean":"2026-02-22T23:24:01.168770+0000","last_became_active":"2026-02-22T23:23:53.549316+0000","last_became_peered":"2026-02-22T23:23:53.549316+0000","last_unstale":"2026-02-22T23:24:01.168770+0000","last_undegraded":"2026-02-22T23:24:01.168770+0000","last_fullsized":"2026-02-22T23:24:01.168770+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:51.885433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:51.885433+0000","last_clean_scrub_stamp":"2026-02-22T23:23:51.885433+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:22:13.854378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27136,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344704,"statfs":{"total":96636764160,"available":96608976896,"internally_reserved":0,"allocated":176128,"data_stored":58434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":180224,"data_stored":58453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27136,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344704,"statfs":{"total":96636764160,"available":96608976896,"internally_reserved":0,"allocated":176128,"data_stored":58434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27136,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344704,"statfs":{"total":96636764160,"available":96608976896,"internally_reserved":0,"allocated":176128,"data_stored":58434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27136,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344704,"statfs":{"total":96636764160,"available":96608976896,"internally_reserved":0,"allocated":176128,"data_stored":58434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":708608,"data_stored":587362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":696320,"data_stored":582654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27589067},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27136,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344704,"statfs":{"total":96636764160,"available":96608976896,"internally_reserved":0,"allocated":167936,"data_stored":53734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T23:24:04.498 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T23:24:04.570 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.562+0000 7fca50643640 1 Processor -- start 2026-02-22T23:24:04.570 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.562+0000 7fca50643640 1 -- start start 2026-02-22T23:24:04.570 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.563+0000 7fca50643640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca48071530 con 0x7fca480af060 2026-02-22T23:24:04.570 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.563+0000 7fca50643640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca48070210 con 0x7fca480704d0 2026-02-22T23:24:04.570 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.563+0000 7fca50643640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca480b18f0 con 0x7fca48140d80 2026-02-22T23:24:04.570 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.563+0000 7fca4e3b8640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7fca480af060 0x7fca48140670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:47190/0 (socket says 10.20.193.93:47190) 2026-02-22T23:24:04.570 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.563+0000 7fca4e3b8640 1 -- 10.20.193.93:0/4217466989 learned_addr learned my addr 10.20.193.93:0/4217466989 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:04.570 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.563+0000 7fca4d3b6640 1 -- 10.20.193.93:0/4217466989 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3530294050 0 0) 0x7fca48071530 con 0x7fca480af060 2026-02-22T23:24:04.571 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.563+0000 7fca4d3b6640 1 -- 10.20.193.93:0/4217466989 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca30003620 con 0x7fca480af060 2026-02-22T23:24:04.571 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.563+0000 7fca4d3b6640 1 -- 10.20.193.93:0/4217466989 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2346391689 0 0) 0x7fca480b18f0 con 0x7fca48140d80 2026-02-22T23:24:04.571 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.563+0000 7fca4d3b6640 1 -- 10.20.193.93:0/4217466989 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca48071530 con 0x7fca48140d80 2026-02-22T23:24:04.571 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.563+0000 7fca4d3b6640 1 -- 10.20.193.93:0/4217466989 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3259098779 0 0) 0x7fca48071530 con 0x7fca48140d80 2026-02-22T23:24:04.571 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.563+0000 7fca4d3b6640 1 -- 10.20.193.93:0/4217466989 >> v1:10.20.193.155:6789/0 conn(0x7fca480704d0 legacy=0x7fca48143d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T23:24:04.571 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.563+0000 7fca4d3b6640 1 -- 10.20.193.93:0/4217466989 >> v1:10.20.193.93:6789/0 conn(0x7fca480af060 legacy=0x7fca48140670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.571 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.563+0000 7fca4d3b6640 1 -- 10.20.193.93:0/4217466989 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca480b14e0 con 0x7fca48140d80 2026-02-22T23:24:04.571 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.563+0000 7fca4d3b6640 1 -- 10.20.193.93:0/4217466989 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fca3c002e80 con 0x7fca48140d80 2026-02-22T23:24:04.571 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.563+0000 7fca4d3b6640 1 -- 10.20.193.93:0/4217466989 <== mon.2 v1:10.20.193.93:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fca3c003020 con 0x7fca48140d80 2026-02-22T23:24:04.571 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.563+0000 7fca4d3b6640 1 -- 10.20.193.93:0/4217466989 <== mon.2 v1:10.20.193.93:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fca3c0034b0 con 0x7fca48140d80 2026-02-22T23:24:04.571 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.564+0000 7fca50643640 1 -- 10.20.193.93:0/4217466989 >> v1:10.20.193.93:6790/0 conn(0x7fca48140d80 legacy=0x7fca48143670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.571 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.564+0000 7fca50643640 1 -- 10.20.193.93:0/4217466989 shutdown_connections 2026-02-22T23:24:04.572 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.564+0000 7fca50643640 1 -- 10.20.193.93:0/4217466989 >> 10.20.193.93:0/4217466989 conn(0x7fca480b1d30 msgr2=0x7fca480b2140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:04.572 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.564+0000 7fca50643640 1 -- 10.20.193.93:0/4217466989 shutdown_connections 2026-02-22T23:24:04.572 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.564+0000 7fca50643640 1 -- 10.20.193.93:0/4217466989 wait complete. 2026-02-22T23:24:04.572 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.564+0000 7fca50643640 1 Processor -- start 2026-02-22T23:24:04.572 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.564+0000 7fca50643640 1 -- start start 2026-02-22T23:24:04.572 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.565+0000 7fca50643640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca480b37a0 con 0x7fca48140d80 2026-02-22T23:24:04.572 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.565+0000 7fca50643640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca480b3a10 con 0x7fca480704d0 2026-02-22T23:24:04.572 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.565+0000 7fca50643640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca48072940 con 0x7fca480af060 2026-02-22T23:24:04.572 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.565+0000 7fca4dbb7640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7fca480af060 0x7fca48135100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:34418/0 (socket says 10.20.193.93:34418) 2026-02-22T23:24:04.573 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.565+0000 7fca4dbb7640 1 -- 10.20.193.93:0/1725386492 learned_addr learned my addr 10.20.193.93:0/1725386492 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:04.573 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.565+0000 7fca2effd640 1 -- 10.20.193.93:0/1725386492 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1152285112 0 0) 0x7fca48072940 con 0x7fca480af060 2026-02-22T23:24:04.573 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.565+0000 7fca2effd640 1 -- 10.20.193.93:0/1725386492 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca18003620 con 0x7fca480af060 2026-02-22T23:24:04.573 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.565+0000 7fca2effd640 1 -- 10.20.193.93:0/1725386492 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4118259323 0 0) 0x7fca480b37a0 con 0x7fca48140d80 2026-02-22T23:24:04.573 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.565+0000 7fca2effd640 1 -- 10.20.193.93:0/1725386492 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca48072940 con 0x7fca48140d80 2026-02-22T23:24:04.573 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.565+0000 7fca2effd640 1 -- 10.20.193.93:0/1725386492 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 92729661 0 0) 0x7fca18003620 con 0x7fca480af060 2026-02-22T23:24:04.573 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.565+0000 7fca2effd640 1 -- 10.20.193.93:0/1725386492 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fca480b37a0 con 0x7fca480af060 2026-02-22T23:24:04.573 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.565+0000 7fca2effd640 1 -- 10.20.193.93:0/1725386492 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fca3c003810 con 0x7fca480af060 2026-02-22T23:24:04.573 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.565+0000 7fca2effd640 1 -- 10.20.193.93:0/1725386492 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2525492949 0 0) 0x7fca48072940 con 0x7fca48140d80 2026-02-22T23:24:04.573 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.565+0000 7fca2effd640 1 -- 10.20.193.93:0/1725386492 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fca18003620 con 0x7fca48140d80 2026-02-22T23:24:04.573 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.565+0000 7fca2effd640 1 -- 10.20.193.93:0/1725386492 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fca440030a0 con 0x7fca48140d80 2026-02-22T23:24:04.574 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.565+0000 7fca4e3b8640 1 -- 10.20.193.93:0/1725386492 >> v1:10.20.193.155:6789/0 conn(0x7fca480704d0 legacy=0x7fca48073000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-22T23:24:04.574 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.565+0000 7fca4e3b8640 1 -- 10.20.193.93:0/1725386492 >> v1:10.20.193.155:6789/0 conn(0x7fca480704d0 legacy=0x7fca48073000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T23:24:04.574 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.565+0000 7fca4e3b8640 1 --1- 10.20.193.93:0/1725386492 >> v1:10.20.193.155:6789/0 conn(0x7fca480704d0 0x7fca48073000 :-1 s=OPENED pgs=166 cs=1 l=1).handle_message read tag failed 2026-02-22T23:24:04.574 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.565+0000 7fca4e3b8640 1 --1- 10.20.193.93:0/1725386492 >> v1:10.20.193.155:6789/0 conn(0x7fca480704d0 0x7fca48073000 :-1 s=OPENED pgs=166 cs=1 l=1).fault on lossy channel, failing 2026-02-22T23:24:04.574 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.565+0000 7fca2effd640 1 -- 10.20.193.93:0/1725386492 <== mon.2 v1:10.20.193.93:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2182562291 0 0) 0x7fca480b37a0 con 0x7fca480af060 2026-02-22T23:24:04.574 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.565+0000 7fca2effd640 1 -- 10.20.193.93:0/1725386492 >> v1:10.20.193.155:6789/0 conn(0x7fca480704d0 legacy=0x7fca48073000 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:24:04.574 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.565+0000 7fca2effd640 1 -- 10.20.193.93:0/1725386492 >> v1:10.20.193.93:6789/0 conn(0x7fca48140d80 legacy=0x7fca481dd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.574 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.565+0000 7fca2effd640 1 -- 10.20.193.93:0/1725386492 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca48072b10 con 0x7fca480af060 2026-02-22T23:24:04.574 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.565+0000 7fca50643640 1 -- 10.20.193.93:0/1725386492 --> v1:10.20.193.93:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fca48135810 con 0x7fca480af060 2026-02-22T23:24:04.574 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.565+0000 7fca50643640 1 -- 10.20.193.93:0/1725386492 --> v1:10.20.193.93:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fca481ddd60 con 0x7fca480af060 2026-02-22T23:24:04.574 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.565+0000 7fca2effd640 1 -- 10.20.193.93:0/1725386492 <== mon.2 v1:10.20.193.93:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fca3c002e60 con 0x7fca480af060 2026-02-22T23:24:04.574 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.565+0000 7fca2effd640 1 -- 10.20.193.93:0/1725386492 <== mon.2 v1:10.20.193.93:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fca3c003e00 con 0x7fca480af060 2026-02-22T23:24:04.575 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.566+0000 7fca50643640 1 -- 10.20.193.93:0/1725386492 --> v1:10.20.193.93:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca480008d0 con 0x7fca480af060 2026-02-22T23:24:04.575 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.566+0000 7fca2effd640 1 -- 10.20.193.93:0/1725386492 <== mon.2 v1:10.20.193.93:6790/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7fca3c01d990 con 0x7fca480af060 2026-02-22T23:24:04.575 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.567+0000 7fca2effd640 1 -- 10.20.193.93:0/1725386492 <== mon.2 v1:10.20.193.93:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 4142+0+0 (unknown 2994938210 0 0) 0x7fca3c094260 con 0x7fca480af060 2026-02-22T23:24:04.575 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.568+0000 7fca2effd640 1 -- 10.20.193.93:0/1725386492 <== mon.2 v1:10.20.193.93:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7fca3c05da60 con 0x7fca480af060 2026-02-22T23:24:04.652 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.649+0000 7fca50643640 1 -- 10.20.193.93:0/1725386492 --> v1:10.20.193.155:6800/3108481844 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fca48072ce0 con 0x7fca18078110 2026-02-22T23:24:04.653 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.651+0000 7fca2effd640 1 -- 10.20.193.93:0/1725386492 <== mgr.4108 v1:10.20.193.155:6800/3108481844 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+35786 (unknown 2965378022 0 2941660292) 0x7fca38007910 con 0x7fca18078110 2026-02-22T23:24:04.654 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:24:04.655 INFO:teuthology.orchestra.run.trial093.stderr:dumped all 2026-02-22T23:24:04.655 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.651+0000 7fca50643640 1 -- 10.20.193.93:0/1725386492 >> v1:10.20.193.155:6800/3108481844 conn(0x7fca18078110 legacy=0x7fca1807a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.655 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.651+0000 7fca50643640 1 -- 10.20.193.93:0/1725386492 >> v1:10.20.193.93:6790/0 conn(0x7fca480af060 legacy=0x7fca48135100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.655 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.651+0000 7fca50643640 1 -- 10.20.193.93:0/1725386492 shutdown_connections 2026-02-22T23:24:04.655 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.651+0000 7fca50643640 1 -- 10.20.193.93:0/1725386492 >> 10.20.193.93:0/1725386492 conn(0x7fca480b1d30 msgr2=0x7fca48143670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:04.655 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.651+0000 7fca50643640 1 -- 10.20.193.93:0/1725386492 shutdown_connections 2026-02-22T23:24:04.656 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.651+0000 7fca50643640 1 -- 10.20.193.93:0/1725386492 wait complete. 2026-02-22T23:24:04.662 INFO:teuthology.orchestra.run.trial093.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2026-02-22T23:24:03.057665+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218140,"kb_used_data":2400,"kb_used_omap":12,"kb_used_meta":215539,"kb_avail":754756580,"statfs":{"total":773094113280,"available":772870737920,"internally_reserved":0,"allocated":2457600,"data_stored":1515939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":220712504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.102587"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T23:24:00.993186+0000","last_change":"2026-02-22T23:24:00.993186+0000","last_active":"2026-02-22T23:24:00.993186+0000","last_peered":"2026-02-22T23:24:00.993186+0000","last_clean":"2026-02-22T23:24:00.993186+0000","last_became_active":"2026-02-22T23:23:58.958814+0000","last_became_peered":"2026-02-22T23:23:58.958814+0000","last_unstale":"2026-02-22T23:24:00.993186+0000","last_undegraded":"2026-02-22T23:24:00.993186+0000","last_fullsized":"2026-02-22T23:24:00.993186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_clean_scrub_stamp":"2026-02-22T23:23:57.931636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:57:54.120290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00022938900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T23:24:00.945989+0000","last_change":"2026-02-22T23:24:00.946318+0000","last_active":"2026-02-22T23:24:00.945989+0000","last_peered":"2026-02-22T23:24:00.945989+0000","last_clean":"2026-02-22T23:24:00.945989+0000","last_became_active":"2026-02-22T23:23:58.938089+0000","last_became_peered":"2026-02-22T23:23:58.938089+0000","last_unstale":"2026-02-22T23:24:00.945989+0000","last_undegraded":"2026-02-22T23:24:00.945989+0000","last_fullsized":"2026-02-22T23:24:00.945989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_clean_scrub_stamp":"2026-02-22T23:23:57.931636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:57:44.956161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056227399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T23:24:01.168896+0000","last_change":"2026-02-22T23:24:01.168991+0000","last_active":"2026-02-22T23:24:01.168896+0000","last_peered":"2026-02-22T23:24:01.168896+0000","last_clean":"2026-02-22T23:24:01.168896+0000","last_became_active":"2026-02-22T23:23:59.257807+0000","last_became_peered":"2026-02-22T23:23:59.257807+0000","last_unstale":"2026-02-22T23:24:01.168896+0000","last_undegraded":"2026-02-22T23:24:01.168896+0000","last_fullsized":"2026-02-22T23:24:01.168896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_clean_scrub_stamp":"2026-02-22T23:23:57.931636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:41:56.557451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000177021,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T23:24:00.945937+0000","last_change":"2026-02-22T23:24:00.946170+0000","last_active":"2026-02-22T23:24:00.945937+0000","last_peered":"2026-02-22T23:24:00.945937+0000","last_clean":"2026-02-22T23:24:00.945937+0000","last_became_active":"2026-02-22T23:23:59.237046+0000","last_became_peered":"2026-02-22T23:23:59.237046+0000","last_unstale":"2026-02-22T23:24:00.945937+0000","last_undegraded":"2026-02-22T23:24:00.945937+0000","last_fullsized":"2026-02-22T23:24:00.945937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_clean_scrub_stamp":"2026-02-22T23:23:57.931636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:24:35.277604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000445938,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T23:24:00.965905+0000","last_change":"2026-02-22T23:24:00.965007+0000","last_active":"2026-02-22T23:24:00.965905+0000","last_peered":"2026-02-22T23:24:00.965905+0000","last_clean":"2026-02-22T23:24:00.965905+0000","last_became_active":"2026-02-22T23:23:58.958840+0000","last_became_peered":"2026-02-22T23:23:58.958840+0000","last_unstale":"2026-02-22T23:24:00.965905+0000","last_undegraded":"2026-02-22T23:24:00.965905+0000","last_fullsized":"2026-02-22T23:24:00.965905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_clean_scrub_stamp":"2026-02-22T23:23:57.931636+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:58:17.312579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00022545200000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T23:24:01.027919+0000","last_change":"2026-02-22T23:24:01.027919+0000","last_active":"2026-02-22T23:24:01.027919+0000","last_peered":"2026-02-22T23:24:01.027919+0000","last_clean":"2026-02-22T23:24:01.027919+0000","last_became_active":"2026-02-22T23:23:59.236692+0000","last_became_peered":"2026-02-22T23:23:59.236692+0000","last_unstale":"2026-02-22T23:24:01.027919+0000","last_undegraded":"2026-02-22T23:24:01.027919+0000","last_fullsized":"2026-02-22T23:24:01.027919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_clean_scrub_stamp":"2026-02-22T23:23:57.931636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:54:26.153298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017529500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T23:24:01.168928+0000","last_change":"2026-02-22T23:24:01.168995+0000","last_active":"2026-02-22T23:24:01.168928+0000","last_peered":"2026-02-22T23:24:01.168928+0000","last_clean":"2026-02-22T23:24:01.168928+0000","last_became_active":"2026-02-22T23:23:58.958969+0000","last_became_peered":"2026-02-22T23:23:58.958969+0000","last_unstale":"2026-02-22T23:24:01.168928+0000","last_undegraded":"2026-02-22T23:24:01.168928+0000","last_fullsized":"2026-02-22T23:24:01.168928+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_clean_scrub_stamp":"2026-02-22T23:23:57.931636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:55:46.818746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000181831,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T23:24:00.965025+0000","last_change":"2026-02-22T23:24:00.965025+0000","last_active":"2026-02-22T23:24:00.965025+0000","last_peered":"2026-02-22T23:24:00.965025+0000","last_clean":"2026-02-22T23:24:00.965025+0000","last_became_active":"2026-02-22T23:23:58.958830+0000","last_became_peered":"2026-02-22T23:23:58.958830+0000","last_unstale":"2026-02-22T23:24:00.965025+0000","last_undegraded":"2026-02-22T23:24:00.965025+0000","last_fullsized":"2026-02-22T23:24:00.965025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_clean_scrub_stamp":"2026-02-22T23:23:57.931636+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:18:15.715586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000241392,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'112","reported_seq":156,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T23:24:01.168770+0000","last_change":"2026-02-22T23:23:53.549952+0000","last_active":"2026-02-22T23:24:01.168770+0000","last_peered":"2026-02-22T23:24:01.168770+0000","last_clean":"2026-02-22T23:24:01.168770+0000","last_became_active":"2026-02-22T23:23:53.549316+0000","last_became_peered":"2026-02-22T23:23:53.549316+0000","last_unstale":"2026-02-22T23:24:01.168770+0000","last_undegraded":"2026-02-22T23:24:01.168770+0000","last_fullsized":"2026-02-22T23:24:01.168770+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:51.885433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:51.885433+0000","last_clean_scrub_stamp":"2026-02-22T23:23:51.885433+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:22:13.854378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27136,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344704,"statfs":{"total":96636764160,"available":96608976896,"internally_reserved":0,"allocated":176128,"data_stored":58434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":180224,"data_stored":58453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27136,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344704,"statfs":{"total":96636764160,"available":96608976896,"internally_reserved":0,"allocated":176128,"data_stored":58434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27136,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344704,"statfs":{"total":96636764160,"available":96608976896,"internally_reserved":0,"allocated":176128,"data_stored":58434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27136,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344704,"statfs":{"total":96636764160,"available":96608976896,"internally_reserved":0,"allocated":176128,"data_stored":58434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":708608,"data_stored":587362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":696320,"data_stored":582654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27589067},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27136,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344704,"statfs":{"total":96636764160,"available":96608976896,"internally_reserved":0,"allocated":167936,"data_stored":53734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T23:24:04.663 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-22T23:24:04.663 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-22T23:24:04.664 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-22T23:24:04.664 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-22T23:24:04.731 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.728+0000 7f5e3f66f640 1 Processor -- start 2026-02-22T23:24:04.731 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.728+0000 7f5e3f66f640 1 -- start start 2026-02-22T23:24:04.732 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.728+0000 7f5e3f66f640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e38071530 con 0x7f5e380704d0 2026-02-22T23:24:04.732 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.728+0000 7f5e3f66f640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e38070210 con 0x7f5e380af060 2026-02-22T23:24:04.732 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.728+0000 7f5e3f66f640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e380b18f0 con 0x7f5e38140d80 2026-02-22T23:24:04.732 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.729+0000 7f5e3cbe3640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7f5e38140d80 0x7f5e38143670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:34426/0 (socket says 10.20.193.93:34426) 2026-02-22T23:24:04.732 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.729+0000 7f5e3cbe3640 1 -- 10.20.193.93:0/4270834440 learned_addr learned my addr 10.20.193.93:0/4270834440 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:04.732 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.729+0000 7f5e3dbe5640 1 --1- 10.20.193.93:0/4270834440 >> v1:10.20.193.93:6789/0 conn(0x7f5e380704d0 0x7f5e38143d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:47196/0 (socket says 10.20.193.93:47196) 2026-02-22T23:24:04.732 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.729+0000 7f5e27fff640 1 -- 10.20.193.93:0/4270834440 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 159110730 0 0) 0x7f5e380b18f0 con 0x7f5e38140d80 2026-02-22T23:24:04.732 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.729+0000 7f5e27fff640 1 -- 10.20.193.93:0/4270834440 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e20003620 con 0x7f5e38140d80 2026-02-22T23:24:04.732 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.729+0000 7f5e27fff640 1 -- 10.20.193.93:0/4270834440 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2062628330 0 0) 0x7f5e38071530 con 0x7f5e380704d0 2026-02-22T23:24:04.732 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.729+0000 7f5e27fff640 1 -- 10.20.193.93:0/4270834440 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e380b18f0 con 0x7f5e380704d0 2026-02-22T23:24:04.732 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.729+0000 7f5e27fff640 1 -- 10.20.193.93:0/4270834440 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3815664381 0 0) 0x7f5e20003620 con 0x7f5e38140d80 2026-02-22T23:24:04.732 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.729+0000 7f5e27fff640 1 -- 10.20.193.93:0/4270834440 >> v1:10.20.193.155:6789/0 conn(0x7f5e380af060 legacy=0x7f5e38140670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.732 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.729+0000 7f5e27fff640 1 -- 10.20.193.93:0/4270834440 >> v1:10.20.193.93:6789/0 conn(0x7f5e380704d0 legacy=0x7f5e38143d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.732 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.729+0000 7f5e27fff640 1 -- 10.20.193.93:0/4270834440 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e380b14e0 con 0x7f5e38140d80 2026-02-22T23:24:04.732 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.729+0000 7f5e27fff640 1 -- 10.20.193.93:0/4270834440 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f5e2c002ea0 con 0x7f5e38140d80 2026-02-22T23:24:04.732 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.729+0000 7f5e27fff640 1 -- 10.20.193.93:0/4270834440 <== mon.2 v1:10.20.193.93:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5e2c003040 con 0x7f5e38140d80 2026-02-22T23:24:04.732 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.729+0000 7f5e27fff640 1 -- 10.20.193.93:0/4270834440 <== mon.2 v1:10.20.193.93:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f5e2c003490 con 0x7f5e38140d80 2026-02-22T23:24:04.733 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.729+0000 7f5e3f66f640 1 -- 10.20.193.93:0/4270834440 >> v1:10.20.193.93:6790/0 conn(0x7f5e38140d80 legacy=0x7f5e38143670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.733 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.729+0000 7f5e3f66f640 1 -- 10.20.193.93:0/4270834440 shutdown_connections 2026-02-22T23:24:04.733 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.729+0000 7f5e3f66f640 1 -- 10.20.193.93:0/4270834440 >> 10.20.193.93:0/4270834440 conn(0x7f5e380b1d30 msgr2=0x7f5e380b2140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:04.733 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.729+0000 7f5e3f66f640 1 -- 10.20.193.93:0/4270834440 shutdown_connections 2026-02-22T23:24:04.733 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.729+0000 7f5e3f66f640 1 -- 10.20.193.93:0/4270834440 wait complete. 2026-02-22T23:24:04.733 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.730+0000 7f5e3f66f640 1 Processor -- start 2026-02-22T23:24:04.733 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.730+0000 7f5e3f66f640 1 -- start start 2026-02-22T23:24:04.734 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.730+0000 7f5e3f66f640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e38073200 con 0x7f5e380704d0 2026-02-22T23:24:04.734 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.730+0000 7f5e3f66f640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e381447f0 con 0x7f5e380af060 2026-02-22T23:24:04.734 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.730+0000 7f5e3f66f640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e381359a0 con 0x7f5e38140d80 2026-02-22T23:24:04.734 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.730+0000 7f5e3d3e4640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7f5e380704d0 0x7f5e38135290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:47212/0 (socket says 10.20.193.93:47212) 2026-02-22T23:24:04.734 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.730+0000 7f5e3d3e4640 1 -- 10.20.193.93:0/2122055615 learned_addr learned my addr 10.20.193.93:0/2122055615 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:04.734 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.730+0000 7f5e25ffb640 1 -- 10.20.193.93:0/2122055615 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1191602495 0 0) 0x7f5e381359a0 con 0x7f5e38140d80 2026-02-22T23:24:04.734 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.730+0000 7f5e25ffb640 1 -- 10.20.193.93:0/2122055615 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e08003620 con 0x7f5e38140d80 2026-02-22T23:24:04.734 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.730+0000 7f5e25ffb640 1 -- 10.20.193.93:0/2122055615 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3602083714 0 0) 0x7f5e38073200 con 0x7f5e380704d0 2026-02-22T23:24:04.734 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.730+0000 7f5e25ffb640 1 -- 10.20.193.93:0/2122055615 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e381359a0 con 0x7f5e380704d0 2026-02-22T23:24:04.734 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.731+0000 7f5e25ffb640 1 -- 10.20.193.93:0/2122055615 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3311251193 0 0) 0x7f5e08003620 con 0x7f5e38140d80 2026-02-22T23:24:04.734 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.731+0000 7f5e25ffb640 1 -- 10.20.193.93:0/2122055615 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5e38073200 con 0x7f5e38140d80 2026-02-22T23:24:04.734 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.731+0000 7f5e25ffb640 1 -- 10.20.193.93:0/2122055615 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f5e340034c0 con 0x7f5e38140d80 2026-02-22T23:24:04.734 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.731+0000 7f5e25ffb640 1 -- 10.20.193.93:0/2122055615 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1929172991 0 0) 0x7f5e381359a0 con 0x7f5e380704d0 2026-02-22T23:24:04.735 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.731+0000 7f5e25ffb640 1 -- 10.20.193.93:0/2122055615 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5e08003620 con 0x7f5e380704d0 2026-02-22T23:24:04.735 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.731+0000 7f5e25ffb640 1 -- 10.20.193.93:0/2122055615 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f5e28003180 con 0x7f5e380704d0 2026-02-22T23:24:04.735 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.731+0000 7f5e25ffb640 1 -- 10.20.193.93:0/2122055615 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4231307841 0 0) 0x7f5e381447f0 con 0x7f5e380af060 2026-02-22T23:24:04.735 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.731+0000 7f5e25ffb640 1 -- 10.20.193.93:0/2122055615 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e381359a0 con 0x7f5e380af060 2026-02-22T23:24:04.735 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.731+0000 7f5e25ffb640 1 -- 10.20.193.93:0/2122055615 <== mon.2 v1:10.20.193.93:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 360772947 0 0) 0x7f5e38073200 con 0x7f5e38140d80 2026-02-22T23:24:04.735 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.731+0000 7f5e25ffb640 1 -- 10.20.193.93:0/2122055615 >> v1:10.20.193.155:6789/0 conn(0x7f5e380af060 legacy=0x7f5e38146940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.735 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.731+0000 7f5e25ffb640 1 -- 10.20.193.93:0/2122055615 >> v1:10.20.193.93:6789/0 conn(0x7f5e380704d0 legacy=0x7f5e38135290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.735 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.731+0000 7f5e25ffb640 1 -- 10.20.193.93:0/2122055615 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e38135b70 con 0x7f5e38140d80 2026-02-22T23:24:04.735 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.731+0000 7f5e3f66f640 1 -- 10.20.193.93:0/2122055615 --> v1:10.20.193.93:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5e380b4a70 con 0x7f5e38140d80 2026-02-22T23:24:04.735 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.731+0000 7f5e3f66f640 1 -- 10.20.193.93:0/2122055615 --> v1:10.20.193.93:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f5e38145220 con 0x7f5e38140d80 2026-02-22T23:24:04.735 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.731+0000 7f5e25ffb640 1 -- 10.20.193.93:0/2122055615 <== mon.2 v1:10.20.193.93:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5e34004c60 con 0x7f5e38140d80 2026-02-22T23:24:04.735 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.731+0000 7f5e25ffb640 1 -- 10.20.193.93:0/2122055615 <== mon.2 v1:10.20.193.93:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f5e34004fb0 con 0x7f5e38140d80 2026-02-22T23:24:04.735 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.731+0000 7f5e3f66f640 1 -- 10.20.193.93:0/2122055615 --> v1:10.20.193.93:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e380733d0 con 0x7f5e38140d80 2026-02-22T23:24:04.735 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.732+0000 7f5e25ffb640 1 -- 10.20.193.93:0/2122055615 <== mon.2 v1:10.20.193.93:6790/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7f5e3401d780 con 0x7f5e38140d80 2026-02-22T23:24:04.735 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.732+0000 7f5e25ffb640 1 -- 10.20.193.93:0/2122055615 <== mon.2 v1:10.20.193.93:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 4142+0+0 (unknown 2994938210 0 0) 0x7f5e34094530 con 0x7f5e38140d80 2026-02-22T23:24:04.737 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.734+0000 7f5e25ffb640 1 -- 10.20.193.93:0/2122055615 <== mon.2 v1:10.20.193.93:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f5e3405dd30 con 0x7f5e38140d80 2026-02-22T23:24:04.836 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.833+0000 7f5e3f66f640 1 -- 10.20.193.93:0/2122055615 --> v1:10.20.193.93:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5e38076960 con 0x7f5e38140d80 2026-02-22T23:24:04.837 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.833+0000 7f5e25ffb640 1 -- 10.20.193.93:0/2122055615 <== mon.2 v1:10.20.193.93:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (unknown 3730786198 0 4185958460) 0x7f5e3405d630 con 0x7f5e38140d80 2026-02-22T23:24:04.837 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:24:04.837 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-22T23:24:04.838 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.834+0000 7f5e3f66f640 1 -- 10.20.193.93:0/2122055615 >> v1:10.20.193.155:6800/3108481844 conn(0x7f5e080780f0 legacy=0x7f5e0807a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.838 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.834+0000 7f5e3f66f640 1 -- 10.20.193.93:0/2122055615 >> v1:10.20.193.93:6790/0 conn(0x7f5e38140d80 legacy=0x7f5e38147050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.838 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.834+0000 7f5e3f66f640 1 -- 10.20.193.93:0/2122055615 shutdown_connections 2026-02-22T23:24:04.839 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.834+0000 7f5e3f66f640 1 -- 10.20.193.93:0/2122055615 >> 10.20.193.93:0/2122055615 conn(0x7f5e380b1d30 msgr2=0x7f5e3813ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:04.839 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.834+0000 7f5e3f66f640 1 -- 10.20.193.93:0/2122055615 shutdown_connections 2026-02-22T23:24:04.839 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.834+0000 7f5e3f66f640 1 -- 10.20.193.93:0/2122055615 wait complete. 2026-02-22T23:24:04.845 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-22T23:24:04.845 INFO:teuthology.run_tasks:Running task exec... 2026-02-22T23:24:04.856 INFO:teuthology.task.exec:Executing custom commands... 2026-02-22T23:24:04.857 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@trial093.front.sepia.ceph.com 2026-02-22T23:24:04.857 DEBUG:teuthology.orchestra.run.trial093:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd pool create cephsqlite' 2026-02-22T23:24:04.921 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.918+0000 7f24d903c640 1 Processor -- start 2026-02-22T23:24:04.922 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.918+0000 7f24d903c640 1 -- start start 2026-02-22T23:24:04.923 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.919+0000 7f24d903c640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24d40ac5c0 con 0x7f24d40af380 2026-02-22T23:24:04.923 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.919+0000 7f24d903c640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24d4140f60 con 0x7f24d40743b0 2026-02-22T23:24:04.923 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.919+0000 7f24d903c640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24d4141130 con 0x7f24d40b0910 2026-02-22T23:24:04.923 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.919+0000 7f24d2575640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7f24d40af380 0x7f24d4140850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:47224/0 (socket says 10.20.193.93:47224) 2026-02-22T23:24:04.923 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.919+0000 7f24d2575640 1 -- 10.20.193.93:0/2831441282 learned_addr learned my addr 10.20.193.93:0/2831441282 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:04.923 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.919+0000 7f24d3577640 1 --1- 10.20.193.93:0/2831441282 >> v1:10.20.193.93:6790/0 conn(0x7f24d40b0910 0x7f24d414ef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:34460/0 (socket says 10.20.193.93:34460) 2026-02-22T23:24:04.923 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.919+0000 7f24d1d74640 1 -- 10.20.193.93:0/2831441282 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3150123068 0 0) 0x7f24d40ac5c0 con 0x7f24d40af380 2026-02-22T23:24:04.923 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.919+0000 7f24d1d74640 1 -- 10.20.193.93:0/2831441282 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24c0003620 con 0x7f24d40af380 2026-02-22T23:24:04.923 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.919+0000 7f24d1d74640 1 -- 10.20.193.93:0/2831441282 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 270983344 0 0) 0x7f24d4141130 con 0x7f24d40b0910 2026-02-22T23:24:04.923 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.919+0000 7f24d1d74640 1 -- 10.20.193.93:0/2831441282 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24d40ac5c0 con 0x7f24d40b0910 2026-02-22T23:24:04.923 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.919+0000 7f24d1d74640 1 -- 10.20.193.93:0/2831441282 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2629756097 0 0) 0x7f24c0003620 con 0x7f24d40af380 2026-02-22T23:24:04.923 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.919+0000 7f24d1d74640 1 -- 10.20.193.93:0/2831441282 >> v1:10.20.193.93:6790/0 conn(0x7f24d40b0910 legacy=0x7f24d414ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.923 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.919+0000 7f24d1d74640 1 -- 10.20.193.93:0/2831441282 >> v1:10.20.193.155:6789/0 conn(0x7f24d40743b0 legacy=0x7f24d4146bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.923 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.919+0000 7f24d1d74640 1 -- 10.20.193.93:0/2831441282 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d40b0290 con 0x7f24d40af380 2026-02-22T23:24:04.923 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.919+0000 7f24d1d74640 1 -- 10.20.193.93:0/2831441282 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f24bc002dd0 con 0x7f24d40af380 2026-02-22T23:24:04.923 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.919+0000 7f24d1d74640 1 -- 10.20.193.93:0/2831441282 <== mon.0 v1:10.20.193.93:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f24bc002ff0 con 0x7f24d40af380 2026-02-22T23:24:04.923 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.919+0000 7f24d1d74640 1 -- 10.20.193.93:0/2831441282 <== mon.0 v1:10.20.193.93:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f24bc003440 con 0x7f24d40af380 2026-02-22T23:24:04.923 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.920+0000 7f24d903c640 1 -- 10.20.193.93:0/2831441282 >> v1:10.20.193.93:6789/0 conn(0x7f24d40af380 legacy=0x7f24d4140850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.923 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.920+0000 7f24d903c640 1 -- 10.20.193.93:0/2831441282 shutdown_connections 2026-02-22T23:24:04.923 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.920+0000 7f24d903c640 1 -- 10.20.193.93:0/2831441282 >> 10.20.193.93:0/2831441282 conn(0x7f24d406d1b0 msgr2=0x7f24d40b4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:04.923 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.920+0000 7f24d903c640 1 -- 10.20.193.93:0/2831441282 shutdown_connections 2026-02-22T23:24:04.923 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.920+0000 7f24d903c640 1 -- 10.20.193.93:0/2831441282 wait complete. 2026-02-22T23:24:04.925 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.920+0000 7f24d903c640 1 Processor -- start 2026-02-22T23:24:04.925 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.920+0000 7f24d903c640 1 -- start start 2026-02-22T23:24:04.925 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.921+0000 7f24d903c640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24d4146000 con 0x7f24d40743b0 2026-02-22T23:24:04.925 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.921+0000 7f24d903c640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24d41461d0 con 0x7f24d40af380 2026-02-22T23:24:04.925 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.921+0000 7f24d2d76640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7f24d40743b0 0x7f24d4133f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:47240/0 (socket says 10.20.193.93:47240) 2026-02-22T23:24:04.925 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.921+0000 7f24d2d76640 1 -- 10.20.193.93:0/812260803 learned_addr learned my addr 10.20.193.93:0/812260803 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:04.925 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.921+0000 7f24d903c640 1 -- 10.20.193.93:0/812260803 --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24d4141ab0 con 0x7f24d40b0910 2026-02-22T23:24:04.925 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.921+0000 7f24b37fe640 1 -- 10.20.193.93:0/812260803 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1825549282 0 0) 0x7f24d4141ab0 con 0x7f24d40b0910 2026-02-22T23:24:04.925 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.921+0000 7f24b37fe640 1 -- 10.20.193.93:0/812260803 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24a0003620 con 0x7f24d40b0910 2026-02-22T23:24:04.925 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.921+0000 7f24b37fe640 1 -- 10.20.193.93:0/812260803 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2720447722 0 0) 0x7f24d4146000 con 0x7f24d40743b0 2026-02-22T23:24:04.925 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.921+0000 7f24b37fe640 1 -- 10.20.193.93:0/812260803 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24d4141ab0 con 0x7f24d40743b0 2026-02-22T23:24:04.925 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.921+0000 7f24b37fe640 1 -- 10.20.193.93:0/812260803 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2255188900 0 0) 0x7f24a0003620 con 0x7f24d40b0910 2026-02-22T23:24:04.925 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.921+0000 7f24b37fe640 1 -- 10.20.193.93:0/812260803 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f24d4146000 con 0x7f24d40b0910 2026-02-22T23:24:04.925 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.921+0000 7f24b37fe640 1 -- 10.20.193.93:0/812260803 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f24c4003300 con 0x7f24d40b0910 2026-02-22T23:24:04.925 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.921+0000 7f24b37fe640 1 -- 10.20.193.93:0/812260803 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2986765 0 0) 0x7f24d41461d0 con 0x7f24d40af380 2026-02-22T23:24:04.925 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.921+0000 7f24b37fe640 1 -- 10.20.193.93:0/812260803 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24a0003620 con 0x7f24d40af380 2026-02-22T23:24:04.925 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.921+0000 7f24b37fe640 1 -- 10.20.193.93:0/812260803 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2066636593 0 0) 0x7f24d4141ab0 con 0x7f24d40743b0 2026-02-22T23:24:04.925 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.921+0000 7f24b37fe640 1 -- 10.20.193.93:0/812260803 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f24d41461d0 con 0x7f24d40743b0 2026-02-22T23:24:04.925 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.921+0000 7f24b37fe640 1 -- 10.20.193.93:0/812260803 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f24c8003200 con 0x7f24d40743b0 2026-02-22T23:24:04.926 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.921+0000 7f24b37fe640 1 -- 10.20.193.93:0/812260803 <== mon.2 v1:10.20.193.93:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 661298220 0 0) 0x7f24d4146000 con 0x7f24d40b0910 2026-02-22T23:24:04.926 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.921+0000 7f24b37fe640 1 -- 10.20.193.93:0/812260803 >> v1:10.20.193.155:6789/0 conn(0x7f24d40af380 legacy=0x7f24d4143a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.926 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.921+0000 7f24b37fe640 1 -- 10.20.193.93:0/812260803 >> v1:10.20.193.93:6789/0 conn(0x7f24d40743b0 legacy=0x7f24d4133f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:04.926 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.921+0000 7f24b37fe640 1 -- 10.20.193.93:0/812260803 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d4141c80 con 0x7f24d40b0910 2026-02-22T23:24:04.926 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.921+0000 7f24d903c640 1 -- 10.20.193.93:0/812260803 --> v1:10.20.193.93:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f24d4134690 con 0x7f24d40b0910 2026-02-22T23:24:04.926 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.921+0000 7f24d903c640 1 -- 10.20.193.93:0/812260803 --> v1:10.20.193.93:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f24d4134a70 con 0x7f24d40b0910 2026-02-22T23:24:04.926 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.921+0000 7f24b37fe640 1 -- 10.20.193.93:0/812260803 <== mon.2 v1:10.20.193.93:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f24c40038b0 con 0x7f24d40b0910 2026-02-22T23:24:04.926 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.921+0000 7f24b37fe640 1 -- 10.20.193.93:0/812260803 <== mon.2 v1:10.20.193.93:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f24c4004e00 con 0x7f24d40b0910 2026-02-22T23:24:04.926 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.921+0000 7f24d903c640 1 -- 10.20.193.93:0/812260803 --> v1:10.20.193.93:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24d4141e50 con 0x7f24d40b0910 2026-02-22T23:24:04.926 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.922+0000 7f24b37fe640 1 -- 10.20.193.93:0/812260803 <== mon.2 v1:10.20.193.93:6790/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7f24c401d5d0 con 0x7f24d40b0910 2026-02-22T23:24:04.926 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.922+0000 7f24b37fe640 1 -- 10.20.193.93:0/812260803 <== mon.2 v1:10.20.193.93:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 4142+0+0 (unknown 2994938210 0 0) 0x7f24c4094450 con 0x7f24d40b0910 2026-02-22T23:24:04.928 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:04.925+0000 7f24b37fe640 1 -- 10.20.193.93:0/812260803 <== mon.2 v1:10.20.193.93:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f24c405dc50 con 0x7f24d40b0910 2026-02-22T23:24:05.011 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.008+0000 7f24d903c640 1 -- 10.20.193.93:0/812260803 --> v1:10.20.193.93:6790/0 -- mon_command({"prefix": "osd pool create", "pool": "cephsqlite"} v 0) -- 0x7f24d40ac060 con 0x7f24d40b0910 2026-02-22T23:24:05.156 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.153+0000 7f24b37fe640 1 -- 10.20.193.93:0/812260803 <== mon.2 v1:10.20.193.93:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephsqlite"}]=0 pool 'cephsqlite' created v21) ==== 110+0+0 (unknown 3433093893 0 0) 0x7f24c405d550 con 0x7f24d40b0910 2026-02-22T23:24:05.157 INFO:teuthology.orchestra.run.trial093.stderr:pool 'cephsqlite' created 2026-02-22T23:24:05.158 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.155+0000 7f24d903c640 1 -- 10.20.193.93:0/812260803 >> v1:10.20.193.155:6800/3108481844 conn(0x7f24a00781c0 legacy=0x7f24a007a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:05.158 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.155+0000 7f24d903c640 1 -- 10.20.193.93:0/812260803 >> v1:10.20.193.93:6790/0 conn(0x7f24d40b0910 legacy=0x7f24d41e5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:05.158 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.155+0000 7f24d903c640 1 -- 10.20.193.93:0/812260803 shutdown_connections 2026-02-22T23:24:05.158 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.155+0000 7f24d903c640 1 -- 10.20.193.93:0/812260803 >> 10.20.193.93:0/812260803 conn(0x7f24d406d1b0 msgr2=0x7f24d40b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:05.159 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.155+0000 7f24d903c640 1 -- 10.20.193.93:0/812260803 shutdown_connections 2026-02-22T23:24:05.159 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.155+0000 7f24d903c640 1 -- 10.20.193.93:0/812260803 wait complete. 2026-02-22T23:24:05.167 DEBUG:teuthology.orchestra.run.trial093:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph auth get-or-create client.libcephsqlite mon '"'"'profile simple-rados-client-with-blocklist'"'"' osd '"'"'allow rwx pool=cephsqlite'"'"' >> /etc/ceph/ceph.keyring' 2026-02-22T23:24:05.239 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.231+0000 7f302ffa0640 1 Processor -- start 2026-02-22T23:24:05.240 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.231+0000 7f302ffa0640 1 -- start start 2026-02-22T23:24:05.240 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.232+0000 7f302ffa0640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3028070080 con 0x7f30280b16d0 2026-02-22T23:24:05.240 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.232+0000 7f302ffa0640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30280b11b0 con 0x7f30280aeff0 2026-02-22T23:24:05.240 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.232+0000 7f302ffa0640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3028074890 con 0x7f3028140f40 2026-02-22T23:24:05.240 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.232+0000 7f302d514640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7f30280b16d0 0x7f3028140830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:47242/0 (socket says 10.20.193.93:47242) 2026-02-22T23:24:05.240 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.232+0000 7f302d514640 1 -- 10.20.193.93:0/3424331479 learned_addr learned my addr 10.20.193.93:0/3424331479 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:05.240 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.232+0000 7f302cd13640 1 -- 10.20.193.93:0/3424331479 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3465265748 0 0) 0x7f3028070080 con 0x7f30280b16d0 2026-02-22T23:24:05.240 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.232+0000 7f302cd13640 1 -- 10.20.193.93:0/3424331479 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3010003620 con 0x7f30280b16d0 2026-02-22T23:24:05.240 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.232+0000 7f302cd13640 1 -- 10.20.193.93:0/3424331479 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1933453715 0 0) 0x7f3028074890 con 0x7f3028140f40 2026-02-22T23:24:05.241 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.232+0000 7f302cd13640 1 -- 10.20.193.93:0/3424331479 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3028070080 con 0x7f3028140f40 2026-02-22T23:24:05.241 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.232+0000 7f302cd13640 1 -- 10.20.193.93:0/3424331479 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 682514336 0 0) 0x7f3010003620 con 0x7f30280b16d0 2026-02-22T23:24:05.241 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.232+0000 7f302cd13640 1 -- 10.20.193.93:0/3424331479 >> v1:10.20.193.93:6790/0 conn(0x7f3028140f40 legacy=0x7f302814edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:05.241 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.232+0000 7f302cd13640 1 -- 10.20.193.93:0/3424331479 >> v1:10.20.193.155:6789/0 conn(0x7f30280aeff0 legacy=0x7f3028146a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:05.241 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.232+0000 7f302cd13640 1 -- 10.20.193.93:0/3424331479 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3028147180 con 0x7f30280b16d0 2026-02-22T23:24:05.241 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.232+0000 7f302cd13640 1 -- 10.20.193.93:0/3424331479 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f301c002ea0 con 0x7f30280b16d0 2026-02-22T23:24:05.241 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.232+0000 7f302cd13640 1 -- 10.20.193.93:0/3424331479 <== mon.0 v1:10.20.193.93:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f301c0030c0 con 0x7f30280b16d0 2026-02-22T23:24:05.241 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.232+0000 7f302cd13640 1 -- 10.20.193.93:0/3424331479 <== mon.0 v1:10.20.193.93:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f301c003550 con 0x7f30280b16d0 2026-02-22T23:24:05.241 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.233+0000 7f302ffa0640 1 -- 10.20.193.93:0/3424331479 >> v1:10.20.193.93:6789/0 conn(0x7f30280b16d0 legacy=0x7f3028140830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:05.241 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.233+0000 7f302ffa0640 1 -- 10.20.193.93:0/3424331479 shutdown_connections 2026-02-22T23:24:05.241 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.233+0000 7f302ffa0640 1 -- 10.20.193.93:0/3424331479 >> 10.20.193.93:0/3424331479 conn(0x7f30280b50f0 msgr2=0x7f30280b54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:05.241 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.233+0000 7f302ffa0640 1 -- 10.20.193.93:0/3424331479 shutdown_connections 2026-02-22T23:24:05.242 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.233+0000 7f302ffa0640 1 -- 10.20.193.93:0/3424331479 wait complete. 2026-02-22T23:24:05.242 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.233+0000 7f302ffa0640 1 Processor -- start 2026-02-22T23:24:05.242 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.233+0000 7f302ffa0640 1 -- start start 2026-02-22T23:24:05.242 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.233+0000 7f302ffa0640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30281423e0 con 0x7f3028140f40 2026-02-22T23:24:05.242 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.233+0000 7f302ffa0640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30281441a0 con 0x7f30280b16d0 2026-02-22T23:24:05.242 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.234+0000 7f302ffa0640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3028141ec0 con 0x7f30280aeff0 2026-02-22T23:24:05.242 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.234+0000 7f302dd15640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7f30280aeff0 0x7f3028135210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:34472/0 (socket says 10.20.193.93:34472) 2026-02-22T23:24:05.242 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.234+0000 7f302dd15640 1 -- 10.20.193.93:0/2010767198 learned_addr learned my addr 10.20.193.93:0/2010767198 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:24:05.242 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.234+0000 7f30167fc640 1 -- 10.20.193.93:0/2010767198 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 814166241 0 0) 0x7f3028141ec0 con 0x7f30280aeff0 2026-02-22T23:24:05.242 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.234+0000 7f30167fc640 1 -- 10.20.193.93:0/2010767198 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ff8003620 con 0x7f30280aeff0 2026-02-22T23:24:05.242 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.234+0000 7f30167fc640 1 -- 10.20.193.93:0/2010767198 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4161876669 0 0) 0x7f30281423e0 con 0x7f3028140f40 2026-02-22T23:24:05.242 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.234+0000 7f30167fc640 1 -- 10.20.193.93:0/2010767198 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3028141ec0 con 0x7f3028140f40 2026-02-22T23:24:05.243 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.234+0000 7f30167fc640 1 -- 10.20.193.93:0/2010767198 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 65898133 0 0) 0x7f2ff8003620 con 0x7f30280aeff0 2026-02-22T23:24:05.243 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.234+0000 7f30167fc640 1 -- 10.20.193.93:0/2010767198 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f30281423e0 con 0x7f30280aeff0 2026-02-22T23:24:05.243 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.234+0000 7f30167fc640 1 -- 10.20.193.93:0/2010767198 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f30180031e0 con 0x7f30280aeff0 2026-02-22T23:24:05.243 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.234+0000 7f30167fc640 1 -- 10.20.193.93:0/2010767198 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1625094792 0 0) 0x7f3028141ec0 con 0x7f3028140f40 2026-02-22T23:24:05.243 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.234+0000 7f30167fc640 1 -- 10.20.193.93:0/2010767198 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2ff8003620 con 0x7f3028140f40 2026-02-22T23:24:05.243 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.234+0000 7f30167fc640 1 -- 10.20.193.93:0/2010767198 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f3024003360 con 0x7f3028140f40 2026-02-22T23:24:05.243 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.234+0000 7f30167fc640 1 -- 10.20.193.93:0/2010767198 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 515826949 0 0) 0x7f30281441a0 con 0x7f30280b16d0 2026-02-22T23:24:05.243 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.234+0000 7f30167fc640 1 -- 10.20.193.93:0/2010767198 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3028141ec0 con 0x7f30280b16d0 2026-02-22T23:24:05.243 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.234+0000 7f30167fc640 1 -- 10.20.193.93:0/2010767198 <== mon.2 v1:10.20.193.93:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 574114557 0 0) 0x7f30281423e0 con 0x7f30280aeff0 2026-02-22T23:24:05.243 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.234+0000 7f30167fc640 1 -- 10.20.193.93:0/2010767198 >> v1:10.20.193.155:6789/0 conn(0x7f30280b16d0 legacy=0x7f3028144b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:05.243 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.234+0000 7f30167fc640 1 -- 10.20.193.93:0/2010767198 >> v1:10.20.193.93:6789/0 conn(0x7f3028140f40 legacy=0x7f3028142870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:05.243 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.234+0000 7f30167fc640 1 -- 10.20.193.93:0/2010767198 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3028135920 con 0x7f30280aeff0 2026-02-22T23:24:05.244 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.234+0000 7f302ffa0640 1 -- 10.20.193.93:0/2010767198 --> v1:10.20.193.93:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3028135c30 con 0x7f30280aeff0 2026-02-22T23:24:05.244 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.234+0000 7f30167fc640 1 -- 10.20.193.93:0/2010767198 <== mon.2 v1:10.20.193.93:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3018003460 con 0x7f30280aeff0 2026-02-22T23:24:05.244 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.234+0000 7f30167fc640 1 -- 10.20.193.93:0/2010767198 <== mon.2 v1:10.20.193.93:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f3018003b60 con 0x7f30280aeff0 2026-02-22T23:24:05.244 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.234+0000 7f302ffa0640 1 -- 10.20.193.93:0/2010767198 --> v1:10.20.193.93:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f3028145410 con 0x7f30280aeff0 2026-02-22T23:24:05.244 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.234+0000 7f302ffa0640 1 -- 10.20.193.93:0/2010767198 --> v1:10.20.193.93:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30280008d0 con 0x7f30280aeff0 2026-02-22T23:24:05.244 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.235+0000 7f30167fc640 1 -- 10.20.193.93:0/2010767198 <== mon.2 v1:10.20.193.93:6790/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7f3018003d00 con 0x7f30280aeff0 2026-02-22T23:24:05.244 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.235+0000 7f30167fc640 1 -- 10.20.193.93:0/2010767198 <== mon.2 v1:10.20.193.93:6790/0 8 ==== osd_map(21..21 src has 1..21) ==== 4463+0+0 (unknown 4058485735 0 0) 0x7f30180944b0 con 0x7f30280aeff0 2026-02-22T23:24:05.245 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.238+0000 7f30167fc640 1 -- 10.20.193.93:0/2010767198 <== mon.2 v1:10.20.193.93:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f301805db70 con 0x7f30280aeff0 2026-02-22T23:24:05.354 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.351+0000 7f302ffa0640 1 -- 10.20.193.93:0/2010767198 --> v1:10.20.193.93:6790/0 -- mon_command({"prefix": "auth get-or-create", "entity": "client.libcephsqlite", "caps": ["mon", "profile simple-rados-client-with-blocklist", "osd", "allow rwx pool=cephsqlite"]} v 0) -- 0x7f3028142090 con 0x7f30280aeff0 2026-02-22T23:24:05.356 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.353+0000 7f30167fc640 1 -- 10.20.193.93:0/2010767198 <== mon.2 v1:10.20.193.93:6790/0 10 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.libcephsqlite", "caps": ["mon", "profile simple-rados-client-with-blocklist", "osd", "allow rwx pool=cephsqlite"]}]=0 v10) ==== 199+0+71 (unknown 192141596 0 628812025) 0x7f301805d470 con 0x7f30280aeff0 2026-02-22T23:24:05.359 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.355+0000 7f302ffa0640 1 -- 10.20.193.93:0/2010767198 >> v1:10.20.193.155:6800/3108481844 conn(0x7f2ff8078120 legacy=0x7f2ff807a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:05.359 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.355+0000 7f302ffa0640 1 -- 10.20.193.93:0/2010767198 >> v1:10.20.193.93:6790/0 conn(0x7f30280aeff0 legacy=0x7f3028135210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:24:05.359 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.355+0000 7f302ffa0640 1 -- 10.20.193.93:0/2010767198 shutdown_connections 2026-02-22T23:24:05.359 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.355+0000 7f302ffa0640 1 -- 10.20.193.93:0/2010767198 >> 10.20.193.93:0/2010767198 conn(0x7f30280b50f0 msgr2=0x7f302813ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:24:05.359 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.355+0000 7f302ffa0640 1 -- 10.20.193.93:0/2010767198 shutdown_connections 2026-02-22T23:24:05.359 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:24:05.355+0000 7f302ffa0640 1 -- 10.20.193.93:0/2010767198 wait complete. 2026-02-22T23:24:05.367 INFO:teuthology.run_tasks:Running task exec... 2026-02-22T23:24:05.381 INFO:teuthology.task.exec:Executing custom commands... 2026-02-22T23:24:05.381 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@trial093.front.sepia.ceph.com 2026-02-22T23:24:05.382 DEBUG:teuthology.orchestra.run.trial093:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph_test_libcephsqlite --id libcephsqlite --no-log-to-stderr' 2026-02-22T23:24:05.418 INFO:teuthology.orchestra.run.trial093.stdout:[==========] Running 20 tests from 1 test suite. 2026-02-22T23:24:05.419 INFO:teuthology.orchestra.run.trial093.stdout:[----------] Global test environment set-up. 2026-02-22T23:24:05.419 INFO:teuthology.orchestra.run.trial093.stdout:[----------] 20 tests from CephSQLiteTest 2026-02-22T23:24:10.424 INFO:teuthology.orchestra.run.trial093.stdout:[ RUN ] CephSQLiteTest.Create 2026-02-22T23:24:10.430 INFO:teuthology.orchestra.run.trial093.stdout:using database: file:cephsqlite:/a258bcb9-e361-4a75-911a-8e4b7afe76c4.db?vfs=ceph 2026-02-22T23:24:10.430 INFO:teuthology.orchestra.run.trial093.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2026-02-22T23:24:10.433 INFO:teuthology.orchestra.run.trial093.stdout:CREATE TABLE foo (a INT); 2026-02-22T23:24:10.440 INFO:teuthology.orchestra.run.trial093.stdout:[ OK ] CephSQLiteTest.Create (17 ms) 2026-02-22T23:24:10.440 INFO:teuthology.orchestra.run.trial093.stdout:[ RUN ] CephSQLiteTest.InsertBulk4096 2026-02-22T23:24:10.445 INFO:teuthology.orchestra.run.trial093.stdout:using database: file:cephsqlite:/112f9039-5e7d-4a01-9448-4a971e375fc6.db?vfs=ceph 2026-02-22T23:24:10.445 INFO:teuthology.orchestra.run.trial093.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2026-02-22T23:24:10.448 INFO:teuthology.orchestra.run.trial093.stdout:PRAGMA page_size = 4096;CREATE TABLE foo (a INT);WITH RECURSIVE c(x) AS ( VALUES(1) UNION ALL SELECT x+1 FROM c )INSERT INTO foo (a) SELECT RANDOM() FROM c LIMIT 1000000;PRAGMA page_size; 2026-02-22T23:24:11.314 INFO:teuthology.orchestra.run.trial093.stdout:[ OK ] CephSQLiteTest.InsertBulk4096 (873 ms) 2026-02-22T23:24:11.314 INFO:teuthology.orchestra.run.trial093.stdout:[ RUN ] CephSQLiteTest.InsertBulk 2026-02-22T23:24:11.319 INFO:teuthology.orchestra.run.trial093.stdout:using database: file:cephsqlite:/8bcc6012-39c3-4e7d-96b6-69173f3ebe63.db?vfs=ceph 2026-02-22T23:24:11.319 INFO:teuthology.orchestra.run.trial093.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2026-02-22T23:24:11.320 INFO:teuthology.orchestra.run.trial093.stdout:CREATE TABLE foo (a INT);WITH RECURSIVE c(x) AS ( VALUES(1) UNION ALL SELECT x+1 FROM c )INSERT INTO foo (a) SELECT RANDOM() FROM c LIMIT 1000000; 2026-02-22T23:24:11.509 INFO:teuthology.orchestra.run.trial093.stdout:[ OK ] CephSQLiteTest.InsertBulk (195 ms) 2026-02-22T23:24:11.509 INFO:teuthology.orchestra.run.trial093.stdout:[ RUN ] CephSQLiteTest.UpdateBulk 2026-02-22T23:24:11.514 INFO:teuthology.orchestra.run.trial093.stdout:using database: file:cephsqlite:/508d9220-d12e-4c54-a00f-0712167a2b2f.db?vfs=ceph 2026-02-22T23:24:11.514 INFO:teuthology.orchestra.run.trial093.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2026-02-22T23:24:11.516 INFO:teuthology.orchestra.run.trial093.stdout:CREATE TABLE foo (a INT);WITH RECURSIVE c(x) AS ( VALUES(1) UNION ALL SELECT x+1 FROM c )INSERT INTO foo (a) SELECT x FROM c LIMIT 1000000;SELECT SUM(a) FROM foo;UPDATE foo SET a = a+a;SELECT SUM(a) FROM foo; 2026-02-22T23:24:12.003 INFO:teuthology.orchestra.run.trial093.stdout:[ OK ] CephSQLiteTest.UpdateBulk (494 ms) 2026-02-22T23:24:12.003 INFO:teuthology.orchestra.run.trial093.stdout:[ RUN ] CephSQLiteTest.InsertRate 2026-02-22T23:24:12.008 INFO:teuthology.orchestra.run.trial093.stdout:using database: file:cephsqlite:/df54db51-b298-425f-bd83-14a96f1f77c5.db?vfs=ceph 2026-02-22T23:24:12.008 INFO:teuthology.orchestra.run.trial093.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2026-02-22T23:24:12.010 INFO:teuthology.orchestra.run.trial093.stdout:CREATE TABLE foo (a INT);INSERT INTO foo (a) VALUES (RANDOM()); 2026-02-22T23:24:12.631 INFO:teuthology.orchestra.run.trial093.stdout:transactions per second: 162.871 2026-02-22T23:24:12.631 INFO:teuthology.orchestra.run.trial093.stdout:[ OK ] CephSQLiteTest.InsertRate (628 ms) 2026-02-22T23:24:12.631 INFO:teuthology.orchestra.run.trial093.stdout:[ RUN ] CephSQLiteTest.DatabaseShrink 2026-02-22T23:24:12.636 INFO:teuthology.orchestra.run.trial093.stdout:using database: file:cephsqlite:/eb4faa5a-92b4-47c9-b7d4-5f1ac81d3fd2.db?vfs=ceph 2026-02-22T23:24:12.636 INFO:teuthology.orchestra.run.trial093.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2026-02-22T23:24:12.638 INFO:teuthology.orchestra.run.trial093.stdout:CREATE TABLE foo (a INT);WITH RECURSIVE c(x) AS ( VALUES(1) UNION ALL SELECT x+1 FROM c )INSERT INTO foo (a) SELECT x FROM c LIMIT 1000000;DELETE FROM foo WHERE RANDOM()%4 < 3;VACUUM; 2026-02-22T23:24:13.269 INFO:teuthology.orchestra.run.trial093.stdout:[ OK ] CephSQLiteTest.DatabaseShrink (638 ms) 2026-02-22T23:24:13.269 INFO:teuthology.orchestra.run.trial093.stdout:[ RUN ] CephSQLiteTest.InsertExclusiveRate 2026-02-22T23:24:13.273 INFO:teuthology.orchestra.run.trial093.stdout:using database: file:cephsqlite:/29798a3f-1070-4ba9-a624-99277f998c82.db?vfs=ceph 2026-02-22T23:24:13.274 INFO:teuthology.orchestra.run.trial093.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2026-02-22T23:24:13.275 INFO:teuthology.orchestra.run.trial093.stdout:PRAGMA locking_mode=EXCLUSIVE;CREATE TABLE foo (a INT);INSERT INTO foo (a) VALUES (RANDOM()); 2026-02-22T23:24:13.558 INFO:teuthology.orchestra.run.trial093.stdout:transactions per second: 362.328 2026-02-22T23:24:13.559 INFO:teuthology.orchestra.run.trial093.stdout:[ OK ] CephSQLiteTest.InsertExclusiveRate (290 ms) 2026-02-22T23:24:13.559 INFO:teuthology.orchestra.run.trial093.stdout:[ RUN ] CephSQLiteTest.InsertExclusiveWALRate 2026-02-22T23:24:13.564 INFO:teuthology.orchestra.run.trial093.stdout:using database: file:cephsqlite:/1a815961-6952-46ce-9e4a-1309957aeafc.db?vfs=ceph 2026-02-22T23:24:13.564 INFO:teuthology.orchestra.run.trial093.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2026-02-22T23:24:13.565 INFO:teuthology.orchestra.run.trial093.stdout:PRAGMA locking_mode=EXCLUSIVE;PRAGMA journal_mode=WAL;CREATE TABLE foo (a INT);INSERT INTO foo (a) VALUES (RANDOM()); 2026-02-22T23:24:13.690 INFO:teuthology.orchestra.run.trial093.stdout:transactions per second: 909.114 2026-02-22T23:24:13.698 INFO:teuthology.orchestra.run.trial093.stdout:[ OK ] CephSQLiteTest.InsertExclusiveWALRate (139 ms) 2026-02-22T23:24:13.698 INFO:teuthology.orchestra.run.trial093.stdout:[ RUN ] CephSQLiteTest.WALTransactionSync 2026-02-22T23:24:13.703 INFO:teuthology.orchestra.run.trial093.stdout:using database: file:cephsqlite:/a5faf69e-27bf-416f-a64c-e26445c107ba.db?vfs=ceph 2026-02-22T23:24:13.703 INFO:teuthology.orchestra.run.trial093.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2026-02-22T23:24:13.705 INFO:teuthology.orchestra.run.trial093.stdout:PRAGMA locking_mode=EXCLUSIVE;PRAGMA journal_mode=WAL;CREATE TABLE foo (a INT);INSERT INTO perf (v) VALUES (ceph_perf());BEGIN TRANSACTION;INSERT INTO foo (a) VALUES (RANDOM());END TRANSACTION;INSERT INTO perf (v) VALUES (ceph_perf());SELECT a.atom-b.atom FROM p AS a, p AS b WHERE a.i = ? AND b.i = ? AND a.fullkey = '$.libcephsqlite_vfs.opf_sync.avgcount' AND b.fullkey = '$.libcephsqlite_vfs.opf_sync.avgcount'; 2026-02-22T23:24:13.725 INFO:teuthology.orchestra.run.trial093.stdout:[ OK ] CephSQLiteTest.WALTransactionSync (28 ms) 2026-02-22T23:24:13.725 INFO:teuthology.orchestra.run.trial093.stdout:[ RUN ] CephSQLiteTest.PersistTransactionSync 2026-02-22T23:24:13.730 INFO:teuthology.orchestra.run.trial093.stdout:using database: file:cephsqlite:/44aa92f9-5dd4-4da6-b806-90f46e6d7e6b.db?vfs=ceph 2026-02-22T23:24:13.730 INFO:teuthology.orchestra.run.trial093.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2026-02-22T23:24:13.731 INFO:teuthology.orchestra.run.trial093.stdout:BEGIN TRANSACTION;CREATE TABLE foo (a INT);INSERT INTO foo (a) VALUES (RANDOM());END TRANSACTION;INSERT INTO perf (v) VALUES (ceph_perf());SELECT a.atom-b.atom FROM p AS a, p AS b WHERE a.i = ? AND b.i = ? AND a.fullkey = '$.libcephsqlite_vfs.opf_sync.avgcount' AND b.fullkey = '$.libcephsqlite_vfs.opf_sync.avgcount'; 2026-02-22T23:24:13.740 INFO:teuthology.orchestra.run.trial093.stdout:[ OK ] CephSQLiteTest.PersistTransactionSync (15 ms) 2026-02-22T23:24:13.740 INFO:teuthology.orchestra.run.trial093.stdout:[ RUN ] CephSQLiteTest.InsertExclusiveLock 2026-02-22T23:24:13.745 INFO:teuthology.orchestra.run.trial093.stdout:using database: file:cephsqlite:/282e22ee-7309-41dd-ad16-a5548b138804.db?vfs=ceph 2026-02-22T23:24:13.745 INFO:teuthology.orchestra.run.trial093.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2026-02-22T23:24:13.747 INFO:teuthology.orchestra.run.trial093.stdout:PRAGMA locking_mode=EXCLUSIVE;CREATE TABLE foo (a INT);INSERT INTO foo (a) VALUES (RANDOM());INSERT INTO perf (v) VALUES (ceph_perf());SELECT a.atom, b.atom, a.atom-b.atom FROM p AS a, p AS b WHERE a.i = ? AND b.i = ? AND a.fullkey = '$.libcephsqlite_vfs.opf_lock.avgcount' AND b.fullkey = '$.libcephsqlite_vfs.opf_lock.avgcount';SELECT a.atom, b.atom, a.atom-b.atom FROM p AS a, p AS b WHERE a.i = ? AND b.i = ? AND a.fullkey = '$.libcephsqlite_striper.lock' AND b.fullkey = '$.libcephsqlite_striper.lock'; 2026-02-22T23:24:13.757 INFO:teuthology.orchestra.run.trial093.stdout:[ OK ] CephSQLiteTest.InsertExclusiveLock (17 ms) 2026-02-22T23:24:13.758 INFO:teuthology.orchestra.run.trial093.stdout:[ RUN ] CephSQLiteTest.TransactionSizeUpdate 2026-02-22T23:24:13.761 INFO:teuthology.orchestra.run.trial093.stdout:using database: file:cephsqlite:/3e00f0de-6271-4c83-8b21-4845f0990f23.db?vfs=ceph 2026-02-22T23:24:13.762 INFO:teuthology.orchestra.run.trial093.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2026-02-22T23:24:13.763 INFO:teuthology.orchestra.run.trial093.stdout:BEGIN TRANSACTION;CREATE TABLE foo (a INT);INSERT INTO foo (a) VALUES (RANDOM());END TRANSACTION;INSERT INTO perf (v) VALUES (ceph_perf());SELECT a.atom, b.atom, a.atom-b.atom FROM p AS a, p AS b WHERE a.i = ? AND b.i = ? AND a.fullkey = '$.libcephsqlite_striper.update_size' AND b.fullkey = '$.libcephsqlite_striper.update_size'; 2026-02-22T23:24:13.772 INFO:teuthology.orchestra.run.trial093.stdout:[ OK ] CephSQLiteTest.TransactionSizeUpdate (14 ms) 2026-02-22T23:24:13.772 INFO:teuthology.orchestra.run.trial093.stdout:[ RUN ] CephSQLiteTest.AllocatedGrowth 2026-02-22T23:24:13.777 INFO:teuthology.orchestra.run.trial093.stdout:using database: file:cephsqlite:/772a9071-a8e3-4275-acad-c01266b28dc9.db?vfs=ceph 2026-02-22T23:24:13.777 INFO:teuthology.orchestra.run.trial093.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2026-02-22T23:24:13.779 INFO:teuthology.orchestra.run.trial093.stdout:CREATE TABLE foo (a BLOB);WITH RECURSIVE c(x) AS ( VALUES(1) UNION ALL SELECT x+1 FROM c )INSERT INTO foo (a) SELECT RANDOMBLOB(1<<20) FROM c LIMIT 1024;INSERT INTO perf (v) VALUES (ceph_perf());SELECT a.atom, b.atom, a.atom-b.atom FROM p AS a, p AS b WHERE a.i = ? AND b.i = ? AND a.fullkey = '$.libcephsqlite_striper.update_allocated' AND b.fullkey = '$.libcephsqlite_striper.update_allocated'; 2026-02-22T23:24:17.216 INFO:teuthology.orchestra.run.trial093.stdout:[ OK ] CephSQLiteTest.AllocatedGrowth (3444 ms) 2026-02-22T23:24:17.217 INFO:teuthology.orchestra.run.trial093.stdout:[ RUN ] CephSQLiteTest.DeleteBulk 2026-02-22T23:24:17.222 INFO:teuthology.orchestra.run.trial093.stdout:using database: file:cephsqlite:/8c5ace87-9501-43d7-b0b4-da1d284eb3d8.db?vfs=ceph 2026-02-22T23:24:17.222 INFO:teuthology.orchestra.run.trial093.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2026-02-22T23:24:17.223 INFO:teuthology.orchestra.run.trial093.stdout:CREATE TABLE foo (a INT);WITH RECURSIVE c(x) AS ( VALUES(1) UNION ALL SELECT x+1 FROM c )INSERT INTO foo (a) SELECT x FROM c LIMIT 1000000;DELETE FROM foo WHERE RANDOM()%2 == 0; 2026-02-22T23:24:17.521 INFO:teuthology.orchestra.run.trial093.stdout:[ OK ] CephSQLiteTest.DeleteBulk (305 ms) 2026-02-22T23:24:17.521 INFO:teuthology.orchestra.run.trial093.stdout:[ RUN ] CephSQLiteTest.DropMassive 2026-02-22T23:24:17.525 INFO:teuthology.orchestra.run.trial093.stdout:using database: file:cephsqlite:/f3cd5419-dc67-4071-8435-67e1c401042c.db?vfs=ceph 2026-02-22T23:24:17.526 INFO:teuthology.orchestra.run.trial093.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2026-02-22T23:24:17.528 INFO:teuthology.orchestra.run.trial093.stdout:CREATE TABLE foo (a BLOB);WITH RECURSIVE c(x) AS ( VALUES(1) UNION ALL SELECT x+1 FROM c )INSERT INTO foo (a) SELECT RANDOMBLOB(1<<20) FROM c LIMIT 1024;DROP TABLE foo;VACUUM;INSERT INTO perf (v) VALUES (ceph_perf());SELECT a.atom, b.atom FROM p AS a, p AS b WHERE a.i = ? AND b.i = ? AND a.fullkey = '$.libcephsqlite_striper.shrink' AND b.fullkey = '$.libcephsqlite_striper.shrink';SELECT a.atom-b.atom FROM p AS a, p AS b WHERE a.i = ? AND b.i = ? AND a.fullkey = '$.libcephsqlite_striper.shrink_bytes' AND b.fullkey = '$.libcephsqlite_striper.shrink_bytes'; 2026-02-22T23:24:27.622 INFO:teuthology.orchestra.run.trial093.stdout:[ OK ] CephSQLiteTest.DropMassive (10102 ms) 2026-02-22T23:24:27.622 INFO:teuthology.orchestra.run.trial093.stdout:[ RUN ] CephSQLiteTest.InsertMassiveVerify 2026-02-22T23:24:27.627 INFO:teuthology.orchestra.run.trial093.stdout:using database: file:cephsqlite:/16961eaf-ec1d-455b-a9e1-a0ef79d90b13.db?vfs=ceph 2026-02-22T23:24:27.627 INFO:teuthology.orchestra.run.trial093.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2026-02-22T23:24:27.630 INFO:teuthology.orchestra.run.trial093.stdout:CREATE TABLE foo (a BLOB);CREATE TEMPORARY TABLE bar (a BLOB);WITH RECURSIVE c(x) AS ( VALUES(1) UNION ALL SELECT x+1 FROM c )INSERT INTO bar (a) SELECT RANDOMBLOB(1<<20) FROM c LIMIT 1024;SELECT a FROM bar;INSERT INTO foo (a) SELECT a FROM bar;SELECT a FROM foo; 2026-02-22T23:24:32.477 INFO:teuthology.orchestra.run.trial093.stdout:[ OK ] CephSQLiteTest.InsertMassiveVerify (4854 ms) 2026-02-22T23:24:32.477 INFO:teuthology.orchestra.run.trial093.stdout:[ RUN ] CephSQLiteTest.PerfValid 2026-02-22T23:24:32.483 INFO:teuthology.orchestra.run.trial093.stdout:using database: file:cephsqlite:/3d2b3df4-822e-4a2e-97be-903771b4347e.db?vfs=ceph 2026-02-22T23:24:32.483 INFO:teuthology.orchestra.run.trial093.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2026-02-22T23:24:32.486 INFO:teuthology.orchestra.run.trial093.stdout:SELECT json_valid(ceph_perf()); 2026-02-22T23:24:32.486 INFO:teuthology.orchestra.run.trial093.stdout:[ OK ] CephSQLiteTest.PerfValid (10 ms) 2026-02-22T23:24:32.486 INFO:teuthology.orchestra.run.trial093.stdout:[ RUN ] CephSQLiteTest.StatusValid 2026-02-22T23:24:32.491 INFO:teuthology.orchestra.run.trial093.stdout:using database: file:cephsqlite:/f70ef576-6c6a-46bf-b3ab-e08f3ace7993.db?vfs=ceph 2026-02-22T23:24:32.491 INFO:teuthology.orchestra.run.trial093.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2026-02-22T23:24:32.494 INFO:teuthology.orchestra.run.trial093.stdout:SELECT json_valid(ceph_status()); 2026-02-22T23:24:32.495 INFO:teuthology.orchestra.run.trial093.stdout:[ OK ] CephSQLiteTest.StatusValid (8 ms) 2026-02-22T23:24:32.495 INFO:teuthology.orchestra.run.trial093.stdout:[ RUN ] CephSQLiteTest.CurrentTime 2026-02-22T23:24:32.501 INFO:teuthology.orchestra.run.trial093.stdout:using database: file:cephsqlite:/81adea76-b427-4fc8-96a6-3816cbd96c98.db?vfs=ceph 2026-02-22T23:24:32.501 INFO:teuthology.orchestra.run.trial093.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2026-02-22T23:24:32.504 INFO:teuthology.orchestra.run.trial093.stdout:SELECT strftime('%s', 'now'); 2026-02-22T23:24:32.504 INFO:teuthology.orchestra.run.trial093.stdout:[ OK ] CephSQLiteTest.CurrentTime (10 ms) 2026-02-22T23:24:32.505 INFO:teuthology.orchestra.run.trial093.stdout:[ RUN ] CephSQLiteTest.StatusFields 2026-02-22T23:24:32.510 INFO:teuthology.orchestra.run.trial093.stdout:using database: file:cephsqlite:/7f596d02-bdbb-474a-b152-2d51146ba98f.db?vfs=ceph 2026-02-22T23:24:32.510 INFO:teuthology.orchestra.run.trial093.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2026-02-22T23:24:32.513 INFO:teuthology.orchestra.run.trial093.stdout:SELECT json_extract(ceph_status(), '$.addr');SELECT json_extract(ceph_status(), '$.id'); 2026-02-22T23:24:32.513 INFO:teuthology.orchestra.run.trial093.stdout:10.20.193.93:0/2058005769 2026-02-22T23:24:32.513 INFO:teuthology.orchestra.run.trial093.stdout:4482 2026-02-22T23:24:32.513 INFO:teuthology.orchestra.run.trial093.stdout:[ OK ] CephSQLiteTest.StatusFields (9 ms) 2026-02-22T23:24:32.513 INFO:teuthology.orchestra.run.trial093.stdout:[----------] 20 tests from CephSQLiteTest (22090 ms total) 2026-02-22T23:24:32.513 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:24:32.513 INFO:teuthology.orchestra.run.trial093.stdout:[----------] Global test environment tear-down 2026-02-22T23:24:32.513 INFO:teuthology.orchestra.run.trial093.stdout:[==========] 20 tests from 1 test suite ran. (27095 ms total) 2026-02-22T23:24:32.513 INFO:teuthology.orchestra.run.trial093.stdout:[ PASSED ] 20 tests. 2026-02-22T23:24:32.565 INFO:teuthology.run_tasks:Running task workunit... 2026-02-22T23:24:32.582 INFO:tasks.workunit:Pulling workunits from ref f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-22T23:24:32.582 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-22T23:24:32.582 DEBUG:teuthology.orchestra.run.trial093:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-22T23:24:32.622 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T23:24:32.622 INFO:teuthology.orchestra.run.trial093.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-22T23:24:32.623 DEBUG:teuthology.orchestra.run.trial093:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-22T23:24:32.678 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-22T23:24:32.678 DEBUG:teuthology.orchestra.run.trial093:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-22T23:24:32.734 INFO:tasks.workunit:timeout=3h 2026-02-22T23:24:32.734 INFO:tasks.workunit:cleanup=True 2026-02-22T23:24:32.735 DEBUG:teuthology.orchestra.run.trial093:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-22T23:24:32.798 INFO:tasks.workunit.client.0.trial093.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-22T23:24:53.331 INFO:tasks.workunit.client.0.trial093.stderr:Note: switching to 'f90f4eaebb28b619cf76e80cbbe997656da69579'. 2026-02-22T23:24:53.331 INFO:tasks.workunit.client.0.trial093.stderr: 2026-02-22T23:24:53.331 INFO:tasks.workunit.client.0.trial093.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-22T23:24:53.331 INFO:tasks.workunit.client.0.trial093.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-22T23:24:53.331 INFO:tasks.workunit.client.0.trial093.stderr:state without impacting any branches by switching back to a branch. 2026-02-22T23:24:53.331 INFO:tasks.workunit.client.0.trial093.stderr: 2026-02-22T23:24:53.331 INFO:tasks.workunit.client.0.trial093.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-22T23:24:53.331 INFO:tasks.workunit.client.0.trial093.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-22T23:24:53.331 INFO:tasks.workunit.client.0.trial093.stderr: 2026-02-22T23:24:53.331 INFO:tasks.workunit.client.0.trial093.stderr: git switch -c 2026-02-22T23:24:53.331 INFO:tasks.workunit.client.0.trial093.stderr: 2026-02-22T23:24:53.331 INFO:tasks.workunit.client.0.trial093.stderr:Or undo this operation with: 2026-02-22T23:24:53.332 INFO:tasks.workunit.client.0.trial093.stderr: 2026-02-22T23:24:53.332 INFO:tasks.workunit.client.0.trial093.stderr: git switch - 2026-02-22T23:24:53.332 INFO:tasks.workunit.client.0.trial093.stderr: 2026-02-22T23:24:53.332 INFO:tasks.workunit.client.0.trial093.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-22T23:24:53.332 INFO:tasks.workunit.client.0.trial093.stderr: 2026-02-22T23:24:53.332 INFO:tasks.workunit.client.0.trial093.stderr:HEAD is now at f90f4eaebb2 Merge branch 'wip-74712-squid' of https://github.com/idryomov/ceph into wip-yuri6-testing-2026-02-22-1629-squid 2026-02-22T23:24:53.338 DEBUG:teuthology.orchestra.run.trial093:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-22T23:24:53.399 INFO:tasks.workunit.client.0.trial093.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2026-02-22T23:24:53.401 INFO:tasks.workunit.client.0.trial093.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-22T23:24:53.401 INFO:tasks.workunit.client.0.trial093.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2026-02-22T23:24:53.551 INFO:tasks.workunit.client.0.trial093.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2026-02-22T23:24:53.597 INFO:tasks.workunit.client.0.trial093.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2026-02-22T23:24:53.636 INFO:tasks.workunit.client.0.trial093.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-22T23:24:53.637 INFO:tasks.workunit.client.0.trial093.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-22T23:24:53.637 INFO:tasks.workunit.client.0.trial093.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2026-02-22T23:24:53.669 INFO:tasks.workunit.client.0.trial093.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-22T23:24:53.672 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-22T23:24:53.672 DEBUG:teuthology.orchestra.run.trial093:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-22T23:24:53.730 INFO:tasks.workunit:Running workunits matching rados/test_libcephsqlite.sh on client.0... 2026-02-22T23:24:53.733 INFO:tasks.workunit:Running workunit rados/test_libcephsqlite.sh... 2026-02-22T23:24:53.733 DEBUG:teuthology.orchestra.run.trial093:workunit test rados/test_libcephsqlite.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f90f4eaebb28b619cf76e80cbbe997656da69579 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CEPH_ARGS='--id libcephsqlite --no-log-to-stderr' adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_libcephsqlite.sh cephsqlite 2026-02-22T23:24:53.790 INFO:tasks.workunit.client.0.trial093.stderr:+ pool=cephsqlite 2026-02-22T23:24:53.790 INFO:tasks.workunit.client.0.trial093.stderr:++ basename /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_libcephsqlite.sh 2026-02-22T23:24:53.790 INFO:tasks.workunit.client.0.trial093.stderr:+ ns=test_libcephsqlite.sh 2026-02-22T23:24:53.790 INFO:tasks.workunit.client.0.trial093.stderr:+ striper rm baz.db 2026-02-22T23:24:53.791 INFO:tasks.workunit.client.0.trial093.stderr:+ rados --pool=cephsqlite --namespace=test_libcephsqlite.sh --striper rm baz.db 2026-02-22T23:24:53.818 INFO:tasks.workunit.client.0.trial093.stderr:+ sqlite 2026-02-22T23:24:53.818 INFO:tasks.workunit.client.0.trial093.stderr:+ background= 2026-02-22T23:24:53.818 INFO:tasks.workunit.client.0.trial093.stderr:+ '[' '' = b ']' 2026-02-22T23:24:53.818 INFO:tasks.workunit.client.0.trial093.stderr:++ cat 2026-02-22T23:24:53.819 INFO:tasks.workunit.client.0.trial093.stderr:+ a='create table if not exists foo (a INT); 2026-02-22T23:24:53.819 INFO:tasks.workunit.client.0.trial093.stderr:insert into foo (a) values (RANDOM()); 2026-02-22T23:24:53.819 INFO:tasks.workunit.client.0.trial093.stderr:drop table foo;' 2026-02-22T23:24:53.819 INFO:tasks.workunit.client.0.trial093.stderr:+ printf %s 'create table if not exists foo (a INT); 2026-02-22T23:24:53.819 INFO:tasks.workunit.client.0.trial093.stderr:insert into foo (a) values (RANDOM()); 2026-02-22T23:24:53.819 INFO:tasks.workunit.client.0.trial093.stderr:drop table foo;' 2026-02-22T23:24:53.819 INFO:tasks.workunit.client.0.trial093.stderr:create table if not exists foo (a INT); 2026-02-22T23:24:53.819 INFO:tasks.workunit.client.0.trial093.stderr:insert into foo (a) values (RANDOM()); 2026-02-22T23:24:53.819 INFO:tasks.workunit.client.0.trial093.stderr:drop table foo;+ '[' '' '!=' b ']' 2026-02-22T23:24:53.819 INFO:tasks.workunit.client.0.trial093.stderr:+ wait 2026-02-22T23:24:53.819 INFO:tasks.workunit.client.0.trial093.stderr:+ sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd '.open file:///cephsqlite:test_libcephsqlite.sh/baz.db?vfs=ceph' -cmd '.output stdout' 2026-02-22T23:24:53.901 INFO:tasks.workunit.client.0.trial093.stderr: 2026-02-22T23:24:53.901 INFO:tasks.workunit.client.0.trial093.stderr:real 0m0.083s 2026-02-22T23:24:53.901 INFO:tasks.workunit.client.0.trial093.stderr:user 0m0.021s 2026-02-22T23:24:53.901 INFO:tasks.workunit.client.0.trial093.stderr:sys 0m0.011s 2026-02-22T23:24:53.901 INFO:tasks.workunit.client.0.trial093.stderr:+ striper stat baz.db 2026-02-22T23:24:53.901 INFO:tasks.workunit.client.0.trial093.stderr:+ rados --pool=cephsqlite --namespace=test_libcephsqlite.sh --striper stat baz.db 2026-02-22T23:24:53.922 INFO:tasks.workunit.client.0.trial093.stdout:cephsqlite/baz.db mtime 2026-02-22T23:24:53.000000+0000, size 8192 2026-02-22T23:24:53.924 INFO:tasks.workunit.client.0.trial093.stderr:+ striper rm baz.db 2026-02-22T23:24:53.924 INFO:tasks.workunit.client.0.trial093.stderr:+ rados --pool=cephsqlite --namespace=test_libcephsqlite.sh --striper rm baz.db 2026-02-22T23:24:53.947 INFO:tasks.workunit.client.0.trial093.stderr:+ sqlite 2026-02-22T23:24:53.949 INFO:tasks.workunit.client.0.trial093.stderr:++ repeat 10 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:53.950 INFO:tasks.workunit.client.0.trial093.stderr:++ n=10 2026-02-22T23:24:53.950 INFO:tasks.workunit.client.0.trial093.stderr:++ shift 2026-02-22T23:24:53.950 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i = 0 )) 2026-02-22T23:24:53.950 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 10 )) 2026-02-22T23:24:53.950 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:53.950 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:53.950 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 10 )) 2026-02-22T23:24:53.950 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:53.950 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:53.950 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 10 )) 2026-02-22T23:24:53.950 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:53.950 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:53.951 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 10 )) 2026-02-22T23:24:53.951 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:53.951 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:53.951 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 10 )) 2026-02-22T23:24:53.951 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:53.951 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:53.951 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 10 )) 2026-02-22T23:24:53.951 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:53.951 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:53.951 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 10 )) 2026-02-22T23:24:53.951 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:53.951 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:53.952 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 10 )) 2026-02-22T23:24:53.952 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:53.952 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:53.952 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 10 )) 2026-02-22T23:24:53.952 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:53.952 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:53.952 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 10 )) 2026-02-22T23:24:53.952 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:53.952 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:53.952 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 10 )) 2026-02-22T23:24:53.952 INFO:tasks.workunit.client.0.trial093.stderr:+ background= 2026-02-22T23:24:53.952 INFO:tasks.workunit.client.0.trial093.stderr:+ '[' '' = b ']' 2026-02-22T23:24:53.952 INFO:tasks.workunit.client.0.trial093.stderr:++ cat 2026-02-22T23:24:53.953 INFO:tasks.workunit.client.0.trial093.stderr:+ a='CREATE TABLE IF NOT EXISTS rand(text BLOB NOT NULL); 2026-02-22T23:24:53.953 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:53.953 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:53.953 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:53.953 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:53.953 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:53.953 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:53.953 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:53.953 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:53.953 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:53.953 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:53.953 INFO:tasks.workunit.client.0.trial093.stderr:SELECT LENGTH(text) FROM rand; 2026-02-22T23:24:53.953 INFO:tasks.workunit.client.0.trial093.stderr:DROP TABLE rand;' 2026-02-22T23:24:53.954 INFO:tasks.workunit.client.0.trial093.stderr:+ printf %s 'CREATE TABLE IF NOT EXISTS rand(text BLOB NOT NULL); 2026-02-22T23:24:53.954 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:53.954 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:53.954 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:53.954 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:53.954 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:53.954 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:53.954 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:53.954 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:53.954 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:53.954 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:53.954 INFO:tasks.workunit.client.0.trial093.stderr:SELECT LENGTH(text) FROM rand; 2026-02-22T23:24:53.954 INFO:tasks.workunit.client.0.trial093.stderr:DROP TABLE rand;' 2026-02-22T23:24:53.955 INFO:tasks.workunit.client.0.trial093.stderr:CREATE TABLE IF NOT EXISTS rand(text BLOB NOT NULL); 2026-02-22T23:24:53.955 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:53.955 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:53.955 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:53.955 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:53.955 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:53.955 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:53.955 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:53.955 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:53.955 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:53.955 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:53.955 INFO:tasks.workunit.client.0.trial093.stderr:SELECT LENGTH(text) FROM rand; 2026-02-22T23:24:53.956 INFO:tasks.workunit.client.0.trial093.stderr:DROP TABLE rand;+ '[' '' '!=' b ']' 2026-02-22T23:24:53.956 INFO:tasks.workunit.client.0.trial093.stderr:+ wait 2026-02-22T23:24:53.956 INFO:tasks.workunit.client.0.trial093.stderr:+ sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd '.open file:///cephsqlite:test_libcephsqlite.sh/baz.db?vfs=ceph' -cmd '.output stdout' 2026-02-22T23:24:54.195 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.195 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.195 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.195 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.195 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.195 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.195 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.195 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.195 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.195 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.254 INFO:tasks.workunit.client.0.trial093.stderr: 2026-02-22T23:24:54.255 INFO:tasks.workunit.client.0.trial093.stderr:real 0m0.298s 2026-02-22T23:24:54.255 INFO:tasks.workunit.client.0.trial093.stderr:user 0m0.035s 2026-02-22T23:24:54.255 INFO:tasks.workunit.client.0.trial093.stderr:sys 0m0.027s 2026-02-22T23:24:54.255 INFO:tasks.workunit.client.0.trial093.stderr:+ sqlite 2026-02-22T23:24:54.255 INFO:tasks.workunit.client.0.trial093.stderr:++ repeat 100 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.255 INFO:tasks.workunit.client.0.trial093.stderr:++ n=100 2026-02-22T23:24:54.255 INFO:tasks.workunit.client.0.trial093.stderr:++ shift 2026-02-22T23:24:54.255 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i = 0 )) 2026-02-22T23:24:54.255 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.256 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.256 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.256 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.256 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.256 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.256 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.256 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.256 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.256 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.256 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.256 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.256 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.257 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.257 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.257 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.257 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.257 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.257 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.257 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.257 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.257 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.257 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.257 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.257 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.258 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.258 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.258 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.258 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.258 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.258 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.258 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.258 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.258 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.258 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.258 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.258 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.259 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.259 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.259 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.259 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.259 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.259 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.259 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.259 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.259 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.259 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.259 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.259 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.260 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.260 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.260 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.260 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.260 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.260 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.260 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.260 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.260 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.260 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.261 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.261 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.261 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.261 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.261 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.261 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.261 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.261 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.261 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.261 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.261 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.261 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.262 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.262 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.262 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.262 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.262 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.262 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.262 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.262 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.262 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.262 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.262 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.262 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.262 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.263 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.263 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.263 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.263 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.263 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.263 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.263 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.263 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.263 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.263 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.263 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.263 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.264 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.264 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.264 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.264 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.264 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.264 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.264 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.264 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.264 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.264 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.264 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.264 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.264 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.265 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.265 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.265 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.265 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.265 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.265 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.265 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.265 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.265 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.265 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.265 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.265 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.265 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.266 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.266 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.266 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.266 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.266 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.266 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.266 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.266 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.266 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.266 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.266 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.266 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.266 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.267 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.267 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.267 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.267 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.267 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.267 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.267 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.267 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.267 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.267 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.267 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.267 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.267 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.268 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.268 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.268 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.268 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.268 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.268 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.268 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.268 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.268 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.268 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.268 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.268 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.268 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.269 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.269 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.269 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.269 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.269 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.269 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.269 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.269 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.269 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.269 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.269 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.269 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.269 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.270 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.270 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.270 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.270 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.270 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.270 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.270 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.270 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.270 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.270 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.270 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.270 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.270 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.271 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.271 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.271 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.271 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.271 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.271 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.271 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.271 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.271 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.271 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.271 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.271 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.271 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.272 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.272 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.272 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.272 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.272 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.272 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.272 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.272 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.272 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.272 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.272 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.272 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.272 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.273 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.273 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.273 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.273 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.273 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.273 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.273 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.273 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.273 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.273 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.273 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.273 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.273 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.274 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.274 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.274 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.274 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.274 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.274 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.274 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.274 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.274 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.274 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.274 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.274 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.274 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.275 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.275 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.275 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.275 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.275 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.275 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.275 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.275 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.275 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.275 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.275 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.275 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.275 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.275 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.276 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.276 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.276 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.276 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.276 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.276 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.276 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.276 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.276 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.276 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.276 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.276 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.276 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.277 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.277 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.277 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.277 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.277 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.277 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.277 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.277 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.277 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.277 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.277 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.277 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.278 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.278 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.278 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.278 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.278 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.278 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.278 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.278 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.278 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.278 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.278 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.278 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.278 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.279 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.279 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.279 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.279 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.279 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.279 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.279 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.279 INFO:tasks.workunit.client.0.trial093.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2026-02-22T23:24:54.279 INFO:tasks.workunit.client.0.trial093.stderr:++ (( ++i )) 2026-02-22T23:24:54.279 INFO:tasks.workunit.client.0.trial093.stderr:++ (( i < 100 )) 2026-02-22T23:24:54.279 INFO:tasks.workunit.client.0.trial093.stderr:+ background= 2026-02-22T23:24:54.279 INFO:tasks.workunit.client.0.trial093.stderr:+ '[' '' = b ']' 2026-02-22T23:24:54.279 INFO:tasks.workunit.client.0.trial093.stderr:++ cat 2026-02-22T23:24:54.279 INFO:tasks.workunit.client.0.trial093.stderr:+ a='BEGIN TRANSACTION; 2026-02-22T23:24:54.279 INFO:tasks.workunit.client.0.trial093.stderr:CREATE TABLE IF NOT EXISTS rand(text BLOB NOT NULL); 2026-02-22T23:24:54.280 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.280 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.280 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.280 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.280 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.280 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.280 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.280 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.280 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.280 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.280 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.280 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.280 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.280 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.280 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.281 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.281 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.281 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.281 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.281 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.281 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.281 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.281 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.281 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.281 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.281 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.281 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.281 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.281 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.282 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.282 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.282 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.282 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.282 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.282 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.282 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.282 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.282 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.282 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.282 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.282 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.282 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.282 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.282 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.282 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.283 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.283 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.283 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.283 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.283 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.283 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.283 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.283 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.283 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.283 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.283 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.283 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.283 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.283 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.283 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.283 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.283 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.284 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.284 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.284 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.284 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.284 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.284 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.284 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.284 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.284 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.284 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.284 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.284 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.284 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.284 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.285 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.285 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.285 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.285 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.285 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.285 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.285 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.285 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.285 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.285 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.285 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.285 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.285 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.285 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.285 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.285 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.285 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.286 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.286 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.286 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.286 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.286 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.286 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.286 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.286 INFO:tasks.workunit.client.0.trial093.stderr:COMMIT; 2026-02-22T23:24:54.286 INFO:tasks.workunit.client.0.trial093.stderr:SELECT LENGTH(text) FROM rand; 2026-02-22T23:24:54.286 INFO:tasks.workunit.client.0.trial093.stderr:DROP TABLE rand;' 2026-02-22T23:24:54.286 INFO:tasks.workunit.client.0.trial093.stderr:+ printf %s 'BEGIN TRANSACTION; 2026-02-22T23:24:54.286 INFO:tasks.workunit.client.0.trial093.stderr:CREATE TABLE IF NOT EXISTS rand(text BLOB NOT NULL); 2026-02-22T23:24:54.286 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.286 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.286 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.286 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.286 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.286 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.287 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.287 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.287 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.287 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.287 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.287 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.287 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.287 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.287 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.287 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.287 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.287 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.287 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.287 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.287 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.287 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.287 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.287 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.287 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.288 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.288 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.288 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.288 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.288 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.288 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.288 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.288 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.288 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.288 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.288 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.288 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.288 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.288 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.288 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.288 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.288 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.288 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.289 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.289 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.289 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.289 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.289 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.289 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.289 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.289 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.289 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.289 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.289 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.289 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.289 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.289 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.289 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.289 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.289 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.289 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.289 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.289 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.290 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.290 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.290 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.290 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.290 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.290 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.290 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.290 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.290 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.290 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.290 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.290 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.290 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.290 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.290 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.290 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.290 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.290 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.290 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.291 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.291 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.291 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.291 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.291 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.291 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.291 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.291 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.291 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.291 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.291 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.291 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.291 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.291 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.291 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.291 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.291 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.291 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.291 INFO:tasks.workunit.client.0.trial093.stderr:COMMIT; 2026-02-22T23:24:54.291 INFO:tasks.workunit.client.0.trial093.stderr:SELECT LENGTH(text) FROM rand; 2026-02-22T23:24:54.292 INFO:tasks.workunit.client.0.trial093.stderr:DROP TABLE rand;' 2026-02-22T23:24:54.292 INFO:tasks.workunit.client.0.trial093.stderr:BEGIN TRANSACTION; 2026-02-22T23:24:54.292 INFO:tasks.workunit.client.0.trial093.stderr:CREATE TABLE IF NOT EXISTS rand(text BLOB NOT NULL); 2026-02-22T23:24:54.292 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.292 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.292 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.292 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.292 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.292 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.292 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.292 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.292 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.292 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.292 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.292 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.292 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.292 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.292 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.292 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.292 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.292 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.293 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.293 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.293 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.293 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.293 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.293 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.293 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.293 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.293 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.293 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.293 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.293 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.293 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.293 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.293 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.293 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.293 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.293 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.293 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.293 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.293 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.293 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.294 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.294 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.294 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.294 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.294 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.294 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.294 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.294 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.294 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.294 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.294 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.294 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.294 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.294 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.294 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.294 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.294 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.294 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.294 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.294 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.294 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.294 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.295 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.295 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.295 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.295 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.295 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.295 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.295 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.295 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.295 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.295 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.295 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.295 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.295 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.295 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.295 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.295 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.295 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.295 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.295 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.295 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.295 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.296 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.296 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.296 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.296 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.296 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.296 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.296 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.296 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.296 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.296 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.296 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.296 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.296 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.296 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.296 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.296 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.296 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2026-02-22T23:24:54.296 INFO:tasks.workunit.client.0.trial093.stderr:COMMIT; 2026-02-22T23:24:54.296 INFO:tasks.workunit.client.0.trial093.stderr:SELECT LENGTH(text) FROM rand; 2026-02-22T23:24:54.296 INFO:tasks.workunit.client.0.trial093.stderr:DROP TABLE rand;+ '[' '' '!=' b ']' 2026-02-22T23:24:54.296 INFO:tasks.workunit.client.0.trial093.stderr:+ wait 2026-02-22T23:24:54.297 INFO:tasks.workunit.client.0.trial093.stderr:+ sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd '.open file:///cephsqlite:test_libcephsqlite.sh/baz.db?vfs=ceph' -cmd '.output stdout' 2026-02-22T23:24:54.367 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.367 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.367 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.367 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.367 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.368 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.368 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.368 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.368 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.368 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.368 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.368 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.368 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.368 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.368 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.368 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.368 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.368 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.368 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.368 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.368 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.368 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.369 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.369 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.369 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.369 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.369 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.369 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.369 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.369 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.369 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.369 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.369 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.369 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.369 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.369 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.369 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.369 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.369 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.370 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.370 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.370 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.370 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.370 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.370 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.370 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.370 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.370 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.370 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.370 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.370 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.370 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.370 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.370 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.370 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.370 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.370 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.371 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.371 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.371 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.371 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.371 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.371 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.371 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.371 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.371 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.371 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.371 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.371 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.371 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.371 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.371 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.371 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.371 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.371 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.372 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.372 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.372 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.372 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.372 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.372 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.372 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.372 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.372 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.372 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.372 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.372 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.372 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.372 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.372 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.372 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.372 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.372 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.373 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.373 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.373 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.373 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.373 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.373 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.373 INFO:tasks.workunit.client.0.trial093.stdout:4096 2026-02-22T23:24:54.664 INFO:tasks.workunit.client.0.trial093.stderr: 2026-02-22T23:24:54.664 INFO:tasks.workunit.client.0.trial093.stderr:real 0m0.418s 2026-02-22T23:24:54.664 INFO:tasks.workunit.client.0.trial093.stderr:user 0m0.050s 2026-02-22T23:24:54.664 INFO:tasks.workunit.client.0.trial093.stderr:sys 0m0.032s 2026-02-22T23:24:54.664 INFO:tasks.workunit.client.0.trial093.stderr:+ striper rm baz.db 2026-02-22T23:24:54.664 INFO:tasks.workunit.client.0.trial093.stderr:+ rados --pool=cephsqlite --namespace=test_libcephsqlite.sh --striper rm baz.db 2026-02-22T23:24:54.688 INFO:tasks.workunit.client.0.trial093.stderr:+ date 2026-02-22T23:24:54.688 INFO:tasks.workunit.client.0.trial093.stdout:Sun Feb 22 11:24:54 PM UTC 2026 2026-02-22T23:24:54.689 INFO:tasks.workunit.client.0.trial093.stderr:+ sqlite b 2026-02-22T23:24:54.689 INFO:tasks.workunit.client.0.trial093.stderr:+ background=b 2026-02-22T23:24:54.689 INFO:tasks.workunit.client.0.trial093.stderr:+ '[' b = b ']' 2026-02-22T23:24:54.689 INFO:tasks.workunit.client.0.trial093.stderr:+ shift 2026-02-22T23:24:54.689 INFO:tasks.workunit.client.0.trial093.stderr:++ cat 2026-02-22T23:24:54.689 INFO:tasks.workunit.client.0.trial093.stderr:+ a='CREATE TABLE foo (a BLOB); 2026-02-22T23:24:54.689 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO foo VALUES ("start"); 2026-02-22T23:24:54.689 INFO:tasks.workunit.client.0.trial093.stderr:WITH RECURSIVE c(x) AS 2026-02-22T23:24:54.689 INFO:tasks.workunit.client.0.trial093.stderr: ( 2026-02-22T23:24:54.689 INFO:tasks.workunit.client.0.trial093.stderr: VALUES(1) 2026-02-22T23:24:54.690 INFO:tasks.workunit.client.0.trial093.stderr: UNION ALL 2026-02-22T23:24:54.690 INFO:tasks.workunit.client.0.trial093.stderr: SELECT x+1 2026-02-22T23:24:54.690 INFO:tasks.workunit.client.0.trial093.stderr: FROM c 2026-02-22T23:24:54.690 INFO:tasks.workunit.client.0.trial093.stderr: ) 2026-02-22T23:24:54.690 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO foo (a) 2026-02-22T23:24:54.690 INFO:tasks.workunit.client.0.trial093.stderr: SELECT RANDOMBLOB(1<<20) 2026-02-22T23:24:54.690 INFO:tasks.workunit.client.0.trial093.stderr: FROM c 2026-02-22T23:24:54.690 INFO:tasks.workunit.client.0.trial093.stderr: LIMIT (1<<20);' 2026-02-22T23:24:54.690 INFO:tasks.workunit.client.0.trial093.stderr:+ printf %s 'CREATE TABLE foo (a BLOB); 2026-02-22T23:24:54.690 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO foo VALUES ("start"); 2026-02-22T23:24:54.690 INFO:tasks.workunit.client.0.trial093.stderr:WITH RECURSIVE c(x) AS 2026-02-22T23:24:54.690 INFO:tasks.workunit.client.0.trial093.stderr: ( 2026-02-22T23:24:54.690 INFO:tasks.workunit.client.0.trial093.stderr: VALUES(1) 2026-02-22T23:24:54.690 INFO:tasks.workunit.client.0.trial093.stderr: UNION ALL 2026-02-22T23:24:54.690 INFO:tasks.workunit.client.0.trial093.stderr: SELECT x+1 2026-02-22T23:24:54.690 INFO:tasks.workunit.client.0.trial093.stderr: FROM c 2026-02-22T23:24:54.690 INFO:tasks.workunit.client.0.trial093.stderr: ) 2026-02-22T23:24:54.690 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO foo (a) 2026-02-22T23:24:54.690 INFO:tasks.workunit.client.0.trial093.stderr: SELECT RANDOMBLOB(1<<20) 2026-02-22T23:24:54.690 INFO:tasks.workunit.client.0.trial093.stderr: FROM c 2026-02-22T23:24:54.690 INFO:tasks.workunit.client.0.trial093.stderr: LIMIT (1<<20);' 2026-02-22T23:24:54.690 INFO:tasks.workunit.client.0.trial093.stderr:CREATE TABLE foo (a BLOB); 2026-02-22T23:24:54.690 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO foo VALUES ("start"); 2026-02-22T23:24:54.690 INFO:tasks.workunit.client.0.trial093.stderr:WITH RECURSIVE c(x) AS 2026-02-22T23:24:54.690 INFO:tasks.workunit.client.0.trial093.stderr: ( 2026-02-22T23:24:54.690 INFO:tasks.workunit.client.0.trial093.stderr: VALUES(1) 2026-02-22T23:24:54.690 INFO:tasks.workunit.client.0.trial093.stderr: UNION ALL 2026-02-22T23:24:54.690 INFO:tasks.workunit.client.0.trial093.stderr: SELECT x+1 2026-02-22T23:24:54.690 INFO:tasks.workunit.client.0.trial093.stderr: FROM c 2026-02-22T23:24:54.690 INFO:tasks.workunit.client.0.trial093.stderr: ) 2026-02-22T23:24:54.690 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO foo (a) 2026-02-22T23:24:54.690 INFO:tasks.workunit.client.0.trial093.stderr: SELECT RANDOMBLOB(1<<20) 2026-02-22T23:24:54.690 INFO:tasks.workunit.client.0.trial093.stderr: FROM c 2026-02-22T23:24:54.691 INFO:tasks.workunit.client.0.trial093.stderr: LIMIT (1<<20);+ '[' b '!=' b ']' 2026-02-22T23:24:54.691 INFO:tasks.workunit.client.0.trial093.stderr:+ sleep 10 2026-02-22T23:24:54.691 INFO:tasks.workunit.client.0.trial093.stderr:+ sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd '.open file:///cephsqlite:test_libcephsqlite.sh/baz.db?vfs=ceph' -cmd '.output stdout' 2026-02-22T23:25:04.691 INFO:tasks.workunit.client.0.trial093.stdout:done 2026-02-22T23:25:04.691 INFO:tasks.workunit.client.0.trial093.stderr:+ echo done 2026-02-22T23:25:04.691 INFO:tasks.workunit.client.0.trial093.stderr:+ jobs -l 2026-02-22T23:25:04.691 INFO:tasks.workunit.client.0.trial093.stdout:[1]+ 48496 Running sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd ".open file:///$pool:$ns/baz.db?vfs=ceph" -cmd '.output stdout' <<< "$a" & 2026-02-22T23:25:04.691 INFO:tasks.workunit.client.0.trial093.stderr:++ jobs -p 2026-02-22T23:25:04.691 INFO:tasks.workunit.client.0.trial093.stderr:+ kill -KILL -- 48496 2026-02-22T23:25:04.691 INFO:tasks.workunit.client.0.trial093.stderr:+ date 2026-02-22T23:25:04.693 INFO:tasks.workunit.client.0.trial093.stdout:Sun Feb 22 11:25:04 PM UTC 2026 2026-02-22T23:25:04.693 INFO:tasks.workunit.client.0.trial093.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_libcephsqlite.sh: line 94: 48496 Killed sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd ".open file:///$pool:$ns/baz.db?vfs=ceph" -cmd '.output stdout' <<< "$a" 2026-02-22T23:25:04.693 INFO:tasks.workunit.client.0.trial093.stderr:+ wait 2026-02-22T23:25:04.693 INFO:tasks.workunit.client.0.trial093.stderr:+ date 2026-02-22T23:25:04.694 INFO:tasks.workunit.client.0.trial093.stdout:Sun Feb 22 11:25:04 PM UTC 2026 2026-02-22T23:25:04.694 INFO:tasks.workunit.client.0.trial093.stderr:++ sqlite 2026-02-22T23:25:04.694 INFO:tasks.workunit.client.0.trial093.stderr:++ background= 2026-02-22T23:25:04.694 INFO:tasks.workunit.client.0.trial093.stderr:++ '[' '' = b ']' 2026-02-22T23:25:04.694 INFO:tasks.workunit.client.0.trial093.stderr:+++ cat 2026-02-22T23:25:04.695 INFO:tasks.workunit.client.0.trial093.stderr:++ a='SELECT COUNT(*) FROM foo;' 2026-02-22T23:25:04.695 INFO:tasks.workunit.client.0.trial093.stderr:++ printf %s 'SELECT COUNT(*) FROM foo;' 2026-02-22T23:25:04.695 INFO:tasks.workunit.client.0.trial093.stderr:SELECT COUNT(*) FROM foo;++ '[' '' '!=' b ']' 2026-02-22T23:25:04.695 INFO:tasks.workunit.client.0.trial093.stderr:++ wait 2026-02-22T23:25:04.695 INFO:tasks.workunit.client.0.trial093.stderr:++ sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd '.open file:///cephsqlite:test_libcephsqlite.sh/baz.db?vfs=ceph' -cmd '.output stdout' 2026-02-22T23:25:32.779 INFO:tasks.workunit.client.0.trial093.stderr:+ n=1 2026-02-22T23:25:32.779 INFO:tasks.workunit.client.0.trial093.stderr:+ '[' 1 -eq 1 ']' 2026-02-22T23:25:32.779 INFO:tasks.workunit.client.0.trial093.stderr:+ striper rm baz.db 2026-02-22T23:25:32.779 INFO:tasks.workunit.client.0.trial093.stderr:+ rados --pool=cephsqlite --namespace=test_libcephsqlite.sh --striper rm baz.db 2026-02-22T23:25:32.806 INFO:tasks.workunit.client.0.trial093.stderr:+ date 2026-02-22T23:25:32.807 INFO:tasks.workunit.client.0.trial093.stdout:Sun Feb 22 11:25:32 PM UTC 2026 2026-02-22T23:25:32.807 INFO:tasks.workunit.client.0.trial093.stderr:+ sqlite b 2026-02-22T23:25:32.808 INFO:tasks.workunit.client.0.trial093.stderr:+ background=b 2026-02-22T23:25:32.808 INFO:tasks.workunit.client.0.trial093.stderr:+ '[' b = b ']' 2026-02-22T23:25:32.808 INFO:tasks.workunit.client.0.trial093.stderr:+ shift 2026-02-22T23:25:32.808 INFO:tasks.workunit.client.0.trial093.stderr:++ cat 2026-02-22T23:25:32.808 INFO:tasks.workunit.client.0.trial093.stderr:+ a='CREATE TABLE foo (a BLOB); 2026-02-22T23:25:32.808 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO foo VALUES ("start"); 2026-02-22T23:25:32.808 INFO:tasks.workunit.client.0.trial093.stderr:WITH RECURSIVE c(x) AS 2026-02-22T23:25:32.809 INFO:tasks.workunit.client.0.trial093.stderr: ( 2026-02-22T23:25:32.809 INFO:tasks.workunit.client.0.trial093.stderr: VALUES(1) 2026-02-22T23:25:32.809 INFO:tasks.workunit.client.0.trial093.stderr: UNION ALL 2026-02-22T23:25:32.809 INFO:tasks.workunit.client.0.trial093.stderr: SELECT x+1 2026-02-22T23:25:32.809 INFO:tasks.workunit.client.0.trial093.stderr: FROM c 2026-02-22T23:25:32.809 INFO:tasks.workunit.client.0.trial093.stderr: ) 2026-02-22T23:25:32.809 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO foo (a) 2026-02-22T23:25:32.809 INFO:tasks.workunit.client.0.trial093.stderr: SELECT RANDOMBLOB(1<<20) 2026-02-22T23:25:32.809 INFO:tasks.workunit.client.0.trial093.stderr: FROM c 2026-02-22T23:25:32.809 INFO:tasks.workunit.client.0.trial093.stderr: LIMIT (1<<20);' 2026-02-22T23:25:32.809 INFO:tasks.workunit.client.0.trial093.stderr:+ printf %s 'CREATE TABLE foo (a BLOB); 2026-02-22T23:25:32.809 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO foo VALUES ("start"); 2026-02-22T23:25:32.809 INFO:tasks.workunit.client.0.trial093.stderr:WITH RECURSIVE c(x) AS 2026-02-22T23:25:32.809 INFO:tasks.workunit.client.0.trial093.stderr: ( 2026-02-22T23:25:32.809 INFO:tasks.workunit.client.0.trial093.stderr: VALUES(1) 2026-02-22T23:25:32.809 INFO:tasks.workunit.client.0.trial093.stderr: UNION ALL 2026-02-22T23:25:32.809 INFO:tasks.workunit.client.0.trial093.stderr: SELECT x+1 2026-02-22T23:25:32.809 INFO:tasks.workunit.client.0.trial093.stderr: FROM c 2026-02-22T23:25:32.809 INFO:tasks.workunit.client.0.trial093.stderr: ) 2026-02-22T23:25:32.809 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO foo (a) 2026-02-22T23:25:32.810 INFO:tasks.workunit.client.0.trial093.stderr: SELECT RANDOMBLOB(1<<20) 2026-02-22T23:25:32.810 INFO:tasks.workunit.client.0.trial093.stderr: FROM c 2026-02-22T23:25:32.810 INFO:tasks.workunit.client.0.trial093.stderr: LIMIT (1<<20);' 2026-02-22T23:25:32.810 INFO:tasks.workunit.client.0.trial093.stderr:CREATE TABLE foo (a BLOB); 2026-02-22T23:25:32.810 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO foo VALUES ("start"); 2026-02-22T23:25:32.810 INFO:tasks.workunit.client.0.trial093.stderr:WITH RECURSIVE c(x) AS 2026-02-22T23:25:32.810 INFO:tasks.workunit.client.0.trial093.stderr: ( 2026-02-22T23:25:32.810 INFO:tasks.workunit.client.0.trial093.stderr: VALUES(1) 2026-02-22T23:25:32.810 INFO:tasks.workunit.client.0.trial093.stderr: UNION ALL 2026-02-22T23:25:32.810 INFO:tasks.workunit.client.0.trial093.stderr: SELECT x+1 2026-02-22T23:25:32.810 INFO:tasks.workunit.client.0.trial093.stderr: FROM c 2026-02-22T23:25:32.810 INFO:tasks.workunit.client.0.trial093.stderr: ) 2026-02-22T23:25:32.810 INFO:tasks.workunit.client.0.trial093.stderr:INSERT INTO foo (a) 2026-02-22T23:25:32.810 INFO:tasks.workunit.client.0.trial093.stderr: SELECT RANDOMBLOB(1<<20) 2026-02-22T23:25:32.810 INFO:tasks.workunit.client.0.trial093.stderr: FROM c 2026-02-22T23:25:32.810 INFO:tasks.workunit.client.0.trial093.stderr: LIMIT (1<<20);+ '[' b '!=' b ']' 2026-02-22T23:25:32.810 INFO:tasks.workunit.client.0.trial093.stderr:+ sleep 20 2026-02-22T23:25:32.810 INFO:tasks.workunit.client.0.trial093.stderr:+ sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd '.open file:///cephsqlite:test_libcephsqlite.sh/baz.db?vfs=ceph' -cmd '.output stdout' 2026-02-22T23:25:52.809 INFO:tasks.workunit.client.0.trial093.stderr:+ jobs -l 2026-02-22T23:25:52.810 INFO:tasks.workunit.client.0.trial093.stdout:[1]+ 48564 Running sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd ".open file:///$pool:$ns/baz.db?vfs=ceph" -cmd '.output stdout' <<< "$a" & 2026-02-22T23:25:52.811 INFO:tasks.workunit.client.0.trial093.stderr:++ jobs -p 2026-02-22T23:25:52.811 INFO:tasks.workunit.client.0.trial093.stderr:+ kill -STOP -- 48564 2026-02-22T23:25:52.811 INFO:tasks.workunit.client.0.trial093.stderr:+ sleep 45 2026-02-22T23:26:37.811 INFO:tasks.workunit.client.0.trial093.stderr:+ date 2026-02-22T23:26:37.812 INFO:tasks.workunit.client.0.trial093.stdout:Sun Feb 22 11:26:37 PM UTC 2026 2026-02-22T23:26:37.813 INFO:tasks.workunit.client.0.trial093.stderr:++ jobs -p 2026-02-22T23:26:37.813 INFO:tasks.workunit.client.0.trial093.stderr:+ kill -CONT -- 48564 2026-02-22T23:26:37.814 INFO:tasks.workunit.client.0.trial093.stderr:+ sleep 10 2026-02-22T23:26:37.827 INFO:tasks.workunit.client.0.trial093.stderr:Error: near line 3: disk I/O error 2026-02-22T23:26:47.815 INFO:tasks.workunit.client.0.trial093.stderr:+ date 2026-02-22T23:26:47.816 INFO:tasks.workunit.client.0.trial093.stdout:Sun Feb 22 11:26:47 PM UTC 2026 2026-02-22T23:26:47.817 INFO:tasks.workunit.client.0.trial093.stderr:+ wait 2026-02-22T23:26:47.817 INFO:tasks.workunit.client.0.trial093.stderr:+ date 2026-02-22T23:26:47.817 INFO:tasks.workunit.client.0.trial093.stdout:Sun Feb 22 11:26:47 PM UTC 2026 2026-02-22T23:26:47.818 INFO:tasks.workunit.client.0.trial093.stderr:++ sqlite 2026-02-22T23:26:47.818 INFO:tasks.workunit.client.0.trial093.stderr:++ background= 2026-02-22T23:26:47.818 INFO:tasks.workunit.client.0.trial093.stderr:++ '[' '' = b ']' 2026-02-22T23:26:47.818 INFO:tasks.workunit.client.0.trial093.stderr:+++ cat 2026-02-22T23:26:47.819 INFO:tasks.workunit.client.0.trial093.stderr:++ a='SELECT COUNT(*) FROM foo;' 2026-02-22T23:26:47.819 INFO:tasks.workunit.client.0.trial093.stderr:++ printf %s 'SELECT COUNT(*) FROM foo;' 2026-02-22T23:26:47.820 INFO:tasks.workunit.client.0.trial093.stderr:SELECT COUNT(*) FROM foo;++ '[' '' '!=' b ']' 2026-02-22T23:26:47.820 INFO:tasks.workunit.client.0.trial093.stderr:++ wait 2026-02-22T23:26:47.820 INFO:tasks.workunit.client.0.trial093.stderr:++ sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd '.open file:///cephsqlite:test_libcephsqlite.sh/baz.db?vfs=ceph' -cmd '.output stdout' 2026-02-22T23:26:48.851 INFO:tasks.workunit.client.0.trial093.stderr:+ n=1 2026-02-22T23:26:48.852 INFO:tasks.workunit.client.0.trial093.stderr:+ '[' 1 -eq 1 ']' 2026-02-22T23:26:48.852 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-22T23:26:48.852 DEBUG:teuthology.orchestra.run.trial093:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-22T23:26:48.919 INFO:tasks.workunit:Stopping ['rados/test_libcephsqlite.sh cephsqlite'] on client.0... 2026-02-22T23:26:48.919 DEBUG:teuthology.orchestra.run.trial093:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-22T23:26:49.259 DEBUG:teuthology.parallel:result is None 2026-02-22T23:26:49.260 DEBUG:teuthology.orchestra.run.trial093:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2026-02-22T23:26:49.285 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2026-02-22T23:26:49.285 DEBUG:teuthology.orchestra.run.trial093:> rmdir -- /home/ubuntu/cephtest/mnt.0 2026-02-22T23:26:49.341 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2026-02-22T23:26:49.342 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-22T23:26:49.351 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-22T23:26:49.351 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T23:26:49.449 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.446+0000 7f6e0080e640 1 Processor -- start 2026-02-22T23:26:49.449 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.446+0000 7f6e0080e640 1 -- start start 2026-02-22T23:26:49.454 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.447+0000 7f6e0080e640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6df80b5ba0 con 0x7f6df80b57c0 2026-02-22T23:26:49.454 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.447+0000 7f6e0080e640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6df8144120 con 0x7f6df8143cc0 2026-02-22T23:26:49.454 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.447+0000 7f6e0080e640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6df80729c0 con 0x7f6df8143750 2026-02-22T23:26:49.455 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.447+0000 7f6dfed84640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7f6df8143750 0x7f6df814f500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:53442/0 (socket says 10.20.193.93:53442) 2026-02-22T23:26:49.455 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.447+0000 7f6dfed84640 1 -- 10.20.193.93:0/825592811 learned_addr learned my addr 10.20.193.93:0/825592811 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:26:49.455 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.447+0000 7f6dfe583640 1 --1- 10.20.193.93:0/825592811 >> v1:10.20.193.93:6789/0 conn(0x7f6df80b57c0 0x7f6df806fdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:36794/0 (socket says 10.20.193.93:36794) 2026-02-22T23:26:49.455 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.447+0000 7f6dfd581640 1 -- 10.20.193.93:0/825592811 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1338404296 0 0) 0x7f6df80729c0 con 0x7f6df8143750 2026-02-22T23:26:49.455 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.447+0000 7f6dfd581640 1 -- 10.20.193.93:0/825592811 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6de8003620 con 0x7f6df8143750 2026-02-22T23:26:49.455 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.447+0000 7f6dfd581640 1 -- 10.20.193.93:0/825592811 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3669172887 0 0) 0x7f6df80b5ba0 con 0x7f6df80b57c0 2026-02-22T23:26:49.455 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.447+0000 7f6dfd581640 1 -- 10.20.193.93:0/825592811 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6df80729c0 con 0x7f6df80b57c0 2026-02-22T23:26:49.455 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.447+0000 7f6dfd581640 1 -- 10.20.193.93:0/825592811 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2496449994 0 0) 0x7f6de8003620 con 0x7f6df8143750 2026-02-22T23:26:49.455 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.447+0000 7f6dfdd82640 1 -- 10.20.193.93:0/825592811 >> v1:10.20.193.155:6789/0 conn(0x7f6df8143cc0 legacy=0x7f6df8143040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-22T23:26:49.455 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.447+0000 7f6dfdd82640 1 -- 10.20.193.93:0/825592811 >> v1:10.20.193.155:6789/0 conn(0x7f6df8143cc0 legacy=0x7f6df8143040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T23:26:49.455 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.447+0000 7f6dfdd82640 1 --1- 10.20.193.93:0/825592811 >> v1:10.20.193.155:6789/0 conn(0x7f6df8143cc0 0x7f6df8143040 :-1 s=OPENED pgs=308 cs=1 l=1).handle_message read tag failed 2026-02-22T23:26:49.456 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.447+0000 7f6dfd581640 1 -- 10.20.193.93:0/825592811 >> v1:10.20.193.155:6789/0 conn(0x7f6df8143cc0 legacy=0x7f6df8143040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:49.456 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.447+0000 7f6dfdd82640 1 --1- 10.20.193.93:0/825592811 >> v1:10.20.193.155:6789/0 conn(0x7f6df8143cc0 0x7f6df8143040 :-1 s=OPENED pgs=308 cs=1 l=1).fault on lossy channel, failing 2026-02-22T23:26:49.456 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.447+0000 7f6dfd581640 1 -- 10.20.193.93:0/825592811 >> v1:10.20.193.93:6789/0 conn(0x7f6df80b57c0 legacy=0x7f6df806fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:49.456 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.447+0000 7f6dfd581640 1 -- 10.20.193.93:0/825592811 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6df806def0 con 0x7f6df8143750 2026-02-22T23:26:49.456 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.447+0000 7f6dfd581640 1 -- 10.20.193.93:0/825592811 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f6dec003220 con 0x7f6df8143750 2026-02-22T23:26:49.456 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.447+0000 7f6dfd581640 1 -- 10.20.193.93:0/825592811 <== mon.2 v1:10.20.193.93:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6dec003440 con 0x7f6df8143750 2026-02-22T23:26:49.456 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.447+0000 7f6dfd581640 1 -- 10.20.193.93:0/825592811 <== mon.2 v1:10.20.193.93:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f6dec003810 con 0x7f6df8143750 2026-02-22T23:26:49.456 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.447+0000 7f6e0080e640 1 -- 10.20.193.93:0/825592811 >> v1:10.20.193.93:6790/0 conn(0x7f6df8143750 legacy=0x7f6df814f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:49.456 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.447+0000 7f6e0080e640 1 -- 10.20.193.93:0/825592811 shutdown_connections 2026-02-22T23:26:49.456 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.447+0000 7f6e0080e640 1 -- 10.20.193.93:0/825592811 >> 10.20.193.93:0/825592811 conn(0x7f6df80b7490 msgr2=0x7f6df806d480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:49.456 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.447+0000 7f6e0080e640 1 -- 10.20.193.93:0/825592811 shutdown_connections 2026-02-22T23:26:49.456 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.447+0000 7f6e0080e640 1 -- 10.20.193.93:0/825592811 wait complete. 2026-02-22T23:26:49.457 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.448+0000 7f6e0080e640 1 Processor -- start 2026-02-22T23:26:49.457 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.448+0000 7f6e0080e640 1 -- start start 2026-02-22T23:26:49.457 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.449+0000 7f6e0080e640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6df81df410 con 0x7f6df8143750 2026-02-22T23:26:49.457 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.449+0000 7f6e0080e640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6df8147fe0 con 0x7f6df8143cc0 2026-02-22T23:26:49.457 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.449+0000 7f6e0080e640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6df80afda0 con 0x7f6df80b57c0 2026-02-22T23:26:49.457 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.449+0000 7f6dfe583640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7f6df80b57c0 0x7f6df81de5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:53456/0 (socket says 10.20.193.93:53456) 2026-02-22T23:26:49.457 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.449+0000 7f6dfe583640 1 -- 10.20.193.93:0/2961559617 learned_addr learned my addr 10.20.193.93:0/2961559617 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:26:49.457 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.449+0000 7f6de2ffd640 1 -- 10.20.193.93:0/2961559617 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3042196969 0 0) 0x7f6df81df410 con 0x7f6df8143750 2026-02-22T23:26:49.457 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.449+0000 7f6de2ffd640 1 -- 10.20.193.93:0/2961559617 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6dc8003620 con 0x7f6df8143750 2026-02-22T23:26:49.457 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.449+0000 7f6de2ffd640 1 -- 10.20.193.93:0/2961559617 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 126082733 0 0) 0x7f6df80afda0 con 0x7f6df80b57c0 2026-02-22T23:26:49.457 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.449+0000 7f6de2ffd640 1 -- 10.20.193.93:0/2961559617 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6df81df410 con 0x7f6df80b57c0 2026-02-22T23:26:49.457 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.449+0000 7f6de2ffd640 1 -- 10.20.193.93:0/2961559617 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4168078423 0 0) 0x7f6dc8003620 con 0x7f6df8143750 2026-02-22T23:26:49.458 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.449+0000 7f6de2ffd640 1 -- 10.20.193.93:0/2961559617 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6df80afda0 con 0x7f6df8143750 2026-02-22T23:26:49.458 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.449+0000 7f6de2ffd640 1 -- 10.20.193.93:0/2961559617 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 726720583 0 0) 0x7f6df81df410 con 0x7f6df80b57c0 2026-02-22T23:26:49.458 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.449+0000 7f6de2ffd640 1 -- 10.20.193.93:0/2961559617 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6dc8003620 con 0x7f6df80b57c0 2026-02-22T23:26:49.458 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.449+0000 7f6de2ffd640 1 -- 10.20.193.93:0/2961559617 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f6de4003040 con 0x7f6df8143750 2026-02-22T23:26:49.458 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.449+0000 7f6de2ffd640 1 -- 10.20.193.93:0/2961559617 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f6df0003140 con 0x7f6df80b57c0 2026-02-22T23:26:49.458 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.449+0000 7f6de2ffd640 1 -- 10.20.193.93:0/2961559617 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2270162161 0 0) 0x7f6df8147fe0 con 0x7f6df8143cc0 2026-02-22T23:26:49.458 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.449+0000 7f6de2ffd640 1 -- 10.20.193.93:0/2961559617 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6df81df410 con 0x7f6df8143cc0 2026-02-22T23:26:49.458 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.449+0000 7f6de2ffd640 1 -- 10.20.193.93:0/2961559617 <== mon.2 v1:10.20.193.93:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3687235079 0 0) 0x7f6dc8003620 con 0x7f6df80b57c0 2026-02-22T23:26:49.458 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.449+0000 7f6de2ffd640 1 -- 10.20.193.93:0/2961559617 >> v1:10.20.193.155:6789/0 conn(0x7f6df8143cc0 legacy=0x7f6df81e5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:49.458 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.449+0000 7f6de2ffd640 1 -- 10.20.193.93:0/2961559617 >> v1:10.20.193.93:6789/0 conn(0x7f6df8143750 legacy=0x7f6df81ded00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:49.458 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.449+0000 7f6de2ffd640 1 -- 10.20.193.93:0/2961559617 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6df80aff70 con 0x7f6df80b57c0 2026-02-22T23:26:49.458 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.449+0000 7f6e0080e640 1 -- 10.20.193.93:0/2961559617 --> v1:10.20.193.93:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6df80af850 con 0x7f6df80b57c0 2026-02-22T23:26:49.458 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.449+0000 7f6de2ffd640 1 -- 10.20.193.93:0/2961559617 <== mon.2 v1:10.20.193.93:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6df0003480 con 0x7f6df80b57c0 2026-02-22T23:26:49.459 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.449+0000 7f6e0080e640 1 -- 10.20.193.93:0/2961559617 --> v1:10.20.193.93:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f6df80af240 con 0x7f6df80b57c0 2026-02-22T23:26:49.459 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.449+0000 7f6de2ffd640 1 -- 10.20.193.93:0/2961559617 <== mon.2 v1:10.20.193.93:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f6df0004d30 con 0x7f6df80b57c0 2026-02-22T23:26:49.459 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.449+0000 7f6e0080e640 1 -- 10.20.193.93:0/2961559617 --> v1:10.20.193.93:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6df80769a0 con 0x7f6df80b57c0 2026-02-22T23:26:49.459 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.450+0000 7f6de2ffd640 1 -- 10.20.193.93:0/2961559617 <== mon.2 v1:10.20.193.93:6790/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7f6df0004ed0 con 0x7f6df80b57c0 2026-02-22T23:26:49.459 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.451+0000 7f6de2ffd640 1 -- 10.20.193.93:0/2961559617 <== mon.2 v1:10.20.193.93:6790/0 8 ==== osd_map(25..25 src has 1..25) ==== 4521+0+0 (unknown 3458299925 0 0) 0x7f6df00943b0 con 0x7f6df80b57c0 2026-02-22T23:26:49.459 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.453+0000 7f6de2ffd640 1 -- 10.20.193.93:0/2961559617 <== mon.2 v1:10.20.193.93:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f6df005da90 con 0x7f6df80b57c0 2026-02-22T23:26:49.536 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.534+0000 7f6e0080e640 1 -- 10.20.193.93:0/2961559617 --> v1:10.20.193.155:6800/3108481844 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6df8069810 con 0x7f6dc8078130 2026-02-22T23:26:49.539 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.537+0000 7f6de2ffd640 1 -- 10.20.193.93:0/2961559617 <== mgr.4108 v1:10.20.193.155:6800/3108481844 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+117470 (unknown 2965378022 0 711047821) 0x7f6df8069810 con 0x7f6dc8078130 2026-02-22T23:26:49.540 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:26:49.541 INFO:teuthology.orchestra.run.trial093.stderr:dumped all 2026-02-22T23:26:49.543 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.537+0000 7f6e0080e640 1 -- 10.20.193.93:0/2961559617 >> v1:10.20.193.155:6800/3108481844 conn(0x7f6dc8078130 legacy=0x7f6dc807a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:49.543 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.537+0000 7f6e0080e640 1 -- 10.20.193.93:0/2961559617 >> v1:10.20.193.93:6790/0 conn(0x7f6df80b57c0 legacy=0x7f6df81de5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:49.543 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.537+0000 7f6e0080e640 1 -- 10.20.193.93:0/2961559617 shutdown_connections 2026-02-22T23:26:49.543 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.537+0000 7f6e0080e640 1 -- 10.20.193.93:0/2961559617 >> 10.20.193.93:0/2961559617 conn(0x7f6df80b7490 msgr2=0x7f6df80742b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:49.543 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.537+0000 7f6e0080e640 1 -- 10.20.193.93:0/2961559617 shutdown_connections 2026-02-22T23:26:49.543 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.537+0000 7f6e0080e640 1 -- 10.20.193.93:0/2961559617 wait complete. 2026-02-22T23:26:49.548 INFO:teuthology.orchestra.run.trial093.stdout:{"pg_ready":true,"pg_map":{"version":108,"stamp":"2026-02-22T23:26:49.076981+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3699569979,"num_objects":913,"num_object_clones":0,"num_object_copies":1826,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":913,"num_whiteouts":0,"num_read":2596,"num_read_kb":2594,"num_write":211088,"num_write_kb":5844191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":209834,"ondisk_log_size":209834,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":9057864,"kb_used_data":6936712,"kb_used_omap":12,"kb_used_meta":2121011,"kb_avail":745916856,"statfs":{"total":773094113280,"available":763818860544,"internally_reserved":0,"allocated":7103193088,"data_stored":7097724734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":2171915832},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.000998"},"pg_stats":[{"pgid":"3.1f","version":"24'5669","reported_seq":5695,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:42.625998+0000","last_change":"2026-02-22T23:24:05.678004+0000","last_active":"2026-02-22T23:25:42.625998+0000","last_peered":"2026-02-22T23:25:42.625998+0000","last_clean":"2026-02-22T23:25:42.625998+0000","last_became_active":"2026-02-22T23:24:05.677831+0000","last_became_peered":"2026-02-22T23:24:05.677831+0000","last_unstale":"2026-02-22T23:25:42.625998+0000","last_undegraded":"2026-02-22T23:25:42.625998+0000","last_fullsized":"2026-02-22T23:25:42.625998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":5669,"log_dups_size":0,"ondisk_log_size":5669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:57:57.417265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":42,"num_read_kb":34,"num_write":5679,"num_write_kb":173190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"24'6644","reported_seq":6661,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:26:37.834590+0000","last_change":"2026-02-22T23:24:05.677818+0000","last_active":"2026-02-22T23:26:37.834590+0000","last_peered":"2026-02-22T23:26:37.834590+0000","last_clean":"2026-02-22T23:26:37.834590+0000","last_became_active":"2026-02-22T23:24:05.677553+0000","last_became_peered":"2026-02-22T23:24:05.677553+0000","last_unstale":"2026-02-22T23:26:37.834590+0000","last_undegraded":"2026-02-22T23:26:37.834590+0000","last_fullsized":"2026-02-22T23:26:37.834590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":6644,"log_dups_size":0,"ondisk_log_size":6644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:09:23.644370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123726176,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":6626,"num_write_kb":171222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"24'10596","reported_seq":10611,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:47.680368+0000","last_change":"2026-02-22T23:24:05.699174+0000","last_active":"2026-02-22T23:25:47.680368+0000","last_peered":"2026-02-22T23:25:47.680368+0000","last_clean":"2026-02-22T23:25:47.680368+0000","last_became_active":"2026-02-22T23:24:05.698937+0000","last_became_peered":"2026-02-22T23:24:05.698937+0000","last_unstale":"2026-02-22T23:25:47.680368+0000","last_undegraded":"2026-02-22T23:25:47.680368+0000","last_fullsized":"2026-02-22T23:25:47.680368+0000","mapping_epoch":21,"log_start":"23'500","ondisk_log_start":"23'500","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:22:21.223110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10572,"num_write_kb":197375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"23'4680","reported_seq":4696,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:32.780986+0000","last_change":"2026-02-22T23:24:05.699429+0000","last_active":"2026-02-22T23:25:32.780986+0000","last_peered":"2026-02-22T23:25:32.780986+0000","last_clean":"2026-02-22T23:25:32.780986+0000","last_became_active":"2026-02-22T23:24:05.699243+0000","last_became_peered":"2026-02-22T23:24:05.699243+0000","last_unstale":"2026-02-22T23:25:32.780986+0000","last_undegraded":"2026-02-22T23:25:32.780986+0000","last_fullsized":"2026-02-22T23:25:32.780986+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":4680,"log_dups_size":0,"ondisk_log_size":4680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:05:06.112990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134218240,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":4685,"num_write_kb":192906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"24'6873","reported_seq":6904,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:49.186640+0000","last_change":"2026-02-22T23:24:05.676230+0000","last_active":"2026-02-22T23:25:49.186640+0000","last_peered":"2026-02-22T23:25:49.186640+0000","last_clean":"2026-02-22T23:25:49.186640+0000","last_became_active":"2026-02-22T23:24:05.675974+0000","last_became_peered":"2026-02-22T23:24:05.675974+0000","last_unstale":"2026-02-22T23:25:49.186640+0000","last_undegraded":"2026-02-22T23:25:49.186640+0000","last_fullsized":"2026-02-22T23:25:49.186640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":6873,"log_dups_size":0,"ondisk_log_size":6873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T05:55:27.937687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113508352,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":67,"num_read_kb":50,"num_write":6857,"num_write_kb":185605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"24'6839","reported_seq":6858,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:52.900210+0000","last_change":"2026-02-22T23:24:05.698151+0000","last_active":"2026-02-22T23:25:52.900210+0000","last_peered":"2026-02-22T23:25:52.900210+0000","last_clean":"2026-02-22T23:25:52.900210+0000","last_became_active":"2026-02-22T23:24:05.697565+0000","last_became_peered":"2026-02-22T23:24:05.697565+0000","last_unstale":"2026-02-22T23:25:52.900210+0000","last_undegraded":"2026-02-22T23:25:52.900210+0000","last_fullsized":"2026-02-22T23:25:52.900210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":6839,"log_dups_size":0,"ondisk_log_size":6839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:14:40.260925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92406800,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":18,"num_read_kb":13,"num_write":6841,"num_write_kb":183644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"24'6366","reported_seq":6387,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:39.060326+0000","last_change":"2026-02-22T23:24:05.676826+0000","last_active":"2026-02-22T23:25:39.060326+0000","last_peered":"2026-02-22T23:25:39.060326+0000","last_clean":"2026-02-22T23:25:39.060326+0000","last_became_active":"2026-02-22T23:24:05.676667+0000","last_became_peered":"2026-02-22T23:24:05.676667+0000","last_unstale":"2026-02-22T23:25:39.060326+0000","last_undegraded":"2026-02-22T23:25:39.060326+0000","last_fullsized":"2026-02-22T23:25:39.060326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":6366,"log_dups_size":0,"ondisk_log_size":6366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:06:15.433587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134218240,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":6334,"num_write_kb":211582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"24'8354","reported_seq":8369,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:48.311605+0000","last_change":"2026-02-22T23:24:05.676885+0000","last_active":"2026-02-22T23:25:48.311605+0000","last_peered":"2026-02-22T23:25:48.311605+0000","last_clean":"2026-02-22T23:25:48.311605+0000","last_became_active":"2026-02-22T23:24:05.676778+0000","last_became_peered":"2026-02-22T23:24:05.676778+0000","last_unstale":"2026-02-22T23:25:48.311605+0000","last_undegraded":"2026-02-22T23:25:48.311605+0000","last_fullsized":"2026-02-22T23:25:48.311605+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":8354,"log_dups_size":0,"ondisk_log_size":8354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:45:06.374608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111804416,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8352,"num_write_kb":153987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"24'10337","reported_seq":10352,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:50.164507+0000","last_change":"2026-02-22T23:24:05.678349+0000","last_active":"2026-02-22T23:25:50.164507+0000","last_peered":"2026-02-22T23:25:50.164507+0000","last_clean":"2026-02-22T23:25:50.164507+0000","last_became_active":"2026-02-22T23:24:05.678254+0000","last_became_peered":"2026-02-22T23:24:05.678254+0000","last_unstale":"2026-02-22T23:25:50.164507+0000","last_undegraded":"2026-02-22T23:25:50.164507+0000","last_fullsized":"2026-02-22T23:25:50.164507+0000","mapping_epoch":21,"log_start":"23'300","ondisk_log_start":"23'300","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":10037,"log_dups_size":0,"ondisk_log_size":10037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:42.110328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10330,"num_write_kb":231303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"24'5812","reported_seq":5846,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:48.652826+0000","last_change":"2026-02-22T23:24:05.699492+0000","last_active":"2026-02-22T23:25:48.652826+0000","last_peered":"2026-02-22T23:25:48.652826+0000","last_clean":"2026-02-22T23:25:48.652826+0000","last_became_active":"2026-02-22T23:24:05.698976+0000","last_became_peered":"2026-02-22T23:24:05.698976+0000","last_unstale":"2026-02-22T23:25:48.652826+0000","last_undegraded":"2026-02-22T23:25:48.652826+0000","last_fullsized":"2026-02-22T23:25:48.652826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":5812,"log_dups_size":0,"ondisk_log_size":5812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:57:42.732331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142475792,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":73,"num_read_kb":117,"num_write":5831,"num_write_kb":192524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"24'10713","reported_seq":10744,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:44.477511+0000","last_change":"2026-02-22T23:24:05.698881+0000","last_active":"2026-02-22T23:25:44.477511+0000","last_peered":"2026-02-22T23:25:44.477511+0000","last_clean":"2026-02-22T23:25:44.477511+0000","last_became_active":"2026-02-22T23:24:05.698465+0000","last_became_peered":"2026-02-22T23:24:05.698465+0000","last_unstale":"2026-02-22T23:25:44.477511+0000","last_undegraded":"2026-02-22T23:25:44.477511+0000","last_fullsized":"2026-02-22T23:25:44.477511+0000","mapping_epoch":21,"log_start":"23'700","ondisk_log_start":"23'700","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":10013,"log_dups_size":0,"ondisk_log_size":10013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:26:04.313983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132097872,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":68,"num_read_kb":57,"num_write":10731,"num_write_kb":177027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"24'9608","reported_seq":9623,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:51.260144+0000","last_change":"2026-02-22T23:24:05.699000+0000","last_active":"2026-02-22T23:25:51.260144+0000","last_peered":"2026-02-22T23:25:51.260144+0000","last_clean":"2026-02-22T23:25:51.260144+0000","last_became_active":"2026-02-22T23:24:05.698446+0000","last_became_peered":"2026-02-22T23:24:05.698446+0000","last_unstale":"2026-02-22T23:25:51.260144+0000","last_undegraded":"2026-02-22T23:25:51.260144+0000","last_fullsized":"2026-02-22T23:25:51.260144+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":9608,"log_dups_size":0,"ondisk_log_size":9608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:15:51.299900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184549376,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9557,"num_write_kb":251658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:32.780292+0000","last_change":"2026-02-22T23:24:00.993186+0000","last_active":"2026-02-22T23:25:32.780292+0000","last_peered":"2026-02-22T23:25:32.780292+0000","last_clean":"2026-02-22T23:25:32.780292+0000","last_became_active":"2026-02-22T23:23:58.958814+0000","last_became_peered":"2026-02-22T23:23:58.958814+0000","last_unstale":"2026-02-22T23:25:32.780292+0000","last_undegraded":"2026-02-22T23:25:32.780292+0000","last_fullsized":"2026-02-22T23:25:32.780292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_clean_scrub_stamp":"2026-02-22T23:23:57.931636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:57:54.120290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00022938900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"24'11033","reported_seq":11080,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:52.649412+0000","last_change":"2026-02-22T23:24:05.676485+0000","last_active":"2026-02-22T23:25:52.649412+0000","last_peered":"2026-02-22T23:25:52.649412+0000","last_clean":"2026-02-22T23:25:52.649412+0000","last_became_active":"2026-02-22T23:24:05.676228+0000","last_became_peered":"2026-02-22T23:24:05.676228+0000","last_unstale":"2026-02-22T23:25:52.649412+0000","last_undegraded":"2026-02-22T23:25:52.649412+0000","last_fullsized":"2026-02-22T23:25:52.649412+0000","mapping_epoch":21,"log_start":"23'1000","ondisk_log_start":"23'1000","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":10033,"log_dups_size":0,"ondisk_log_size":10033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:43:54.254422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137103184,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":120,"num_read_kb":161,"num_write":11063,"num_write_kb":200793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:32.760424+0000","last_change":"2026-02-22T23:24:00.946318+0000","last_active":"2026-02-22T23:25:32.760424+0000","last_peered":"2026-02-22T23:25:32.760424+0000","last_clean":"2026-02-22T23:25:32.760424+0000","last_became_active":"2026-02-22T23:23:58.938089+0000","last_became_peered":"2026-02-22T23:23:58.938089+0000","last_unstale":"2026-02-22T23:25:32.760424+0000","last_undegraded":"2026-02-22T23:25:32.760424+0000","last_fullsized":"2026-02-22T23:25:32.760424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_clean_scrub_stamp":"2026-02-22T23:23:57.931636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:57:44.956161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056227399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"24'3988","reported_seq":4022,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:46.810878+0000","last_change":"2026-02-22T23:24:05.678549+0000","last_active":"2026-02-22T23:25:46.810878+0000","last_peered":"2026-02-22T23:25:46.810878+0000","last_clean":"2026-02-22T23:25:46.810878+0000","last_became_active":"2026-02-22T23:24:05.678384+0000","last_became_peered":"2026-02-22T23:24:05.678384+0000","last_unstale":"2026-02-22T23:25:46.810878+0000","last_undegraded":"2026-02-22T23:25:46.810878+0000","last_fullsized":"2026-02-22T23:25:46.810878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":3988,"log_dups_size":0,"ondisk_log_size":3988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:39:53.846864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92275200,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":3968,"num_write_kb":148167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:32.769886+0000","last_change":"2026-02-22T23:24:01.168991+0000","last_active":"2026-02-22T23:25:32.769886+0000","last_peered":"2026-02-22T23:25:32.769886+0000","last_clean":"2026-02-22T23:25:32.769886+0000","last_became_active":"2026-02-22T23:23:59.257807+0000","last_became_peered":"2026-02-22T23:23:59.257807+0000","last_unstale":"2026-02-22T23:25:32.769886+0000","last_undegraded":"2026-02-22T23:25:32.769886+0000","last_fullsized":"2026-02-22T23:25:32.769886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_clean_scrub_stamp":"2026-02-22T23:23:57.931636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:41:56.557451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000177021,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"24'7551","reported_seq":7669,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:39.834164+0000","last_change":"2026-02-22T23:24:05.721996+0000","last_active":"2026-02-22T23:25:39.834164+0000","last_peered":"2026-02-22T23:25:39.834164+0000","last_clean":"2026-02-22T23:25:39.834164+0000","last_became_active":"2026-02-22T23:24:05.721799+0000","last_became_peered":"2026-02-22T23:24:05.721799+0000","last_unstale":"2026-02-22T23:25:39.834164+0000","last_undegraded":"2026-02-22T23:25:39.834164+0000","last_fullsized":"2026-02-22T23:25:39.834164+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":7551,"log_dups_size":0,"ondisk_log_size":7551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:40.662718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121775136,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":109,"num_read_kb":107,"num_write":7564,"num_write_kb":181611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:32.760346+0000","last_change":"2026-02-22T23:24:00.946170+0000","last_active":"2026-02-22T23:25:32.760346+0000","last_peered":"2026-02-22T23:25:32.760346+0000","last_clean":"2026-02-22T23:25:32.760346+0000","last_became_active":"2026-02-22T23:23:59.237046+0000","last_became_peered":"2026-02-22T23:23:59.237046+0000","last_unstale":"2026-02-22T23:25:32.760346+0000","last_undegraded":"2026-02-22T23:25:32.760346+0000","last_fullsized":"2026-02-22T23:25:32.760346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_clean_scrub_stamp":"2026-02-22T23:23:57.931636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:24:35.277604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000445938,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"24'7209","reported_seq":7224,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:52.076213+0000","last_change":"2026-02-22T23:24:05.698370+0000","last_active":"2026-02-22T23:25:52.076213+0000","last_peered":"2026-02-22T23:25:52.076213+0000","last_clean":"2026-02-22T23:25:52.076213+0000","last_became_active":"2026-02-22T23:24:05.698126+0000","last_became_peered":"2026-02-22T23:24:05.698126+0000","last_unstale":"2026-02-22T23:25:52.076213+0000","last_undegraded":"2026-02-22T23:25:52.076213+0000","last_fullsized":"2026-02-22T23:25:52.076213+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":7209,"log_dups_size":0,"ondisk_log_size":7209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:39:47.547907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145358848,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7203,"num_write_kb":211206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"24'7464","reported_seq":7479,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:45.546228+0000","last_change":"2026-02-22T23:24:05.699144+0000","last_active":"2026-02-22T23:25:45.546228+0000","last_peered":"2026-02-22T23:25:45.546228+0000","last_clean":"2026-02-22T23:25:45.546228+0000","last_became_active":"2026-02-22T23:24:05.698528+0000","last_became_peered":"2026-02-22T23:24:05.698528+0000","last_unstale":"2026-02-22T23:25:45.546228+0000","last_undegraded":"2026-02-22T23:25:45.546228+0000","last_fullsized":"2026-02-22T23:25:45.546228+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":7464,"log_dups_size":0,"ondisk_log_size":7464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:19:20.407473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86704128,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7460,"num_write_kb":164306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:32.780951+0000","last_change":"2026-02-22T23:24:00.965007+0000","last_active":"2026-02-22T23:25:32.780951+0000","last_peered":"2026-02-22T23:25:32.780951+0000","last_clean":"2026-02-22T23:25:32.780951+0000","last_became_active":"2026-02-22T23:23:58.958840+0000","last_became_peered":"2026-02-22T23:23:58.958840+0000","last_unstale":"2026-02-22T23:25:32.780951+0000","last_undegraded":"2026-02-22T23:25:32.780951+0000","last_fullsized":"2026-02-22T23:25:32.780951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_clean_scrub_stamp":"2026-02-22T23:23:57.931636+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:58:17.312579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00022545200000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"24'5354","reported_seq":5369,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:45.397376+0000","last_change":"2026-02-22T23:24:05.721947+0000","last_active":"2026-02-22T23:25:45.397376+0000","last_peered":"2026-02-22T23:25:45.397376+0000","last_clean":"2026-02-22T23:25:45.397376+0000","last_became_active":"2026-02-22T23:24:05.721787+0000","last_became_peered":"2026-02-22T23:24:05.721787+0000","last_unstale":"2026-02-22T23:25:45.397376+0000","last_undegraded":"2026-02-22T23:25:45.397376+0000","last_fullsized":"2026-02-22T23:25:45.397376+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":5354,"log_dups_size":0,"ondisk_log_size":5354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:33:38.835812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5307,"num_write_kb":179763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:32.747217+0000","last_change":"2026-02-22T23:24:01.027919+0000","last_active":"2026-02-22T23:25:32.747217+0000","last_peered":"2026-02-22T23:25:32.747217+0000","last_clean":"2026-02-22T23:25:32.747217+0000","last_became_active":"2026-02-22T23:23:59.236692+0000","last_became_peered":"2026-02-22T23:23:59.236692+0000","last_unstale":"2026-02-22T23:25:32.747217+0000","last_undegraded":"2026-02-22T23:25:32.747217+0000","last_fullsized":"2026-02-22T23:25:32.747217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_clean_scrub_stamp":"2026-02-22T23:23:57.931636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:54:26.153298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017529500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"24'2789","reported_seq":2804,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:32.871202+0000","last_change":"2026-02-22T23:24:05.675997+0000","last_active":"2026-02-22T23:25:32.871202+0000","last_peered":"2026-02-22T23:25:32.871202+0000","last_clean":"2026-02-22T23:25:32.871202+0000","last_became_active":"2026-02-22T23:24:05.675717+0000","last_became_peered":"2026-02-22T23:24:05.675717+0000","last_unstale":"2026-02-22T23:25:32.871202+0000","last_undegraded":"2026-02-22T23:25:32.871202+0000","last_fullsized":"2026-02-22T23:25:32.871202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":2789,"log_dups_size":0,"ondisk_log_size":2789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:41:22.213828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2762,"num_write_kb":135681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:32.769625+0000","last_change":"2026-02-22T23:24:01.168995+0000","last_active":"2026-02-22T23:25:32.769625+0000","last_peered":"2026-02-22T23:25:32.769625+0000","last_clean":"2026-02-22T23:25:32.769625+0000","last_became_active":"2026-02-22T23:23:58.958969+0000","last_became_peered":"2026-02-22T23:23:58.958969+0000","last_unstale":"2026-02-22T23:25:32.769625+0000","last_undegraded":"2026-02-22T23:25:32.769625+0000","last_fullsized":"2026-02-22T23:25:32.769625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_clean_scrub_stamp":"2026-02-22T23:23:57.931636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:55:46.818746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000181831,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"24'6352","reported_seq":6391,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:37.951358+0000","last_change":"2026-02-22T23:24:05.677858+0000","last_active":"2026-02-22T23:25:37.951358+0000","last_peered":"2026-02-22T23:25:37.951358+0000","last_clean":"2026-02-22T23:25:37.951358+0000","last_became_active":"2026-02-22T23:24:05.677638+0000","last_became_peered":"2026-02-22T23:24:05.677638+0000","last_unstale":"2026-02-22T23:25:37.951358+0000","last_undegraded":"2026-02-22T23:25:37.951358+0000","last_fullsized":"2026-02-22T23:25:37.951358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":6352,"log_dups_size":0,"ondisk_log_size":6352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:07:53.203571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120522936,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":72,"num_read_kb":119,"num_write":6510,"num_write_kb":147601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:32.780969+0000","last_change":"2026-02-22T23:24:00.965025+0000","last_active":"2026-02-22T23:25:32.780969+0000","last_peered":"2026-02-22T23:25:32.780969+0000","last_clean":"2026-02-22T23:25:32.780969+0000","last_became_active":"2026-02-22T23:23:58.958830+0000","last_became_peered":"2026-02-22T23:23:58.958830+0000","last_unstale":"2026-02-22T23:25:32.780969+0000","last_undegraded":"2026-02-22T23:25:32.780969+0000","last_fullsized":"2026-02-22T23:25:32.780969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_clean_scrub_stamp":"2026-02-22T23:23:57.931636+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:18:15.715586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000241392,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'112","reported_seq":165,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:32.769702+0000","last_change":"2026-02-22T23:23:53.549952+0000","last_active":"2026-02-22T23:25:32.769702+0000","last_peered":"2026-02-22T23:25:32.769702+0000","last_clean":"2026-02-22T23:25:32.769702+0000","last_became_active":"2026-02-22T23:23:53.549316+0000","last_became_peered":"2026-02-22T23:23:53.549316+0000","last_unstale":"2026-02-22T23:25:32.769702+0000","last_undegraded":"2026-02-22T23:25:32.769702+0000","last_fullsized":"2026-02-22T23:25:32.769702+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:51.885433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:51.885433+0000","last_clean_scrub_stamp":"2026-02-22T23:23:51.885433+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:22:13.854378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"24'2960","reported_seq":2975,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:32.871146+0000","last_change":"2026-02-22T23:24:05.676579+0000","last_active":"2026-02-22T23:25:32.871146+0000","last_peered":"2026-02-22T23:25:32.871146+0000","last_clean":"2026-02-22T23:25:32.871146+0000","last_became_active":"2026-02-22T23:24:05.676326+0000","last_became_peered":"2026-02-22T23:24:05.676326+0000","last_unstale":"2026-02-22T23:25:32.871146+0000","last_undegraded":"2026-02-22T23:25:32.871146+0000","last_fullsized":"2026-02-22T23:25:32.871146+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":2960,"log_dups_size":0,"ondisk_log_size":2960,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:50:20.594097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2892,"num_write_kb":127875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"24'12253","reported_seq":12402,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:26:47.868806+0000","last_change":"2026-02-22T23:24:05.742635+0000","last_active":"2026-02-22T23:26:47.868806+0000","last_peered":"2026-02-22T23:26:47.868806+0000","last_clean":"2026-02-22T23:26:47.868806+0000","last_became_active":"2026-02-22T23:24:05.742493+0000","last_became_peered":"2026-02-22T23:24:05.742493+0000","last_unstale":"2026-02-22T23:26:47.868806+0000","last_undegraded":"2026-02-22T23:26:47.868806+0000","last_fullsized":"2026-02-22T23:26:47.868806+0000","mapping_epoch":21,"log_start":"23'2200","ondisk_log_start":"23'2200","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":10053,"log_dups_size":0,"ondisk_log_size":10053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:41:02.830405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":416,"num_read_kb":369,"num_write":8564,"num_write_kb":186891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"24'5951","reported_seq":6271,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:39.745294+0000","last_change":"2026-02-22T23:24:05.700011+0000","last_active":"2026-02-22T23:25:39.745294+0000","last_peered":"2026-02-22T23:25:39.745294+0000","last_clean":"2026-02-22T23:25:39.745294+0000","last_became_active":"2026-02-22T23:24:05.699884+0000","last_became_peered":"2026-02-22T23:24:05.699884+0000","last_unstale":"2026-02-22T23:25:39.745294+0000","last_undegraded":"2026-02-22T23:25:39.745294+0000","last_fullsized":"2026-02-22T23:25:39.745294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":5951,"log_dups_size":0,"ondisk_log_size":5951,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:03:30.857839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125960192,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":1022,"num_read_kb":916,"num_write":6136,"num_write_kb":193925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"23'3861","reported_seq":3876,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:32.745866+0000","last_change":"2026-02-22T23:24:05.677159+0000","last_active":"2026-02-22T23:25:32.745866+0000","last_peered":"2026-02-22T23:25:32.745866+0000","last_clean":"2026-02-22T23:25:32.745866+0000","last_became_active":"2026-02-22T23:24:05.676965+0000","last_became_peered":"2026-02-22T23:24:05.676965+0000","last_unstale":"2026-02-22T23:25:32.745866+0000","last_undegraded":"2026-02-22T23:25:32.745866+0000","last_fullsized":"2026-02-22T23:25:32.745866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":3861,"log_dups_size":0,"ondisk_log_size":3861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:16:14.298454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3859,"num_write_kb":148998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"24'5907","reported_seq":5922,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:44.204066+0000","last_change":"2026-02-22T23:24:05.698233+0000","last_active":"2026-02-22T23:25:44.204066+0000","last_peered":"2026-02-22T23:25:44.204066+0000","last_clean":"2026-02-22T23:25:44.204066+0000","last_became_active":"2026-02-22T23:24:05.698018+0000","last_became_peered":"2026-02-22T23:24:05.698018+0000","last_unstale":"2026-02-22T23:25:44.204066+0000","last_undegraded":"2026-02-22T23:25:44.204066+0000","last_fullsized":"2026-02-22T23:25:44.204066+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":5907,"log_dups_size":0,"ondisk_log_size":5907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:18:23.745174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131465216,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5859,"num_write_kb":186691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"24'3920","reported_seq":3951,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:32.891686+0000","last_change":"2026-02-22T23:24:05.699599+0000","last_active":"2026-02-22T23:25:32.891686+0000","last_peered":"2026-02-22T23:25:32.891686+0000","last_clean":"2026-02-22T23:25:32.891686+0000","last_became_active":"2026-02-22T23:24:05.699221+0000","last_became_peered":"2026-02-22T23:24:05.699221+0000","last_unstale":"2026-02-22T23:25:32.891686+0000","last_undegraded":"2026-02-22T23:25:32.891686+0000","last_fullsized":"2026-02-22T23:25:32.891686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":3920,"log_dups_size":0,"ondisk_log_size":3920,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:55:25.272147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":50,"num_read_kb":41,"num_write":3928,"num_write_kb":197645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"24'7433","reported_seq":7525,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:46.434450+0000","last_change":"2026-02-22T23:24:05.700990+0000","last_active":"2026-02-22T23:25:46.434450+0000","last_peered":"2026-02-22T23:25:46.434450+0000","last_clean":"2026-02-22T23:25:46.434450+0000","last_became_active":"2026-02-22T23:24:05.700853+0000","last_became_peered":"2026-02-22T23:24:05.700853+0000","last_unstale":"2026-02-22T23:25:46.434450+0000","last_undegraded":"2026-02-22T23:25:46.434450+0000","last_fullsized":"2026-02-22T23:25:46.434450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":7433,"log_dups_size":0,"ondisk_log_size":7433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:11:05.345071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100672016,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":292,"num_read_kb":283,"num_write":7694,"num_write_kb":156562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"24'6490","reported_seq":6515,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:41.558989+0000","last_change":"2026-02-22T23:24:05.700618+0000","last_active":"2026-02-22T23:25:41.558989+0000","last_peered":"2026-02-22T23:25:41.558989+0000","last_clean":"2026-02-22T23:25:41.558989+0000","last_became_active":"2026-02-22T23:24:05.700510+0000","last_became_peered":"2026-02-22T23:24:05.700510+0000","last_unstale":"2026-02-22T23:25:41.558989+0000","last_undegraded":"2026-02-22T23:25:41.558989+0000","last_fullsized":"2026-02-22T23:25:41.558989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":6490,"log_dups_size":0,"ondisk_log_size":6490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:43:14.176802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96600064,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":42,"num_read_kb":32,"num_write":6466,"num_write_kb":214278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"24'6019","reported_seq":6034,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:52.449849+0000","last_change":"2026-02-22T23:24:05.698639+0000","last_active":"2026-02-22T23:25:52.449849+0000","last_peered":"2026-02-22T23:25:52.449849+0000","last_clean":"2026-02-22T23:25:52.449849+0000","last_became_active":"2026-02-22T23:24:05.698492+0000","last_became_peered":"2026-02-22T23:24:05.698492+0000","last_unstale":"2026-02-22T23:25:52.449849+0000","last_undegraded":"2026-02-22T23:25:52.449849+0000","last_fullsized":"2026-02-22T23:25:52.449849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":6019,"log_dups_size":0,"ondisk_log_size":6019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:30:49.518883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5970,"num_write_kb":185477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"23'4568","reported_seq":4583,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:32.769647+0000","last_change":"2026-02-22T23:24:05.699724+0000","last_active":"2026-02-22T23:25:32.769647+0000","last_peered":"2026-02-22T23:25:32.769647+0000","last_clean":"2026-02-22T23:25:32.769647+0000","last_became_active":"2026-02-22T23:24:05.699288+0000","last_became_peered":"2026-02-22T23:24:05.699288+0000","last_unstale":"2026-02-22T23:25:32.769647+0000","last_undegraded":"2026-02-22T23:25:32.769647+0000","last_fullsized":"2026-02-22T23:25:32.769647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":4568,"log_dups_size":0,"ondisk_log_size":4568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:02:21.223324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4562,"num_write_kb":202117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"24'4038","reported_seq":4056,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:32.871911+0000","last_change":"2026-02-22T23:24:05.677658+0000","last_active":"2026-02-22T23:25:32.871911+0000","last_peered":"2026-02-22T23:25:32.871911+0000","last_clean":"2026-02-22T23:25:32.871911+0000","last_became_active":"2026-02-22T23:24:05.677479+0000","last_became_peered":"2026-02-22T23:24:05.677479+0000","last_unstale":"2026-02-22T23:25:32.871911+0000","last_undegraded":"2026-02-22T23:25:32.871911+0000","last_fullsized":"2026-02-22T23:25:32.871911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":4038,"log_dups_size":0,"ondisk_log_size":4038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:27:53.526953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":3995,"num_write_kb":197509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"24'6788","reported_seq":6810,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:36.965698+0000","last_change":"2026-02-22T23:24:05.700217+0000","last_active":"2026-02-22T23:25:36.965698+0000","last_peered":"2026-02-22T23:25:36.965698+0000","last_clean":"2026-02-22T23:25:36.965698+0000","last_became_active":"2026-02-22T23:24:05.700038+0000","last_became_peered":"2026-02-22T23:24:05.700038+0000","last_unstale":"2026-02-22T23:25:36.965698+0000","last_undegraded":"2026-02-22T23:25:36.965698+0000","last_fullsized":"2026-02-22T23:25:36.965698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":6788,"log_dups_size":0,"ondisk_log_size":6788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:29:59.558337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":18,"num_read_kb":140,"num_write":6784,"num_write_kb":152398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3698979592,"num_objects":909,"num_object_clones":0,"num_object_copies":1818,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":909,"num_whiteouts":0,"num_read":2510,"num_read_kb":2521,"num_write":210941,"num_write_kb":5841517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7100317696,"data_stored":7096043672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":209719,"ondisk_log_size":209719,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542181,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415080,"kb_used_data":333976,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":93956760,"statfs":{"total":96636764160,"available":96211722240,"internally_reserved":0,"allocated":341991424,"data_stored":341655248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":83032519},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542182,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1389124,"kb_used_data":1061044,"kb_used_omap":1,"kb_used_meta":328062,"kb_avail":92982716,"statfs":{"total":96636764160,"available":95214301184,"internally_reserved":0,"allocated":1086509056,"data_stored":1085677479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":335935942},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542181,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1810112,"kb_used_data":1364016,"kb_used_omap":1,"kb_used_meta":446078,"kb_avail":92561728,"statfs":{"total":96636764160,"available":94783209472,"internally_reserved":0,"allocated":1396752384,"data_stored":1395769992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":456784326},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542182,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1411444,"kb_used_data":1101348,"kb_used_omap":1,"kb_used_meta":310078,"kb_avail":92960396,"statfs":{"total":96636764160,"available":95191445504,"internally_reserved":0,"allocated":1127780352,"data_stored":1126958172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":317520328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542181,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":409328,"kb_used_data":311584,"kb_used_omap":1,"kb_used_meta":97726,"kb_avail":93962512,"statfs":{"total":96636764160,"available":96217612288,"internally_reserved":0,"allocated":319062016,"data_stored":318758564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":100071878},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542182,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1350648,"kb_used_data":1004520,"kb_used_omap":1,"kb_used_meta":346110,"kb_avail":93021192,"statfs":{"total":96636764160,"available":95253700608,"internally_reserved":0,"allocated":1028628480,"data_stored":1027798968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":354417094},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1451188,"kb_used_data":1123108,"kb_used_omap":1,"kb_used_meta":328062,"kb_avail":92920652,"statfs":{"total":96636764160,"available":95150747648,"internally_reserved":0,"allocated":1150062592,"data_stored":1149147236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":335935947},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":820940,"kb_used_data":637116,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":93550900,"statfs":{"total":96636764160,"available":95796121600,"internally_reserved":0,"allocated":652406784,"data_stored":651959075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":188217798},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1027870720,"data_stored":1027192144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":652177408,"data_stored":651881160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":318836736,"data_stored":318680668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1127555072,"data_stored":1126880276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1396527104,"data_stored":1395692096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1086279680,"data_stored":1085599564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":341766144,"data_stored":341577352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1149304832,"data_stored":1148540412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T23:26:49.552 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T23:26:49.621 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.618+0000 7fb3bdd6a640 1 Processor -- start 2026-02-22T23:26:49.621 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.618+0000 7fb3bdd6a640 1 -- start start 2026-02-22T23:26:49.622 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.618+0000 7fb3bdd6a640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3b80b1380 con 0x7fb3b80b1680 2026-02-22T23:26:49.622 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.618+0000 7fb3bdd6a640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3b80716b0 con 0x7fb3b80af500 2026-02-22T23:26:49.622 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.618+0000 7fb3bdd6a640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3b8071990 con 0x7fb3b80b0fa0 2026-02-22T23:26:49.622 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.618+0000 7fb3b77fe640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7fb3b80b0fa0 0x7fb3b8140a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:53472/0 (socket says 10.20.193.93:53472) 2026-02-22T23:26:49.622 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.618+0000 7fb3b77fe640 1 -- 10.20.193.93:0/2207361863 learned_addr learned my addr 10.20.193.93:0/2207361863 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:26:49.622 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.618+0000 7fb3b6ffd640 1 --1- 10.20.193.93:0/2207361863 >> v1:10.20.193.93:6789/0 conn(0x7fb3b80b1680 0x7fb3b80aedf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:36816/0 (socket says 10.20.193.93:36816) 2026-02-22T23:26:49.622 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.618+0000 7fb3b67fc640 1 -- 10.20.193.93:0/2207361863 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1519999259 0 0) 0x7fb3b8071990 con 0x7fb3b80b0fa0 2026-02-22T23:26:49.622 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.618+0000 7fb3b67fc640 1 -- 10.20.193.93:0/2207361863 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb39c003620 con 0x7fb3b80b0fa0 2026-02-22T23:26:49.622 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.618+0000 7fb3b67fc640 1 -- 10.20.193.93:0/2207361863 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2540929604 0 0) 0x7fb3b80b1380 con 0x7fb3b80b1680 2026-02-22T23:26:49.622 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.618+0000 7fb3b67fc640 1 -- 10.20.193.93:0/2207361863 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3b8071990 con 0x7fb3b80b1680 2026-02-22T23:26:49.622 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.619+0000 7fb3b67fc640 1 -- 10.20.193.93:0/2207361863 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2140911168 0 0) 0x7fb39c003620 con 0x7fb3b80b0fa0 2026-02-22T23:26:49.622 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.619+0000 7fb3b67fc640 1 -- 10.20.193.93:0/2207361863 >> v1:10.20.193.155:6789/0 conn(0x7fb3b80af500 legacy=0x7fb3b814f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:49.622 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.619+0000 7fb3b67fc640 1 -- 10.20.193.93:0/2207361863 >> v1:10.20.193.93:6789/0 conn(0x7fb3b80b1680 legacy=0x7fb3b80aedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:49.622 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.619+0000 7fb3b67fc640 1 -- 10.20.193.93:0/2207361863 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3b8144020 con 0x7fb3b80b0fa0 2026-02-22T23:26:49.622 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.619+0000 7fb3b67fc640 1 -- 10.20.193.93:0/2207361863 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fb3a4002ea0 con 0x7fb3b80b0fa0 2026-02-22T23:26:49.622 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.619+0000 7fb3b67fc640 1 -- 10.20.193.93:0/2207361863 <== mon.2 v1:10.20.193.93:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb3a4003040 con 0x7fb3b80b0fa0 2026-02-22T23:26:49.622 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.619+0000 7fb3b67fc640 1 -- 10.20.193.93:0/2207361863 <== mon.2 v1:10.20.193.93:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fb3a4003410 con 0x7fb3b80b0fa0 2026-02-22T23:26:49.622 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.619+0000 7fb3bdd6a640 1 -- 10.20.193.93:0/2207361863 >> v1:10.20.193.93:6790/0 conn(0x7fb3b80b0fa0 legacy=0x7fb3b8140a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:49.624 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.619+0000 7fb3bdd6a640 1 -- 10.20.193.93:0/2207361863 shutdown_connections 2026-02-22T23:26:49.624 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.619+0000 7fb3bdd6a640 1 -- 10.20.193.93:0/2207361863 >> 10.20.193.93:0/2207361863 conn(0x7fb3b80b20c0 msgr2=0x7fb3b80b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:49.624 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.619+0000 7fb3bdd6a640 1 -- 10.20.193.93:0/2207361863 shutdown_connections 2026-02-22T23:26:49.624 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.619+0000 7fb3bdd6a640 1 -- 10.20.193.93:0/2207361863 wait complete. 2026-02-22T23:26:49.624 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.619+0000 7fb3bdd6a640 1 Processor -- start 2026-02-22T23:26:49.624 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.620+0000 7fb3bdd6a640 1 -- start start 2026-02-22T23:26:49.624 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.620+0000 7fb3bdd6a640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3b8073a60 con 0x7fb3b80b1680 2026-02-22T23:26:49.624 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.620+0000 7fb3bdd6a640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3b81477a0 con 0x7fb3b8071db0 2026-02-22T23:26:49.624 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.620+0000 7fb3bdd6a640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3b81db730 con 0x7fb3b80b0fa0 2026-02-22T23:26:49.624 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.620+0000 7fb3b6ffd640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7fb3b80b1680 0x7fb3b80744d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:36818/0 (socket says 10.20.193.93:36818) 2026-02-22T23:26:49.624 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.620+0000 7fb3b6ffd640 1 -- 10.20.193.93:0/2490032762 learned_addr learned my addr 10.20.193.93:0/2490032762 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:26:49.624 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.620+0000 7fb3b77fe640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7fb3b80b0fa0 0x7fb3b81db020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:53480/0 (socket says 10.20.193.93:53480) 2026-02-22T23:26:49.624 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.620+0000 7fb393fff640 1 -- 10.20.193.93:0/2490032762 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2261774887 0 0) 0x7fb3b8073a60 con 0x7fb3b80b1680 2026-02-22T23:26:49.624 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.620+0000 7fb393fff640 1 -- 10.20.193.93:0/2490032762 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb388003620 con 0x7fb3b80b1680 2026-02-22T23:26:49.624 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.620+0000 7fb393fff640 1 -- 10.20.193.93:0/2490032762 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1041580080 0 0) 0x7fb3b81db730 con 0x7fb3b80b0fa0 2026-02-22T23:26:49.624 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.620+0000 7fb393fff640 1 -- 10.20.193.93:0/2490032762 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3b8073a60 con 0x7fb3b80b0fa0 2026-02-22T23:26:49.624 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.620+0000 7fb393fff640 1 -- 10.20.193.93:0/2490032762 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 24146857 0 0) 0x7fb388003620 con 0x7fb3b80b1680 2026-02-22T23:26:49.624 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.620+0000 7fb393fff640 1 -- 10.20.193.93:0/2490032762 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb3b81db730 con 0x7fb3b80b1680 2026-02-22T23:26:49.624 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.620+0000 7fb393fff640 1 -- 10.20.193.93:0/2490032762 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fb3a8003120 con 0x7fb3b80b1680 2026-02-22T23:26:49.624 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.620+0000 7fb393fff640 1 -- 10.20.193.93:0/2490032762 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 237149652 0 0) 0x7fb3b8073a60 con 0x7fb3b80b0fa0 2026-02-22T23:26:49.624 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.620+0000 7fb393fff640 1 -- 10.20.193.93:0/2490032762 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb388003620 con 0x7fb3b80b0fa0 2026-02-22T23:26:49.625 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.620+0000 7fb393fff640 1 -- 10.20.193.93:0/2490032762 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fb3a40031f0 con 0x7fb3b80b0fa0 2026-02-22T23:26:49.625 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.620+0000 7fb393fff640 1 -- 10.20.193.93:0/2490032762 <== mon.0 v1:10.20.193.93:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 760825834 0 0) 0x7fb3b81db730 con 0x7fb3b80b1680 2026-02-22T23:26:49.625 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.620+0000 7fb393fff640 1 -- 10.20.193.93:0/2490032762 >> v1:10.20.193.93:6790/0 conn(0x7fb3b80b0fa0 legacy=0x7fb3b81db020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:49.625 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.620+0000 7fb393fff640 1 -- 10.20.193.93:0/2490032762 >> v1:10.20.193.155:6789/0 conn(0x7fb3b8071db0 legacy=0x7fb3b81da160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:49.625 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.620+0000 7fb393fff640 1 -- 10.20.193.93:0/2490032762 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3b8074be0 con 0x7fb3b80b1680 2026-02-22T23:26:49.625 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.620+0000 7fb3bdd6a640 1 -- 10.20.193.93:0/2490032762 --> v1:10.20.193.93:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb3b8072870 con 0x7fb3b80b1680 2026-02-22T23:26:49.625 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.620+0000 7fb3bdd6a640 1 -- 10.20.193.93:0/2490032762 --> v1:10.20.193.93:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb3b81da870 con 0x7fb3b80b1680 2026-02-22T23:26:49.625 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.620+0000 7fb393fff640 1 -- 10.20.193.93:0/2490032762 <== mon.0 v1:10.20.193.93:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb3a8003460 con 0x7fb3b80b1680 2026-02-22T23:26:49.625 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.620+0000 7fb393fff640 1 -- 10.20.193.93:0/2490032762 <== mon.0 v1:10.20.193.93:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fb3a8004d30 con 0x7fb3b80b1680 2026-02-22T23:26:49.625 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.621+0000 7fb3bdd6a640 1 -- 10.20.193.93:0/2490032762 --> v1:10.20.193.93:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3b81db900 con 0x7fb3b80b1680 2026-02-22T23:26:49.625 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.621+0000 7fb393fff640 1 -- 10.20.193.93:0/2490032762 <== mon.0 v1:10.20.193.93:6789/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7fb3a801d500 con 0x7fb3b80b1680 2026-02-22T23:26:49.625 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.622+0000 7fb393fff640 1 -- 10.20.193.93:0/2490032762 <== mon.0 v1:10.20.193.93:6789/0 8 ==== osd_map(25..25 src has 1..25) ==== 4521+0+0 (unknown 3458299925 0 0) 0x7fb3a8094420 con 0x7fb3b80b1680 2026-02-22T23:26:49.627 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.624+0000 7fb393fff640 1 -- 10.20.193.93:0/2490032762 <== mon.0 v1:10.20.193.93:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7fb3a805db00 con 0x7fb3b80b1680 2026-02-22T23:26:49.708 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.705+0000 7fb3bdd6a640 1 -- 10.20.193.93:0/2490032762 --> v1:10.20.193.155:6800/3108481844 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb3b8074db0 con 0x7fb388078030 2026-02-22T23:26:49.711 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.708+0000 7fb393fff640 1 -- 10.20.193.93:0/2490032762 <== mgr.4108 v1:10.20.193.155:6800/3108481844 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+117470 (unknown 2965378022 0 711047821) 0x7fb3a4003430 con 0x7fb388078030 2026-02-22T23:26:49.712 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:26:49.713 INFO:teuthology.orchestra.run.trial093.stderr:dumped all 2026-02-22T23:26:49.715 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.708+0000 7fb3bdd6a640 1 -- 10.20.193.93:0/2490032762 >> v1:10.20.193.155:6800/3108481844 conn(0x7fb388078030 legacy=0x7fb38807a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:49.715 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.708+0000 7fb3bdd6a640 1 -- 10.20.193.93:0/2490032762 >> v1:10.20.193.93:6789/0 conn(0x7fb3b80b1680 legacy=0x7fb3b80744d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:49.715 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.708+0000 7fb3bdd6a640 1 -- 10.20.193.93:0/2490032762 shutdown_connections 2026-02-22T23:26:49.715 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.708+0000 7fb3bdd6a640 1 -- 10.20.193.93:0/2490032762 >> 10.20.193.93:0/2490032762 conn(0x7fb3b80b20c0 msgr2=0x7fb3b813f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:49.716 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.708+0000 7fb3bdd6a640 1 -- 10.20.193.93:0/2490032762 shutdown_connections 2026-02-22T23:26:49.716 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.708+0000 7fb3bdd6a640 1 -- 10.20.193.93:0/2490032762 wait complete. 2026-02-22T23:26:49.719 INFO:teuthology.orchestra.run.trial093.stdout:{"pg_ready":true,"pg_map":{"version":108,"stamp":"2026-02-22T23:26:49.076981+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3699569979,"num_objects":913,"num_object_clones":0,"num_object_copies":1826,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":913,"num_whiteouts":0,"num_read":2596,"num_read_kb":2594,"num_write":211088,"num_write_kb":5844191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":209834,"ondisk_log_size":209834,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":9057864,"kb_used_data":6936712,"kb_used_omap":12,"kb_used_meta":2121011,"kb_avail":745916856,"statfs":{"total":773094113280,"available":763818860544,"internally_reserved":0,"allocated":7103193088,"data_stored":7097724734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":2171915832},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.000998"},"pg_stats":[{"pgid":"3.1f","version":"24'5669","reported_seq":5695,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:42.625998+0000","last_change":"2026-02-22T23:24:05.678004+0000","last_active":"2026-02-22T23:25:42.625998+0000","last_peered":"2026-02-22T23:25:42.625998+0000","last_clean":"2026-02-22T23:25:42.625998+0000","last_became_active":"2026-02-22T23:24:05.677831+0000","last_became_peered":"2026-02-22T23:24:05.677831+0000","last_unstale":"2026-02-22T23:25:42.625998+0000","last_undegraded":"2026-02-22T23:25:42.625998+0000","last_fullsized":"2026-02-22T23:25:42.625998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":5669,"log_dups_size":0,"ondisk_log_size":5669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:57:57.417265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":42,"num_read_kb":34,"num_write":5679,"num_write_kb":173190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"24'6644","reported_seq":6661,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:26:37.834590+0000","last_change":"2026-02-22T23:24:05.677818+0000","last_active":"2026-02-22T23:26:37.834590+0000","last_peered":"2026-02-22T23:26:37.834590+0000","last_clean":"2026-02-22T23:26:37.834590+0000","last_became_active":"2026-02-22T23:24:05.677553+0000","last_became_peered":"2026-02-22T23:24:05.677553+0000","last_unstale":"2026-02-22T23:26:37.834590+0000","last_undegraded":"2026-02-22T23:26:37.834590+0000","last_fullsized":"2026-02-22T23:26:37.834590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":6644,"log_dups_size":0,"ondisk_log_size":6644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:09:23.644370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123726176,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":6626,"num_write_kb":171222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"24'10596","reported_seq":10611,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:47.680368+0000","last_change":"2026-02-22T23:24:05.699174+0000","last_active":"2026-02-22T23:25:47.680368+0000","last_peered":"2026-02-22T23:25:47.680368+0000","last_clean":"2026-02-22T23:25:47.680368+0000","last_became_active":"2026-02-22T23:24:05.698937+0000","last_became_peered":"2026-02-22T23:24:05.698937+0000","last_unstale":"2026-02-22T23:25:47.680368+0000","last_undegraded":"2026-02-22T23:25:47.680368+0000","last_fullsized":"2026-02-22T23:25:47.680368+0000","mapping_epoch":21,"log_start":"23'500","ondisk_log_start":"23'500","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:22:21.223110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10572,"num_write_kb":197375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"23'4680","reported_seq":4696,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:32.780986+0000","last_change":"2026-02-22T23:24:05.699429+0000","last_active":"2026-02-22T23:25:32.780986+0000","last_peered":"2026-02-22T23:25:32.780986+0000","last_clean":"2026-02-22T23:25:32.780986+0000","last_became_active":"2026-02-22T23:24:05.699243+0000","last_became_peered":"2026-02-22T23:24:05.699243+0000","last_unstale":"2026-02-22T23:25:32.780986+0000","last_undegraded":"2026-02-22T23:25:32.780986+0000","last_fullsized":"2026-02-22T23:25:32.780986+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":4680,"log_dups_size":0,"ondisk_log_size":4680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:05:06.112990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134218240,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":4685,"num_write_kb":192906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"24'6873","reported_seq":6904,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:49.186640+0000","last_change":"2026-02-22T23:24:05.676230+0000","last_active":"2026-02-22T23:25:49.186640+0000","last_peered":"2026-02-22T23:25:49.186640+0000","last_clean":"2026-02-22T23:25:49.186640+0000","last_became_active":"2026-02-22T23:24:05.675974+0000","last_became_peered":"2026-02-22T23:24:05.675974+0000","last_unstale":"2026-02-22T23:25:49.186640+0000","last_undegraded":"2026-02-22T23:25:49.186640+0000","last_fullsized":"2026-02-22T23:25:49.186640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":6873,"log_dups_size":0,"ondisk_log_size":6873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T05:55:27.937687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113508352,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":67,"num_read_kb":50,"num_write":6857,"num_write_kb":185605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"24'6839","reported_seq":6858,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:52.900210+0000","last_change":"2026-02-22T23:24:05.698151+0000","last_active":"2026-02-22T23:25:52.900210+0000","last_peered":"2026-02-22T23:25:52.900210+0000","last_clean":"2026-02-22T23:25:52.900210+0000","last_became_active":"2026-02-22T23:24:05.697565+0000","last_became_peered":"2026-02-22T23:24:05.697565+0000","last_unstale":"2026-02-22T23:25:52.900210+0000","last_undegraded":"2026-02-22T23:25:52.900210+0000","last_fullsized":"2026-02-22T23:25:52.900210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":6839,"log_dups_size":0,"ondisk_log_size":6839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:14:40.260925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92406800,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":18,"num_read_kb":13,"num_write":6841,"num_write_kb":183644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"24'6366","reported_seq":6387,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:39.060326+0000","last_change":"2026-02-22T23:24:05.676826+0000","last_active":"2026-02-22T23:25:39.060326+0000","last_peered":"2026-02-22T23:25:39.060326+0000","last_clean":"2026-02-22T23:25:39.060326+0000","last_became_active":"2026-02-22T23:24:05.676667+0000","last_became_peered":"2026-02-22T23:24:05.676667+0000","last_unstale":"2026-02-22T23:25:39.060326+0000","last_undegraded":"2026-02-22T23:25:39.060326+0000","last_fullsized":"2026-02-22T23:25:39.060326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":6366,"log_dups_size":0,"ondisk_log_size":6366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:06:15.433587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134218240,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":6334,"num_write_kb":211582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"24'8354","reported_seq":8369,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:48.311605+0000","last_change":"2026-02-22T23:24:05.676885+0000","last_active":"2026-02-22T23:25:48.311605+0000","last_peered":"2026-02-22T23:25:48.311605+0000","last_clean":"2026-02-22T23:25:48.311605+0000","last_became_active":"2026-02-22T23:24:05.676778+0000","last_became_peered":"2026-02-22T23:24:05.676778+0000","last_unstale":"2026-02-22T23:25:48.311605+0000","last_undegraded":"2026-02-22T23:25:48.311605+0000","last_fullsized":"2026-02-22T23:25:48.311605+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":8354,"log_dups_size":0,"ondisk_log_size":8354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:45:06.374608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111804416,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8352,"num_write_kb":153987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"24'10337","reported_seq":10352,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:50.164507+0000","last_change":"2026-02-22T23:24:05.678349+0000","last_active":"2026-02-22T23:25:50.164507+0000","last_peered":"2026-02-22T23:25:50.164507+0000","last_clean":"2026-02-22T23:25:50.164507+0000","last_became_active":"2026-02-22T23:24:05.678254+0000","last_became_peered":"2026-02-22T23:24:05.678254+0000","last_unstale":"2026-02-22T23:25:50.164507+0000","last_undegraded":"2026-02-22T23:25:50.164507+0000","last_fullsized":"2026-02-22T23:25:50.164507+0000","mapping_epoch":21,"log_start":"23'300","ondisk_log_start":"23'300","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":10037,"log_dups_size":0,"ondisk_log_size":10037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:42.110328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10330,"num_write_kb":231303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"24'5812","reported_seq":5846,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:48.652826+0000","last_change":"2026-02-22T23:24:05.699492+0000","last_active":"2026-02-22T23:25:48.652826+0000","last_peered":"2026-02-22T23:25:48.652826+0000","last_clean":"2026-02-22T23:25:48.652826+0000","last_became_active":"2026-02-22T23:24:05.698976+0000","last_became_peered":"2026-02-22T23:24:05.698976+0000","last_unstale":"2026-02-22T23:25:48.652826+0000","last_undegraded":"2026-02-22T23:25:48.652826+0000","last_fullsized":"2026-02-22T23:25:48.652826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":5812,"log_dups_size":0,"ondisk_log_size":5812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:57:42.732331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142475792,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":73,"num_read_kb":117,"num_write":5831,"num_write_kb":192524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"24'10713","reported_seq":10744,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:44.477511+0000","last_change":"2026-02-22T23:24:05.698881+0000","last_active":"2026-02-22T23:25:44.477511+0000","last_peered":"2026-02-22T23:25:44.477511+0000","last_clean":"2026-02-22T23:25:44.477511+0000","last_became_active":"2026-02-22T23:24:05.698465+0000","last_became_peered":"2026-02-22T23:24:05.698465+0000","last_unstale":"2026-02-22T23:25:44.477511+0000","last_undegraded":"2026-02-22T23:25:44.477511+0000","last_fullsized":"2026-02-22T23:25:44.477511+0000","mapping_epoch":21,"log_start":"23'700","ondisk_log_start":"23'700","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":10013,"log_dups_size":0,"ondisk_log_size":10013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:26:04.313983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132097872,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":68,"num_read_kb":57,"num_write":10731,"num_write_kb":177027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"24'9608","reported_seq":9623,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:51.260144+0000","last_change":"2026-02-22T23:24:05.699000+0000","last_active":"2026-02-22T23:25:51.260144+0000","last_peered":"2026-02-22T23:25:51.260144+0000","last_clean":"2026-02-22T23:25:51.260144+0000","last_became_active":"2026-02-22T23:24:05.698446+0000","last_became_peered":"2026-02-22T23:24:05.698446+0000","last_unstale":"2026-02-22T23:25:51.260144+0000","last_undegraded":"2026-02-22T23:25:51.260144+0000","last_fullsized":"2026-02-22T23:25:51.260144+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":9608,"log_dups_size":0,"ondisk_log_size":9608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:15:51.299900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184549376,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9557,"num_write_kb":251658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:32.780292+0000","last_change":"2026-02-22T23:24:00.993186+0000","last_active":"2026-02-22T23:25:32.780292+0000","last_peered":"2026-02-22T23:25:32.780292+0000","last_clean":"2026-02-22T23:25:32.780292+0000","last_became_active":"2026-02-22T23:23:58.958814+0000","last_became_peered":"2026-02-22T23:23:58.958814+0000","last_unstale":"2026-02-22T23:25:32.780292+0000","last_undegraded":"2026-02-22T23:25:32.780292+0000","last_fullsized":"2026-02-22T23:25:32.780292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_clean_scrub_stamp":"2026-02-22T23:23:57.931636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:57:54.120290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00022938900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"24'11033","reported_seq":11080,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:52.649412+0000","last_change":"2026-02-22T23:24:05.676485+0000","last_active":"2026-02-22T23:25:52.649412+0000","last_peered":"2026-02-22T23:25:52.649412+0000","last_clean":"2026-02-22T23:25:52.649412+0000","last_became_active":"2026-02-22T23:24:05.676228+0000","last_became_peered":"2026-02-22T23:24:05.676228+0000","last_unstale":"2026-02-22T23:25:52.649412+0000","last_undegraded":"2026-02-22T23:25:52.649412+0000","last_fullsized":"2026-02-22T23:25:52.649412+0000","mapping_epoch":21,"log_start":"23'1000","ondisk_log_start":"23'1000","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":10033,"log_dups_size":0,"ondisk_log_size":10033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:43:54.254422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137103184,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":120,"num_read_kb":161,"num_write":11063,"num_write_kb":200793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:32.760424+0000","last_change":"2026-02-22T23:24:00.946318+0000","last_active":"2026-02-22T23:25:32.760424+0000","last_peered":"2026-02-22T23:25:32.760424+0000","last_clean":"2026-02-22T23:25:32.760424+0000","last_became_active":"2026-02-22T23:23:58.938089+0000","last_became_peered":"2026-02-22T23:23:58.938089+0000","last_unstale":"2026-02-22T23:25:32.760424+0000","last_undegraded":"2026-02-22T23:25:32.760424+0000","last_fullsized":"2026-02-22T23:25:32.760424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_clean_scrub_stamp":"2026-02-22T23:23:57.931636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:57:44.956161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056227399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"24'3988","reported_seq":4022,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:46.810878+0000","last_change":"2026-02-22T23:24:05.678549+0000","last_active":"2026-02-22T23:25:46.810878+0000","last_peered":"2026-02-22T23:25:46.810878+0000","last_clean":"2026-02-22T23:25:46.810878+0000","last_became_active":"2026-02-22T23:24:05.678384+0000","last_became_peered":"2026-02-22T23:24:05.678384+0000","last_unstale":"2026-02-22T23:25:46.810878+0000","last_undegraded":"2026-02-22T23:25:46.810878+0000","last_fullsized":"2026-02-22T23:25:46.810878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":3988,"log_dups_size":0,"ondisk_log_size":3988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:39:53.846864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92275200,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":3968,"num_write_kb":148167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:32.769886+0000","last_change":"2026-02-22T23:24:01.168991+0000","last_active":"2026-02-22T23:25:32.769886+0000","last_peered":"2026-02-22T23:25:32.769886+0000","last_clean":"2026-02-22T23:25:32.769886+0000","last_became_active":"2026-02-22T23:23:59.257807+0000","last_became_peered":"2026-02-22T23:23:59.257807+0000","last_unstale":"2026-02-22T23:25:32.769886+0000","last_undegraded":"2026-02-22T23:25:32.769886+0000","last_fullsized":"2026-02-22T23:25:32.769886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_clean_scrub_stamp":"2026-02-22T23:23:57.931636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:41:56.557451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000177021,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"24'7551","reported_seq":7669,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:39.834164+0000","last_change":"2026-02-22T23:24:05.721996+0000","last_active":"2026-02-22T23:25:39.834164+0000","last_peered":"2026-02-22T23:25:39.834164+0000","last_clean":"2026-02-22T23:25:39.834164+0000","last_became_active":"2026-02-22T23:24:05.721799+0000","last_became_peered":"2026-02-22T23:24:05.721799+0000","last_unstale":"2026-02-22T23:25:39.834164+0000","last_undegraded":"2026-02-22T23:25:39.834164+0000","last_fullsized":"2026-02-22T23:25:39.834164+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":7551,"log_dups_size":0,"ondisk_log_size":7551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:40.662718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121775136,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":109,"num_read_kb":107,"num_write":7564,"num_write_kb":181611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:32.760346+0000","last_change":"2026-02-22T23:24:00.946170+0000","last_active":"2026-02-22T23:25:32.760346+0000","last_peered":"2026-02-22T23:25:32.760346+0000","last_clean":"2026-02-22T23:25:32.760346+0000","last_became_active":"2026-02-22T23:23:59.237046+0000","last_became_peered":"2026-02-22T23:23:59.237046+0000","last_unstale":"2026-02-22T23:25:32.760346+0000","last_undegraded":"2026-02-22T23:25:32.760346+0000","last_fullsized":"2026-02-22T23:25:32.760346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_clean_scrub_stamp":"2026-02-22T23:23:57.931636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:24:35.277604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000445938,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"24'7209","reported_seq":7224,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:52.076213+0000","last_change":"2026-02-22T23:24:05.698370+0000","last_active":"2026-02-22T23:25:52.076213+0000","last_peered":"2026-02-22T23:25:52.076213+0000","last_clean":"2026-02-22T23:25:52.076213+0000","last_became_active":"2026-02-22T23:24:05.698126+0000","last_became_peered":"2026-02-22T23:24:05.698126+0000","last_unstale":"2026-02-22T23:25:52.076213+0000","last_undegraded":"2026-02-22T23:25:52.076213+0000","last_fullsized":"2026-02-22T23:25:52.076213+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":7209,"log_dups_size":0,"ondisk_log_size":7209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:39:47.547907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145358848,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7203,"num_write_kb":211206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"24'7464","reported_seq":7479,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:45.546228+0000","last_change":"2026-02-22T23:24:05.699144+0000","last_active":"2026-02-22T23:25:45.546228+0000","last_peered":"2026-02-22T23:25:45.546228+0000","last_clean":"2026-02-22T23:25:45.546228+0000","last_became_active":"2026-02-22T23:24:05.698528+0000","last_became_peered":"2026-02-22T23:24:05.698528+0000","last_unstale":"2026-02-22T23:25:45.546228+0000","last_undegraded":"2026-02-22T23:25:45.546228+0000","last_fullsized":"2026-02-22T23:25:45.546228+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":7464,"log_dups_size":0,"ondisk_log_size":7464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:19:20.407473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86704128,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7460,"num_write_kb":164306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:32.780951+0000","last_change":"2026-02-22T23:24:00.965007+0000","last_active":"2026-02-22T23:25:32.780951+0000","last_peered":"2026-02-22T23:25:32.780951+0000","last_clean":"2026-02-22T23:25:32.780951+0000","last_became_active":"2026-02-22T23:23:58.958840+0000","last_became_peered":"2026-02-22T23:23:58.958840+0000","last_unstale":"2026-02-22T23:25:32.780951+0000","last_undegraded":"2026-02-22T23:25:32.780951+0000","last_fullsized":"2026-02-22T23:25:32.780951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_clean_scrub_stamp":"2026-02-22T23:23:57.931636+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:58:17.312579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00022545200000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"24'5354","reported_seq":5369,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:45.397376+0000","last_change":"2026-02-22T23:24:05.721947+0000","last_active":"2026-02-22T23:25:45.397376+0000","last_peered":"2026-02-22T23:25:45.397376+0000","last_clean":"2026-02-22T23:25:45.397376+0000","last_became_active":"2026-02-22T23:24:05.721787+0000","last_became_peered":"2026-02-22T23:24:05.721787+0000","last_unstale":"2026-02-22T23:25:45.397376+0000","last_undegraded":"2026-02-22T23:25:45.397376+0000","last_fullsized":"2026-02-22T23:25:45.397376+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":5354,"log_dups_size":0,"ondisk_log_size":5354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:33:38.835812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5307,"num_write_kb":179763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:32.747217+0000","last_change":"2026-02-22T23:24:01.027919+0000","last_active":"2026-02-22T23:25:32.747217+0000","last_peered":"2026-02-22T23:25:32.747217+0000","last_clean":"2026-02-22T23:25:32.747217+0000","last_became_active":"2026-02-22T23:23:59.236692+0000","last_became_peered":"2026-02-22T23:23:59.236692+0000","last_unstale":"2026-02-22T23:25:32.747217+0000","last_undegraded":"2026-02-22T23:25:32.747217+0000","last_fullsized":"2026-02-22T23:25:32.747217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_clean_scrub_stamp":"2026-02-22T23:23:57.931636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:54:26.153298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017529500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"24'2789","reported_seq":2804,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:32.871202+0000","last_change":"2026-02-22T23:24:05.675997+0000","last_active":"2026-02-22T23:25:32.871202+0000","last_peered":"2026-02-22T23:25:32.871202+0000","last_clean":"2026-02-22T23:25:32.871202+0000","last_became_active":"2026-02-22T23:24:05.675717+0000","last_became_peered":"2026-02-22T23:24:05.675717+0000","last_unstale":"2026-02-22T23:25:32.871202+0000","last_undegraded":"2026-02-22T23:25:32.871202+0000","last_fullsized":"2026-02-22T23:25:32.871202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":2789,"log_dups_size":0,"ondisk_log_size":2789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:41:22.213828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2762,"num_write_kb":135681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:32.769625+0000","last_change":"2026-02-22T23:24:01.168995+0000","last_active":"2026-02-22T23:25:32.769625+0000","last_peered":"2026-02-22T23:25:32.769625+0000","last_clean":"2026-02-22T23:25:32.769625+0000","last_became_active":"2026-02-22T23:23:58.958969+0000","last_became_peered":"2026-02-22T23:23:58.958969+0000","last_unstale":"2026-02-22T23:25:32.769625+0000","last_undegraded":"2026-02-22T23:25:32.769625+0000","last_fullsized":"2026-02-22T23:25:32.769625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_clean_scrub_stamp":"2026-02-22T23:23:57.931636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:55:46.818746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000181831,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"24'6352","reported_seq":6391,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:37.951358+0000","last_change":"2026-02-22T23:24:05.677858+0000","last_active":"2026-02-22T23:25:37.951358+0000","last_peered":"2026-02-22T23:25:37.951358+0000","last_clean":"2026-02-22T23:25:37.951358+0000","last_became_active":"2026-02-22T23:24:05.677638+0000","last_became_peered":"2026-02-22T23:24:05.677638+0000","last_unstale":"2026-02-22T23:25:37.951358+0000","last_undegraded":"2026-02-22T23:25:37.951358+0000","last_fullsized":"2026-02-22T23:25:37.951358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":6352,"log_dups_size":0,"ondisk_log_size":6352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:07:53.203571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120522936,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":72,"num_read_kb":119,"num_write":6510,"num_write_kb":147601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:32.780969+0000","last_change":"2026-02-22T23:24:00.965025+0000","last_active":"2026-02-22T23:25:32.780969+0000","last_peered":"2026-02-22T23:25:32.780969+0000","last_clean":"2026-02-22T23:25:32.780969+0000","last_became_active":"2026-02-22T23:23:58.958830+0000","last_became_peered":"2026-02-22T23:23:58.958830+0000","last_unstale":"2026-02-22T23:25:32.780969+0000","last_undegraded":"2026-02-22T23:25:32.780969+0000","last_fullsized":"2026-02-22T23:25:32.780969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_clean_scrub_stamp":"2026-02-22T23:23:57.931636+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:18:15.715586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000241392,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'112","reported_seq":165,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:32.769702+0000","last_change":"2026-02-22T23:23:53.549952+0000","last_active":"2026-02-22T23:25:32.769702+0000","last_peered":"2026-02-22T23:25:32.769702+0000","last_clean":"2026-02-22T23:25:32.769702+0000","last_became_active":"2026-02-22T23:23:53.549316+0000","last_became_peered":"2026-02-22T23:23:53.549316+0000","last_unstale":"2026-02-22T23:25:32.769702+0000","last_undegraded":"2026-02-22T23:25:32.769702+0000","last_fullsized":"2026-02-22T23:25:32.769702+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:51.885433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:51.885433+0000","last_clean_scrub_stamp":"2026-02-22T23:23:51.885433+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:22:13.854378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"24'2960","reported_seq":2975,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:32.871146+0000","last_change":"2026-02-22T23:24:05.676579+0000","last_active":"2026-02-22T23:25:32.871146+0000","last_peered":"2026-02-22T23:25:32.871146+0000","last_clean":"2026-02-22T23:25:32.871146+0000","last_became_active":"2026-02-22T23:24:05.676326+0000","last_became_peered":"2026-02-22T23:24:05.676326+0000","last_unstale":"2026-02-22T23:25:32.871146+0000","last_undegraded":"2026-02-22T23:25:32.871146+0000","last_fullsized":"2026-02-22T23:25:32.871146+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":2960,"log_dups_size":0,"ondisk_log_size":2960,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:50:20.594097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2892,"num_write_kb":127875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"24'12253","reported_seq":12402,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:26:47.868806+0000","last_change":"2026-02-22T23:24:05.742635+0000","last_active":"2026-02-22T23:26:47.868806+0000","last_peered":"2026-02-22T23:26:47.868806+0000","last_clean":"2026-02-22T23:26:47.868806+0000","last_became_active":"2026-02-22T23:24:05.742493+0000","last_became_peered":"2026-02-22T23:24:05.742493+0000","last_unstale":"2026-02-22T23:26:47.868806+0000","last_undegraded":"2026-02-22T23:26:47.868806+0000","last_fullsized":"2026-02-22T23:26:47.868806+0000","mapping_epoch":21,"log_start":"23'2200","ondisk_log_start":"23'2200","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":10053,"log_dups_size":0,"ondisk_log_size":10053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:41:02.830405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":416,"num_read_kb":369,"num_write":8564,"num_write_kb":186891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"24'5951","reported_seq":6271,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:39.745294+0000","last_change":"2026-02-22T23:24:05.700011+0000","last_active":"2026-02-22T23:25:39.745294+0000","last_peered":"2026-02-22T23:25:39.745294+0000","last_clean":"2026-02-22T23:25:39.745294+0000","last_became_active":"2026-02-22T23:24:05.699884+0000","last_became_peered":"2026-02-22T23:24:05.699884+0000","last_unstale":"2026-02-22T23:25:39.745294+0000","last_undegraded":"2026-02-22T23:25:39.745294+0000","last_fullsized":"2026-02-22T23:25:39.745294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":5951,"log_dups_size":0,"ondisk_log_size":5951,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:03:30.857839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125960192,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":1022,"num_read_kb":916,"num_write":6136,"num_write_kb":193925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"23'3861","reported_seq":3876,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:32.745866+0000","last_change":"2026-02-22T23:24:05.677159+0000","last_active":"2026-02-22T23:25:32.745866+0000","last_peered":"2026-02-22T23:25:32.745866+0000","last_clean":"2026-02-22T23:25:32.745866+0000","last_became_active":"2026-02-22T23:24:05.676965+0000","last_became_peered":"2026-02-22T23:24:05.676965+0000","last_unstale":"2026-02-22T23:25:32.745866+0000","last_undegraded":"2026-02-22T23:25:32.745866+0000","last_fullsized":"2026-02-22T23:25:32.745866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":3861,"log_dups_size":0,"ondisk_log_size":3861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:16:14.298454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3859,"num_write_kb":148998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"24'5907","reported_seq":5922,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:44.204066+0000","last_change":"2026-02-22T23:24:05.698233+0000","last_active":"2026-02-22T23:25:44.204066+0000","last_peered":"2026-02-22T23:25:44.204066+0000","last_clean":"2026-02-22T23:25:44.204066+0000","last_became_active":"2026-02-22T23:24:05.698018+0000","last_became_peered":"2026-02-22T23:24:05.698018+0000","last_unstale":"2026-02-22T23:25:44.204066+0000","last_undegraded":"2026-02-22T23:25:44.204066+0000","last_fullsized":"2026-02-22T23:25:44.204066+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":5907,"log_dups_size":0,"ondisk_log_size":5907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:18:23.745174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131465216,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5859,"num_write_kb":186691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"24'3920","reported_seq":3951,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:32.891686+0000","last_change":"2026-02-22T23:24:05.699599+0000","last_active":"2026-02-22T23:25:32.891686+0000","last_peered":"2026-02-22T23:25:32.891686+0000","last_clean":"2026-02-22T23:25:32.891686+0000","last_became_active":"2026-02-22T23:24:05.699221+0000","last_became_peered":"2026-02-22T23:24:05.699221+0000","last_unstale":"2026-02-22T23:25:32.891686+0000","last_undegraded":"2026-02-22T23:25:32.891686+0000","last_fullsized":"2026-02-22T23:25:32.891686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":3920,"log_dups_size":0,"ondisk_log_size":3920,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:55:25.272147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":50,"num_read_kb":41,"num_write":3928,"num_write_kb":197645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"24'7433","reported_seq":7525,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:46.434450+0000","last_change":"2026-02-22T23:24:05.700990+0000","last_active":"2026-02-22T23:25:46.434450+0000","last_peered":"2026-02-22T23:25:46.434450+0000","last_clean":"2026-02-22T23:25:46.434450+0000","last_became_active":"2026-02-22T23:24:05.700853+0000","last_became_peered":"2026-02-22T23:24:05.700853+0000","last_unstale":"2026-02-22T23:25:46.434450+0000","last_undegraded":"2026-02-22T23:25:46.434450+0000","last_fullsized":"2026-02-22T23:25:46.434450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":7433,"log_dups_size":0,"ondisk_log_size":7433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:11:05.345071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100672016,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":292,"num_read_kb":283,"num_write":7694,"num_write_kb":156562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"24'6490","reported_seq":6515,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:41.558989+0000","last_change":"2026-02-22T23:24:05.700618+0000","last_active":"2026-02-22T23:25:41.558989+0000","last_peered":"2026-02-22T23:25:41.558989+0000","last_clean":"2026-02-22T23:25:41.558989+0000","last_became_active":"2026-02-22T23:24:05.700510+0000","last_became_peered":"2026-02-22T23:24:05.700510+0000","last_unstale":"2026-02-22T23:25:41.558989+0000","last_undegraded":"2026-02-22T23:25:41.558989+0000","last_fullsized":"2026-02-22T23:25:41.558989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":6490,"log_dups_size":0,"ondisk_log_size":6490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:43:14.176802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96600064,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":42,"num_read_kb":32,"num_write":6466,"num_write_kb":214278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"24'6019","reported_seq":6034,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:52.449849+0000","last_change":"2026-02-22T23:24:05.698639+0000","last_active":"2026-02-22T23:25:52.449849+0000","last_peered":"2026-02-22T23:25:52.449849+0000","last_clean":"2026-02-22T23:25:52.449849+0000","last_became_active":"2026-02-22T23:24:05.698492+0000","last_became_peered":"2026-02-22T23:24:05.698492+0000","last_unstale":"2026-02-22T23:25:52.449849+0000","last_undegraded":"2026-02-22T23:25:52.449849+0000","last_fullsized":"2026-02-22T23:25:52.449849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":6019,"log_dups_size":0,"ondisk_log_size":6019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:30:49.518883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5970,"num_write_kb":185477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"23'4568","reported_seq":4583,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:32.769647+0000","last_change":"2026-02-22T23:24:05.699724+0000","last_active":"2026-02-22T23:25:32.769647+0000","last_peered":"2026-02-22T23:25:32.769647+0000","last_clean":"2026-02-22T23:25:32.769647+0000","last_became_active":"2026-02-22T23:24:05.699288+0000","last_became_peered":"2026-02-22T23:24:05.699288+0000","last_unstale":"2026-02-22T23:25:32.769647+0000","last_undegraded":"2026-02-22T23:25:32.769647+0000","last_fullsized":"2026-02-22T23:25:32.769647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":4568,"log_dups_size":0,"ondisk_log_size":4568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:02:21.223324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4562,"num_write_kb":202117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"24'4038","reported_seq":4056,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:32.871911+0000","last_change":"2026-02-22T23:24:05.677658+0000","last_active":"2026-02-22T23:25:32.871911+0000","last_peered":"2026-02-22T23:25:32.871911+0000","last_clean":"2026-02-22T23:25:32.871911+0000","last_became_active":"2026-02-22T23:24:05.677479+0000","last_became_peered":"2026-02-22T23:24:05.677479+0000","last_unstale":"2026-02-22T23:25:32.871911+0000","last_undegraded":"2026-02-22T23:25:32.871911+0000","last_fullsized":"2026-02-22T23:25:32.871911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":4038,"log_dups_size":0,"ondisk_log_size":4038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:27:53.526953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":3995,"num_write_kb":197509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"24'6788","reported_seq":6810,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:36.965698+0000","last_change":"2026-02-22T23:24:05.700217+0000","last_active":"2026-02-22T23:25:36.965698+0000","last_peered":"2026-02-22T23:25:36.965698+0000","last_clean":"2026-02-22T23:25:36.965698+0000","last_became_active":"2026-02-22T23:24:05.700038+0000","last_became_peered":"2026-02-22T23:24:05.700038+0000","last_unstale":"2026-02-22T23:25:36.965698+0000","last_undegraded":"2026-02-22T23:25:36.965698+0000","last_fullsized":"2026-02-22T23:25:36.965698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":6788,"log_dups_size":0,"ondisk_log_size":6788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:29:59.558337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":18,"num_read_kb":140,"num_write":6784,"num_write_kb":152398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3698979592,"num_objects":909,"num_object_clones":0,"num_object_copies":1818,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":909,"num_whiteouts":0,"num_read":2510,"num_read_kb":2521,"num_write":210941,"num_write_kb":5841517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7100317696,"data_stored":7096043672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":209719,"ondisk_log_size":209719,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542181,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415080,"kb_used_data":333976,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":93956760,"statfs":{"total":96636764160,"available":96211722240,"internally_reserved":0,"allocated":341991424,"data_stored":341655248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":83032519},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542182,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1389124,"kb_used_data":1061044,"kb_used_omap":1,"kb_used_meta":328062,"kb_avail":92982716,"statfs":{"total":96636764160,"available":95214301184,"internally_reserved":0,"allocated":1086509056,"data_stored":1085677479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":335935942},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542181,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1810112,"kb_used_data":1364016,"kb_used_omap":1,"kb_used_meta":446078,"kb_avail":92561728,"statfs":{"total":96636764160,"available":94783209472,"internally_reserved":0,"allocated":1396752384,"data_stored":1395769992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":456784326},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542182,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1411444,"kb_used_data":1101348,"kb_used_omap":1,"kb_used_meta":310078,"kb_avail":92960396,"statfs":{"total":96636764160,"available":95191445504,"internally_reserved":0,"allocated":1127780352,"data_stored":1126958172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":317520328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542181,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":409328,"kb_used_data":311584,"kb_used_omap":1,"kb_used_meta":97726,"kb_avail":93962512,"statfs":{"total":96636764160,"available":96217612288,"internally_reserved":0,"allocated":319062016,"data_stored":318758564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":100071878},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542182,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1350648,"kb_used_data":1004520,"kb_used_omap":1,"kb_used_meta":346110,"kb_avail":93021192,"statfs":{"total":96636764160,"available":95253700608,"internally_reserved":0,"allocated":1028628480,"data_stored":1027798968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":354417094},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1451188,"kb_used_data":1123108,"kb_used_omap":1,"kb_used_meta":328062,"kb_avail":92920652,"statfs":{"total":96636764160,"available":95150747648,"internally_reserved":0,"allocated":1150062592,"data_stored":1149147236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":335935947},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":820940,"kb_used_data":637116,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":93550900,"statfs":{"total":96636764160,"available":95796121600,"internally_reserved":0,"allocated":652406784,"data_stored":651959075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":188217798},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1027870720,"data_stored":1027192144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":652177408,"data_stored":651881160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":318836736,"data_stored":318680668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1127555072,"data_stored":1126880276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1396527104,"data_stored":1395692096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1086279680,"data_stored":1085599564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":341766144,"data_stored":341577352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1149304832,"data_stored":1148540412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T23:26:49.724 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-22T23:26:49.725 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T23:26:49.797 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.789+0000 7f27e992c640 1 Processor -- start 2026-02-22T23:26:49.797 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.789+0000 7f27e992c640 1 -- start start 2026-02-22T23:26:49.798 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.790+0000 7f27e992c640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27e40b1380 con 0x7f27e40af500 2026-02-22T23:26:49.798 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.790+0000 7f27e992c640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27e40716b0 con 0x7f27e40b0fa0 2026-02-22T23:26:49.798 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.790+0000 7f27e992c640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27e4071990 con 0x7f27e40b1680 2026-02-22T23:26:49.798 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.790+0000 7f27e27fc640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7f27e40b1680 0x7f27e40aedf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:53486/0 (socket says 10.20.193.93:53486) 2026-02-22T23:26:49.798 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.790+0000 7f27e27fc640 1 -- 10.20.193.93:0/2886376276 learned_addr learned my addr 10.20.193.93:0/2886376276 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:26:49.798 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.790+0000 7f27e37fe640 1 --1- 10.20.193.93:0/2886376276 >> v1:10.20.193.93:6789/0 conn(0x7f27e40af500 0x7f27e414f290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:36830/0 (socket says 10.20.193.93:36830) 2026-02-22T23:26:49.798 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.790+0000 7f27e1ffb640 1 -- 10.20.193.93:0/2886376276 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1063559228 0 0) 0x7f27e4071990 con 0x7f27e40b1680 2026-02-22T23:26:49.799 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.790+0000 7f27e1ffb640 1 -- 10.20.193.93:0/2886376276 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27d0003620 con 0x7f27e40b1680 2026-02-22T23:26:49.799 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.790+0000 7f27e1ffb640 1 -- 10.20.193.93:0/2886376276 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1633481478 0 0) 0x7f27e40b1380 con 0x7f27e40af500 2026-02-22T23:26:49.799 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.790+0000 7f27e1ffb640 1 -- 10.20.193.93:0/2886376276 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27e4071990 con 0x7f27e40af500 2026-02-22T23:26:49.799 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.790+0000 7f27e1ffb640 1 -- 10.20.193.93:0/2886376276 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2522598537 0 0) 0x7f27d0003620 con 0x7f27e40b1680 2026-02-22T23:26:49.799 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.790+0000 7f27e1ffb640 1 -- 10.20.193.93:0/2886376276 >> v1:10.20.193.155:6789/0 conn(0x7f27e40b0fa0 legacy=0x7f27e4140a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:49.799 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.790+0000 7f27e1ffb640 1 -- 10.20.193.93:0/2886376276 >> v1:10.20.193.93:6789/0 conn(0x7f27e40af500 legacy=0x7f27e414f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:49.799 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.790+0000 7f27e1ffb640 1 -- 10.20.193.93:0/2886376276 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27e4144020 con 0x7f27e40b1680 2026-02-22T23:26:49.799 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.790+0000 7f27e1ffb640 1 -- 10.20.193.93:0/2886376276 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f27cc002ea0 con 0x7f27e40b1680 2026-02-22T23:26:49.799 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.790+0000 7f27e1ffb640 1 -- 10.20.193.93:0/2886376276 <== mon.2 v1:10.20.193.93:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f27cc0030c0 con 0x7f27e40b1680 2026-02-22T23:26:49.799 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.790+0000 7f27e1ffb640 1 -- 10.20.193.93:0/2886376276 <== mon.2 v1:10.20.193.93:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f27cc003490 con 0x7f27e40b1680 2026-02-22T23:26:49.799 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.791+0000 7f27e992c640 1 -- 10.20.193.93:0/2886376276 >> v1:10.20.193.93:6790/0 conn(0x7f27e40b1680 legacy=0x7f27e40aedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:49.800 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.791+0000 7f27e992c640 1 -- 10.20.193.93:0/2886376276 shutdown_connections 2026-02-22T23:26:49.800 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.791+0000 7f27e992c640 1 -- 10.20.193.93:0/2886376276 >> 10.20.193.93:0/2886376276 conn(0x7f27e40b20c0 msgr2=0x7f27e40b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:49.800 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.791+0000 7f27e992c640 1 -- 10.20.193.93:0/2886376276 shutdown_connections 2026-02-22T23:26:49.800 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.791+0000 7f27e992c640 1 -- 10.20.193.93:0/2886376276 wait complete. 2026-02-22T23:26:49.800 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.791+0000 7f27e992c640 1 Processor -- start 2026-02-22T23:26:49.800 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.791+0000 7f27e992c640 1 -- start start 2026-02-22T23:26:49.800 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.792+0000 7f27e992c640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27e4146600 con 0x7f27e40b1680 2026-02-22T23:26:49.800 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.792+0000 7f27e992c640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27e4145240 con 0x7f27e40b0fa0 2026-02-22T23:26:49.800 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.792+0000 7f27e992c640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27e41db970 con 0x7f27e4074950 2026-02-22T23:26:49.800 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.792+0000 7f27e27fc640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7f27e40b1680 0x7f27e4147070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:36842/0 (socket says 10.20.193.93:36842) 2026-02-22T23:26:49.800 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.792+0000 7f27e27fc640 1 -- 10.20.193.93:0/911833681 learned_addr learned my addr 10.20.193.93:0/911833681 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:26:49.800 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.792+0000 7f27bbfff640 1 -- 10.20.193.93:0/911833681 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2746063878 0 0) 0x7f27e4146600 con 0x7f27e40b1680 2026-02-22T23:26:49.801 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.792+0000 7f27bbfff640 1 -- 10.20.193.93:0/911833681 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27b4003620 con 0x7f27e40b1680 2026-02-22T23:26:49.801 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.792+0000 7f27bbfff640 1 -- 10.20.193.93:0/911833681 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2416443013 0 0) 0x7f27e41db970 con 0x7f27e4074950 2026-02-22T23:26:49.801 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.792+0000 7f27bbfff640 1 -- 10.20.193.93:0/911833681 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27e4146600 con 0x7f27e4074950 2026-02-22T23:26:49.801 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.792+0000 7f27bbfff640 1 -- 10.20.193.93:0/911833681 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 166954317 0 0) 0x7f27b4003620 con 0x7f27e40b1680 2026-02-22T23:26:49.801 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.792+0000 7f27bbfff640 1 -- 10.20.193.93:0/911833681 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f27e41db970 con 0x7f27e40b1680 2026-02-22T23:26:49.801 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.792+0000 7f27bbfff640 1 -- 10.20.193.93:0/911833681 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f27cc003450 con 0x7f27e40b1680 2026-02-22T23:26:49.801 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.792+0000 7f27bbfff640 1 -- 10.20.193.93:0/911833681 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 352619078 0 0) 0x7f27e4146600 con 0x7f27e4074950 2026-02-22T23:26:49.801 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.792+0000 7f27bbfff640 1 -- 10.20.193.93:0/911833681 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f27b4003620 con 0x7f27e4074950 2026-02-22T23:26:49.801 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.792+0000 7f27bbfff640 1 -- 10.20.193.93:0/911833681 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f27d40034c0 con 0x7f27e4074950 2026-02-22T23:26:49.801 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.792+0000 7f27bbfff640 1 -- 10.20.193.93:0/911833681 <== mon.0 v1:10.20.193.93:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 269865738 0 0) 0x7f27e41db970 con 0x7f27e40b1680 2026-02-22T23:26:49.801 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.792+0000 7f27bbfff640 1 -- 10.20.193.93:0/911833681 >> v1:10.20.193.93:6790/0 conn(0x7f27e4074950 legacy=0x7f27e4147780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:49.801 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.792+0000 7f27bbfff640 1 -- 10.20.193.93:0/911833681 >> v1:10.20.193.155:6789/0 conn(0x7f27e40b0fa0 legacy=0x7f27e41db260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:49.802 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.792+0000 7f27bbfff640 1 -- 10.20.193.93:0/911833681 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27e41dbb40 con 0x7f27e40b1680 2026-02-22T23:26:49.802 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.792+0000 7f27e992c640 1 -- 10.20.193.93:0/911833681 --> v1:10.20.193.93:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f27e4074400 con 0x7f27e40b1680 2026-02-22T23:26:49.802 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.792+0000 7f27e992c640 1 -- 10.20.193.93:0/911833681 --> v1:10.20.193.93:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f27e41dace0 con 0x7f27e40b1680 2026-02-22T23:26:49.802 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.792+0000 7f27bbfff640 1 -- 10.20.193.93:0/911833681 <== mon.0 v1:10.20.193.93:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f27cc003020 con 0x7f27e40b1680 2026-02-22T23:26:49.802 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.792+0000 7f27bbfff640 1 -- 10.20.193.93:0/911833681 <== mon.0 v1:10.20.193.93:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f27cc004d30 con 0x7f27e40b1680 2026-02-22T23:26:49.802 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.793+0000 7f27e992c640 1 -- 10.20.193.93:0/911833681 --> v1:10.20.193.93:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27e40b0b10 con 0x7f27e40b1680 2026-02-22T23:26:49.802 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.793+0000 7f27bbfff640 1 -- 10.20.193.93:0/911833681 <== mon.0 v1:10.20.193.93:6789/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7f27cc004ed0 con 0x7f27e40b1680 2026-02-22T23:26:49.802 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.794+0000 7f27bbfff640 1 -- 10.20.193.93:0/911833681 <== mon.0 v1:10.20.193.93:6789/0 8 ==== osd_map(25..25 src has 1..25) ==== 4521+0+0 (unknown 3458299925 0 0) 0x7f27cc0943f0 con 0x7f27e40b1680 2026-02-22T23:26:49.803 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.795+0000 7f27bbfff640 1 -- 10.20.193.93:0/911833681 <== mon.0 v1:10.20.193.93:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f27cc05da70 con 0x7f27e40b1680 2026-02-22T23:26:49.880 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.877+0000 7f27e992c640 1 -- 10.20.193.93:0/911833681 --> v1:10.20.193.155:6800/3108481844 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f27e4144df0 con 0x7f27b4078040 2026-02-22T23:26:49.883 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.880+0000 7f27bbfff640 1 -- 10.20.193.93:0/911833681 <== mgr.4108 v1:10.20.193.155:6800/3108481844 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+117470 (unknown 2965378022 0 711047821) 0x7f27e4144df0 con 0x7f27b4078040 2026-02-22T23:26:49.884 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:26:49.885 INFO:teuthology.orchestra.run.trial093.stderr:dumped all 2026-02-22T23:26:49.886 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.881+0000 7f27e992c640 1 -- 10.20.193.93:0/911833681 >> v1:10.20.193.155:6800/3108481844 conn(0x7f27b4078040 legacy=0x7f27b407a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:49.886 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.881+0000 7f27e992c640 1 -- 10.20.193.93:0/911833681 >> v1:10.20.193.93:6789/0 conn(0x7f27e40b1680 legacy=0x7f27e4147070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:49.886 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.881+0000 7f27e992c640 1 -- 10.20.193.93:0/911833681 shutdown_connections 2026-02-22T23:26:49.886 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.881+0000 7f27e992c640 1 -- 10.20.193.93:0/911833681 >> 10.20.193.93:0/911833681 conn(0x7f27e40b20c0 msgr2=0x7f27e40b24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:49.886 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.881+0000 7f27e992c640 1 -- 10.20.193.93:0/911833681 shutdown_connections 2026-02-22T23:26:49.886 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.881+0000 7f27e992c640 1 -- 10.20.193.93:0/911833681 wait complete. 2026-02-22T23:26:49.892 INFO:teuthology.orchestra.run.trial093.stdout:{"pg_ready":true,"pg_map":{"version":108,"stamp":"2026-02-22T23:26:49.076981+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3699569979,"num_objects":913,"num_object_clones":0,"num_object_copies":1826,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":913,"num_whiteouts":0,"num_read":2596,"num_read_kb":2594,"num_write":211088,"num_write_kb":5844191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":209834,"ondisk_log_size":209834,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":9057864,"kb_used_data":6936712,"kb_used_omap":12,"kb_used_meta":2121011,"kb_avail":745916856,"statfs":{"total":773094113280,"available":763818860544,"internally_reserved":0,"allocated":7103193088,"data_stored":7097724734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":2171915832},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.000998"},"pg_stats":[{"pgid":"3.1f","version":"24'5669","reported_seq":5695,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:42.625998+0000","last_change":"2026-02-22T23:24:05.678004+0000","last_active":"2026-02-22T23:25:42.625998+0000","last_peered":"2026-02-22T23:25:42.625998+0000","last_clean":"2026-02-22T23:25:42.625998+0000","last_became_active":"2026-02-22T23:24:05.677831+0000","last_became_peered":"2026-02-22T23:24:05.677831+0000","last_unstale":"2026-02-22T23:25:42.625998+0000","last_undegraded":"2026-02-22T23:25:42.625998+0000","last_fullsized":"2026-02-22T23:25:42.625998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":5669,"log_dups_size":0,"ondisk_log_size":5669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:57:57.417265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":42,"num_read_kb":34,"num_write":5679,"num_write_kb":173190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"24'6644","reported_seq":6661,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:26:37.834590+0000","last_change":"2026-02-22T23:24:05.677818+0000","last_active":"2026-02-22T23:26:37.834590+0000","last_peered":"2026-02-22T23:26:37.834590+0000","last_clean":"2026-02-22T23:26:37.834590+0000","last_became_active":"2026-02-22T23:24:05.677553+0000","last_became_peered":"2026-02-22T23:24:05.677553+0000","last_unstale":"2026-02-22T23:26:37.834590+0000","last_undegraded":"2026-02-22T23:26:37.834590+0000","last_fullsized":"2026-02-22T23:26:37.834590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":6644,"log_dups_size":0,"ondisk_log_size":6644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:09:23.644370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123726176,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":6626,"num_write_kb":171222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"24'10596","reported_seq":10611,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:47.680368+0000","last_change":"2026-02-22T23:24:05.699174+0000","last_active":"2026-02-22T23:25:47.680368+0000","last_peered":"2026-02-22T23:25:47.680368+0000","last_clean":"2026-02-22T23:25:47.680368+0000","last_became_active":"2026-02-22T23:24:05.698937+0000","last_became_peered":"2026-02-22T23:24:05.698937+0000","last_unstale":"2026-02-22T23:25:47.680368+0000","last_undegraded":"2026-02-22T23:25:47.680368+0000","last_fullsized":"2026-02-22T23:25:47.680368+0000","mapping_epoch":21,"log_start":"23'500","ondisk_log_start":"23'500","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:22:21.223110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10572,"num_write_kb":197375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"23'4680","reported_seq":4696,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:32.780986+0000","last_change":"2026-02-22T23:24:05.699429+0000","last_active":"2026-02-22T23:25:32.780986+0000","last_peered":"2026-02-22T23:25:32.780986+0000","last_clean":"2026-02-22T23:25:32.780986+0000","last_became_active":"2026-02-22T23:24:05.699243+0000","last_became_peered":"2026-02-22T23:24:05.699243+0000","last_unstale":"2026-02-22T23:25:32.780986+0000","last_undegraded":"2026-02-22T23:25:32.780986+0000","last_fullsized":"2026-02-22T23:25:32.780986+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":4680,"log_dups_size":0,"ondisk_log_size":4680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:05:06.112990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134218240,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":4685,"num_write_kb":192906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"24'6873","reported_seq":6904,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:49.186640+0000","last_change":"2026-02-22T23:24:05.676230+0000","last_active":"2026-02-22T23:25:49.186640+0000","last_peered":"2026-02-22T23:25:49.186640+0000","last_clean":"2026-02-22T23:25:49.186640+0000","last_became_active":"2026-02-22T23:24:05.675974+0000","last_became_peered":"2026-02-22T23:24:05.675974+0000","last_unstale":"2026-02-22T23:25:49.186640+0000","last_undegraded":"2026-02-22T23:25:49.186640+0000","last_fullsized":"2026-02-22T23:25:49.186640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":6873,"log_dups_size":0,"ondisk_log_size":6873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T05:55:27.937687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113508352,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":67,"num_read_kb":50,"num_write":6857,"num_write_kb":185605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"24'6839","reported_seq":6858,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:52.900210+0000","last_change":"2026-02-22T23:24:05.698151+0000","last_active":"2026-02-22T23:25:52.900210+0000","last_peered":"2026-02-22T23:25:52.900210+0000","last_clean":"2026-02-22T23:25:52.900210+0000","last_became_active":"2026-02-22T23:24:05.697565+0000","last_became_peered":"2026-02-22T23:24:05.697565+0000","last_unstale":"2026-02-22T23:25:52.900210+0000","last_undegraded":"2026-02-22T23:25:52.900210+0000","last_fullsized":"2026-02-22T23:25:52.900210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":6839,"log_dups_size":0,"ondisk_log_size":6839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:14:40.260925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92406800,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":18,"num_read_kb":13,"num_write":6841,"num_write_kb":183644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"24'6366","reported_seq":6387,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:39.060326+0000","last_change":"2026-02-22T23:24:05.676826+0000","last_active":"2026-02-22T23:25:39.060326+0000","last_peered":"2026-02-22T23:25:39.060326+0000","last_clean":"2026-02-22T23:25:39.060326+0000","last_became_active":"2026-02-22T23:24:05.676667+0000","last_became_peered":"2026-02-22T23:24:05.676667+0000","last_unstale":"2026-02-22T23:25:39.060326+0000","last_undegraded":"2026-02-22T23:25:39.060326+0000","last_fullsized":"2026-02-22T23:25:39.060326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":6366,"log_dups_size":0,"ondisk_log_size":6366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:06:15.433587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134218240,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":6334,"num_write_kb":211582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"24'8354","reported_seq":8369,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:48.311605+0000","last_change":"2026-02-22T23:24:05.676885+0000","last_active":"2026-02-22T23:25:48.311605+0000","last_peered":"2026-02-22T23:25:48.311605+0000","last_clean":"2026-02-22T23:25:48.311605+0000","last_became_active":"2026-02-22T23:24:05.676778+0000","last_became_peered":"2026-02-22T23:24:05.676778+0000","last_unstale":"2026-02-22T23:25:48.311605+0000","last_undegraded":"2026-02-22T23:25:48.311605+0000","last_fullsized":"2026-02-22T23:25:48.311605+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":8354,"log_dups_size":0,"ondisk_log_size":8354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:45:06.374608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111804416,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8352,"num_write_kb":153987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"24'10337","reported_seq":10352,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:50.164507+0000","last_change":"2026-02-22T23:24:05.678349+0000","last_active":"2026-02-22T23:25:50.164507+0000","last_peered":"2026-02-22T23:25:50.164507+0000","last_clean":"2026-02-22T23:25:50.164507+0000","last_became_active":"2026-02-22T23:24:05.678254+0000","last_became_peered":"2026-02-22T23:24:05.678254+0000","last_unstale":"2026-02-22T23:25:50.164507+0000","last_undegraded":"2026-02-22T23:25:50.164507+0000","last_fullsized":"2026-02-22T23:25:50.164507+0000","mapping_epoch":21,"log_start":"23'300","ondisk_log_start":"23'300","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":10037,"log_dups_size":0,"ondisk_log_size":10037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:42.110328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10330,"num_write_kb":231303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"24'5812","reported_seq":5846,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:48.652826+0000","last_change":"2026-02-22T23:24:05.699492+0000","last_active":"2026-02-22T23:25:48.652826+0000","last_peered":"2026-02-22T23:25:48.652826+0000","last_clean":"2026-02-22T23:25:48.652826+0000","last_became_active":"2026-02-22T23:24:05.698976+0000","last_became_peered":"2026-02-22T23:24:05.698976+0000","last_unstale":"2026-02-22T23:25:48.652826+0000","last_undegraded":"2026-02-22T23:25:48.652826+0000","last_fullsized":"2026-02-22T23:25:48.652826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":5812,"log_dups_size":0,"ondisk_log_size":5812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:57:42.732331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142475792,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":73,"num_read_kb":117,"num_write":5831,"num_write_kb":192524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"24'10713","reported_seq":10744,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:44.477511+0000","last_change":"2026-02-22T23:24:05.698881+0000","last_active":"2026-02-22T23:25:44.477511+0000","last_peered":"2026-02-22T23:25:44.477511+0000","last_clean":"2026-02-22T23:25:44.477511+0000","last_became_active":"2026-02-22T23:24:05.698465+0000","last_became_peered":"2026-02-22T23:24:05.698465+0000","last_unstale":"2026-02-22T23:25:44.477511+0000","last_undegraded":"2026-02-22T23:25:44.477511+0000","last_fullsized":"2026-02-22T23:25:44.477511+0000","mapping_epoch":21,"log_start":"23'700","ondisk_log_start":"23'700","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":10013,"log_dups_size":0,"ondisk_log_size":10013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:26:04.313983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132097872,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":68,"num_read_kb":57,"num_write":10731,"num_write_kb":177027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"24'9608","reported_seq":9623,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:51.260144+0000","last_change":"2026-02-22T23:24:05.699000+0000","last_active":"2026-02-22T23:25:51.260144+0000","last_peered":"2026-02-22T23:25:51.260144+0000","last_clean":"2026-02-22T23:25:51.260144+0000","last_became_active":"2026-02-22T23:24:05.698446+0000","last_became_peered":"2026-02-22T23:24:05.698446+0000","last_unstale":"2026-02-22T23:25:51.260144+0000","last_undegraded":"2026-02-22T23:25:51.260144+0000","last_fullsized":"2026-02-22T23:25:51.260144+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":9608,"log_dups_size":0,"ondisk_log_size":9608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:15:51.299900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184549376,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9557,"num_write_kb":251658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:32.780292+0000","last_change":"2026-02-22T23:24:00.993186+0000","last_active":"2026-02-22T23:25:32.780292+0000","last_peered":"2026-02-22T23:25:32.780292+0000","last_clean":"2026-02-22T23:25:32.780292+0000","last_became_active":"2026-02-22T23:23:58.958814+0000","last_became_peered":"2026-02-22T23:23:58.958814+0000","last_unstale":"2026-02-22T23:25:32.780292+0000","last_undegraded":"2026-02-22T23:25:32.780292+0000","last_fullsized":"2026-02-22T23:25:32.780292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_clean_scrub_stamp":"2026-02-22T23:23:57.931636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:57:54.120290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00022938900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"24'11033","reported_seq":11080,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:52.649412+0000","last_change":"2026-02-22T23:24:05.676485+0000","last_active":"2026-02-22T23:25:52.649412+0000","last_peered":"2026-02-22T23:25:52.649412+0000","last_clean":"2026-02-22T23:25:52.649412+0000","last_became_active":"2026-02-22T23:24:05.676228+0000","last_became_peered":"2026-02-22T23:24:05.676228+0000","last_unstale":"2026-02-22T23:25:52.649412+0000","last_undegraded":"2026-02-22T23:25:52.649412+0000","last_fullsized":"2026-02-22T23:25:52.649412+0000","mapping_epoch":21,"log_start":"23'1000","ondisk_log_start":"23'1000","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":10033,"log_dups_size":0,"ondisk_log_size":10033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:43:54.254422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137103184,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":120,"num_read_kb":161,"num_write":11063,"num_write_kb":200793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:32.760424+0000","last_change":"2026-02-22T23:24:00.946318+0000","last_active":"2026-02-22T23:25:32.760424+0000","last_peered":"2026-02-22T23:25:32.760424+0000","last_clean":"2026-02-22T23:25:32.760424+0000","last_became_active":"2026-02-22T23:23:58.938089+0000","last_became_peered":"2026-02-22T23:23:58.938089+0000","last_unstale":"2026-02-22T23:25:32.760424+0000","last_undegraded":"2026-02-22T23:25:32.760424+0000","last_fullsized":"2026-02-22T23:25:32.760424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_clean_scrub_stamp":"2026-02-22T23:23:57.931636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:57:44.956161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056227399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"24'3988","reported_seq":4022,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:46.810878+0000","last_change":"2026-02-22T23:24:05.678549+0000","last_active":"2026-02-22T23:25:46.810878+0000","last_peered":"2026-02-22T23:25:46.810878+0000","last_clean":"2026-02-22T23:25:46.810878+0000","last_became_active":"2026-02-22T23:24:05.678384+0000","last_became_peered":"2026-02-22T23:24:05.678384+0000","last_unstale":"2026-02-22T23:25:46.810878+0000","last_undegraded":"2026-02-22T23:25:46.810878+0000","last_fullsized":"2026-02-22T23:25:46.810878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":3988,"log_dups_size":0,"ondisk_log_size":3988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:39:53.846864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92275200,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":3968,"num_write_kb":148167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:32.769886+0000","last_change":"2026-02-22T23:24:01.168991+0000","last_active":"2026-02-22T23:25:32.769886+0000","last_peered":"2026-02-22T23:25:32.769886+0000","last_clean":"2026-02-22T23:25:32.769886+0000","last_became_active":"2026-02-22T23:23:59.257807+0000","last_became_peered":"2026-02-22T23:23:59.257807+0000","last_unstale":"2026-02-22T23:25:32.769886+0000","last_undegraded":"2026-02-22T23:25:32.769886+0000","last_fullsized":"2026-02-22T23:25:32.769886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_clean_scrub_stamp":"2026-02-22T23:23:57.931636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:41:56.557451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000177021,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"24'7551","reported_seq":7669,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:39.834164+0000","last_change":"2026-02-22T23:24:05.721996+0000","last_active":"2026-02-22T23:25:39.834164+0000","last_peered":"2026-02-22T23:25:39.834164+0000","last_clean":"2026-02-22T23:25:39.834164+0000","last_became_active":"2026-02-22T23:24:05.721799+0000","last_became_peered":"2026-02-22T23:24:05.721799+0000","last_unstale":"2026-02-22T23:25:39.834164+0000","last_undegraded":"2026-02-22T23:25:39.834164+0000","last_fullsized":"2026-02-22T23:25:39.834164+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":7551,"log_dups_size":0,"ondisk_log_size":7551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:40.662718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121775136,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":109,"num_read_kb":107,"num_write":7564,"num_write_kb":181611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:32.760346+0000","last_change":"2026-02-22T23:24:00.946170+0000","last_active":"2026-02-22T23:25:32.760346+0000","last_peered":"2026-02-22T23:25:32.760346+0000","last_clean":"2026-02-22T23:25:32.760346+0000","last_became_active":"2026-02-22T23:23:59.237046+0000","last_became_peered":"2026-02-22T23:23:59.237046+0000","last_unstale":"2026-02-22T23:25:32.760346+0000","last_undegraded":"2026-02-22T23:25:32.760346+0000","last_fullsized":"2026-02-22T23:25:32.760346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_clean_scrub_stamp":"2026-02-22T23:23:57.931636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:24:35.277604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000445938,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"24'7209","reported_seq":7224,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:52.076213+0000","last_change":"2026-02-22T23:24:05.698370+0000","last_active":"2026-02-22T23:25:52.076213+0000","last_peered":"2026-02-22T23:25:52.076213+0000","last_clean":"2026-02-22T23:25:52.076213+0000","last_became_active":"2026-02-22T23:24:05.698126+0000","last_became_peered":"2026-02-22T23:24:05.698126+0000","last_unstale":"2026-02-22T23:25:52.076213+0000","last_undegraded":"2026-02-22T23:25:52.076213+0000","last_fullsized":"2026-02-22T23:25:52.076213+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":7209,"log_dups_size":0,"ondisk_log_size":7209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:39:47.547907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145358848,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7203,"num_write_kb":211206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"24'7464","reported_seq":7479,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:45.546228+0000","last_change":"2026-02-22T23:24:05.699144+0000","last_active":"2026-02-22T23:25:45.546228+0000","last_peered":"2026-02-22T23:25:45.546228+0000","last_clean":"2026-02-22T23:25:45.546228+0000","last_became_active":"2026-02-22T23:24:05.698528+0000","last_became_peered":"2026-02-22T23:24:05.698528+0000","last_unstale":"2026-02-22T23:25:45.546228+0000","last_undegraded":"2026-02-22T23:25:45.546228+0000","last_fullsized":"2026-02-22T23:25:45.546228+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":7464,"log_dups_size":0,"ondisk_log_size":7464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:19:20.407473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86704128,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7460,"num_write_kb":164306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:32.780951+0000","last_change":"2026-02-22T23:24:00.965007+0000","last_active":"2026-02-22T23:25:32.780951+0000","last_peered":"2026-02-22T23:25:32.780951+0000","last_clean":"2026-02-22T23:25:32.780951+0000","last_became_active":"2026-02-22T23:23:58.958840+0000","last_became_peered":"2026-02-22T23:23:58.958840+0000","last_unstale":"2026-02-22T23:25:32.780951+0000","last_undegraded":"2026-02-22T23:25:32.780951+0000","last_fullsized":"2026-02-22T23:25:32.780951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_clean_scrub_stamp":"2026-02-22T23:23:57.931636+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:58:17.312579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00022545200000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"24'5354","reported_seq":5369,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:45.397376+0000","last_change":"2026-02-22T23:24:05.721947+0000","last_active":"2026-02-22T23:25:45.397376+0000","last_peered":"2026-02-22T23:25:45.397376+0000","last_clean":"2026-02-22T23:25:45.397376+0000","last_became_active":"2026-02-22T23:24:05.721787+0000","last_became_peered":"2026-02-22T23:24:05.721787+0000","last_unstale":"2026-02-22T23:25:45.397376+0000","last_undegraded":"2026-02-22T23:25:45.397376+0000","last_fullsized":"2026-02-22T23:25:45.397376+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":5354,"log_dups_size":0,"ondisk_log_size":5354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:33:38.835812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5307,"num_write_kb":179763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:32.747217+0000","last_change":"2026-02-22T23:24:01.027919+0000","last_active":"2026-02-22T23:25:32.747217+0000","last_peered":"2026-02-22T23:25:32.747217+0000","last_clean":"2026-02-22T23:25:32.747217+0000","last_became_active":"2026-02-22T23:23:59.236692+0000","last_became_peered":"2026-02-22T23:23:59.236692+0000","last_unstale":"2026-02-22T23:25:32.747217+0000","last_undegraded":"2026-02-22T23:25:32.747217+0000","last_fullsized":"2026-02-22T23:25:32.747217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_clean_scrub_stamp":"2026-02-22T23:23:57.931636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:54:26.153298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017529500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"24'2789","reported_seq":2804,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:32.871202+0000","last_change":"2026-02-22T23:24:05.675997+0000","last_active":"2026-02-22T23:25:32.871202+0000","last_peered":"2026-02-22T23:25:32.871202+0000","last_clean":"2026-02-22T23:25:32.871202+0000","last_became_active":"2026-02-22T23:24:05.675717+0000","last_became_peered":"2026-02-22T23:24:05.675717+0000","last_unstale":"2026-02-22T23:25:32.871202+0000","last_undegraded":"2026-02-22T23:25:32.871202+0000","last_fullsized":"2026-02-22T23:25:32.871202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":2789,"log_dups_size":0,"ondisk_log_size":2789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:41:22.213828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2762,"num_write_kb":135681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:32.769625+0000","last_change":"2026-02-22T23:24:01.168995+0000","last_active":"2026-02-22T23:25:32.769625+0000","last_peered":"2026-02-22T23:25:32.769625+0000","last_clean":"2026-02-22T23:25:32.769625+0000","last_became_active":"2026-02-22T23:23:58.958969+0000","last_became_peered":"2026-02-22T23:23:58.958969+0000","last_unstale":"2026-02-22T23:25:32.769625+0000","last_undegraded":"2026-02-22T23:25:32.769625+0000","last_fullsized":"2026-02-22T23:25:32.769625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_clean_scrub_stamp":"2026-02-22T23:23:57.931636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:55:46.818746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000181831,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"24'6352","reported_seq":6391,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:37.951358+0000","last_change":"2026-02-22T23:24:05.677858+0000","last_active":"2026-02-22T23:25:37.951358+0000","last_peered":"2026-02-22T23:25:37.951358+0000","last_clean":"2026-02-22T23:25:37.951358+0000","last_became_active":"2026-02-22T23:24:05.677638+0000","last_became_peered":"2026-02-22T23:24:05.677638+0000","last_unstale":"2026-02-22T23:25:37.951358+0000","last_undegraded":"2026-02-22T23:25:37.951358+0000","last_fullsized":"2026-02-22T23:25:37.951358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":6352,"log_dups_size":0,"ondisk_log_size":6352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:07:53.203571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120522936,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":72,"num_read_kb":119,"num_write":6510,"num_write_kb":147601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:32.780969+0000","last_change":"2026-02-22T23:24:00.965025+0000","last_active":"2026-02-22T23:25:32.780969+0000","last_peered":"2026-02-22T23:25:32.780969+0000","last_clean":"2026-02-22T23:25:32.780969+0000","last_became_active":"2026-02-22T23:23:58.958830+0000","last_became_peered":"2026-02-22T23:23:58.958830+0000","last_unstale":"2026-02-22T23:25:32.780969+0000","last_undegraded":"2026-02-22T23:25:32.780969+0000","last_fullsized":"2026-02-22T23:25:32.780969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_clean_scrub_stamp":"2026-02-22T23:23:57.931636+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:18:15.715586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000241392,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'112","reported_seq":165,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:32.769702+0000","last_change":"2026-02-22T23:23:53.549952+0000","last_active":"2026-02-22T23:25:32.769702+0000","last_peered":"2026-02-22T23:25:32.769702+0000","last_clean":"2026-02-22T23:25:32.769702+0000","last_became_active":"2026-02-22T23:23:53.549316+0000","last_became_peered":"2026-02-22T23:23:53.549316+0000","last_unstale":"2026-02-22T23:25:32.769702+0000","last_undegraded":"2026-02-22T23:25:32.769702+0000","last_fullsized":"2026-02-22T23:25:32.769702+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:51.885433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:51.885433+0000","last_clean_scrub_stamp":"2026-02-22T23:23:51.885433+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:22:13.854378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"24'2960","reported_seq":2975,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:32.871146+0000","last_change":"2026-02-22T23:24:05.676579+0000","last_active":"2026-02-22T23:25:32.871146+0000","last_peered":"2026-02-22T23:25:32.871146+0000","last_clean":"2026-02-22T23:25:32.871146+0000","last_became_active":"2026-02-22T23:24:05.676326+0000","last_became_peered":"2026-02-22T23:24:05.676326+0000","last_unstale":"2026-02-22T23:25:32.871146+0000","last_undegraded":"2026-02-22T23:25:32.871146+0000","last_fullsized":"2026-02-22T23:25:32.871146+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":2960,"log_dups_size":0,"ondisk_log_size":2960,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:50:20.594097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2892,"num_write_kb":127875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"24'12253","reported_seq":12402,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:26:47.868806+0000","last_change":"2026-02-22T23:24:05.742635+0000","last_active":"2026-02-22T23:26:47.868806+0000","last_peered":"2026-02-22T23:26:47.868806+0000","last_clean":"2026-02-22T23:26:47.868806+0000","last_became_active":"2026-02-22T23:24:05.742493+0000","last_became_peered":"2026-02-22T23:24:05.742493+0000","last_unstale":"2026-02-22T23:26:47.868806+0000","last_undegraded":"2026-02-22T23:26:47.868806+0000","last_fullsized":"2026-02-22T23:26:47.868806+0000","mapping_epoch":21,"log_start":"23'2200","ondisk_log_start":"23'2200","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":10053,"log_dups_size":0,"ondisk_log_size":10053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:41:02.830405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":416,"num_read_kb":369,"num_write":8564,"num_write_kb":186891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"24'5951","reported_seq":6271,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:39.745294+0000","last_change":"2026-02-22T23:24:05.700011+0000","last_active":"2026-02-22T23:25:39.745294+0000","last_peered":"2026-02-22T23:25:39.745294+0000","last_clean":"2026-02-22T23:25:39.745294+0000","last_became_active":"2026-02-22T23:24:05.699884+0000","last_became_peered":"2026-02-22T23:24:05.699884+0000","last_unstale":"2026-02-22T23:25:39.745294+0000","last_undegraded":"2026-02-22T23:25:39.745294+0000","last_fullsized":"2026-02-22T23:25:39.745294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":5951,"log_dups_size":0,"ondisk_log_size":5951,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:03:30.857839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125960192,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":1022,"num_read_kb":916,"num_write":6136,"num_write_kb":193925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"23'3861","reported_seq":3876,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:32.745866+0000","last_change":"2026-02-22T23:24:05.677159+0000","last_active":"2026-02-22T23:25:32.745866+0000","last_peered":"2026-02-22T23:25:32.745866+0000","last_clean":"2026-02-22T23:25:32.745866+0000","last_became_active":"2026-02-22T23:24:05.676965+0000","last_became_peered":"2026-02-22T23:24:05.676965+0000","last_unstale":"2026-02-22T23:25:32.745866+0000","last_undegraded":"2026-02-22T23:25:32.745866+0000","last_fullsized":"2026-02-22T23:25:32.745866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":3861,"log_dups_size":0,"ondisk_log_size":3861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:16:14.298454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3859,"num_write_kb":148998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"24'5907","reported_seq":5922,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:44.204066+0000","last_change":"2026-02-22T23:24:05.698233+0000","last_active":"2026-02-22T23:25:44.204066+0000","last_peered":"2026-02-22T23:25:44.204066+0000","last_clean":"2026-02-22T23:25:44.204066+0000","last_became_active":"2026-02-22T23:24:05.698018+0000","last_became_peered":"2026-02-22T23:24:05.698018+0000","last_unstale":"2026-02-22T23:25:44.204066+0000","last_undegraded":"2026-02-22T23:25:44.204066+0000","last_fullsized":"2026-02-22T23:25:44.204066+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":5907,"log_dups_size":0,"ondisk_log_size":5907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:18:23.745174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131465216,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5859,"num_write_kb":186691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"24'3920","reported_seq":3951,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:32.891686+0000","last_change":"2026-02-22T23:24:05.699599+0000","last_active":"2026-02-22T23:25:32.891686+0000","last_peered":"2026-02-22T23:25:32.891686+0000","last_clean":"2026-02-22T23:25:32.891686+0000","last_became_active":"2026-02-22T23:24:05.699221+0000","last_became_peered":"2026-02-22T23:24:05.699221+0000","last_unstale":"2026-02-22T23:25:32.891686+0000","last_undegraded":"2026-02-22T23:25:32.891686+0000","last_fullsized":"2026-02-22T23:25:32.891686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":3920,"log_dups_size":0,"ondisk_log_size":3920,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:55:25.272147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":50,"num_read_kb":41,"num_write":3928,"num_write_kb":197645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"24'7433","reported_seq":7525,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:46.434450+0000","last_change":"2026-02-22T23:24:05.700990+0000","last_active":"2026-02-22T23:25:46.434450+0000","last_peered":"2026-02-22T23:25:46.434450+0000","last_clean":"2026-02-22T23:25:46.434450+0000","last_became_active":"2026-02-22T23:24:05.700853+0000","last_became_peered":"2026-02-22T23:24:05.700853+0000","last_unstale":"2026-02-22T23:25:46.434450+0000","last_undegraded":"2026-02-22T23:25:46.434450+0000","last_fullsized":"2026-02-22T23:25:46.434450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":7433,"log_dups_size":0,"ondisk_log_size":7433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:11:05.345071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100672016,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":292,"num_read_kb":283,"num_write":7694,"num_write_kb":156562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"24'6490","reported_seq":6515,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:41.558989+0000","last_change":"2026-02-22T23:24:05.700618+0000","last_active":"2026-02-22T23:25:41.558989+0000","last_peered":"2026-02-22T23:25:41.558989+0000","last_clean":"2026-02-22T23:25:41.558989+0000","last_became_active":"2026-02-22T23:24:05.700510+0000","last_became_peered":"2026-02-22T23:24:05.700510+0000","last_unstale":"2026-02-22T23:25:41.558989+0000","last_undegraded":"2026-02-22T23:25:41.558989+0000","last_fullsized":"2026-02-22T23:25:41.558989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":6490,"log_dups_size":0,"ondisk_log_size":6490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:43:14.176802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96600064,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":42,"num_read_kb":32,"num_write":6466,"num_write_kb":214278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"24'6019","reported_seq":6034,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:52.449849+0000","last_change":"2026-02-22T23:24:05.698639+0000","last_active":"2026-02-22T23:25:52.449849+0000","last_peered":"2026-02-22T23:25:52.449849+0000","last_clean":"2026-02-22T23:25:52.449849+0000","last_became_active":"2026-02-22T23:24:05.698492+0000","last_became_peered":"2026-02-22T23:24:05.698492+0000","last_unstale":"2026-02-22T23:25:52.449849+0000","last_undegraded":"2026-02-22T23:25:52.449849+0000","last_fullsized":"2026-02-22T23:25:52.449849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":6019,"log_dups_size":0,"ondisk_log_size":6019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:30:49.518883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5970,"num_write_kb":185477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"23'4568","reported_seq":4583,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:32.769647+0000","last_change":"2026-02-22T23:24:05.699724+0000","last_active":"2026-02-22T23:25:32.769647+0000","last_peered":"2026-02-22T23:25:32.769647+0000","last_clean":"2026-02-22T23:25:32.769647+0000","last_became_active":"2026-02-22T23:24:05.699288+0000","last_became_peered":"2026-02-22T23:24:05.699288+0000","last_unstale":"2026-02-22T23:25:32.769647+0000","last_undegraded":"2026-02-22T23:25:32.769647+0000","last_fullsized":"2026-02-22T23:25:32.769647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":4568,"log_dups_size":0,"ondisk_log_size":4568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:02:21.223324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4562,"num_write_kb":202117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"24'4038","reported_seq":4056,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:32.871911+0000","last_change":"2026-02-22T23:24:05.677658+0000","last_active":"2026-02-22T23:25:32.871911+0000","last_peered":"2026-02-22T23:25:32.871911+0000","last_clean":"2026-02-22T23:25:32.871911+0000","last_became_active":"2026-02-22T23:24:05.677479+0000","last_became_peered":"2026-02-22T23:24:05.677479+0000","last_unstale":"2026-02-22T23:25:32.871911+0000","last_undegraded":"2026-02-22T23:25:32.871911+0000","last_fullsized":"2026-02-22T23:25:32.871911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":4038,"log_dups_size":0,"ondisk_log_size":4038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:27:53.526953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":3995,"num_write_kb":197509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"24'6788","reported_seq":6810,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-22T23:25:36.965698+0000","last_change":"2026-02-22T23:24:05.700217+0000","last_active":"2026-02-22T23:25:36.965698+0000","last_peered":"2026-02-22T23:25:36.965698+0000","last_clean":"2026-02-22T23:25:36.965698+0000","last_became_active":"2026-02-22T23:24:05.700038+0000","last_became_peered":"2026-02-22T23:24:05.700038+0000","last_unstale":"2026-02-22T23:25:36.965698+0000","last_undegraded":"2026-02-22T23:25:36.965698+0000","last_fullsized":"2026-02-22T23:25:36.965698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":6788,"log_dups_size":0,"ondisk_log_size":6788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:29:59.558337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":18,"num_read_kb":140,"num_write":6784,"num_write_kb":152398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3698979592,"num_objects":909,"num_object_clones":0,"num_object_copies":1818,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":909,"num_whiteouts":0,"num_read":2510,"num_read_kb":2521,"num_write":210941,"num_write_kb":5841517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7100317696,"data_stored":7096043672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":209719,"ondisk_log_size":209719,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542181,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415080,"kb_used_data":333976,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":93956760,"statfs":{"total":96636764160,"available":96211722240,"internally_reserved":0,"allocated":341991424,"data_stored":341655248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":83032519},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542182,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1389124,"kb_used_data":1061044,"kb_used_omap":1,"kb_used_meta":328062,"kb_avail":92982716,"statfs":{"total":96636764160,"available":95214301184,"internally_reserved":0,"allocated":1086509056,"data_stored":1085677479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":335935942},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542181,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1810112,"kb_used_data":1364016,"kb_used_omap":1,"kb_used_meta":446078,"kb_avail":92561728,"statfs":{"total":96636764160,"available":94783209472,"internally_reserved":0,"allocated":1396752384,"data_stored":1395769992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":456784326},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542182,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1411444,"kb_used_data":1101348,"kb_used_omap":1,"kb_used_meta":310078,"kb_avail":92960396,"statfs":{"total":96636764160,"available":95191445504,"internally_reserved":0,"allocated":1127780352,"data_stored":1126958172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":317520328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542181,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":409328,"kb_used_data":311584,"kb_used_omap":1,"kb_used_meta":97726,"kb_avail":93962512,"statfs":{"total":96636764160,"available":96217612288,"internally_reserved":0,"allocated":319062016,"data_stored":318758564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":100071878},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542182,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1350648,"kb_used_data":1004520,"kb_used_omap":1,"kb_used_meta":346110,"kb_avail":93021192,"statfs":{"total":96636764160,"available":95253700608,"internally_reserved":0,"allocated":1028628480,"data_stored":1027798968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":354417094},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1451188,"kb_used_data":1123108,"kb_used_omap":1,"kb_used_meta":328062,"kb_avail":92920652,"statfs":{"total":96636764160,"available":95150747648,"internally_reserved":0,"allocated":1150062592,"data_stored":1149147236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":335935947},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":820940,"kb_used_data":637116,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":93550900,"statfs":{"total":96636764160,"available":95796121600,"internally_reserved":0,"allocated":652406784,"data_stored":651959075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":188217798},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1027870720,"data_stored":1027192144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":652177408,"data_stored":651881160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":318836736,"data_stored":318680668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1127555072,"data_stored":1126880276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1396527104,"data_stored":1395692096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1086279680,"data_stored":1085599564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":341766144,"data_stored":341577352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1149304832,"data_stored":1148540412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T23:26:49.896 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-22T23:26:49.968 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.960+0000 7f702ad03640 1 Processor -- start 2026-02-22T23:26:49.968 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.960+0000 7f702ad03640 1 -- start start 2026-02-22T23:26:49.968 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.961+0000 7f702ad03640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70240b1380 con 0x7f70240af500 2026-02-22T23:26:49.968 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.961+0000 7f702ad03640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70240716b0 con 0x7f70240b0fa0 2026-02-22T23:26:49.968 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.961+0000 7f702ad03640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7024071990 con 0x7f70240b1680 2026-02-22T23:26:49.968 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.961+0000 7f701bfff640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7f70240b1680 0x7f70240aedf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:53504/0 (socket says 10.20.193.93:53504) 2026-02-22T23:26:49.969 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.961+0000 7f701bfff640 1 -- 10.20.193.93:0/35814306 learned_addr learned my addr 10.20.193.93:0/35814306 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:26:49.969 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.961+0000 7f7029279640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7f70240af500 0x7f702414f290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:36850/0 (socket says 10.20.193.93:36850) 2026-02-22T23:26:49.969 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.961+0000 7f701b7fe640 1 -- 10.20.193.93:0/35814306 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2559860453 0 0) 0x7f7024071990 con 0x7f70240b1680 2026-02-22T23:26:49.969 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.961+0000 7f701b7fe640 1 -- 10.20.193.93:0/35814306 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7010003620 con 0x7f70240b1680 2026-02-22T23:26:49.969 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.961+0000 7f701b7fe640 1 -- 10.20.193.93:0/35814306 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 590399272 0 0) 0x7f70240b1380 con 0x7f70240af500 2026-02-22T23:26:49.969 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.961+0000 7f701b7fe640 1 -- 10.20.193.93:0/35814306 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7024071990 con 0x7f70240af500 2026-02-22T23:26:49.969 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.961+0000 7f701b7fe640 1 -- 10.20.193.93:0/35814306 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 71251101 0 0) 0x7f7010003620 con 0x7f70240b1680 2026-02-22T23:26:49.969 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.961+0000 7f701b7fe640 1 -- 10.20.193.93:0/35814306 >> v1:10.20.193.155:6789/0 conn(0x7f70240b0fa0 legacy=0x7f7024140a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T23:26:49.969 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.961+0000 7f701b7fe640 1 -- 10.20.193.93:0/35814306 >> v1:10.20.193.93:6789/0 conn(0x7f70240af500 legacy=0x7f702414f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:49.969 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.961+0000 7f701b7fe640 1 -- 10.20.193.93:0/35814306 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7024144020 con 0x7f70240b1680 2026-02-22T23:26:49.969 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.961+0000 7f701b7fe640 1 -- 10.20.193.93:0/35814306 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f700c002ea0 con 0x7f70240b1680 2026-02-22T23:26:49.970 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.961+0000 7f701b7fe640 1 -- 10.20.193.93:0/35814306 <== mon.2 v1:10.20.193.93:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f700c003040 con 0x7f70240b1680 2026-02-22T23:26:49.970 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.961+0000 7f701b7fe640 1 -- 10.20.193.93:0/35814306 <== mon.2 v1:10.20.193.93:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f700c003450 con 0x7f70240b1680 2026-02-22T23:26:49.970 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.962+0000 7f702ad03640 1 -- 10.20.193.93:0/35814306 >> v1:10.20.193.93:6790/0 conn(0x7f70240b1680 legacy=0x7f70240aedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:49.970 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.962+0000 7f702ad03640 1 -- 10.20.193.93:0/35814306 shutdown_connections 2026-02-22T23:26:49.970 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.962+0000 7f702ad03640 1 -- 10.20.193.93:0/35814306 >> 10.20.193.93:0/35814306 conn(0x7f70240b20c0 msgr2=0x7f70240b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:49.970 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.962+0000 7f702ad03640 1 -- 10.20.193.93:0/35814306 shutdown_connections 2026-02-22T23:26:49.970 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.962+0000 7f702ad03640 1 -- 10.20.193.93:0/35814306 wait complete. 2026-02-22T23:26:49.970 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.962+0000 7f702ad03640 1 Processor -- start 2026-02-22T23:26:49.970 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.963+0000 7f702ad03640 1 -- start start 2026-02-22T23:26:49.970 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.963+0000 7f702ad03640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f702411d660 con 0x7f70240b1680 2026-02-22T23:26:49.970 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.963+0000 7f702ad03640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7024147320 con 0x7f7024146590 2026-02-22T23:26:49.970 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.963+0000 7f702ad03640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7024073970 con 0x7f70240b0fa0 2026-02-22T23:26:49.971 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.963+0000 7f7028a78640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7f70240b0fa0 0x7f70241de1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:53508/0 (socket says 10.20.193.93:53508) 2026-02-22T23:26:49.971 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.963+0000 7f701bfff640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7f70240b1680 0x7f70241de8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:36854/0 (socket says 10.20.193.93:36854) 2026-02-22T23:26:49.971 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.963+0000 7f7028a78640 1 -- 10.20.193.93:0/862112305 learned_addr learned my addr 10.20.193.93:0/862112305 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:26:49.971 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.963+0000 7f70197fa640 1 -- 10.20.193.93:0/862112305 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3949613183 0 0) 0x7f702411d660 con 0x7f70240b1680 2026-02-22T23:26:49.971 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.963+0000 7f70197fa640 1 -- 10.20.193.93:0/862112305 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ff4003620 con 0x7f70240b1680 2026-02-22T23:26:49.971 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.963+0000 7f70197fa640 1 -- 10.20.193.93:0/862112305 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 896381197 0 0) 0x7f7024073970 con 0x7f70240b0fa0 2026-02-22T23:26:49.971 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.963+0000 7f70197fa640 1 -- 10.20.193.93:0/862112305 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f702411d660 con 0x7f70240b0fa0 2026-02-22T23:26:49.971 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.963+0000 7f70197fa640 1 -- 10.20.193.93:0/862112305 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2051787608 0 0) 0x7f6ff4003620 con 0x7f70240b1680 2026-02-22T23:26:49.971 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.963+0000 7f70197fa640 1 -- 10.20.193.93:0/862112305 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7024073970 con 0x7f70240b1680 2026-02-22T23:26:49.971 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.963+0000 7f70197fa640 1 -- 10.20.193.93:0/862112305 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f700c003450 con 0x7f70240b1680 2026-02-22T23:26:49.971 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.963+0000 7f70197fa640 1 -- 10.20.193.93:0/862112305 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 916710511 0 0) 0x7f702411d660 con 0x7f70240b0fa0 2026-02-22T23:26:49.971 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.963+0000 7f70197fa640 1 -- 10.20.193.93:0/862112305 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6ff4003620 con 0x7f70240b0fa0 2026-02-22T23:26:49.972 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.963+0000 7f70197fa640 1 -- 10.20.193.93:0/862112305 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f7014004070 con 0x7f70240b0fa0 2026-02-22T23:26:49.972 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.963+0000 7f70197fa640 1 -- 10.20.193.93:0/862112305 <== mon.0 v1:10.20.193.93:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4257751236 0 0) 0x7f7024073970 con 0x7f70240b1680 2026-02-22T23:26:49.972 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.963+0000 7f70197fa640 1 -- 10.20.193.93:0/862112305 >> v1:10.20.193.93:6790/0 conn(0x7f70240b0fa0 legacy=0x7f70241de1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:49.972 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.963+0000 7f70197fa640 1 -- 10.20.193.93:0/862112305 >> v1:10.20.193.155:6789/0 conn(0x7f7024146590 legacy=0x7f70241e5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:49.972 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.963+0000 7f70197fa640 1 -- 10.20.193.93:0/862112305 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7024073b40 con 0x7f70240b1680 2026-02-22T23:26:49.972 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.963+0000 7f702ad03640 1 -- 10.20.193.93:0/862112305 --> v1:10.20.193.93:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7024146c50 con 0x7f70240b1680 2026-02-22T23:26:49.972 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.963+0000 7f702ad03640 1 -- 10.20.193.93:0/862112305 --> v1:10.20.193.93:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f70241e6e90 con 0x7f70240b1680 2026-02-22T23:26:49.972 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.963+0000 7f70197fa640 1 -- 10.20.193.93:0/862112305 <== mon.0 v1:10.20.193.93:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f700c004b90 con 0x7f70240b1680 2026-02-22T23:26:49.972 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.963+0000 7f70197fa640 1 -- 10.20.193.93:0/862112305 <== mon.0 v1:10.20.193.93:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f700c004fe0 con 0x7f70240b1680 2026-02-22T23:26:49.972 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.964+0000 7f702ad03640 1 -- 10.20.193.93:0/862112305 --> v1:10.20.193.93:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70240b0b10 con 0x7f70240b1680 2026-02-22T23:26:49.972 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.964+0000 7f70197fa640 1 -- 10.20.193.93:0/862112305 <== mon.0 v1:10.20.193.93:6789/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7f700c005180 con 0x7f70240b1680 2026-02-22T23:26:49.972 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.965+0000 7f70197fa640 1 -- 10.20.193.93:0/862112305 <== mon.0 v1:10.20.193.93:6789/0 8 ==== osd_map(25..25 src has 1..25) ==== 4521+0+0 (unknown 3458299925 0 0) 0x7f700c0943c0 con 0x7f70240b1680 2026-02-22T23:26:49.973 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:49.967+0000 7f70197fa640 1 -- 10.20.193.93:0/862112305 <== mon.0 v1:10.20.193.93:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f700c05da40 con 0x7f70240b1680 2026-02-22T23:26:50.053 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:50.050+0000 7f702ad03640 1 -- 10.20.193.93:0/862112305 --> v1:10.20.193.93:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f70241deff0 con 0x7f70240b1680 2026-02-22T23:26:50.054 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:50.050+0000 7f70197fa640 1 -- 10.20.193.93:0/862112305 <== mon.0 v1:10.20.193.93:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+14743 (unknown 780366164 0 5995293) 0x7f700c05d340 con 0x7f70240b1680 2026-02-22T23:26:50.054 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:26:50.054 INFO:teuthology.orchestra.run.trial093.stdout:{"epoch":25,"fsid":"964c49d0-be38-4661-88a8-21893fbedc4f","created":"2026-02-22T23:23:40.901753+0000","modified":"2026-02-22T23:26:48.802702+0000","last_up_change":"2026-02-22T23:23:51.885433+0000","last_in_change":"2026-02-22T23:23:42.448665+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-22T23:23:51.047515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-22T23:23:57.573199+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephsqlite","create_time":"2026-02-22T23:24:05.014656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d1ce1e9f-bb70-4b7b-9dbc-e380de9324c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6806","nonce":3224090065}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6808","nonce":3224090065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6811","nonce":3224090065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6810","nonce":3224090065}]},"public_addr":"10.20.193.93:6806/3224090065","cluster_addr":"10.20.193.93:6808/3224090065","heartbeat_back_addr":"10.20.193.93:6811/3224090065","heartbeat_front_addr":"10.20.193.93:6810/3224090065","state":["exists","up"]},{"osd":1,"uuid":"e5ab5de3-2e0f-4f91-8dfe-c74bff8838d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6800","nonce":4002367425}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6801","nonce":4002367425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6803","nonce":4002367425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6802","nonce":4002367425}]},"public_addr":"10.20.193.93:6800/4002367425","cluster_addr":"10.20.193.93:6801/4002367425","heartbeat_back_addr":"10.20.193.93:6803/4002367425","heartbeat_front_addr":"10.20.193.93:6802/4002367425","state":["exists","up"]},{"osd":2,"uuid":"10d76c55-707a-43c8-b51e-0e5ae595f89e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6812","nonce":945702863}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6813","nonce":945702863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6815","nonce":945702863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6814","nonce":945702863}]},"public_addr":"10.20.193.93:6812/945702863","cluster_addr":"10.20.193.93:6813/945702863","heartbeat_back_addr":"10.20.193.93:6815/945702863","heartbeat_front_addr":"10.20.193.93:6814/945702863","state":["exists","up"]},{"osd":3,"uuid":"d7a29cea-4066-455f-8a32-f4cb5534ae32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6804","nonce":970700542}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6805","nonce":970700542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6809","nonce":970700542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6807","nonce":970700542}]},"public_addr":"10.20.193.93:6804/970700542","cluster_addr":"10.20.193.93:6805/970700542","heartbeat_back_addr":"10.20.193.93:6809/970700542","heartbeat_front_addr":"10.20.193.93:6807/970700542","state":["exists","up"]},{"osd":4,"uuid":"6a1874d8-3703-429f-839b-d3dc0f448b14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6813","nonce":3729844438}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6814","nonce":3729844438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6816","nonce":3729844438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6815","nonce":3729844438}]},"public_addr":"10.20.193.155:6813/3729844438","cluster_addr":"10.20.193.155:6814/3729844438","heartbeat_back_addr":"10.20.193.155:6816/3729844438","heartbeat_front_addr":"10.20.193.155:6815/3729844438","state":["exists","up"]},{"osd":5,"uuid":"447cea4f-f753-457e-b654-85ade052dc45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6806","nonce":887979704}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6808","nonce":887979704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6811","nonce":887979704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6810","nonce":887979704}]},"public_addr":"10.20.193.155:6806/887979704","cluster_addr":"10.20.193.155:6808/887979704","heartbeat_back_addr":"10.20.193.155:6811/887979704","heartbeat_front_addr":"10.20.193.155:6810/887979704","state":["exists","up"]},{"osd":6,"uuid":"dee8274e-5e87-4e06-a9aa-44439f7f5354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6805","nonce":4020397544}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6807","nonce":4020397544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6812","nonce":4020397544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6809","nonce":4020397544}]},"public_addr":"10.20.193.155:6805/4020397544","cluster_addr":"10.20.193.155:6807/4020397544","heartbeat_back_addr":"10.20.193.155:6812/4020397544","heartbeat_front_addr":"10.20.193.155:6809/4020397544","state":["exists","up"]},{"osd":7,"uuid":"c988ac9f-b5ed-48f5-aeb8-96968366722e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6801","nonce":2779097013}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6802","nonce":2779097013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6804","nonce":2779097013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6803","nonce":2779097013}]},"public_addr":"10.20.193.155:6801/2779097013","cluster_addr":"10.20.193.155:6802/2779097013","heartbeat_back_addr":"10.20.193.155:6804/2779097013","heartbeat_front_addr":"10.20.193.155:6803/2779097013","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:23:49.958344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:23:49.877163+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:23:49.987742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:23:49.866208+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:23:49.985851+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:23:50.007610+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:23:49.944652+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T23:23:49.883780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.93:0/523934468":"2026-02-23T00:26:47.849311+0000","10.20.193.93:0/1416457700":"2026-02-23T00:25:32.723439+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T23:26:50.055 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:50.051+0000 7f702ad03640 1 -- 10.20.193.93:0/862112305 >> v1:10.20.193.155:6800/3108481844 conn(0x7f6ff40780e0 legacy=0x7f6ff407a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:50.055 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:50.051+0000 7f702ad03640 1 -- 10.20.193.93:0/862112305 >> v1:10.20.193.93:6789/0 conn(0x7f70240b1680 legacy=0x7f70241de8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:50.055 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:50.051+0000 7f702ad03640 1 -- 10.20.193.93:0/862112305 shutdown_connections 2026-02-22T23:26:50.055 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:50.051+0000 7f702ad03640 1 -- 10.20.193.93:0/862112305 >> 10.20.193.93:0/862112305 conn(0x7f70240b20c0 msgr2=0x7f70240aedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:50.056 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:50.051+0000 7f702ad03640 1 -- 10.20.193.93:0/862112305 shutdown_connections 2026-02-22T23:26:50.056 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:50.051+0000 7f702ad03640 1 -- 10.20.193.93:0/862112305 wait complete. 2026-02-22T23:26:51.063 INFO:tasks.ceph:Scrubbing osd.0 2026-02-22T23:26:51.063 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-22T23:26:51.133 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.130+0000 7f65a028f640 1 Processor -- start 2026-02-22T23:26:51.133 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.130+0000 7f65a028f640 1 -- start start 2026-02-22T23:26:51.133 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.130+0000 7f65a028f640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6598073150 con 0x7f659814d2e0 2026-02-22T23:26:51.134 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.130+0000 7f65a028f640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65980b6380 con 0x7f6598144090 2026-02-22T23:26:51.134 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.130+0000 7f65a028f640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65980746f0 con 0x7f6598072d70 2026-02-22T23:26:51.134 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.130+0000 7f659e004640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7f6598072d70 0x7f6598142e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:53512/0 (socket says 10.20.193.93:53512) 2026-02-22T23:26:51.134 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.130+0000 7f659e004640 1 -- 10.20.193.93:0/1481325237 learned_addr learned my addr 10.20.193.93:0/1481325237 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:26:51.138 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.131+0000 7f659d002640 1 -- 10.20.193.93:0/1481325237 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 141216737 0 0) 0x7f65980746f0 con 0x7f6598072d70 2026-02-22T23:26:51.139 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.131+0000 7f659d002640 1 -- 10.20.193.93:0/1481325237 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6580003620 con 0x7f6598072d70 2026-02-22T23:26:51.139 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.131+0000 7f659d002640 1 -- 10.20.193.93:0/1481325237 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1303507397 0 0) 0x7f6598073150 con 0x7f659814d2e0 2026-02-22T23:26:51.139 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.131+0000 7f659d002640 1 -- 10.20.193.93:0/1481325237 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65980746f0 con 0x7f659814d2e0 2026-02-22T23:26:51.139 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.131+0000 7f659d002640 1 -- 10.20.193.93:0/1481325237 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2001531191 0 0) 0x7f6580003620 con 0x7f6598072d70 2026-02-22T23:26:51.139 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.131+0000 7f659d002640 1 -- 10.20.193.93:0/1481325237 >> v1:10.20.193.155:6789/0 conn(0x7f6598144090 legacy=0x7f65981444d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.139 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.131+0000 7f659d002640 1 -- 10.20.193.93:0/1481325237 >> v1:10.20.193.93:6789/0 conn(0x7f659814d2e0 legacy=0x7f659814f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.139 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.131+0000 7f659d002640 1 -- 10.20.193.93:0/1481325237 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65980749d0 con 0x7f6598072d70 2026-02-22T23:26:51.139 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.131+0000 7f659d002640 1 -- 10.20.193.93:0/1481325237 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f6588002ea0 con 0x7f6598072d70 2026-02-22T23:26:51.139 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.131+0000 7f659d002640 1 -- 10.20.193.93:0/1481325237 <== mon.2 v1:10.20.193.93:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6588003040 con 0x7f6598072d70 2026-02-22T23:26:51.139 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.131+0000 7f659d002640 1 -- 10.20.193.93:0/1481325237 <== mon.2 v1:10.20.193.93:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f6588003450 con 0x7f6598072d70 2026-02-22T23:26:51.140 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.131+0000 7f65a028f640 1 -- 10.20.193.93:0/1481325237 >> v1:10.20.193.93:6790/0 conn(0x7f6598072d70 legacy=0x7f6598142e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.140 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.131+0000 7f65a028f640 1 -- 10.20.193.93:0/1481325237 shutdown_connections 2026-02-22T23:26:51.140 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.131+0000 7f65a028f640 1 -- 10.20.193.93:0/1481325237 >> 10.20.193.93:0/1481325237 conn(0x7f65980b67b0 msgr2=0x7f65980b6bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:51.140 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.131+0000 7f65a028f640 1 -- 10.20.193.93:0/1481325237 shutdown_connections 2026-02-22T23:26:51.140 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.131+0000 7f65a028f640 1 -- 10.20.193.93:0/1481325237 wait complete. 2026-02-22T23:26:51.140 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.132+0000 7f65a028f640 1 Processor -- start 2026-02-22T23:26:51.140 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.132+0000 7f65a028f640 1 -- start start 2026-02-22T23:26:51.140 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.132+0000 7f65a028f640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65981dbd20 con 0x7f659814d2e0 2026-02-22T23:26:51.140 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.132+0000 7f65a028f640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f659813cda0 con 0x7f6598072d70 2026-02-22T23:26:51.140 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.132+0000 7f65a028f640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6598139310 con 0x7f6598144090 2026-02-22T23:26:51.140 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.132+0000 7f659d803640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7f6598144090 0x7f65981de480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:53524/0 (socket says 10.20.193.93:53524) 2026-02-22T23:26:51.141 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.132+0000 7f659d803640 1 -- 10.20.193.93:0/3007646300 learned_addr learned my addr 10.20.193.93:0/3007646300 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:26:51.141 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.132+0000 7f659e805640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7f659814d2e0 0x7f65981e6550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:36880/0 (socket says 10.20.193.93:36880) 2026-02-22T23:26:51.141 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.132+0000 7f657effd640 1 -- 10.20.193.93:0/3007646300 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 584077611 0 0) 0x7f65981dbd20 con 0x7f659814d2e0 2026-02-22T23:26:51.141 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.132+0000 7f657effd640 1 -- 10.20.193.93:0/3007646300 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6568003620 con 0x7f659814d2e0 2026-02-22T23:26:51.141 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.132+0000 7f657effd640 1 -- 10.20.193.93:0/3007646300 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 645688881 0 0) 0x7f6598139310 con 0x7f6598144090 2026-02-22T23:26:51.141 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.132+0000 7f657effd640 1 -- 10.20.193.93:0/3007646300 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65981dbd20 con 0x7f6598144090 2026-02-22T23:26:51.141 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.132+0000 7f657effd640 1 -- 10.20.193.93:0/3007646300 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 799038766 0 0) 0x7f6568003620 con 0x7f659814d2e0 2026-02-22T23:26:51.141 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.132+0000 7f657effd640 1 -- 10.20.193.93:0/3007646300 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6598139310 con 0x7f659814d2e0 2026-02-22T23:26:51.141 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.132+0000 7f657effd640 1 -- 10.20.193.93:0/3007646300 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f65940033e0 con 0x7f659814d2e0 2026-02-22T23:26:51.141 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.132+0000 7f657effd640 1 -- 10.20.193.93:0/3007646300 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1573340829 0 0) 0x7f65981dbd20 con 0x7f6598144090 2026-02-22T23:26:51.141 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.132+0000 7f657effd640 1 -- 10.20.193.93:0/3007646300 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6568003620 con 0x7f6598144090 2026-02-22T23:26:51.141 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.132+0000 7f657effd640 1 -- 10.20.193.93:0/3007646300 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f658c0031c0 con 0x7f6598144090 2026-02-22T23:26:51.141 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.132+0000 7f657effd640 1 -- 10.20.193.93:0/3007646300 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 849503157 0 0) 0x7f659813cda0 con 0x7f6598072d70 2026-02-22T23:26:51.142 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.132+0000 7f657effd640 1 -- 10.20.193.93:0/3007646300 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65981dbd20 con 0x7f6598072d70 2026-02-22T23:26:51.142 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.133+0000 7f657effd640 1 -- 10.20.193.93:0/3007646300 <== mon.0 v1:10.20.193.93:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 344650496 0 0) 0x7f6598139310 con 0x7f659814d2e0 2026-02-22T23:26:51.142 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.133+0000 7f657effd640 1 -- 10.20.193.93:0/3007646300 >> v1:10.20.193.93:6790/0 conn(0x7f6598144090 legacy=0x7f65981de480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.142 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.133+0000 7f657effd640 1 -- 10.20.193.93:0/3007646300 >> v1:10.20.193.155:6789/0 conn(0x7f6598072d70 legacy=0x7f6598138c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.142 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.133+0000 7f657effd640 1 -- 10.20.193.93:0/3007646300 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65981394e0 con 0x7f659814d2e0 2026-02-22T23:26:51.142 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.133+0000 7f65a028f640 1 -- 10.20.193.93:0/3007646300 --> v1:10.20.193.93:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6598139bf0 con 0x7f659814d2e0 2026-02-22T23:26:51.142 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.133+0000 7f65a028f640 1 -- 10.20.193.93:0/3007646300 --> v1:10.20.193.93:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f65981deb90 con 0x7f659814d2e0 2026-02-22T23:26:51.142 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.133+0000 7f657effd640 1 -- 10.20.193.93:0/3007646300 <== mon.0 v1:10.20.193.93:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6594003970 con 0x7f659814d2e0 2026-02-22T23:26:51.142 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.133+0000 7f657effd640 1 -- 10.20.193.93:0/3007646300 <== mon.0 v1:10.20.193.93:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f65940050d0 con 0x7f659814d2e0 2026-02-22T23:26:51.142 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.133+0000 7f65a028f640 1 -- 10.20.193.93:0/3007646300 --> v1:10.20.193.93:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f6598075000 con 0x7f659814d2e0 2026-02-22T23:26:51.143 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.134+0000 7f657effd640 1 -- 10.20.193.93:0/3007646300 <== mon.0 v1:10.20.193.93:6789/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7f659401d8a0 con 0x7f659814d2e0 2026-02-22T23:26:51.143 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.134+0000 7f657effd640 1 -- 10.20.193.93:0/3007646300 <== mon.0 v1:10.20.193.93:6789/0 8 ==== osd_map(25..25 src has 1..25) ==== 4521+0+0 (unknown 3458299925 0 0) 0x7f6594094660 con 0x7f659814d2e0 2026-02-22T23:26:51.143 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.134+0000 7f657effd640 1 -- 10.20.193.93:0/3007646300 --> v1:10.20.193.93:6806/3224090065 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6568083b50 con 0x7f656807ff80 2026-02-22T23:26:51.143 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.134+0000 7f657effd640 1 -- 10.20.193.93:0/3007646300 <== mon.0 v1:10.20.193.93:6789/0 9 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (unknown 2663167439 0 0) 0x7f6594094a70 con 0x7f659814d2e0 2026-02-22T23:26:51.143 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.135+0000 7f657effd640 1 -- 10.20.193.93:0/3007646300 <== osd.0 v1:10.20.193.93:6806/3224090065 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7f6568083b50 con 0x7f656807ff80 2026-02-22T23:26:51.144 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.141+0000 7f65a028f640 1 -- 10.20.193.93:0/3007646300 --> v1:10.20.193.93:6806/3224090065 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f65980b8130 con 0x7f656807ff80 2026-02-22T23:26:51.144 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.141+0000 7f657effd640 1 -- 10.20.193.93:0/3007646300 <== osd.0 v1:10.20.193.93:6806/3224090065 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f65980b8130 con 0x7f656807ff80 2026-02-22T23:26:51.144 INFO:teuthology.orchestra.run.trial093.stdout:{ 2026-02-22T23:26:51.145 INFO:teuthology.orchestra.run.trial093.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-22T23:26:51.145 INFO:teuthology.orchestra.run.trial093.stdout:} 2026-02-22T23:26:51.146 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.141+0000 7f65a028f640 1 -- 10.20.193.93:0/3007646300 >> v1:10.20.193.93:6806/3224090065 conn(0x7f656807ff80 legacy=0x7f65680823a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.146 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.141+0000 7f65a028f640 1 -- 10.20.193.93:0/3007646300 >> v1:10.20.193.155:6800/3108481844 conn(0x7f6568078170 legacy=0x7f656807a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.146 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.141+0000 7f65a028f640 1 -- 10.20.193.93:0/3007646300 >> v1:10.20.193.93:6789/0 conn(0x7f659814d2e0 legacy=0x7f65981e6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.146 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.141+0000 7f659e805640 1 -- 10.20.193.93:0/3007646300 reap_dead start 2026-02-22T23:26:51.146 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.141+0000 7f65a028f640 1 -- 10.20.193.93:0/3007646300 shutdown_connections 2026-02-22T23:26:51.146 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.141+0000 7f65a028f640 1 -- 10.20.193.93:0/3007646300 >> 10.20.193.93:0/3007646300 conn(0x7f65980b67b0 msgr2=0x7f65980b6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:51.146 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.141+0000 7f65a028f640 1 -- 10.20.193.93:0/3007646300 shutdown_connections 2026-02-22T23:26:51.147 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.141+0000 7f65a028f640 1 -- 10.20.193.93:0/3007646300 wait complete. 2026-02-22T23:26:51.152 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-22T23:26:51.224 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.216+0000 7fce46133640 1 Processor -- start 2026-02-22T23:26:51.224 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.216+0000 7fce46133640 1 -- start start 2026-02-22T23:26:51.224 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.217+0000 7fce46133640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce400b16f0 con 0x7fce400b1140 2026-02-22T23:26:51.225 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.217+0000 7fce46133640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce400b1940 con 0x7fce400b0d60 2026-02-22T23:26:51.225 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.217+0000 7fce46133640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce400b5720 con 0x7fce40147940 2026-02-22T23:26:51.225 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.217+0000 7fce3ffff640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7fce40147940 0x7fce4014f280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:53536/0 (socket says 10.20.193.93:53536) 2026-02-22T23:26:51.225 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.217+0000 7fce3effd640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7fce400b1140 0x7fce40147230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:36892/0 (socket says 10.20.193.93:36892) 2026-02-22T23:26:51.225 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.217+0000 7fce3ffff640 1 -- 10.20.193.93:0/4288451562 learned_addr learned my addr 10.20.193.93:0/4288451562 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:26:51.225 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.217+0000 7fce3e7fc640 1 -- 10.20.193.93:0/4288451562 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1145425298 0 0) 0x7fce400b5720 con 0x7fce40147940 2026-02-22T23:26:51.225 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.217+0000 7fce3e7fc640 1 -- 10.20.193.93:0/4288451562 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce24003620 con 0x7fce40147940 2026-02-22T23:26:51.225 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.217+0000 7fce3e7fc640 1 -- 10.20.193.93:0/4288451562 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 467540161 0 0) 0x7fce400b16f0 con 0x7fce400b1140 2026-02-22T23:26:51.225 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.217+0000 7fce3e7fc640 1 -- 10.20.193.93:0/4288451562 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce400b5720 con 0x7fce400b1140 2026-02-22T23:26:51.225 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.217+0000 7fce3e7fc640 1 -- 10.20.193.93:0/4288451562 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2399063773 0 0) 0x7fce24003620 con 0x7fce40147940 2026-02-22T23:26:51.225 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.217+0000 7fce3e7fc640 1 -- 10.20.193.93:0/4288451562 >> v1:10.20.193.155:6789/0 conn(0x7fce400b0d60 legacy=0x7fce40142f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.226 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.217+0000 7fce3e7fc640 1 -- 10.20.193.93:0/4288451562 >> v1:10.20.193.93:6789/0 conn(0x7fce400b1140 legacy=0x7fce40147230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.226 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.217+0000 7fce3e7fc640 1 -- 10.20.193.93:0/4288451562 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce400aedf0 con 0x7fce40147940 2026-02-22T23:26:51.226 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.217+0000 7fce3e7fc640 1 -- 10.20.193.93:0/4288451562 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fce34003150 con 0x7fce40147940 2026-02-22T23:26:51.226 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.217+0000 7fce3e7fc640 1 -- 10.20.193.93:0/4288451562 <== mon.2 v1:10.20.193.93:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fce34003370 con 0x7fce40147940 2026-02-22T23:26:51.226 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.217+0000 7fce3e7fc640 1 -- 10.20.193.93:0/4288451562 <== mon.2 v1:10.20.193.93:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fce34003800 con 0x7fce40147940 2026-02-22T23:26:51.226 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.217+0000 7fce46133640 1 -- 10.20.193.93:0/4288451562 >> v1:10.20.193.93:6790/0 conn(0x7fce40147940 legacy=0x7fce4014f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.226 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.217+0000 7fce46133640 1 -- 10.20.193.93:0/4288451562 shutdown_connections 2026-02-22T23:26:51.226 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.217+0000 7fce46133640 1 -- 10.20.193.93:0/4288451562 >> 10.20.193.93:0/4288451562 conn(0x7fce4006d480 msgr2=0x7fce4006d890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:51.226 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.217+0000 7fce46133640 1 -- 10.20.193.93:0/4288451562 shutdown_connections 2026-02-22T23:26:51.226 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.217+0000 7fce46133640 1 -- 10.20.193.93:0/4288451562 wait complete. 2026-02-22T23:26:51.226 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.218+0000 7fce46133640 1 Processor -- start 2026-02-22T23:26:51.226 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.218+0000 7fce46133640 1 -- start start 2026-02-22T23:26:51.227 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.218+0000 7fce46133640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce401daa60 con 0x7fce400b0d60 2026-02-22T23:26:51.227 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.218+0000 7fce46133640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce4013c360 con 0x7fce40147940 2026-02-22T23:26:51.227 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.218+0000 7fce46133640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce40071cd0 con 0x7fce400b1140 2026-02-22T23:26:51.227 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.218+0000 7fce3f7fe640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7fce400b0d60 0x7fce4013c800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:36900/0 (socket says 10.20.193.93:36900) 2026-02-22T23:26:51.227 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.218+0000 7fce3f7fe640 1 -- 10.20.193.93:0/430317562 learned_addr learned my addr 10.20.193.93:0/430317562 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:26:51.227 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.218+0000 7fce1bfff640 1 -- 10.20.193.93:0/430317562 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3420986967 0 0) 0x7fce401daa60 con 0x7fce400b0d60 2026-02-22T23:26:51.227 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.218+0000 7fce1bfff640 1 -- 10.20.193.93:0/430317562 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce10003620 con 0x7fce400b0d60 2026-02-22T23:26:51.227 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.218+0000 7fce1bfff640 1 -- 10.20.193.93:0/430317562 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1572246748 0 0) 0x7fce40071cd0 con 0x7fce400b1140 2026-02-22T23:26:51.227 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.218+0000 7fce1bfff640 1 -- 10.20.193.93:0/430317562 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce401daa60 con 0x7fce400b1140 2026-02-22T23:26:51.227 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.219+0000 7fce1bfff640 1 -- 10.20.193.93:0/430317562 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1360528905 0 0) 0x7fce10003620 con 0x7fce400b0d60 2026-02-22T23:26:51.227 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.219+0000 7fce1bfff640 1 -- 10.20.193.93:0/430317562 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fce40071cd0 con 0x7fce400b0d60 2026-02-22T23:26:51.227 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.219+0000 7fce1bfff640 1 -- 10.20.193.93:0/430317562 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fce2c003230 con 0x7fce400b0d60 2026-02-22T23:26:51.227 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.219+0000 7fce1bfff640 1 -- 10.20.193.93:0/430317562 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1580949410 0 0) 0x7fce401daa60 con 0x7fce400b1140 2026-02-22T23:26:51.228 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.219+0000 7fce1bfff640 1 -- 10.20.193.93:0/430317562 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fce10003620 con 0x7fce400b1140 2026-02-22T23:26:51.228 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.219+0000 7fce1bfff640 1 -- 10.20.193.93:0/430317562 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fce30002ae0 con 0x7fce400b1140 2026-02-22T23:26:51.228 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.219+0000 7fce1bfff640 1 -- 10.20.193.93:0/430317562 <== mon.0 v1:10.20.193.93:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4183900525 0 0) 0x7fce40071cd0 con 0x7fce400b0d60 2026-02-22T23:26:51.228 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.219+0000 7fce1bfff640 1 -- 10.20.193.93:0/430317562 >> v1:10.20.193.93:6790/0 conn(0x7fce400b1140 legacy=0x7fce4013a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.228 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.219+0000 7fce1bfff640 1 -- 10.20.193.93:0/430317562 >> v1:10.20.193.155:6789/0 conn(0x7fce40147940 legacy=0x7fce401daf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.228 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.219+0000 7fce1bfff640 1 -- 10.20.193.93:0/430317562 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce4013af80 con 0x7fce400b0d60 2026-02-22T23:26:51.228 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.219+0000 7fce46133640 1 -- 10.20.193.93:0/430317562 --> v1:10.20.193.93:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fce4013b850 con 0x7fce400b0d60 2026-02-22T23:26:51.228 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.219+0000 7fce46133640 1 -- 10.20.193.93:0/430317562 --> v1:10.20.193.93:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fce4013ab60 con 0x7fce400b0d60 2026-02-22T23:26:51.228 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.219+0000 7fce1bfff640 1 -- 10.20.193.93:0/430317562 <== mon.0 v1:10.20.193.93:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fce2c003530 con 0x7fce400b0d60 2026-02-22T23:26:51.228 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.219+0000 7fce1bfff640 1 -- 10.20.193.93:0/430317562 <== mon.0 v1:10.20.193.93:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fce2c003b60 con 0x7fce400b0d60 2026-02-22T23:26:51.228 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.219+0000 7fce46133640 1 -- 10.20.193.93:0/430317562 --> v1:10.20.193.93:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce400008d0 con 0x7fce400b0d60 2026-02-22T23:26:51.228 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.220+0000 7fce1bfff640 1 -- 10.20.193.93:0/430317562 <== mon.0 v1:10.20.193.93:6789/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7fce2c003d00 con 0x7fce400b0d60 2026-02-22T23:26:51.229 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.220+0000 7fce1bfff640 1 -- 10.20.193.93:0/430317562 <== mon.0 v1:10.20.193.93:6789/0 8 ==== osd_map(25..25 src has 1..25) ==== 4521+0+0 (unknown 3458299925 0 0) 0x7fce2c0943f0 con 0x7fce400b0d60 2026-02-22T23:26:51.229 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.222+0000 7fce1bfff640 1 -- 10.20.193.93:0/430317562 <== mon.0 v1:10.20.193.93:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7fce2c05dbb0 con 0x7fce400b0d60 2026-02-22T23:26:51.309 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.306+0000 7fce46133640 1 -- 10.20.193.93:0/430317562 --> v1:10.20.193.155:6800/3108481844 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fce40143620 con 0x7fce100780a0 2026-02-22T23:26:51.309 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.306+0000 7fce1bfff640 1 -- 10.20.193.93:0/430317562 <== mgr.4108 v1:10.20.193.155:6800/3108481844 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (unknown 2057319476 0 0) 0x7fce40143620 con 0x7fce100780a0 2026-02-22T23:26:51.309 INFO:teuthology.orchestra.run.trial093.stderr:instructed osd(s) 0 to deep-scrub 2026-02-22T23:26:51.310 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.307+0000 7fce46133640 1 -- 10.20.193.93:0/430317562 >> v1:10.20.193.155:6800/3108481844 conn(0x7fce100780a0 legacy=0x7fce1007a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.310 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.307+0000 7fce46133640 1 -- 10.20.193.93:0/430317562 >> v1:10.20.193.93:6789/0 conn(0x7fce400b0d60 legacy=0x7fce4013c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.311 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.307+0000 7fce46133640 1 -- 10.20.193.93:0/430317562 shutdown_connections 2026-02-22T23:26:51.311 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.307+0000 7fce46133640 1 -- 10.20.193.93:0/430317562 >> 10.20.193.93:0/430317562 conn(0x7fce4006d480 msgr2=0x7fce400af020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:51.311 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.307+0000 7fce46133640 1 -- 10.20.193.93:0/430317562 shutdown_connections 2026-02-22T23:26:51.311 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.307+0000 7fce46133640 1 -- 10.20.193.93:0/430317562 wait complete. 2026-02-22T23:26:51.318 INFO:tasks.ceph:Scrubbing osd.1 2026-02-22T23:26:51.319 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-22T23:26:51.396 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.386+0000 7f809a424640 1 Processor -- start 2026-02-22T23:26:51.396 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.386+0000 7f809a424640 1 -- start start 2026-02-22T23:26:51.396 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.386+0000 7f809a424640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f809406dad0 con 0x7f809406d6f0 2026-02-22T23:26:51.396 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.386+0000 7f809a424640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8094145e40 con 0x7f80940b1600 2026-02-22T23:26:51.396 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.386+0000 7f809a424640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80940b2bd0 con 0x7f809413ef60 2026-02-22T23:26:51.397 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.386+0000 7f8093fff640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7f809406d6f0 0x7f809413e850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:36906/0 (socket says 10.20.193.93:36906) 2026-02-22T23:26:51.397 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.386+0000 7f8093fff640 1 -- 10.20.193.93:0/3945709272 learned_addr learned my addr 10.20.193.93:0/3945709272 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:26:51.397 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.386+0000 7f8092ffd640 1 -- 10.20.193.93:0/3945709272 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1031101837 0 0) 0x7f80940b2bd0 con 0x7f809413ef60 2026-02-22T23:26:51.397 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.387+0000 7f8092ffd640 1 -- 10.20.193.93:0/3945709272 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8078003620 con 0x7f809413ef60 2026-02-22T23:26:51.397 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.387+0000 7f8092ffd640 1 -- 10.20.193.93:0/3945709272 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2057354179 0 0) 0x7f809406dad0 con 0x7f809406d6f0 2026-02-22T23:26:51.397 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.387+0000 7f8092ffd640 1 -- 10.20.193.93:0/3945709272 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80940b2bd0 con 0x7f809406d6f0 2026-02-22T23:26:51.397 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.387+0000 7f809899a640 1 -- 10.20.193.93:0/3945709272 >> v1:10.20.193.93:6790/0 conn(0x7f809413ef60 legacy=0x7f8094145730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2026-02-22T23:26:51.397 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.387+0000 7f809899a640 1 -- 10.20.193.93:0/3945709272 >> v1:10.20.193.93:6790/0 conn(0x7f809413ef60 legacy=0x7f8094145730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T23:26:51.398 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.387+0000 7f809899a640 1 --1- 10.20.193.93:0/3945709272 >> v1:10.20.193.93:6790/0 conn(0x7f809413ef60 0x7f8094145730 :-1 s=OPENED pgs=290 cs=1 l=1).handle_message read tag failed 2026-02-22T23:26:51.398 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.387+0000 7f809899a640 1 --1- 10.20.193.93:0/3945709272 >> v1:10.20.193.93:6790/0 conn(0x7f809413ef60 0x7f8094145730 :-1 s=OPENED pgs=290 cs=1 l=1).fault on lossy channel, failing 2026-02-22T23:26:51.398 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.387+0000 7f8092ffd640 1 -- 10.20.193.93:0/3945709272 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3524725368 0 0) 0x7f80940b2bd0 con 0x7f809406d6f0 2026-02-22T23:26:51.398 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.387+0000 7f8092ffd640 1 -- 10.20.193.93:0/3945709272 >> v1:10.20.193.93:6790/0 conn(0x7f809413ef60 legacy=0x7f8094145730 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:26:51.398 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.387+0000 7f8092ffd640 1 -- 10.20.193.93:0/3945709272 >> v1:10.20.193.155:6789/0 conn(0x7f80940b1600 legacy=0x7f8094145020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.398 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.387+0000 7f8092ffd640 1 -- 10.20.193.93:0/3945709272 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80940b2eb0 con 0x7f809406d6f0 2026-02-22T23:26:51.398 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.387+0000 7f8092ffd640 1 -- 10.20.193.93:0/3945709272 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f8080002e80 con 0x7f809406d6f0 2026-02-22T23:26:51.398 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.387+0000 7f8092ffd640 1 -- 10.20.193.93:0/3945709272 <== mon.0 v1:10.20.193.93:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f80800030a0 con 0x7f809406d6f0 2026-02-22T23:26:51.399 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.387+0000 7f8092ffd640 1 -- 10.20.193.93:0/3945709272 <== mon.0 v1:10.20.193.93:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f80800034b0 con 0x7f809406d6f0 2026-02-22T23:26:51.399 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.387+0000 7f809a424640 1 -- 10.20.193.93:0/3945709272 >> v1:10.20.193.93:6789/0 conn(0x7f809406d6f0 legacy=0x7f809413e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.399 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.387+0000 7f809a424640 1 -- 10.20.193.93:0/3945709272 shutdown_connections 2026-02-22T23:26:51.399 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.387+0000 7f809a424640 1 -- 10.20.193.93:0/3945709272 >> 10.20.193.93:0/3945709272 conn(0x7f80940b6920 msgr2=0x7f80940b6d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:51.399 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.387+0000 7f809a424640 1 -- 10.20.193.93:0/3945709272 shutdown_connections 2026-02-22T23:26:51.399 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.387+0000 7f809a424640 1 -- 10.20.193.93:0/3945709272 wait complete. 2026-02-22T23:26:51.399 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.388+0000 7f809a424640 1 Processor -- start 2026-02-22T23:26:51.399 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.388+0000 7f809a424640 1 -- start start 2026-02-22T23:26:51.399 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.388+0000 7f809a424640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8094132370 con 0x7f809413ef60 2026-02-22T23:26:51.399 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.388+0000 7f809a424640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80941d96d0 con 0x7f809406d6f0 2026-02-22T23:26:51.400 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.388+0000 7f809a424640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f809413f4d0 con 0x7f80940b1600 2026-02-22T23:26:51.400 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.388+0000 7f80937fe640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7f80940b1600 0x7f8094131550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:53558/0 (socket says 10.20.193.93:53558) 2026-02-22T23:26:51.400 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.388+0000 7f80937fe640 1 -- 10.20.193.93:0/1482249342 learned_addr learned my addr 10.20.193.93:0/1482249342 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:26:51.400 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.388+0000 7f8090ff9640 1 -- 10.20.193.93:0/1482249342 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3911469166 0 0) 0x7f809413f4d0 con 0x7f80940b1600 2026-02-22T23:26:51.400 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.388+0000 7f8090ff9640 1 -- 10.20.193.93:0/1482249342 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8064003620 con 0x7f80940b1600 2026-02-22T23:26:51.400 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.388+0000 7f8090ff9640 1 -- 10.20.193.93:0/1482249342 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3692857166 0 0) 0x7f8094132370 con 0x7f809413ef60 2026-02-22T23:26:51.400 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.388+0000 7f8090ff9640 1 -- 10.20.193.93:0/1482249342 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f809413f4d0 con 0x7f809413ef60 2026-02-22T23:26:51.400 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.388+0000 7f8090ff9640 1 -- 10.20.193.93:0/1482249342 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4281172525 0 0) 0x7f8064003620 con 0x7f80940b1600 2026-02-22T23:26:51.400 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.388+0000 7f8090ff9640 1 -- 10.20.193.93:0/1482249342 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8094132370 con 0x7f80940b1600 2026-02-22T23:26:51.401 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.388+0000 7f8090ff9640 1 -- 10.20.193.93:0/1482249342 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f80840031c0 con 0x7f80940b1600 2026-02-22T23:26:51.401 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.388+0000 7f8090ff9640 1 -- 10.20.193.93:0/1482249342 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3323565134 0 0) 0x7f809413f4d0 con 0x7f809413ef60 2026-02-22T23:26:51.401 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.388+0000 7f8090ff9640 1 -- 10.20.193.93:0/1482249342 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8064003620 con 0x7f809413ef60 2026-02-22T23:26:51.401 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.388+0000 7f8090ff9640 1 -- 10.20.193.93:0/1482249342 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f8088003470 con 0x7f809413ef60 2026-02-22T23:26:51.401 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.388+0000 7f8090ff9640 1 -- 10.20.193.93:0/1482249342 <== mon.2 v1:10.20.193.93:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3279605115 0 0) 0x7f8094132370 con 0x7f80940b1600 2026-02-22T23:26:51.401 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.388+0000 7f8090ff9640 1 -- 10.20.193.93:0/1482249342 >> v1:10.20.193.155:6789/0 conn(0x7f809406d6f0 legacy=0x7f809413c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.401 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.388+0000 7f8090ff9640 1 -- 10.20.193.93:0/1482249342 >> v1:10.20.193.93:6789/0 conn(0x7f809413ef60 legacy=0x7f8094131c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.401 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.388+0000 7f8090ff9640 1 -- 10.20.193.93:0/1482249342 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f809413fdd0 con 0x7f80940b1600 2026-02-22T23:26:51.401 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.388+0000 7f809a424640 1 -- 10.20.193.93:0/1482249342 --> v1:10.20.193.93:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f809413e030 con 0x7f80940b1600 2026-02-22T23:26:51.402 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.388+0000 7f809a424640 1 -- 10.20.193.93:0/1482249342 --> v1:10.20.193.93:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f8094132a20 con 0x7f80940b1600 2026-02-22T23:26:51.402 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.388+0000 7f8090ff9640 1 -- 10.20.193.93:0/1482249342 <== mon.2 v1:10.20.193.93:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f80840034e0 con 0x7f80940b1600 2026-02-22T23:26:51.402 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.388+0000 7f8090ff9640 1 -- 10.20.193.93:0/1482249342 <== mon.2 v1:10.20.193.93:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f8084003b60 con 0x7f80940b1600 2026-02-22T23:26:51.402 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.389+0000 7f809a424640 1 -- 10.20.193.93:0/1482249342 --> v1:10.20.193.93:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f8094141310 con 0x7f80940b1600 2026-02-22T23:26:51.402 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.389+0000 7f8090ff9640 1 -- 10.20.193.93:0/1482249342 <== mon.2 v1:10.20.193.93:6790/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7f8084003d80 con 0x7f80940b1600 2026-02-22T23:26:51.402 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.390+0000 7f8090ff9640 1 -- 10.20.193.93:0/1482249342 <== mon.2 v1:10.20.193.93:6790/0 8 ==== osd_map(25..25 src has 1..25) ==== 4521+0+0 (unknown 3458299925 0 0) 0x7f80840945d0 con 0x7f80940b1600 2026-02-22T23:26:51.402 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.390+0000 7f8090ff9640 1 -- 10.20.193.93:0/1482249342 --> v1:10.20.193.93:6800/4002367425 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8064083a50 con 0x7f806407fe80 2026-02-22T23:26:51.402 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.390+0000 7f8090ff9640 1 -- 10.20.193.93:0/1482249342 <== mon.2 v1:10.20.193.93:6790/0 9 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (unknown 2663167439 0 0) 0x7f80840949b0 con 0x7f80940b1600 2026-02-22T23:26:51.402 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.390+0000 7f8090ff9640 1 -- 10.20.193.93:0/1482249342 <== osd.1 v1:10.20.193.93:6800/4002367425 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7f8064083a50 con 0x7f806407fe80 2026-02-22T23:26:51.403 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.397+0000 7f809a424640 1 -- 10.20.193.93:0/1482249342 --> v1:10.20.193.93:6800/4002367425 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f809413f6a0 con 0x7f806407fe80 2026-02-22T23:26:51.403 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.397+0000 7f8090ff9640 1 -- 10.20.193.93:0/1482249342 <== osd.1 v1:10.20.193.93:6800/4002367425 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f809413f6a0 con 0x7f806407fe80 2026-02-22T23:26:51.403 INFO:teuthology.orchestra.run.trial093.stdout:{ 2026-02-22T23:26:51.404 INFO:teuthology.orchestra.run.trial093.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-22T23:26:51.404 INFO:teuthology.orchestra.run.trial093.stdout:} 2026-02-22T23:26:51.405 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.397+0000 7f809a424640 1 -- 10.20.193.93:0/1482249342 >> v1:10.20.193.93:6800/4002367425 conn(0x7f806407fe80 legacy=0x7f80640822a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.405 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.397+0000 7f809a424640 1 -- 10.20.193.93:0/1482249342 >> v1:10.20.193.155:6800/3108481844 conn(0x7f8064077fe0 legacy=0x7f806407a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.405 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.397+0000 7f809a424640 1 -- 10.20.193.93:0/1482249342 >> v1:10.20.193.93:6790/0 conn(0x7f80940b1600 legacy=0x7f8094131550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.405 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.397+0000 7f809899a640 1 -- 10.20.193.93:0/1482249342 reap_dead start 2026-02-22T23:26:51.405 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.397+0000 7f809a424640 1 -- 10.20.193.93:0/1482249342 shutdown_connections 2026-02-22T23:26:51.405 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.397+0000 7f809a424640 1 -- 10.20.193.93:0/1482249342 >> 10.20.193.93:0/1482249342 conn(0x7f80940b6920 msgr2=0x7f809414d500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:51.405 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.397+0000 7f809a424640 1 -- 10.20.193.93:0/1482249342 shutdown_connections 2026-02-22T23:26:51.405 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.397+0000 7f809a424640 1 -- 10.20.193.93:0/1482249342 wait complete. 2026-02-22T23:26:51.407 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-22T23:26:51.479 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.472+0000 7fb46dec9640 1 Processor -- start 2026-02-22T23:26:51.480 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.472+0000 7fb46dec9640 1 -- start start 2026-02-22T23:26:51.480 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.472+0000 7fb46dec9640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb46806e4d0 con 0x7fb468072270 2026-02-22T23:26:51.480 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.472+0000 7fb46dec9640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb468073310 con 0x7fb4681435b0 2026-02-22T23:26:51.480 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.472+0000 7fb46dec9640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4680738b0 con 0x7fb46806e0f0 2026-02-22T23:26:51.480 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.472+0000 7fb4677fe640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7fb46806e0f0 0x7fb468142ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:53560/0 (socket says 10.20.193.93:53560) 2026-02-22T23:26:51.480 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.472+0000 7fb467fff640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7fb468072270 0x7fb468071710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:36912/0 (socket says 10.20.193.93:36912) 2026-02-22T23:26:51.480 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.472+0000 7fb4677fe640 1 -- 10.20.193.93:0/649108348 learned_addr learned my addr 10.20.193.93:0/649108348 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:26:51.480 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.472+0000 7fb4667fc640 1 -- 10.20.193.93:0/649108348 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3122363952 0 0) 0x7fb46806e4d0 con 0x7fb468072270 2026-02-22T23:26:51.480 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.472+0000 7fb4667fc640 1 -- 10.20.193.93:0/649108348 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb44c003620 con 0x7fb468072270 2026-02-22T23:26:51.480 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.472+0000 7fb4667fc640 1 -- 10.20.193.93:0/649108348 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4278262611 0 0) 0x7fb4680738b0 con 0x7fb46806e0f0 2026-02-22T23:26:51.481 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.472+0000 7fb4667fc640 1 -- 10.20.193.93:0/649108348 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb46806e4d0 con 0x7fb46806e0f0 2026-02-22T23:26:51.481 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.473+0000 7fb4667fc640 1 -- 10.20.193.93:0/649108348 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3013432925 0 0) 0x7fb468073310 con 0x7fb4681435b0 2026-02-22T23:26:51.481 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.473+0000 7fb4667fc640 1 -- 10.20.193.93:0/649108348 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4680738b0 con 0x7fb4681435b0 2026-02-22T23:26:51.481 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.473+0000 7fb4667fc640 1 -- 10.20.193.93:0/649108348 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3566133085 0 0) 0x7fb44c003620 con 0x7fb468072270 2026-02-22T23:26:51.481 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.473+0000 7fb4667fc640 1 -- 10.20.193.93:0/649108348 >> v1:10.20.193.93:6790/0 conn(0x7fb46806e0f0 legacy=0x7fb468142ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.481 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.473+0000 7fb4667fc640 1 -- 10.20.193.93:0/649108348 >> v1:10.20.193.155:6789/0 conn(0x7fb4681435b0 legacy=0x7fb468071000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.481 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.473+0000 7fb4667fc640 1 -- 10.20.193.93:0/649108348 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4680735b0 con 0x7fb468072270 2026-02-22T23:26:51.481 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.473+0000 7fb4667fc640 1 -- 10.20.193.93:0/649108348 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fb45c003220 con 0x7fb468072270 2026-02-22T23:26:51.481 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.473+0000 7fb4667fc640 1 -- 10.20.193.93:0/649108348 <== mon.0 v1:10.20.193.93:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb45c0033c0 con 0x7fb468072270 2026-02-22T23:26:51.481 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.473+0000 7fb4667fc640 1 -- 10.20.193.93:0/649108348 <== mon.0 v1:10.20.193.93:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fb45c0037d0 con 0x7fb468072270 2026-02-22T23:26:51.481 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.473+0000 7fb46dec9640 1 -- 10.20.193.93:0/649108348 >> v1:10.20.193.93:6789/0 conn(0x7fb468072270 legacy=0x7fb468071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.481 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.473+0000 7fb46dec9640 1 -- 10.20.193.93:0/649108348 shutdown_connections 2026-02-22T23:26:51.482 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.473+0000 7fb46dec9640 1 -- 10.20.193.93:0/649108348 >> 10.20.193.93:0/649108348 conn(0x7fb4680b7360 msgr2=0x7fb46806d480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:51.482 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.473+0000 7fb46dec9640 1 -- 10.20.193.93:0/649108348 shutdown_connections 2026-02-22T23:26:51.482 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.473+0000 7fb46dec9640 1 -- 10.20.193.93:0/649108348 wait complete. 2026-02-22T23:26:51.482 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.474+0000 7fb46dec9640 1 Processor -- start 2026-02-22T23:26:51.482 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.474+0000 7fb46dec9640 1 -- start start 2026-02-22T23:26:51.482 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.474+0000 7fb46dec9640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb468139c00 con 0x7fb46806e0f0 2026-02-22T23:26:51.482 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.474+0000 7fb46dec9640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb468146e60 con 0x7fb468072270 2026-02-22T23:26:51.482 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.474+0000 7fb46dec9640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb46813c580 con 0x7fb4681435b0 2026-02-22T23:26:51.482 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.474+0000 7fb4677fe640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7fb46806e0f0 0x7fb46813dc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:36920/0 (socket says 10.20.193.93:36920) 2026-02-22T23:26:51.482 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.474+0000 7fb4677fe640 1 -- 10.20.193.93:0/900145415 learned_addr learned my addr 10.20.193.93:0/900145415 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:26:51.482 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.474+0000 7fb443fff640 1 -- 10.20.193.93:0/900145415 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4077092995 0 0) 0x7fb468139c00 con 0x7fb46806e0f0 2026-02-22T23:26:51.482 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.474+0000 7fb443fff640 1 -- 10.20.193.93:0/900145415 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb438003620 con 0x7fb46806e0f0 2026-02-22T23:26:51.483 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.474+0000 7fb443fff640 1 -- 10.20.193.93:0/900145415 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2149460109 0 0) 0x7fb46813c580 con 0x7fb4681435b0 2026-02-22T23:26:51.483 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.474+0000 7fb443fff640 1 -- 10.20.193.93:0/900145415 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb468139c00 con 0x7fb4681435b0 2026-02-22T23:26:51.483 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.474+0000 7fb443fff640 1 -- 10.20.193.93:0/900145415 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 821748397 0 0) 0x7fb438003620 con 0x7fb46806e0f0 2026-02-22T23:26:51.483 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.474+0000 7fb443fff640 1 -- 10.20.193.93:0/900145415 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb46813c580 con 0x7fb46806e0f0 2026-02-22T23:26:51.483 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.474+0000 7fb443fff640 1 -- 10.20.193.93:0/900145415 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fb454002bc0 con 0x7fb46806e0f0 2026-02-22T23:26:51.483 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.474+0000 7fb443fff640 1 -- 10.20.193.93:0/900145415 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 748450337 0 0) 0x7fb468139c00 con 0x7fb4681435b0 2026-02-22T23:26:51.483 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.474+0000 7fb443fff640 1 -- 10.20.193.93:0/900145415 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb438003620 con 0x7fb4681435b0 2026-02-22T23:26:51.483 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.474+0000 7fb443fff640 1 -- 10.20.193.93:0/900145415 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fb45c003570 con 0x7fb4681435b0 2026-02-22T23:26:51.483 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.474+0000 7fb443fff640 1 -- 10.20.193.93:0/900145415 <== mon.0 v1:10.20.193.93:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1831329775 0 0) 0x7fb46813c580 con 0x7fb46806e0f0 2026-02-22T23:26:51.483 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.474+0000 7fb443fff640 1 -- 10.20.193.93:0/900145415 >> v1:10.20.193.93:6790/0 conn(0x7fb4681435b0 legacy=0x7fb4681e5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.483 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.474+0000 7fb443fff640 1 -- 10.20.193.93:0/900145415 >> v1:10.20.193.155:6789/0 conn(0x7fb468072270 legacy=0x7fb4681e2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.483 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.474+0000 7fb443fff640 1 -- 10.20.193.93:0/900145415 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb46813ef70 con 0x7fb46806e0f0 2026-02-22T23:26:51.484 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.474+0000 7fb46dec9640 1 -- 10.20.193.93:0/900145415 --> v1:10.20.193.93:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb468145ec0 con 0x7fb46806e0f0 2026-02-22T23:26:51.484 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.475+0000 7fb46dec9640 1 -- 10.20.193.93:0/900145415 --> v1:10.20.193.93:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb468147ab0 con 0x7fb46806e0f0 2026-02-22T23:26:51.484 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.475+0000 7fb443fff640 1 -- 10.20.193.93:0/900145415 <== mon.0 v1:10.20.193.93:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb454002ea0 con 0x7fb46806e0f0 2026-02-22T23:26:51.484 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.475+0000 7fb443fff640 1 -- 10.20.193.93:0/900145415 <== mon.0 v1:10.20.193.93:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fb454004d70 con 0x7fb46806e0f0 2026-02-22T23:26:51.484 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.475+0000 7fb46dec9640 1 -- 10.20.193.93:0/900145415 --> v1:10.20.193.93:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb46813d830 con 0x7fb46806e0f0 2026-02-22T23:26:51.484 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.476+0000 7fb443fff640 1 -- 10.20.193.93:0/900145415 <== mon.0 v1:10.20.193.93:6789/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7fb45401d5c0 con 0x7fb46806e0f0 2026-02-22T23:26:51.484 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.476+0000 7fb443fff640 1 -- 10.20.193.93:0/900145415 <== mon.0 v1:10.20.193.93:6789/0 8 ==== osd_map(25..25 src has 1..25) ==== 4521+0+0 (unknown 3458299925 0 0) 0x7fb454094570 con 0x7fb46806e0f0 2026-02-22T23:26:51.485 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.478+0000 7fb443fff640 1 -- 10.20.193.93:0/900145415 <== mon.0 v1:10.20.193.93:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7fb45405dc50 con 0x7fb46806e0f0 2026-02-22T23:26:51.563 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.560+0000 7fb46dec9640 1 -- 10.20.193.93:0/900145415 --> v1:10.20.193.155:6800/3108481844 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fb468069810 con 0x7fb4380781d0 2026-02-22T23:26:51.564 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.560+0000 7fb443fff640 1 -- 10.20.193.93:0/900145415 <== mgr.4108 v1:10.20.193.155:6800/3108481844 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (unknown 489605429 0 0) 0x7fb468069810 con 0x7fb4380781d0 2026-02-22T23:26:51.564 INFO:teuthology.orchestra.run.trial093.stderr:instructed osd(s) 1 to deep-scrub 2026-02-22T23:26:51.565 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.561+0000 7fb46dec9640 1 -- 10.20.193.93:0/900145415 >> v1:10.20.193.155:6800/3108481844 conn(0x7fb4380781d0 legacy=0x7fb43807a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.565 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.561+0000 7fb46dec9640 1 -- 10.20.193.93:0/900145415 >> v1:10.20.193.93:6789/0 conn(0x7fb46806e0f0 legacy=0x7fb46813dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.565 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.561+0000 7fb46dec9640 1 -- 10.20.193.93:0/900145415 shutdown_connections 2026-02-22T23:26:51.565 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.561+0000 7fb46dec9640 1 -- 10.20.193.93:0/900145415 >> 10.20.193.93:0/900145415 conn(0x7fb4680b7360 msgr2=0x7fb46813f560 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:51.565 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.561+0000 7fb46dec9640 1 -- 10.20.193.93:0/900145415 shutdown_connections 2026-02-22T23:26:51.565 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.561+0000 7fb46dec9640 1 -- 10.20.193.93:0/900145415 wait complete. 2026-02-22T23:26:51.572 INFO:tasks.ceph:Scrubbing osd.2 2026-02-22T23:26:51.572 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-22T23:26:51.647 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.639+0000 7fd8d0e32640 1 Processor -- start 2026-02-22T23:26:51.647 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.639+0000 7fd8d0e32640 1 -- start start 2026-02-22T23:26:51.648 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.639+0000 7fd8d0e32640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8cc0b1790 con 0x7fd8cc0b30f0 2026-02-22T23:26:51.648 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.639+0000 7fd8d0e32640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8cc1472c0 con 0x7fd8cc0b13b0 2026-02-22T23:26:51.648 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.639+0000 7fd8d0e32640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8cc070860 con 0x7fd8cc1437b0 2026-02-22T23:26:51.648 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.639+0000 7fd8c9d74640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7fd8cc0b30f0 0x7fd8cc1430a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:36924/0 (socket says 10.20.193.93:36924) 2026-02-22T23:26:51.648 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.639+0000 7fd8c9d74640 1 -- 10.20.193.93:0/681870932 learned_addr learned my addr 10.20.193.93:0/681870932 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:26:51.648 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.640+0000 7fd8c9573640 1 -- 10.20.193.93:0/681870932 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4154205419 0 0) 0x7fd8cc0b1790 con 0x7fd8cc0b30f0 2026-02-22T23:26:51.648 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.640+0000 7fd8c9573640 1 -- 10.20.193.93:0/681870932 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8b8003620 con 0x7fd8cc0b30f0 2026-02-22T23:26:51.648 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.640+0000 7fd8c9573640 1 -- 10.20.193.93:0/681870932 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 910673748 0 0) 0x7fd8cc070860 con 0x7fd8cc1437b0 2026-02-22T23:26:51.648 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.640+0000 7fd8c9573640 1 -- 10.20.193.93:0/681870932 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8cc0b1790 con 0x7fd8cc1437b0 2026-02-22T23:26:51.648 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.640+0000 7fd8c9573640 1 -- 10.20.193.93:0/681870932 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1777154701 0 0) 0x7fd8cc1472c0 con 0x7fd8cc0b13b0 2026-02-22T23:26:51.648 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.640+0000 7fd8c9573640 1 -- 10.20.193.93:0/681870932 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8cc070860 con 0x7fd8cc0b13b0 2026-02-22T23:26:51.649 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.640+0000 7fd8c9573640 1 -- 10.20.193.93:0/681870932 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1703107309 0 0) 0x7fd8b8003620 con 0x7fd8cc0b30f0 2026-02-22T23:26:51.649 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.640+0000 7fd8c9573640 1 -- 10.20.193.93:0/681870932 >> v1:10.20.193.93:6790/0 conn(0x7fd8cc1437b0 legacy=0x7fd8cc14f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.649 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.640+0000 7fd8c9573640 1 -- 10.20.193.93:0/681870932 >> v1:10.20.193.155:6789/0 conn(0x7fd8cc0b13b0 legacy=0x7fd8cc1477e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.649 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.640+0000 7fd8c9573640 1 -- 10.20.193.93:0/681870932 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8cc0b1c90 con 0x7fd8cc0b30f0 2026-02-22T23:26:51.649 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.640+0000 7fd8c9573640 1 -- 10.20.193.93:0/681870932 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fd8b4002ea0 con 0x7fd8cc0b30f0 2026-02-22T23:26:51.649 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.640+0000 7fd8c9573640 1 -- 10.20.193.93:0/681870932 <== mon.0 v1:10.20.193.93:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd8b4003040 con 0x7fd8cc0b30f0 2026-02-22T23:26:51.649 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.640+0000 7fd8c9573640 1 -- 10.20.193.93:0/681870932 <== mon.0 v1:10.20.193.93:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fd8b40034d0 con 0x7fd8cc0b30f0 2026-02-22T23:26:51.649 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.640+0000 7fd8d0e32640 1 -- 10.20.193.93:0/681870932 >> v1:10.20.193.93:6789/0 conn(0x7fd8cc0b30f0 legacy=0x7fd8cc1430a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.649 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.640+0000 7fd8d0e32640 1 -- 10.20.193.93:0/681870932 shutdown_connections 2026-02-22T23:26:51.649 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.640+0000 7fd8d0e32640 1 -- 10.20.193.93:0/681870932 >> 10.20.193.93:0/681870932 conn(0x7fd8cc0b2230 msgr2=0x7fd8cc0b2640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:51.649 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.640+0000 7fd8d0e32640 1 -- 10.20.193.93:0/681870932 shutdown_connections 2026-02-22T23:26:51.650 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.640+0000 7fd8d0e32640 1 -- 10.20.193.93:0/681870932 wait complete. 2026-02-22T23:26:51.650 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.641+0000 7fd8d0e32640 1 Processor -- start 2026-02-22T23:26:51.650 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.641+0000 7fd8d0e32640 1 -- start start 2026-02-22T23:26:51.650 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.641+0000 7fd8d0e32640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8cc0740a0 con 0x7fd8cc0b30f0 2026-02-22T23:26:51.650 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.641+0000 7fd8d0e32640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8cc1db970 con 0x7fd8cc0b13b0 2026-02-22T23:26:51.650 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.641+0000 7fd8d0e32640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8cc074340 con 0x7fd8cc1437b0 2026-02-22T23:26:51.650 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.641+0000 7fd8c9d74640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7fd8cc0b30f0 0x7fd8cc1db260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:36936/0 (socket says 10.20.193.93:36936) 2026-02-22T23:26:51.650 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.641+0000 7fd8c9d74640 1 -- 10.20.193.93:0/3630993454 learned_addr learned my addr 10.20.193.93:0/3630993454 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:26:51.650 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.641+0000 7fd8b2ffd640 1 -- 10.20.193.93:0/3630993454 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2384145761 0 0) 0x7fd8cc0740a0 con 0x7fd8cc0b30f0 2026-02-22T23:26:51.650 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.641+0000 7fd8b2ffd640 1 -- 10.20.193.93:0/3630993454 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd898003620 con 0x7fd8cc0b30f0 2026-02-22T23:26:51.650 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.641+0000 7fd8b2ffd640 1 -- 10.20.193.93:0/3630993454 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3203959820 0 0) 0x7fd8cc074340 con 0x7fd8cc1437b0 2026-02-22T23:26:51.650 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.641+0000 7fd8b2ffd640 1 -- 10.20.193.93:0/3630993454 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8cc0740a0 con 0x7fd8cc1437b0 2026-02-22T23:26:51.650 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.641+0000 7fd8b2ffd640 1 -- 10.20.193.93:0/3630993454 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 674458894 0 0) 0x7fd898003620 con 0x7fd8cc0b30f0 2026-02-22T23:26:51.651 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.641+0000 7fd8b2ffd640 1 -- 10.20.193.93:0/3630993454 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd8cc074340 con 0x7fd8cc0b30f0 2026-02-22T23:26:51.651 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.641+0000 7fd8b2ffd640 1 -- 10.20.193.93:0/3630993454 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fd8b4003410 con 0x7fd8cc0b30f0 2026-02-22T23:26:51.651 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.642+0000 7fd8b2ffd640 1 -- 10.20.193.93:0/3630993454 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3943831381 0 0) 0x7fd8cc0740a0 con 0x7fd8cc1437b0 2026-02-22T23:26:51.651 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.642+0000 7fd8b2ffd640 1 -- 10.20.193.93:0/3630993454 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd898003620 con 0x7fd8cc1437b0 2026-02-22T23:26:51.651 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.642+0000 7fd8b2ffd640 1 -- 10.20.193.93:0/3630993454 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fd8bc0032c0 con 0x7fd8cc1437b0 2026-02-22T23:26:51.651 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.642+0000 7fd8b2ffd640 1 -- 10.20.193.93:0/3630993454 <== mon.0 v1:10.20.193.93:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3116416439 0 0) 0x7fd8cc074340 con 0x7fd8cc0b30f0 2026-02-22T23:26:51.651 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.642+0000 7fd8b2ffd640 1 -- 10.20.193.93:0/3630993454 >> v1:10.20.193.93:6790/0 conn(0x7fd8cc1437b0 legacy=0x7fd8cc1e5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.651 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.642+0000 7fd8b2ffd640 1 -- 10.20.193.93:0/3630993454 >> v1:10.20.193.155:6789/0 conn(0x7fd8cc0b13b0 legacy=0x7fd8cc1dab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.651 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.642+0000 7fd8b2ffd640 1 -- 10.20.193.93:0/3630993454 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8cc074620 con 0x7fd8cc0b30f0 2026-02-22T23:26:51.651 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.642+0000 7fd8d0e32640 1 -- 10.20.193.93:0/3630993454 --> v1:10.20.193.93:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd8cc1dedb0 con 0x7fd8cc0b30f0 2026-02-22T23:26:51.651 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.642+0000 7fd8d0e32640 1 -- 10.20.193.93:0/3630993454 --> v1:10.20.193.93:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd8cc1de340 con 0x7fd8cc0b30f0 2026-02-22T23:26:51.651 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.642+0000 7fd8b2ffd640 1 -- 10.20.193.93:0/3630993454 <== mon.0 v1:10.20.193.93:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd8b4004cf0 con 0x7fd8cc0b30f0 2026-02-22T23:26:51.652 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.642+0000 7fd8b2ffd640 1 -- 10.20.193.93:0/3630993454 <== mon.0 v1:10.20.193.93:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fd8b4005040 con 0x7fd8cc0b30f0 2026-02-22T23:26:51.652 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.642+0000 7fd8d0e32640 1 -- 10.20.193.93:0/3630993454 --> v1:10.20.193.93:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fd8cc1de6d0 con 0x7fd8cc0b30f0 2026-02-22T23:26:51.652 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.643+0000 7fd8b2ffd640 1 -- 10.20.193.93:0/3630993454 <== mon.0 v1:10.20.193.93:6789/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7fd8b40051e0 con 0x7fd8cc0b30f0 2026-02-22T23:26:51.652 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.643+0000 7fd8b2ffd640 1 -- 10.20.193.93:0/3630993454 <== mon.0 v1:10.20.193.93:6789/0 8 ==== osd_map(25..25 src has 1..25) ==== 4521+0+0 (unknown 3458299925 0 0) 0x7fd8b4094600 con 0x7fd8cc0b30f0 2026-02-22T23:26:51.652 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.643+0000 7fd8b2ffd640 1 -- 10.20.193.93:0/3630993454 --> v1:10.20.193.93:6812/945702863 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd8b4003040 con 0x7fd89807ff10 2026-02-22T23:26:51.652 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.643+0000 7fd8b2ffd640 1 -- 10.20.193.93:0/3630993454 <== mon.0 v1:10.20.193.93:6789/0 9 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (unknown 2663167439 0 0) 0x7fd8b40949e0 con 0x7fd8cc0b30f0 2026-02-22T23:26:51.652 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.644+0000 7fd8b2ffd640 1 -- 10.20.193.93:0/3630993454 <== osd.2 v1:10.20.193.93:6812/945702863 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7fd8b4003040 con 0x7fd89807ff10 2026-02-22T23:26:51.653 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.650+0000 7fd8d0e32640 1 -- 10.20.193.93:0/3630993454 --> v1:10.20.193.93:6812/945702863 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd8cc074d00 con 0x7fd89807ff10 2026-02-22T23:26:51.653 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.650+0000 7fd8b2ffd640 1 -- 10.20.193.93:0/3630993454 <== osd.2 v1:10.20.193.93:6812/945702863 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fd8cc074d00 con 0x7fd89807ff10 2026-02-22T23:26:51.654 INFO:teuthology.orchestra.run.trial093.stdout:{ 2026-02-22T23:26:51.654 INFO:teuthology.orchestra.run.trial093.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-22T23:26:51.654 INFO:teuthology.orchestra.run.trial093.stdout:} 2026-02-22T23:26:51.655 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.650+0000 7fd8d0e32640 1 -- 10.20.193.93:0/3630993454 >> v1:10.20.193.93:6812/945702863 conn(0x7fd89807ff10 legacy=0x7fd898082330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.655 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.650+0000 7fd8d0e32640 1 -- 10.20.193.93:0/3630993454 >> v1:10.20.193.155:6800/3108481844 conn(0x7fd898078070 legacy=0x7fd89807a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.655 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.650+0000 7fd8d0e32640 1 -- 10.20.193.93:0/3630993454 >> v1:10.20.193.93:6789/0 conn(0x7fd8cc0b30f0 legacy=0x7fd8cc1db260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.655 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.650+0000 7fd8cad76640 1 -- 10.20.193.93:0/3630993454 reap_dead start 2026-02-22T23:26:51.655 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.650+0000 7fd8d0e32640 1 -- 10.20.193.93:0/3630993454 shutdown_connections 2026-02-22T23:26:51.655 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.650+0000 7fd8d0e32640 1 -- 10.20.193.93:0/3630993454 >> 10.20.193.93:0/3630993454 conn(0x7fd8cc0b2230 msgr2=0x7fd8cc0b2610 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:51.655 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.650+0000 7fd8d0e32640 1 -- 10.20.193.93:0/3630993454 shutdown_connections 2026-02-22T23:26:51.655 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.650+0000 7fd8d0e32640 1 -- 10.20.193.93:0/3630993454 wait complete. 2026-02-22T23:26:51.658 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-22T23:26:51.732 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.724+0000 7f0bc3314640 1 Processor -- start 2026-02-22T23:26:51.732 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.724+0000 7f0bc3314640 1 -- start start 2026-02-22T23:26:51.732 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.725+0000 7f0bc3314640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bbc0b16f0 con 0x7f0bbc0b0d60 2026-02-22T23:26:51.733 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.725+0000 7f0bc3314640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bbc0b1940 con 0x7f0bbc147940 2026-02-22T23:26:51.733 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.725+0000 7f0bc3314640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bbc0b5720 con 0x7f0bbc0b1140 2026-02-22T23:26:51.733 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.725+0000 7f0bc1089640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7f0bbc0b0d60 0x7f0bbc142f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:36952/0 (socket says 10.20.193.93:36952) 2026-02-22T23:26:51.733 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.725+0000 7f0bc1089640 1 -- 10.20.193.93:0/3316825300 learned_addr learned my addr 10.20.193.93:0/3316825300 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:26:51.733 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.725+0000 7f0babfff640 1 -- 10.20.193.93:0/3316825300 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2884865258 0 0) 0x7f0bbc0b16f0 con 0x7f0bbc0b0d60 2026-02-22T23:26:51.733 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.725+0000 7f0babfff640 1 -- 10.20.193.93:0/3316825300 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ba4003620 con 0x7f0bbc0b0d60 2026-02-22T23:26:51.734 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.725+0000 7f0babfff640 1 -- 10.20.193.93:0/3316825300 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2142475156 0 0) 0x7f0bbc0b5720 con 0x7f0bbc0b1140 2026-02-22T23:26:51.734 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.725+0000 7f0babfff640 1 -- 10.20.193.93:0/3316825300 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0bbc0b16f0 con 0x7f0bbc0b1140 2026-02-22T23:26:51.734 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.725+0000 7f0babfff640 1 -- 10.20.193.93:0/3316825300 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1391422334 0 0) 0x7f0bbc0b1940 con 0x7f0bbc147940 2026-02-22T23:26:51.734 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.725+0000 7f0babfff640 1 -- 10.20.193.93:0/3316825300 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0bbc0b5720 con 0x7f0bbc147940 2026-02-22T23:26:51.734 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.725+0000 7f0babfff640 1 -- 10.20.193.93:0/3316825300 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2886761108 0 0) 0x7f0ba4003620 con 0x7f0bbc0b0d60 2026-02-22T23:26:51.734 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.725+0000 7f0babfff640 1 -- 10.20.193.93:0/3316825300 >> v1:10.20.193.93:6790/0 conn(0x7f0bbc0b1140 legacy=0x7f0bbc147230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.734 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.725+0000 7f0babfff640 1 -- 10.20.193.93:0/3316825300 >> v1:10.20.193.155:6789/0 conn(0x7f0bbc147940 legacy=0x7f0bbc14f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.734 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.725+0000 7f0babfff640 1 -- 10.20.193.93:0/3316825300 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bbc0aedf0 con 0x7f0bbc0b0d60 2026-02-22T23:26:51.735 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.725+0000 7f0babfff640 1 -- 10.20.193.93:0/3316825300 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f0bac002ea0 con 0x7f0bbc0b0d60 2026-02-22T23:26:51.735 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.725+0000 7f0babfff640 1 -- 10.20.193.93:0/3316825300 <== mon.0 v1:10.20.193.93:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0bac003040 con 0x7f0bbc0b0d60 2026-02-22T23:26:51.735 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.725+0000 7f0babfff640 1 -- 10.20.193.93:0/3316825300 <== mon.0 v1:10.20.193.93:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f0bac0034d0 con 0x7f0bbc0b0d60 2026-02-22T23:26:51.735 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.725+0000 7f0bc3314640 1 -- 10.20.193.93:0/3316825300 >> v1:10.20.193.93:6789/0 conn(0x7f0bbc0b0d60 legacy=0x7f0bbc142f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.735 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.725+0000 7f0bc3314640 1 -- 10.20.193.93:0/3316825300 shutdown_connections 2026-02-22T23:26:51.735 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.725+0000 7f0bc3314640 1 -- 10.20.193.93:0/3316825300 >> 10.20.193.93:0/3316825300 conn(0x7f0bbc06d480 msgr2=0x7f0bbc06d890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:51.736 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.725+0000 7f0bc3314640 1 -- 10.20.193.93:0/3316825300 shutdown_connections 2026-02-22T23:26:51.736 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.725+0000 7f0bc3314640 1 -- 10.20.193.93:0/3316825300 wait complete. 2026-02-22T23:26:51.736 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.726+0000 7f0bc3314640 1 Processor -- start 2026-02-22T23:26:51.736 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.726+0000 7f0bc3314640 1 -- start start 2026-02-22T23:26:51.736 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.727+0000 7f0bc3314640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bbc13e4a0 con 0x7f0bbc0b0d60 2026-02-22T23:26:51.736 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.727+0000 7f0bc3314640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bbc13e780 con 0x7f0bbc0b1140 2026-02-22T23:26:51.736 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.727+0000 7f0bc3314640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bbc13a9b0 con 0x7f0bbc147940 2026-02-22T23:26:51.736 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.727+0000 7f0bc1089640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7f0bbc0b0d60 0x7f0bbc13c9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:36954/0 (socket says 10.20.193.93:36954) 2026-02-22T23:26:51.736 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.727+0000 7f0bc1089640 1 -- 10.20.193.93:0/3014796203 learned_addr learned my addr 10.20.193.93:0/3014796203 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:26:51.736 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.727+0000 7f0bc188a640 1 -- 10.20.193.93:0/3014796203 >> v1:10.20.193.93:6790/0 conn(0x7f0bbc147940 legacy=0x7f0bbc1e5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-22T23:26:51.736 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.727+0000 7f0bc188a640 1 -- 10.20.193.93:0/3014796203 >> v1:10.20.193.93:6790/0 conn(0x7f0bbc147940 legacy=0x7f0bbc1e5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T23:26:51.736 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.727+0000 7f0bc188a640 1 --1- 10.20.193.93:0/3014796203 >> v1:10.20.193.93:6790/0 conn(0x7f0bbc147940 0x7f0bbc1e5540 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).handle_connect_reply_1 read connect reply failed 2026-02-22T23:26:51.737 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.727+0000 7f0bc188a640 1 --1- 10.20.193.93:0/3014796203 >> v1:10.20.193.93:6790/0 conn(0x7f0bbc147940 0x7f0bbc1e5540 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).fault on lossy channel, failing 2026-02-22T23:26:51.737 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.727+0000 7f0ba9ffb640 1 -- 10.20.193.93:0/3014796203 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 402493376 0 0) 0x7f0bbc13e4a0 con 0x7f0bbc0b0d60 2026-02-22T23:26:51.737 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.727+0000 7f0ba9ffb640 1 -- 10.20.193.93:0/3014796203 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b8c003620 con 0x7f0bbc0b0d60 2026-02-22T23:26:51.737 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.727+0000 7f0ba9ffb640 1 -- 10.20.193.93:0/3014796203 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 540698605 0 0) 0x7f0b8c003620 con 0x7f0bbc0b0d60 2026-02-22T23:26:51.737 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.727+0000 7f0ba9ffb640 1 -- 10.20.193.93:0/3014796203 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0bbc13e4a0 con 0x7f0bbc0b0d60 2026-02-22T23:26:51.737 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.727+0000 7f0ba9ffb640 1 -- 10.20.193.93:0/3014796203 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f0bac003390 con 0x7f0bbc0b0d60 2026-02-22T23:26:51.737 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.727+0000 7f0ba9ffb640 1 -- 10.20.193.93:0/3014796203 <== mon.0 v1:10.20.193.93:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4099451610 0 0) 0x7f0bbc13e4a0 con 0x7f0bbc0b0d60 2026-02-22T23:26:51.737 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.727+0000 7f0ba9ffb640 1 -- 10.20.193.93:0/3014796203 >> v1:10.20.193.93:6790/0 conn(0x7f0bbc147940 legacy=0x7f0bbc1e5540 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T23:26:51.737 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.727+0000 7f0ba9ffb640 1 -- 10.20.193.93:0/3014796203 >> v1:10.20.193.155:6789/0 conn(0x7f0bbc0b1140 legacy=0x7f0bbc13d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.737 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.727+0000 7f0ba9ffb640 1 -- 10.20.193.93:0/3014796203 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bbc1dec80 con 0x7f0bbc0b0d60 2026-02-22T23:26:51.737 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.727+0000 7f0bc3314640 1 -- 10.20.193.93:0/3014796203 --> v1:10.20.193.93:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0bbc1de210 con 0x7f0bbc0b0d60 2026-02-22T23:26:51.737 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.727+0000 7f0ba9ffb640 1 -- 10.20.193.93:0/3014796203 <== mon.0 v1:10.20.193.93:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0bac004cf0 con 0x7f0bbc0b0d60 2026-02-22T23:26:51.738 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.727+0000 7f0bc3314640 1 -- 10.20.193.93:0/3014796203 --> v1:10.20.193.93:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f0bbc1e6c60 con 0x7f0bbc0b0d60 2026-02-22T23:26:51.738 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.727+0000 7f0ba9ffb640 1 -- 10.20.193.93:0/3014796203 <== mon.0 v1:10.20.193.93:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f0bac005040 con 0x7f0bbc0b0d60 2026-02-22T23:26:51.738 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.727+0000 7f0bc3314640 1 -- 10.20.193.93:0/3014796203 --> v1:10.20.193.93:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bbc0af980 con 0x7f0bbc0b0d60 2026-02-22T23:26:51.738 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.728+0000 7f0ba9ffb640 1 -- 10.20.193.93:0/3014796203 <== mon.0 v1:10.20.193.93:6789/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7f0bac01d810 con 0x7f0bbc0b0d60 2026-02-22T23:26:51.738 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.728+0000 7f0ba9ffb640 1 -- 10.20.193.93:0/3014796203 <== mon.0 v1:10.20.193.93:6789/0 8 ==== osd_map(25..25 src has 1..25) ==== 4521+0+0 (unknown 3458299925 0 0) 0x7f0bac094520 con 0x7f0bbc0b0d60 2026-02-22T23:26:51.738 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.731+0000 7f0ba9ffb640 1 -- 10.20.193.93:0/3014796203 <== mon.0 v1:10.20.193.93:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f0bac05dc00 con 0x7f0bbc0b0d60 2026-02-22T23:26:51.817 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.813+0000 7f0bc3314640 1 -- 10.20.193.93:0/3014796203 --> v1:10.20.193.155:6800/3108481844 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f0bbc13c5a0 con 0x7f0b8c077f90 2026-02-22T23:26:51.817 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.813+0000 7f0ba9ffb640 1 -- 10.20.193.93:0/3014796203 <== mgr.4108 v1:10.20.193.155:6800/3108481844 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (unknown 3049115190 0 0) 0x7f0bbc13c5a0 con 0x7f0b8c077f90 2026-02-22T23:26:51.818 INFO:teuthology.orchestra.run.trial093.stderr:instructed osd(s) 2 to deep-scrub 2026-02-22T23:26:51.818 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.814+0000 7f0bc3314640 1 -- 10.20.193.93:0/3014796203 >> v1:10.20.193.155:6800/3108481844 conn(0x7f0b8c077f90 legacy=0x7f0b8c07a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.818 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.814+0000 7f0bc3314640 1 -- 10.20.193.93:0/3014796203 >> v1:10.20.193.93:6789/0 conn(0x7f0bbc0b0d60 legacy=0x7f0bbc13c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.818 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.814+0000 7f0bc3314640 1 -- 10.20.193.93:0/3014796203 shutdown_connections 2026-02-22T23:26:51.818 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.814+0000 7f0bc3314640 1 -- 10.20.193.93:0/3014796203 >> 10.20.193.93:0/3014796203 conn(0x7f0bbc06d480 msgr2=0x7f0bbc143860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:51.818 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.814+0000 7f0bc3314640 1 -- 10.20.193.93:0/3014796203 shutdown_connections 2026-02-22T23:26:51.819 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.814+0000 7f0bc3314640 1 -- 10.20.193.93:0/3014796203 wait complete. 2026-02-22T23:26:51.824 INFO:tasks.ceph:Scrubbing osd.3 2026-02-22T23:26:51.824 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2026-02-22T23:26:51.897 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.889+0000 7f3610ff7640 1 Processor -- start 2026-02-22T23:26:51.898 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.889+0000 7f3610ff7640 1 -- start start 2026-02-22T23:26:51.898 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.890+0000 7f3610ff7640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f360c0b1790 con 0x7f360c0b30f0 2026-02-22T23:26:51.898 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.890+0000 7f3610ff7640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f360c1472c0 con 0x7f360c1437b0 2026-02-22T23:26:51.898 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.890+0000 7f3610ff7640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f360c070860 con 0x7f360c0b13b0 2026-02-22T23:26:51.898 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.890+0000 7f360a575640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7f360c0b13b0 0x7f360c1477e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:53610/0 (socket says 10.20.193.93:53610) 2026-02-22T23:26:51.898 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.890+0000 7f360a575640 1 -- 10.20.193.93:0/1248994836 learned_addr learned my addr 10.20.193.93:0/1248994836 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:26:51.898 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.890+0000 7f3609d74640 1 --1- 10.20.193.93:0/1248994836 >> v1:10.20.193.93:6789/0 conn(0x7f360c0b30f0 0x7f360c1430a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:36962/0 (socket says 10.20.193.93:36962) 2026-02-22T23:26:51.899 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.890+0000 7f3609573640 1 -- 10.20.193.93:0/1248994836 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 386624553 0 0) 0x7f360c070860 con 0x7f360c0b13b0 2026-02-22T23:26:51.899 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.890+0000 7f3609573640 1 -- 10.20.193.93:0/1248994836 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35f8003620 con 0x7f360c0b13b0 2026-02-22T23:26:51.899 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.890+0000 7f3609573640 1 -- 10.20.193.93:0/1248994836 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2814049460 0 0) 0x7f360c0b1790 con 0x7f360c0b30f0 2026-02-22T23:26:51.899 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.890+0000 7f3609573640 1 -- 10.20.193.93:0/1248994836 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f360c070860 con 0x7f360c0b30f0 2026-02-22T23:26:51.899 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.890+0000 7f3609573640 1 -- 10.20.193.93:0/1248994836 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3816359129 0 0) 0x7f360c1472c0 con 0x7f360c1437b0 2026-02-22T23:26:51.899 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.890+0000 7f3609573640 1 -- 10.20.193.93:0/1248994836 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f360c0b1790 con 0x7f360c1437b0 2026-02-22T23:26:51.899 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.890+0000 7f3609573640 1 -- 10.20.193.93:0/1248994836 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3664099757 0 0) 0x7f35f8003620 con 0x7f360c0b13b0 2026-02-22T23:26:51.899 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.890+0000 7f3609573640 1 -- 10.20.193.93:0/1248994836 >> v1:10.20.193.155:6789/0 conn(0x7f360c1437b0 legacy=0x7f360c14f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.899 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.890+0000 7f3609573640 1 -- 10.20.193.93:0/1248994836 >> v1:10.20.193.93:6789/0 conn(0x7f360c0b30f0 legacy=0x7f360c1430a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.900 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.890+0000 7f3609573640 1 -- 10.20.193.93:0/1248994836 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f360c0b1c90 con 0x7f360c0b13b0 2026-02-22T23:26:51.900 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.890+0000 7f3609573640 1 -- 10.20.193.93:0/1248994836 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f3600002dd0 con 0x7f360c0b13b0 2026-02-22T23:26:51.900 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.890+0000 7f3609573640 1 -- 10.20.193.93:0/1248994836 <== mon.2 v1:10.20.193.93:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3600002f70 con 0x7f360c0b13b0 2026-02-22T23:26:51.900 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.890+0000 7f3609573640 1 -- 10.20.193.93:0/1248994836 <== mon.2 v1:10.20.193.93:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f3600003400 con 0x7f360c0b13b0 2026-02-22T23:26:51.900 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.890+0000 7f3610ff7640 1 -- 10.20.193.93:0/1248994836 >> v1:10.20.193.93:6790/0 conn(0x7f360c0b13b0 legacy=0x7f360c1477e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.900 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.891+0000 7f3610ff7640 1 -- 10.20.193.93:0/1248994836 shutdown_connections 2026-02-22T23:26:51.900 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.891+0000 7f3610ff7640 1 -- 10.20.193.93:0/1248994836 >> 10.20.193.93:0/1248994836 conn(0x7f360c0b2230 msgr2=0x7f360c0b2640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:51.900 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.891+0000 7f3610ff7640 1 -- 10.20.193.93:0/1248994836 shutdown_connections 2026-02-22T23:26:51.900 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.891+0000 7f3610ff7640 1 -- 10.20.193.93:0/1248994836 wait complete. 2026-02-22T23:26:51.900 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.891+0000 7f3610ff7640 1 Processor -- start 2026-02-22T23:26:51.901 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.891+0000 7f3610ff7640 1 -- start start 2026-02-22T23:26:51.901 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.892+0000 7f3610ff7640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f360c13bc60 con 0x7f360c0b30f0 2026-02-22T23:26:51.901 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.892+0000 7f3610ff7640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f360c13b6f0 con 0x7f360c0b13b0 2026-02-22T23:26:51.901 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.892+0000 7f3610ff7640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f360c072ed0 con 0x7f360c1437b0 2026-02-22T23:26:51.901 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.892+0000 7f3609d74640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7f360c0b30f0 0x7f360c0727c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:36974/0 (socket says 10.20.193.93:36974) 2026-02-22T23:26:51.901 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.892+0000 7f3609d74640 1 -- 10.20.193.93:0/2023103020 learned_addr learned my addr 10.20.193.93:0/2023103020 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:26:51.901 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.892+0000 7f35f2ffd640 1 -- 10.20.193.93:0/2023103020 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2859601876 0 0) 0x7f360c13bc60 con 0x7f360c0b30f0 2026-02-22T23:26:51.901 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.892+0000 7f35f2ffd640 1 -- 10.20.193.93:0/2023103020 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35d8003620 con 0x7f360c0b30f0 2026-02-22T23:26:51.901 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.892+0000 7f35f2ffd640 1 -- 10.20.193.93:0/2023103020 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 68633230 0 0) 0x7f360c072ed0 con 0x7f360c1437b0 2026-02-22T23:26:51.901 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.892+0000 7f35f2ffd640 1 -- 10.20.193.93:0/2023103020 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f360c13bc60 con 0x7f360c1437b0 2026-02-22T23:26:51.902 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.892+0000 7f35f2ffd640 1 -- 10.20.193.93:0/2023103020 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2272707441 0 0) 0x7f35d8003620 con 0x7f360c0b30f0 2026-02-22T23:26:51.902 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.892+0000 7f35f2ffd640 1 -- 10.20.193.93:0/2023103020 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f360c072ed0 con 0x7f360c0b30f0 2026-02-22T23:26:51.902 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.892+0000 7f35f2ffd640 1 -- 10.20.193.93:0/2023103020 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f35f4002aa0 con 0x7f360c0b30f0 2026-02-22T23:26:51.902 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.892+0000 7f35f2ffd640 1 -- 10.20.193.93:0/2023103020 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3150181860 0 0) 0x7f360c13bc60 con 0x7f360c1437b0 2026-02-22T23:26:51.902 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.892+0000 7f35f2ffd640 1 -- 10.20.193.93:0/2023103020 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f35d8003620 con 0x7f360c1437b0 2026-02-22T23:26:51.902 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.892+0000 7f35f2ffd640 1 -- 10.20.193.93:0/2023103020 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f35fc0033e0 con 0x7f360c1437b0 2026-02-22T23:26:51.902 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.892+0000 7f35f2ffd640 1 -- 10.20.193.93:0/2023103020 <== mon.0 v1:10.20.193.93:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1236921385 0 0) 0x7f360c072ed0 con 0x7f360c0b30f0 2026-02-22T23:26:51.902 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.892+0000 7f35f2ffd640 1 -- 10.20.193.93:0/2023103020 >> v1:10.20.193.93:6790/0 conn(0x7f360c1437b0 legacy=0x7f360c1394d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.902 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.892+0000 7f35f2ffd640 1 -- 10.20.193.93:0/2023103020 >> v1:10.20.193.155:6789/0 conn(0x7f360c0b13b0 legacy=0x7f360c13c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.902 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.892+0000 7f35f2ffd640 1 -- 10.20.193.93:0/2023103020 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f360c139be0 con 0x7f360c0b30f0 2026-02-22T23:26:51.903 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.892+0000 7f3610ff7640 1 -- 10.20.193.93:0/2023103020 --> v1:10.20.193.93:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f360c139e70 con 0x7f360c0b30f0 2026-02-22T23:26:51.903 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.892+0000 7f3610ff7640 1 -- 10.20.193.93:0/2023103020 --> v1:10.20.193.93:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f360c13e820 con 0x7f360c0b30f0 2026-02-22T23:26:51.903 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.892+0000 7f35f2ffd640 1 -- 10.20.193.93:0/2023103020 <== mon.0 v1:10.20.193.93:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f35f4002d60 con 0x7f360c0b30f0 2026-02-22T23:26:51.903 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.892+0000 7f35f2ffd640 1 -- 10.20.193.93:0/2023103020 <== mon.0 v1:10.20.193.93:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f35f4004d30 con 0x7f360c0b30f0 2026-02-22T23:26:51.903 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.892+0000 7f3610ff7640 1 -- 10.20.193.93:0/2023103020 --> v1:10.20.193.93:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f360c0008d0 con 0x7f360c0b30f0 2026-02-22T23:26:51.903 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.893+0000 7f35f2ffd640 1 -- 10.20.193.93:0/2023103020 <== mon.0 v1:10.20.193.93:6789/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7f35f401d500 con 0x7f360c0b30f0 2026-02-22T23:26:51.903 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.894+0000 7f35f2ffd640 1 -- 10.20.193.93:0/2023103020 <== mon.0 v1:10.20.193.93:6789/0 8 ==== osd_map(25..25 src has 1..25) ==== 4521+0+0 (unknown 3458299925 0 0) 0x7f35f40944c0 con 0x7f360c0b30f0 2026-02-22T23:26:51.903 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.894+0000 7f35f2ffd640 1 -- 10.20.193.93:0/2023103020 --> v1:10.20.193.93:6804/970700542 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f35d8083a60 con 0x7f35d807fdf0 2026-02-22T23:26:51.903 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.894+0000 7f35f2ffd640 1 -- 10.20.193.93:0/2023103020 <== mon.0 v1:10.20.193.93:6789/0 9 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (unknown 2663167439 0 0) 0x7f35f4094900 con 0x7f360c0b30f0 2026-02-22T23:26:51.904 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.894+0000 7f35f2ffd640 1 -- 10.20.193.93:0/2023103020 <== osd.3 v1:10.20.193.93:6804/970700542 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7f35d8083a60 con 0x7f35d807fdf0 2026-02-22T23:26:51.905 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.900+0000 7f3610ff7640 1 -- 10.20.193.93:0/2023103020 --> v1:10.20.193.93:6804/970700542 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f360c13c160 con 0x7f35d807fdf0 2026-02-22T23:26:51.905 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.900+0000 7f35f2ffd640 1 -- 10.20.193.93:0/2023103020 <== osd.3 v1:10.20.193.93:6804/970700542 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f360c13c160 con 0x7f35d807fdf0 2026-02-22T23:26:51.905 INFO:teuthology.orchestra.run.trial093.stdout:{ 2026-02-22T23:26:51.905 INFO:teuthology.orchestra.run.trial093.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-22T23:26:51.905 INFO:teuthology.orchestra.run.trial093.stdout:} 2026-02-22T23:26:51.907 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.901+0000 7f3610ff7640 1 -- 10.20.193.93:0/2023103020 >> v1:10.20.193.93:6804/970700542 conn(0x7f35d807fdf0 legacy=0x7f35d8082210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.907 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.901+0000 7f3610ff7640 1 -- 10.20.193.93:0/2023103020 >> v1:10.20.193.155:6800/3108481844 conn(0x7f35d8077fe0 legacy=0x7f35d807a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.907 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.901+0000 7f3610ff7640 1 -- 10.20.193.93:0/2023103020 >> v1:10.20.193.93:6789/0 conn(0x7f360c0b30f0 legacy=0x7f360c0727c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.907 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.901+0000 7f360ad76640 1 -- 10.20.193.93:0/2023103020 reap_dead start 2026-02-22T23:26:51.907 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.901+0000 7f3610ff7640 1 -- 10.20.193.93:0/2023103020 shutdown_connections 2026-02-22T23:26:51.907 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.901+0000 7f3610ff7640 1 -- 10.20.193.93:0/2023103020 >> 10.20.193.93:0/2023103020 conn(0x7f360c0b2230 msgr2=0x7f360c0b2610 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:51.907 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.901+0000 7f3610ff7640 1 -- 10.20.193.93:0/2023103020 shutdown_connections 2026-02-22T23:26:51.907 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.901+0000 7f3610ff7640 1 -- 10.20.193.93:0/2023103020 wait complete. 2026-02-22T23:26:51.909 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2026-02-22T23:26:51.981 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.972+0000 7f9504753640 1 Processor -- start 2026-02-22T23:26:51.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.973+0000 7f9504753640 1 -- start start 2026-02-22T23:26:51.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.973+0000 7f9504753640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94fc13bbb0 con 0x7f94fc0aa8e0 2026-02-22T23:26:51.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.973+0000 7f9504753640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94fc0ab5e0 con 0x7f94fc06e3f0 2026-02-22T23:26:51.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.973+0000 7f9504753640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94fc0aacc0 con 0x7f94fc0714f0 2026-02-22T23:26:51.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.973+0000 7f95024c8640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7f94fc0aa8e0 0x7f94fc13b4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:36988/0 (socket says 10.20.193.93:36988) 2026-02-22T23:26:51.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.973+0000 7f95024c8640 1 -- 10.20.193.93:0/3430768540 learned_addr learned my addr 10.20.193.93:0/3430768540 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:26:51.983 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.973+0000 7f95014c6640 1 -- 10.20.193.93:0/3430768540 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1066589680 0 0) 0x7f94fc13bbb0 con 0x7f94fc0aa8e0 2026-02-22T23:26:51.983 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.973+0000 7f95014c6640 1 -- 10.20.193.93:0/3430768540 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94e4003620 con 0x7f94fc0aa8e0 2026-02-22T23:26:51.983 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.973+0000 7f95014c6640 1 -- 10.20.193.93:0/3430768540 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 236400498 0 0) 0x7f94fc0aacc0 con 0x7f94fc0714f0 2026-02-22T23:26:51.983 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.973+0000 7f95014c6640 1 -- 10.20.193.93:0/3430768540 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94fc13bbb0 con 0x7f94fc0714f0 2026-02-22T23:26:51.983 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.973+0000 7f95014c6640 1 -- 10.20.193.93:0/3430768540 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3631023004 0 0) 0x7f94e4003620 con 0x7f94fc0aa8e0 2026-02-22T23:26:51.983 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.973+0000 7f95014c6640 1 -- 10.20.193.93:0/3430768540 >> v1:10.20.193.93:6790/0 conn(0x7f94fc0714f0 legacy=0x7f94fc14d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.983 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.973+0000 7f95014c6640 1 -- 10.20.193.93:0/3430768540 >> v1:10.20.193.155:6789/0 conn(0x7f94fc06e3f0 legacy=0x7f94fc070de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.983 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.973+0000 7f95014c6640 1 -- 10.20.193.93:0/3430768540 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94fc0aae90 con 0x7f94fc0aa8e0 2026-02-22T23:26:51.983 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.973+0000 7f95014c6640 1 -- 10.20.193.93:0/3430768540 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f94ec002ea0 con 0x7f94fc0aa8e0 2026-02-22T23:26:51.983 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.973+0000 7f95014c6640 1 -- 10.20.193.93:0/3430768540 <== mon.0 v1:10.20.193.93:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f94ec0030c0 con 0x7f94fc0aa8e0 2026-02-22T23:26:51.983 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.973+0000 7f95014c6640 1 -- 10.20.193.93:0/3430768540 <== mon.0 v1:10.20.193.93:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f94ec003550 con 0x7f94fc0aa8e0 2026-02-22T23:26:51.983 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.974+0000 7f9504753640 1 -- 10.20.193.93:0/3430768540 >> v1:10.20.193.93:6789/0 conn(0x7f94fc0aa8e0 legacy=0x7f94fc13b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.984 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.974+0000 7f9504753640 1 -- 10.20.193.93:0/3430768540 shutdown_connections 2026-02-22T23:26:51.984 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.974+0000 7f9504753640 1 -- 10.20.193.93:0/3430768540 >> 10.20.193.93:0/3430768540 conn(0x7f94fc06d480 msgr2=0x7f94fc06d890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:51.984 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.974+0000 7f9504753640 1 -- 10.20.193.93:0/3430768540 shutdown_connections 2026-02-22T23:26:51.984 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.974+0000 7f9504753640 1 -- 10.20.193.93:0/3430768540 wait complete. 2026-02-22T23:26:51.984 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.974+0000 7f9504753640 1 Processor -- start 2026-02-22T23:26:51.984 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.974+0000 7f9504753640 1 -- start start 2026-02-22T23:26:51.984 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.975+0000 7f9504753640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94fc1dbe60 con 0x7f94fc06e3f0 2026-02-22T23:26:51.984 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.975+0000 7f9504753640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94fc1dbaa0 con 0x7f94fc0aa8e0 2026-02-22T23:26:51.984 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.975+0000 7f9504753640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94fc1dc7d0 con 0x7f94fc1dc380 2026-02-22T23:26:51.984 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.975+0000 7f95024c8640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7f94fc06e3f0 0x7f94fc1d8580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:36998/0 (socket says 10.20.193.93:36998) 2026-02-22T23:26:51.984 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.975+0000 7f95024c8640 1 -- 10.20.193.93:0/3814935508 learned_addr learned my addr 10.20.193.93:0/3814935508 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:26:51.984 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.975+0000 7f94e2ffd640 1 -- 10.20.193.93:0/3814935508 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2008220107 0 0) 0x7f94fc1dbe60 con 0x7f94fc06e3f0 2026-02-22T23:26:51.985 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.975+0000 7f94e2ffd640 1 -- 10.20.193.93:0/3814935508 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94cc003620 con 0x7f94fc06e3f0 2026-02-22T23:26:51.985 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.975+0000 7f94e2ffd640 1 -- 10.20.193.93:0/3814935508 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 51395838 0 0) 0x7f94fc1dc7d0 con 0x7f94fc1dc380 2026-02-22T23:26:51.985 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.975+0000 7f94e2ffd640 1 -- 10.20.193.93:0/3814935508 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94fc1dbe60 con 0x7f94fc1dc380 2026-02-22T23:26:51.985 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.975+0000 7f94e2ffd640 1 -- 10.20.193.93:0/3814935508 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 916519228 0 0) 0x7f94cc003620 con 0x7f94fc06e3f0 2026-02-22T23:26:51.985 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.975+0000 7f94e2ffd640 1 -- 10.20.193.93:0/3814935508 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f94fc1dc7d0 con 0x7f94fc06e3f0 2026-02-22T23:26:51.985 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.975+0000 7f94e2ffd640 1 -- 10.20.193.93:0/3814935508 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f94ec003410 con 0x7f94fc06e3f0 2026-02-22T23:26:51.985 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.975+0000 7f94e2ffd640 1 -- 10.20.193.93:0/3814935508 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3135952386 0 0) 0x7f94fc1dbe60 con 0x7f94fc1dc380 2026-02-22T23:26:51.985 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.975+0000 7f94e2ffd640 1 -- 10.20.193.93:0/3814935508 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f94cc003620 con 0x7f94fc1dc380 2026-02-22T23:26:51.985 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.975+0000 7f94e2ffd640 1 -- 10.20.193.93:0/3814935508 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f94f8003480 con 0x7f94fc1dc380 2026-02-22T23:26:51.985 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.975+0000 7f94e2ffd640 1 -- 10.20.193.93:0/3814935508 <== mon.0 v1:10.20.193.93:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 51033996 0 0) 0x7f94fc1dc7d0 con 0x7f94fc06e3f0 2026-02-22T23:26:51.985 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.975+0000 7f94e2ffd640 1 -- 10.20.193.93:0/3814935508 >> v1:10.20.193.93:6790/0 conn(0x7f94fc1dc380 legacy=0x7f94fc140860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.985 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.975+0000 7f94e2ffd640 1 -- 10.20.193.93:0/3814935508 >> v1:10.20.193.155:6789/0 conn(0x7f94fc0aa8e0 legacy=0x7f94fc0b1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:51.985 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.975+0000 7f94e2ffd640 1 -- 10.20.193.93:0/3814935508 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94fc1dc9a0 con 0x7f94fc06e3f0 2026-02-22T23:26:51.986 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.975+0000 7f9504753640 1 -- 10.20.193.93:0/3814935508 --> v1:10.20.193.93:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f94fc139250 con 0x7f94fc06e3f0 2026-02-22T23:26:51.986 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.975+0000 7f94e2ffd640 1 -- 10.20.193.93:0/3814935508 <== mon.0 v1:10.20.193.93:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f94ec004d70 con 0x7f94fc06e3f0 2026-02-22T23:26:51.986 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.975+0000 7f9504753640 1 -- 10.20.193.93:0/3814935508 --> v1:10.20.193.93:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f94fc1397c0 con 0x7f94fc06e3f0 2026-02-22T23:26:51.986 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.975+0000 7f94e2ffd640 1 -- 10.20.193.93:0/3814935508 <== mon.0 v1:10.20.193.93:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f94ec0050c0 con 0x7f94fc06e3f0 2026-02-22T23:26:51.986 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.975+0000 7f9504753640 1 -- 10.20.193.93:0/3814935508 --> v1:10.20.193.93:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94fc1dbc70 con 0x7f94fc06e3f0 2026-02-22T23:26:51.986 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.976+0000 7f94e2ffd640 1 -- 10.20.193.93:0/3814935508 <== mon.0 v1:10.20.193.93:6789/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7f94ec01d890 con 0x7f94fc06e3f0 2026-02-22T23:26:51.986 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.977+0000 7f94e2ffd640 1 -- 10.20.193.93:0/3814935508 <== mon.0 v1:10.20.193.93:6789/0 8 ==== osd_map(25..25 src has 1..25) ==== 4521+0+0 (unknown 3458299925 0 0) 0x7f94ec0944d0 con 0x7f94fc06e3f0 2026-02-22T23:26:51.987 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:51.979+0000 7f94e2ffd640 1 -- 10.20.193.93:0/3814935508 <== mon.0 v1:10.20.193.93:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f94ec05db50 con 0x7f94fc06e3f0 2026-02-22T23:26:52.066 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.063+0000 7f9504753640 1 -- 10.20.193.93:0/3814935508 --> v1:10.20.193.155:6800/3108481844 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f94fc140480 con 0x7f94cc078030 2026-02-22T23:26:52.066 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.063+0000 7f94e2ffd640 1 -- 10.20.193.93:0/3814935508 <== mgr.4108 v1:10.20.193.155:6800/3108481844 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (unknown 3526570807 0 0) 0x7f94fc140480 con 0x7f94cc078030 2026-02-22T23:26:52.066 INFO:teuthology.orchestra.run.trial093.stderr:instructed osd(s) 3 to deep-scrub 2026-02-22T23:26:52.067 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.064+0000 7f9504753640 1 -- 10.20.193.93:0/3814935508 >> v1:10.20.193.155:6800/3108481844 conn(0x7f94cc078030 legacy=0x7f94cc07a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.067 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.064+0000 7f9504753640 1 -- 10.20.193.93:0/3814935508 >> v1:10.20.193.93:6789/0 conn(0x7f94fc06e3f0 legacy=0x7f94fc1d8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.067 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.064+0000 7f9504753640 1 -- 10.20.193.93:0/3814935508 shutdown_connections 2026-02-22T23:26:52.067 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.064+0000 7f9504753640 1 -- 10.20.193.93:0/3814935508 >> 10.20.193.93:0/3814935508 conn(0x7f94fc06d480 msgr2=0x7f94fc144920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:52.068 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.064+0000 7f9504753640 1 -- 10.20.193.93:0/3814935508 shutdown_connections 2026-02-22T23:26:52.068 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.064+0000 7f9504753640 1 -- 10.20.193.93:0/3814935508 wait complete. 2026-02-22T23:26:52.074 INFO:tasks.ceph:Scrubbing osd.4 2026-02-22T23:26:52.075 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2026-02-22T23:26:52.145 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.141+0000 7fc0f2feb640 1 Processor -- start 2026-02-22T23:26:52.145 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.142+0000 7fc0f2feb640 1 -- start start 2026-02-22T23:26:52.150 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.142+0000 7fc0f2feb640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0ec073410 con 0x7fc0ec140750 2026-02-22T23:26:52.150 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.142+0000 7fc0f2feb640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0ec074480 con 0x7fc0ec073f60 2026-02-22T23:26:52.150 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.142+0000 7fc0f2feb640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0ec0b3200 con 0x7fc0ec073b80 2026-02-22T23:26:52.150 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.142+0000 7fc0f0d60640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7fc0ec073b80 0x7fc0ec13f4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:53642/0 (socket says 10.20.193.93:53642) 2026-02-22T23:26:52.150 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.142+0000 7fc0f0d60640 1 -- 10.20.193.93:0/2074624672 learned_addr learned my addr 10.20.193.93:0/2074624672 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:26:52.150 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.142+0000 7fc0e37fe640 1 -- 10.20.193.93:0/2074624672 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3248814934 0 0) 0x7fc0ec0b3200 con 0x7fc0ec073b80 2026-02-22T23:26:52.151 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.142+0000 7fc0e37fe640 1 -- 10.20.193.93:0/2074624672 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0d8003620 con 0x7fc0ec073b80 2026-02-22T23:26:52.151 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.142+0000 7fc0e37fe640 1 -- 10.20.193.93:0/2074624672 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3519978882 0 0) 0x7fc0ec073410 con 0x7fc0ec140750 2026-02-22T23:26:52.151 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.142+0000 7fc0e37fe640 1 -- 10.20.193.93:0/2074624672 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0ec0b3200 con 0x7fc0ec140750 2026-02-22T23:26:52.151 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.142+0000 7fc0e37fe640 1 -- 10.20.193.93:0/2074624672 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3762621290 0 0) 0x7fc0d8003620 con 0x7fc0ec073b80 2026-02-22T23:26:52.151 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.142+0000 7fc0e37fe640 1 -- 10.20.193.93:0/2074624672 >> v1:10.20.193.155:6789/0 conn(0x7fc0ec073f60 legacy=0x7fc0ec140040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T23:26:52.151 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.142+0000 7fc0e37fe640 1 -- 10.20.193.93:0/2074624672 >> v1:10.20.193.93:6789/0 conn(0x7fc0ec140750 legacy=0x7fc0ec14b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.151 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.142+0000 7fc0e37fe640 1 -- 10.20.193.93:0/2074624672 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0ec072290 con 0x7fc0ec073b80 2026-02-22T23:26:52.151 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.142+0000 7fc0e37fe640 1 -- 10.20.193.93:0/2074624672 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fc0dc002ea0 con 0x7fc0ec073b80 2026-02-22T23:26:52.151 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.143+0000 7fc0e37fe640 1 -- 10.20.193.93:0/2074624672 <== mon.2 v1:10.20.193.93:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc0dc003040 con 0x7fc0ec073b80 2026-02-22T23:26:52.151 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.143+0000 7fc0e37fe640 1 -- 10.20.193.93:0/2074624672 <== mon.2 v1:10.20.193.93:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fc0dc0034d0 con 0x7fc0ec073b80 2026-02-22T23:26:52.151 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.143+0000 7fc0f2feb640 1 -- 10.20.193.93:0/2074624672 >> v1:10.20.193.93:6790/0 conn(0x7fc0ec073b80 legacy=0x7fc0ec13f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.152 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.143+0000 7fc0f2feb640 1 -- 10.20.193.93:0/2074624672 shutdown_connections 2026-02-22T23:26:52.152 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.143+0000 7fc0f2feb640 1 -- 10.20.193.93:0/2074624672 >> 10.20.193.93:0/2074624672 conn(0x7fc0ec0b2230 msgr2=0x7fc0ec0b2640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:52.152 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.143+0000 7fc0f2feb640 1 -- 10.20.193.93:0/2074624672 shutdown_connections 2026-02-22T23:26:52.152 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.143+0000 7fc0f2feb640 1 -- 10.20.193.93:0/2074624672 wait complete. 2026-02-22T23:26:52.152 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.143+0000 7fc0f2feb640 1 Processor -- start 2026-02-22T23:26:52.152 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.143+0000 7fc0f2feb640 1 -- start start 2026-02-22T23:26:52.152 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.144+0000 7fc0f2feb640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0ec1d18e0 con 0x7fc0ec140750 2026-02-22T23:26:52.152 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.144+0000 7fc0f2feb640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0ec1cf3b0 con 0x7fc0ec073b80 2026-02-22T23:26:52.152 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.144+0000 7fc0f2feb640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0ec1d1330 con 0x7fc0ec073f60 2026-02-22T23:26:52.152 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.144+0000 7fc0f1561640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7fc0ec140750 0x7fc0ec1db570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:37008/0 (socket says 10.20.193.93:37008) 2026-02-22T23:26:52.152 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.144+0000 7fc0f1561640 1 -- 10.20.193.93:0/829455460 learned_addr learned my addr 10.20.193.93:0/829455460 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:26:52.152 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.144+0000 7fc0e3fff640 1 --1- 10.20.193.93:0/829455460 >> v1:10.20.193.93:6790/0 conn(0x7fc0ec073f60 0x7fc0ec138910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:53654/0 (socket says 10.20.193.93:53654) 2026-02-22T23:26:52.153 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.144+0000 7fc0e17fa640 1 -- 10.20.193.93:0/829455460 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3587861644 0 0) 0x7fc0ec1d18e0 con 0x7fc0ec140750 2026-02-22T23:26:52.153 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.144+0000 7fc0e17fa640 1 -- 10.20.193.93:0/829455460 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0bc003620 con 0x7fc0ec140750 2026-02-22T23:26:52.153 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.144+0000 7fc0e17fa640 1 -- 10.20.193.93:0/829455460 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2330796305 0 0) 0x7fc0ec1d1330 con 0x7fc0ec073f60 2026-02-22T23:26:52.153 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.144+0000 7fc0e17fa640 1 -- 10.20.193.93:0/829455460 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0ec1d18e0 con 0x7fc0ec073f60 2026-02-22T23:26:52.153 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.144+0000 7fc0e17fa640 1 -- 10.20.193.93:0/829455460 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2036972785 0 0) 0x7fc0bc003620 con 0x7fc0ec140750 2026-02-22T23:26:52.153 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.144+0000 7fc0e17fa640 1 -- 10.20.193.93:0/829455460 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc0ec1d1330 con 0x7fc0ec140750 2026-02-22T23:26:52.153 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.144+0000 7fc0e17fa640 1 -- 10.20.193.93:0/829455460 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fc0e8003480 con 0x7fc0ec140750 2026-02-22T23:26:52.153 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.144+0000 7fc0e17fa640 1 -- 10.20.193.93:0/829455460 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2467781786 0 0) 0x7fc0ec1d18e0 con 0x7fc0ec073f60 2026-02-22T23:26:52.153 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.144+0000 7fc0e17fa640 1 -- 10.20.193.93:0/829455460 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc0bc003620 con 0x7fc0ec073f60 2026-02-22T23:26:52.153 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.144+0000 7fc0e17fa640 1 -- 10.20.193.93:0/829455460 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fc0d4004080 con 0x7fc0ec073f60 2026-02-22T23:26:52.153 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.144+0000 7fc0e17fa640 1 -- 10.20.193.93:0/829455460 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3234614519 0 0) 0x7fc0ec1cf3b0 con 0x7fc0ec073b80 2026-02-22T23:26:52.153 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.144+0000 7fc0e17fa640 1 -- 10.20.193.93:0/829455460 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0ec1d18e0 con 0x7fc0ec073b80 2026-02-22T23:26:52.154 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.144+0000 7fc0e17fa640 1 -- 10.20.193.93:0/829455460 <== mon.0 v1:10.20.193.93:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3207062375 0 0) 0x7fc0ec1d1330 con 0x7fc0ec140750 2026-02-22T23:26:52.154 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.144+0000 7fc0e17fa640 1 -- 10.20.193.93:0/829455460 >> v1:10.20.193.93:6790/0 conn(0x7fc0ec073f60 legacy=0x7fc0ec138910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.154 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.144+0000 7fc0e17fa640 1 -- 10.20.193.93:0/829455460 >> v1:10.20.193.155:6789/0 conn(0x7fc0ec073b80 legacy=0x7fc0ec1ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.154 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.144+0000 7fc0e17fa640 1 -- 10.20.193.93:0/829455460 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0ec144120 con 0x7fc0ec140750 2026-02-22T23:26:52.154 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.144+0000 7fc0f2feb640 1 -- 10.20.193.93:0/829455460 --> v1:10.20.193.93:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc0ec1cfbe0 con 0x7fc0ec140750 2026-02-22T23:26:52.154 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.144+0000 7fc0f2feb640 1 -- 10.20.193.93:0/829455460 --> v1:10.20.193.93:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc0ec139200 con 0x7fc0ec140750 2026-02-22T23:26:52.154 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.144+0000 7fc0e17fa640 1 -- 10.20.193.93:0/829455460 <== mon.0 v1:10.20.193.93:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc0e8003af0 con 0x7fc0ec140750 2026-02-22T23:26:52.154 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.144+0000 7fc0e17fa640 1 -- 10.20.193.93:0/829455460 <== mon.0 v1:10.20.193.93:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fc0e8004f30 con 0x7fc0ec140750 2026-02-22T23:26:52.154 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.145+0000 7fc0f2feb640 1 -- 10.20.193.93:0/829455460 --> v1:10.20.193.93:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fc0ec0af1b0 con 0x7fc0ec140750 2026-02-22T23:26:52.154 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.145+0000 7fc0e17fa640 1 -- 10.20.193.93:0/829455460 <== mon.0 v1:10.20.193.93:6789/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7fc0e801d700 con 0x7fc0ec140750 2026-02-22T23:26:52.154 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.146+0000 7fc0e17fa640 1 -- 10.20.193.93:0/829455460 <== mon.0 v1:10.20.193.93:6789/0 8 ==== osd_map(25..25 src has 1..25) ==== 4521+0+0 (unknown 3458299925 0 0) 0x7fc0e80946e0 con 0x7fc0ec140750 2026-02-22T23:26:52.154 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.146+0000 7fc0e17fa640 1 -- 10.20.193.93:0/829455460 --> v1:10.20.193.155:6813/3729844438 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc0bc083b50 con 0x7fc0bc07fee0 2026-02-22T23:26:52.155 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.146+0000 7fc0e17fa640 1 -- 10.20.193.93:0/829455460 <== mon.0 v1:10.20.193.93:6789/0 9 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (unknown 2663167439 0 0) 0x7fc0e8094b50 con 0x7fc0ec140750 2026-02-22T23:26:52.155 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.147+0000 7fc0e17fa640 1 -- 10.20.193.93:0/829455460 <== osd.4 v1:10.20.193.155:6813/3729844438 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7fc0bc083b50 con 0x7fc0bc07fee0 2026-02-22T23:26:52.157 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.154+0000 7fc0f2feb640 1 -- 10.20.193.93:0/829455460 --> v1:10.20.193.155:6813/3729844438 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc0ec1d1500 con 0x7fc0bc07fee0 2026-02-22T23:26:52.158 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.154+0000 7fc0e17fa640 1 -- 10.20.193.93:0/829455460 <== osd.4 v1:10.20.193.155:6813/3729844438 2 ==== command_reply(tid 2: 0 ) ==== 8+0+712 (unknown 0 0 714369635) 0x7fc0ec1d1500 con 0x7fc0bc07fee0 2026-02-22T23:26:52.158 INFO:teuthology.orchestra.run.trial093.stdout:{ 2026-02-22T23:26:52.158 INFO:teuthology.orchestra.run.trial093.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-22T23:26:52.158 INFO:teuthology.orchestra.run.trial093.stdout:} 2026-02-22T23:26:52.159 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.155+0000 7fc0f2feb640 1 -- 10.20.193.93:0/829455460 >> v1:10.20.193.155:6813/3729844438 conn(0x7fc0bc07fee0 legacy=0x7fc0bc082300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.159 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.155+0000 7fc0f2feb640 1 -- 10.20.193.93:0/829455460 >> v1:10.20.193.155:6800/3108481844 conn(0x7fc0bc0780d0 legacy=0x7fc0bc07a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.160 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.155+0000 7fc0f2feb640 1 -- 10.20.193.93:0/829455460 >> v1:10.20.193.93:6789/0 conn(0x7fc0ec140750 legacy=0x7fc0ec1db570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.160 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.155+0000 7fc0f1561640 1 -- 10.20.193.93:0/829455460 reap_dead start 2026-02-22T23:26:52.160 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.155+0000 7fc0f2feb640 1 -- 10.20.193.93:0/829455460 shutdown_connections 2026-02-22T23:26:52.160 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.155+0000 7fc0f2feb640 1 -- 10.20.193.93:0/829455460 >> 10.20.193.93:0/829455460 conn(0x7fc0ec0b2230 msgr2=0x7fc0ec0af3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:52.160 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.155+0000 7fc0f2feb640 1 -- 10.20.193.93:0/829455460 shutdown_connections 2026-02-22T23:26:52.160 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.155+0000 7fc0f2feb640 1 -- 10.20.193.93:0/829455460 wait complete. 2026-02-22T23:26:52.163 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2026-02-22T23:26:52.239 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.232+0000 7fa1ddcc9640 1 Processor -- start 2026-02-22T23:26:52.239 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.232+0000 7fa1ddcc9640 1 -- start start 2026-02-22T23:26:52.239 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.232+0000 7fa1ddcc9640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1d813bbb0 con 0x7fa1d806e3f0 2026-02-22T23:26:52.239 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.232+0000 7fa1ddcc9640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1d80ab5e0 con 0x7fa1d80714f0 2026-02-22T23:26:52.240 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.232+0000 7fa1ddcc9640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1d80aacc0 con 0x7fa1d80aa8e0 2026-02-22T23:26:52.240 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.232+0000 7fa1d77fe640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7fa1d80aa8e0 0x7fa1d813b4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:53668/0 (socket says 10.20.193.93:53668) 2026-02-22T23:26:52.240 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.232+0000 7fa1d77fe640 1 -- 10.20.193.93:0/818500793 learned_addr learned my addr 10.20.193.93:0/818500793 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:26:52.240 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.232+0000 7fa1d67fc640 1 -- 10.20.193.93:0/818500793 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2857427884 0 0) 0x7fa1d813bbb0 con 0x7fa1d806e3f0 2026-02-22T23:26:52.240 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.233+0000 7fa1d67fc640 1 -- 10.20.193.93:0/818500793 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1bc003620 con 0x7fa1d806e3f0 2026-02-22T23:26:52.240 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.233+0000 7fa1d67fc640 1 -- 10.20.193.93:0/818500793 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2415798260 0 0) 0x7fa1d80aacc0 con 0x7fa1d80aa8e0 2026-02-22T23:26:52.240 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.233+0000 7fa1d67fc640 1 -- 10.20.193.93:0/818500793 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1d813bbb0 con 0x7fa1d80aa8e0 2026-02-22T23:26:52.240 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.233+0000 7fa1d67fc640 1 -- 10.20.193.93:0/818500793 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2121660974 0 0) 0x7fa1d80ab5e0 con 0x7fa1d80714f0 2026-02-22T23:26:52.240 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.233+0000 7fa1d67fc640 1 -- 10.20.193.93:0/818500793 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1d80aacc0 con 0x7fa1d80714f0 2026-02-22T23:26:52.240 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.233+0000 7fa1d67fc640 1 -- 10.20.193.93:0/818500793 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2614263449 0 0) 0x7fa1bc003620 con 0x7fa1d806e3f0 2026-02-22T23:26:52.241 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.233+0000 7fa1d67fc640 1 -- 10.20.193.93:0/818500793 >> v1:10.20.193.93:6790/0 conn(0x7fa1d80aa8e0 legacy=0x7fa1d813b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.241 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.233+0000 7fa1d67fc640 1 -- 10.20.193.93:0/818500793 >> v1:10.20.193.155:6789/0 conn(0x7fa1d80714f0 legacy=0x7fa1d814d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.241 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.233+0000 7fa1d67fc640 1 -- 10.20.193.93:0/818500793 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1d80aae90 con 0x7fa1d806e3f0 2026-02-22T23:26:52.241 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.233+0000 7fa1d67fc640 1 -- 10.20.193.93:0/818500793 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fa1c8002ea0 con 0x7fa1d806e3f0 2026-02-22T23:26:52.241 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.233+0000 7fa1d67fc640 1 -- 10.20.193.93:0/818500793 <== mon.0 v1:10.20.193.93:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa1c8003040 con 0x7fa1d806e3f0 2026-02-22T23:26:52.241 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.233+0000 7fa1d67fc640 1 -- 10.20.193.93:0/818500793 <== mon.0 v1:10.20.193.93:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fa1c80034d0 con 0x7fa1d806e3f0 2026-02-22T23:26:52.241 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.233+0000 7fa1ddcc9640 1 -- 10.20.193.93:0/818500793 >> v1:10.20.193.93:6789/0 conn(0x7fa1d806e3f0 legacy=0x7fa1d8070de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.241 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.233+0000 7fa1ddcc9640 1 -- 10.20.193.93:0/818500793 shutdown_connections 2026-02-22T23:26:52.241 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.233+0000 7fa1ddcc9640 1 -- 10.20.193.93:0/818500793 >> 10.20.193.93:0/818500793 conn(0x7fa1d806d480 msgr2=0x7fa1d806d890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:52.241 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.233+0000 7fa1ddcc9640 1 -- 10.20.193.93:0/818500793 shutdown_connections 2026-02-22T23:26:52.241 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.233+0000 7fa1ddcc9640 1 -- 10.20.193.93:0/818500793 wait complete. 2026-02-22T23:26:52.241 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.234+0000 7fa1ddcc9640 1 Processor -- start 2026-02-22T23:26:52.242 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.234+0000 7fa1ddcc9640 1 -- start start 2026-02-22T23:26:52.242 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.234+0000 7fa1ddcc9640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1d811dc80 con 0x7fa1d80aa8e0 2026-02-22T23:26:52.242 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.234+0000 7fa1ddcc9640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1d81de4b0 con 0x7fa1d806e3f0 2026-02-22T23:26:52.242 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.234+0000 7fa1ddcc9640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1d813a2f0 con 0x7fa1d8140520 2026-02-22T23:26:52.242 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.234+0000 7fa1d6ffd640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7fa1d80aa8e0 0x7fa1d811d570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:37034/0 (socket says 10.20.193.93:37034) 2026-02-22T23:26:52.242 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.234+0000 7fa1d6ffd640 1 -- 10.20.193.93:0/1933689967 learned_addr learned my addr 10.20.193.93:0/1933689967 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:26:52.242 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.234+0000 7fa1b3fff640 1 -- 10.20.193.93:0/1933689967 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3393141954 0 0) 0x7fa1d811dc80 con 0x7fa1d80aa8e0 2026-02-22T23:26:52.242 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.234+0000 7fa1b3fff640 1 -- 10.20.193.93:0/1933689967 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1a8003620 con 0x7fa1d80aa8e0 2026-02-22T23:26:52.242 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.234+0000 7fa1b3fff640 1 -- 10.20.193.93:0/1933689967 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 876760345 0 0) 0x7fa1d813a2f0 con 0x7fa1d8140520 2026-02-22T23:26:52.242 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.234+0000 7fa1b3fff640 1 -- 10.20.193.93:0/1933689967 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1d811dc80 con 0x7fa1d8140520 2026-02-22T23:26:52.242 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.234+0000 7fa1b3fff640 1 -- 10.20.193.93:0/1933689967 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3267702956 0 0) 0x7fa1a8003620 con 0x7fa1d80aa8e0 2026-02-22T23:26:52.242 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.234+0000 7fa1b3fff640 1 -- 10.20.193.93:0/1933689967 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa1d813a2f0 con 0x7fa1d80aa8e0 2026-02-22T23:26:52.242 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.234+0000 7fa1b3fff640 1 -- 10.20.193.93:0/1933689967 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fa1c8003490 con 0x7fa1d80aa8e0 2026-02-22T23:26:52.243 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.234+0000 7fa1b3fff640 1 -- 10.20.193.93:0/1933689967 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3895429606 0 0) 0x7fa1d811dc80 con 0x7fa1d8140520 2026-02-22T23:26:52.243 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.234+0000 7fa1b3fff640 1 -- 10.20.193.93:0/1933689967 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa1a8003620 con 0x7fa1d8140520 2026-02-22T23:26:52.243 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.234+0000 7fa1b3fff640 1 -- 10.20.193.93:0/1933689967 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fa1cc003480 con 0x7fa1d8140520 2026-02-22T23:26:52.243 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.234+0000 7fa1b3fff640 1 -- 10.20.193.93:0/1933689967 <== mon.0 v1:10.20.193.93:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 931087942 0 0) 0x7fa1d813a2f0 con 0x7fa1d80aa8e0 2026-02-22T23:26:52.243 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.234+0000 7fa1b3fff640 1 -- 10.20.193.93:0/1933689967 >> v1:10.20.193.93:6790/0 conn(0x7fa1d8140520 legacy=0x7fa1d81ddda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.243 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.234+0000 7fa1b3fff640 1 -- 10.20.193.93:0/1933689967 >> v1:10.20.193.155:6789/0 conn(0x7fa1d806e3f0 legacy=0x7fa1d8074350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.243 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.234+0000 7fa1b3fff640 1 -- 10.20.193.93:0/1933689967 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1d813a4c0 con 0x7fa1d80aa8e0 2026-02-22T23:26:52.243 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.234+0000 7fa1ddcc9640 1 -- 10.20.193.93:0/1933689967 --> v1:10.20.193.93:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa1d81395a0 con 0x7fa1d80aa8e0 2026-02-22T23:26:52.243 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.234+0000 7fa1ddcc9640 1 -- 10.20.193.93:0/1933689967 --> v1:10.20.193.93:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa1d8139b10 con 0x7fa1d80aa8e0 2026-02-22T23:26:52.243 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.234+0000 7fa1b3fff640 1 -- 10.20.193.93:0/1933689967 <== mon.0 v1:10.20.193.93:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa1c8003000 con 0x7fa1d80aa8e0 2026-02-22T23:26:52.243 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.234+0000 7fa1b3fff640 1 -- 10.20.193.93:0/1933689967 <== mon.0 v1:10.20.193.93:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fa1c8003c00 con 0x7fa1d80aa8e0 2026-02-22T23:26:52.244 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.235+0000 7fa1ddcc9640 1 -- 10.20.193.93:0/1933689967 --> v1:10.20.193.93:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1d80008d0 con 0x7fa1d80aa8e0 2026-02-22T23:26:52.244 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.235+0000 7fa1b3fff640 1 -- 10.20.193.93:0/1933689967 <== mon.0 v1:10.20.193.93:6789/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7fa1c8003da0 con 0x7fa1d80aa8e0 2026-02-22T23:26:52.244 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.236+0000 7fa1b3fff640 1 -- 10.20.193.93:0/1933689967 <== mon.0 v1:10.20.193.93:6789/0 8 ==== osd_map(25..25 src has 1..25) ==== 4521+0+0 (unknown 3458299925 0 0) 0x7fa1c8094380 con 0x7fa1d80aa8e0 2026-02-22T23:26:52.244 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.237+0000 7fa1b3fff640 1 -- 10.20.193.93:0/1933689967 <== mon.0 v1:10.20.193.93:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7fa1c805da00 con 0x7fa1d80aa8e0 2026-02-22T23:26:52.322 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.319+0000 7fa1ddcc9640 1 -- 10.20.193.93:0/1933689967 --> v1:10.20.193.155:6800/3108481844 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fa1d8073ec0 con 0x7fa1a8078080 2026-02-22T23:26:52.323 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.319+0000 7fa1b3fff640 1 -- 10.20.193.93:0/1933689967 <== mgr.4108 v1:10.20.193.155:6800/3108481844 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (unknown 3782719169 0 0) 0x7fa1d8073ec0 con 0x7fa1a8078080 2026-02-22T23:26:52.323 INFO:teuthology.orchestra.run.trial093.stderr:instructed osd(s) 4 to deep-scrub 2026-02-22T23:26:52.324 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.320+0000 7fa1ddcc9640 1 -- 10.20.193.93:0/1933689967 >> v1:10.20.193.155:6800/3108481844 conn(0x7fa1a8078080 legacy=0x7fa1a807a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.324 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.320+0000 7fa1ddcc9640 1 -- 10.20.193.93:0/1933689967 >> v1:10.20.193.93:6789/0 conn(0x7fa1d80aa8e0 legacy=0x7fa1d811d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.324 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.320+0000 7fa1ddcc9640 1 -- 10.20.193.93:0/1933689967 shutdown_connections 2026-02-22T23:26:52.324 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.320+0000 7fa1ddcc9640 1 -- 10.20.193.93:0/1933689967 >> 10.20.193.93:0/1933689967 conn(0x7fa1d806d480 msgr2=0x7fa1d8144990 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:52.324 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.320+0000 7fa1ddcc9640 1 -- 10.20.193.93:0/1933689967 shutdown_connections 2026-02-22T23:26:52.324 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.320+0000 7fa1ddcc9640 1 -- 10.20.193.93:0/1933689967 wait complete. 2026-02-22T23:26:52.331 INFO:tasks.ceph:Scrubbing osd.5 2026-02-22T23:26:52.331 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2026-02-22T23:26:52.405 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.397+0000 7f253a553640 1 Processor -- start 2026-02-22T23:26:52.405 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.397+0000 7f253a553640 1 -- start start 2026-02-22T23:26:52.405 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.398+0000 7f253a553640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25340b1790 con 0x7f25340b13b0 2026-02-22T23:26:52.405 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.398+0000 7f253a553640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25340b32c0 con 0x7f25340b1b70 2026-02-22T23:26:52.405 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.398+0000 7f253a553640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2534073d60 con 0x7f2534141460 2026-02-22T23:26:52.405 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.398+0000 7f2533fff640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7f25340b13b0 0x7f2534140d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:37050/0 (socket says 10.20.193.93:37050) 2026-02-22T23:26:52.406 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.398+0000 7f2533fff640 1 -- 10.20.193.93:0/2175184979 learned_addr learned my addr 10.20.193.93:0/2175184979 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:26:52.406 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.398+0000 7f2532ffd640 1 -- 10.20.193.93:0/2175184979 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2145191382 0 0) 0x7f2534073d60 con 0x7f2534141460 2026-02-22T23:26:52.406 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.398+0000 7f2532ffd640 1 -- 10.20.193.93:0/2175184979 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2518003620 con 0x7f2534141460 2026-02-22T23:26:52.406 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.398+0000 7f2532ffd640 1 -- 10.20.193.93:0/2175184979 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3891791029 0 0) 0x7f25340b1790 con 0x7f25340b13b0 2026-02-22T23:26:52.406 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.398+0000 7f2532ffd640 1 -- 10.20.193.93:0/2175184979 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2534073d60 con 0x7f25340b13b0 2026-02-22T23:26:52.406 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.398+0000 7f2532ffd640 1 -- 10.20.193.93:0/2175184979 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2484336773 0 0) 0x7f2518003620 con 0x7f2534141460 2026-02-22T23:26:52.406 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.398+0000 7f2532ffd640 1 -- 10.20.193.93:0/2175184979 >> v1:10.20.193.155:6789/0 conn(0x7f25340b1b70 legacy=0x7f2534145340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.406 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.398+0000 7f2532ffd640 1 -- 10.20.193.93:0/2175184979 >> v1:10.20.193.93:6789/0 conn(0x7f25340b13b0 legacy=0x7f2534140d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.406 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.398+0000 7f2532ffd640 1 -- 10.20.193.93:0/2175184979 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2534073920 con 0x7f2534141460 2026-02-22T23:26:52.406 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.398+0000 7f2532ffd640 1 -- 10.20.193.93:0/2175184979 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f2528003220 con 0x7f2534141460 2026-02-22T23:26:52.406 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.398+0000 7f2532ffd640 1 -- 10.20.193.93:0/2175184979 <== mon.2 v1:10.20.193.93:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2528003440 con 0x7f2534141460 2026-02-22T23:26:52.407 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.398+0000 7f2532ffd640 1 -- 10.20.193.93:0/2175184979 <== mon.2 v1:10.20.193.93:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f25280038d0 con 0x7f2534141460 2026-02-22T23:26:52.407 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.398+0000 7f253a553640 1 -- 10.20.193.93:0/2175184979 >> v1:10.20.193.93:6790/0 conn(0x7f2534141460 legacy=0x7f253414d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.407 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.398+0000 7f253a553640 1 -- 10.20.193.93:0/2175184979 shutdown_connections 2026-02-22T23:26:52.407 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.399+0000 7f253a553640 1 -- 10.20.193.93:0/2175184979 >> 10.20.193.93:0/2175184979 conn(0x7f25340b2230 msgr2=0x7f25340b2640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:52.407 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.399+0000 7f253a553640 1 -- 10.20.193.93:0/2175184979 shutdown_connections 2026-02-22T23:26:52.407 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.399+0000 7f253a553640 1 -- 10.20.193.93:0/2175184979 wait complete. 2026-02-22T23:26:52.407 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.399+0000 7f253a553640 1 Processor -- start 2026-02-22T23:26:52.407 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.399+0000 7f253a553640 1 -- start start 2026-02-22T23:26:52.407 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.399+0000 7f253a553640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f253413a260 con 0x7f2534141460 2026-02-22T23:26:52.407 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.399+0000 7f253a553640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f253413c630 con 0x7f25340b13b0 2026-02-22T23:26:52.407 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.399+0000 7f253a553640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f253413c800 con 0x7f25341dc690 2026-02-22T23:26:52.407 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.400+0000 7f2538ac9640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7f25341dc690 0x7f25341394d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:53696/0 (socket says 10.20.193.93:53696) 2026-02-22T23:26:52.408 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.400+0000 7f2538ac9640 1 -- 10.20.193.93:0/3391806628 learned_addr learned my addr 10.20.193.93:0/3391806628 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:26:52.408 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.400+0000 7f25337fe640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7f2534141460 0x7f25341dbf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:37052/0 (socket says 10.20.193.93:37052) 2026-02-22T23:26:52.408 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.400+0000 7f2530ff9640 1 -- 10.20.193.93:0/3391806628 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1619878067 0 0) 0x7f253413a260 con 0x7f2534141460 2026-02-22T23:26:52.408 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.400+0000 7f2530ff9640 1 -- 10.20.193.93:0/3391806628 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2504003620 con 0x7f2534141460 2026-02-22T23:26:52.408 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.400+0000 7f2530ff9640 1 -- 10.20.193.93:0/3391806628 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3114842722 0 0) 0x7f253413c800 con 0x7f25341dc690 2026-02-22T23:26:52.408 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.400+0000 7f2530ff9640 1 -- 10.20.193.93:0/3391806628 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f253413a260 con 0x7f25341dc690 2026-02-22T23:26:52.408 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.400+0000 7f2530ff9640 1 -- 10.20.193.93:0/3391806628 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3840294669 0 0) 0x7f253413c630 con 0x7f25340b13b0 2026-02-22T23:26:52.408 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.400+0000 7f2530ff9640 1 -- 10.20.193.93:0/3391806628 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f253413c800 con 0x7f25340b13b0 2026-02-22T23:26:52.408 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.400+0000 7f2530ff9640 1 -- 10.20.193.93:0/3391806628 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3331713463 0 0) 0x7f253413a260 con 0x7f25341dc690 2026-02-22T23:26:52.408 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.400+0000 7f2530ff9640 1 -- 10.20.193.93:0/3391806628 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f253413c630 con 0x7f25341dc690 2026-02-22T23:26:52.408 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.400+0000 7f2530ff9640 1 -- 10.20.193.93:0/3391806628 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f2528003790 con 0x7f25341dc690 2026-02-22T23:26:52.408 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.400+0000 7f2530ff9640 1 -- 10.20.193.93:0/3391806628 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 692810213 0 0) 0x7f2504003620 con 0x7f2534141460 2026-02-22T23:26:52.409 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.400+0000 7f2530ff9640 1 -- 10.20.193.93:0/3391806628 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f253413a260 con 0x7f2534141460 2026-02-22T23:26:52.409 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.400+0000 7f2530ff9640 1 -- 10.20.193.93:0/3391806628 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f2524003180 con 0x7f2534141460 2026-02-22T23:26:52.409 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.400+0000 7f2530ff9640 1 -- 10.20.193.93:0/3391806628 <== mon.2 v1:10.20.193.93:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1235640727 0 0) 0x7f253413c630 con 0x7f25341dc690 2026-02-22T23:26:52.409 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.400+0000 7f2530ff9640 1 -- 10.20.193.93:0/3391806628 >> v1:10.20.193.155:6789/0 conn(0x7f25340b13b0 legacy=0x7f25341d9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.409 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.400+0000 7f2530ff9640 1 -- 10.20.193.93:0/3391806628 >> v1:10.20.193.93:6789/0 conn(0x7f2534141460 legacy=0x7f25341dbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.409 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.400+0000 7f2530ff9640 1 -- 10.20.193.93:0/3391806628 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f253413c9d0 con 0x7f25341dc690 2026-02-22T23:26:52.409 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.400+0000 7f253a553640 1 -- 10.20.193.93:0/3391806628 --> v1:10.20.193.93:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2534139be0 con 0x7f25341dc690 2026-02-22T23:26:52.409 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.400+0000 7f253a553640 1 -- 10.20.193.93:0/3391806628 --> v1:10.20.193.93:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f25341d8a20 con 0x7f25341dc690 2026-02-22T23:26:52.409 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.400+0000 7f2530ff9640 1 -- 10.20.193.93:0/3391806628 <== mon.2 v1:10.20.193.93:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2528003ca0 con 0x7f25341dc690 2026-02-22T23:26:52.409 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.400+0000 7f2530ff9640 1 -- 10.20.193.93:0/3391806628 <== mon.2 v1:10.20.193.93:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f25280040b0 con 0x7f25341dc690 2026-02-22T23:26:52.409 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.400+0000 7f253a553640 1 -- 10.20.193.93:0/3391806628 --> v1:10.20.193.93:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f25341d9240 con 0x7f25341dc690 2026-02-22T23:26:52.409 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.401+0000 7f2530ff9640 1 -- 10.20.193.93:0/3391806628 <== mon.2 v1:10.20.193.93:6790/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7f2528004250 con 0x7f25341dc690 2026-02-22T23:26:52.410 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.401+0000 7f2530ff9640 1 -- 10.20.193.93:0/3391806628 <== mon.2 v1:10.20.193.93:6790/0 8 ==== osd_map(25..25 src has 1..25) ==== 4521+0+0 (unknown 3458299925 0 0) 0x7f2528094400 con 0x7f25341dc690 2026-02-22T23:26:52.410 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.401+0000 7f2530ff9640 1 -- 10.20.193.93:0/3391806628 --> v1:10.20.193.155:6806/887979704 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2504083ab0 con 0x7f250407fee0 2026-02-22T23:26:52.410 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.401+0000 7f2530ff9640 1 -- 10.20.193.93:0/3391806628 <== mon.2 v1:10.20.193.93:6790/0 9 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (unknown 2663167439 0 0) 0x7f25280948a0 con 0x7f25341dc690 2026-02-22T23:26:52.410 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.402+0000 7f2530ff9640 1 -- 10.20.193.93:0/3391806628 <== osd.5 v1:10.20.193.155:6806/887979704 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7f2504083ab0 con 0x7f250407fee0 2026-02-22T23:26:52.411 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.408+0000 7f253a553640 1 -- 10.20.193.93:0/3391806628 --> v1:10.20.193.155:6806/887979704 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f25340b5510 con 0x7f250407fee0 2026-02-22T23:26:52.412 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.409+0000 7f2530ff9640 1 -- 10.20.193.93:0/3391806628 <== osd.5 v1:10.20.193.155:6806/887979704 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f25340b5510 con 0x7f250407fee0 2026-02-22T23:26:52.412 INFO:teuthology.orchestra.run.trial093.stdout:{ 2026-02-22T23:26:52.412 INFO:teuthology.orchestra.run.trial093.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-22T23:26:52.412 INFO:teuthology.orchestra.run.trial093.stdout:} 2026-02-22T23:26:52.413 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.409+0000 7f253a553640 1 -- 10.20.193.93:0/3391806628 >> v1:10.20.193.155:6806/887979704 conn(0x7f250407fee0 legacy=0x7f2504082300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.413 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.409+0000 7f253a553640 1 -- 10.20.193.93:0/3391806628 >> v1:10.20.193.155:6800/3108481844 conn(0x7f25040780f0 legacy=0x7f250407a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.413 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.409+0000 7f253a553640 1 -- 10.20.193.93:0/3391806628 >> v1:10.20.193.93:6790/0 conn(0x7f25341dc690 legacy=0x7f25341394d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.413 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.409+0000 7f2538ac9640 1 -- 10.20.193.93:0/3391806628 reap_dead start 2026-02-22T23:26:52.414 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.409+0000 7f253a553640 1 -- 10.20.193.93:0/3391806628 shutdown_connections 2026-02-22T23:26:52.414 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.409+0000 7f253a553640 1 -- 10.20.193.93:0/3391806628 >> 10.20.193.93:0/3391806628 conn(0x7f25340b2230 msgr2=0x7f2534140c90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:52.414 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.409+0000 7f253a553640 1 -- 10.20.193.93:0/3391806628 shutdown_connections 2026-02-22T23:26:52.414 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.409+0000 7f253a553640 1 -- 10.20.193.93:0/3391806628 wait complete. 2026-02-22T23:26:52.417 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2026-02-22T23:26:52.489 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.482+0000 7fbb6d949640 1 Processor -- start 2026-02-22T23:26:52.490 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.482+0000 7fbb6d949640 1 -- start start 2026-02-22T23:26:52.490 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.482+0000 7fbb6d949640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb6813bbb0 con 0x7fbb680714f0 2026-02-22T23:26:52.490 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.482+0000 7fbb6d949640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb680ab5e0 con 0x7fbb680aa8e0 2026-02-22T23:26:52.490 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.482+0000 7fbb6d949640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb680aacc0 con 0x7fbb6806e3f0 2026-02-22T23:26:52.490 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.482+0000 7fbb667fc640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7fbb6806e3f0 0x7fbb68070de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:53700/0 (socket says 10.20.193.93:53700) 2026-02-22T23:26:52.490 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.482+0000 7fbb667fc640 1 -- 10.20.193.93:0/4059262396 learned_addr learned my addr 10.20.193.93:0/4059262396 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:26:52.490 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.482+0000 7fbb65ffb640 1 -- 10.20.193.93:0/4059262396 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1741140545 0 0) 0x7fbb680aacc0 con 0x7fbb6806e3f0 2026-02-22T23:26:52.490 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.482+0000 7fbb65ffb640 1 -- 10.20.193.93:0/4059262396 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb54003620 con 0x7fbb6806e3f0 2026-02-22T23:26:52.490 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.482+0000 7fbb65ffb640 1 -- 10.20.193.93:0/4059262396 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2587636386 0 0) 0x7fbb6813bbb0 con 0x7fbb680714f0 2026-02-22T23:26:52.491 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.483+0000 7fbb65ffb640 1 -- 10.20.193.93:0/4059262396 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb680aacc0 con 0x7fbb680714f0 2026-02-22T23:26:52.491 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.483+0000 7fbb65ffb640 1 -- 10.20.193.93:0/4059262396 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3806598577 0 0) 0x7fbb680ab5e0 con 0x7fbb680aa8e0 2026-02-22T23:26:52.491 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.483+0000 7fbb65ffb640 1 -- 10.20.193.93:0/4059262396 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb6813bbb0 con 0x7fbb680aa8e0 2026-02-22T23:26:52.491 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.483+0000 7fbb65ffb640 1 -- 10.20.193.93:0/4059262396 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 90590320 0 0) 0x7fbb54003620 con 0x7fbb6806e3f0 2026-02-22T23:26:52.491 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.483+0000 7fbb65ffb640 1 -- 10.20.193.93:0/4059262396 >> v1:10.20.193.155:6789/0 conn(0x7fbb680aa8e0 legacy=0x7fbb6813b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.491 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.483+0000 7fbb65ffb640 1 -- 10.20.193.93:0/4059262396 >> v1:10.20.193.93:6789/0 conn(0x7fbb680714f0 legacy=0x7fbb6814d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.491 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.483+0000 7fbb65ffb640 1 -- 10.20.193.93:0/4059262396 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb680aae90 con 0x7fbb6806e3f0 2026-02-22T23:26:52.491 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.483+0000 7fbb65ffb640 1 -- 10.20.193.93:0/4059262396 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fbb50002ea0 con 0x7fbb6806e3f0 2026-02-22T23:26:52.491 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.483+0000 7fbb65ffb640 1 -- 10.20.193.93:0/4059262396 <== mon.2 v1:10.20.193.93:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbb50003040 con 0x7fbb6806e3f0 2026-02-22T23:26:52.491 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.483+0000 7fbb65ffb640 1 -- 10.20.193.93:0/4059262396 <== mon.2 v1:10.20.193.93:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fbb500034d0 con 0x7fbb6806e3f0 2026-02-22T23:26:52.491 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.483+0000 7fbb6d949640 1 -- 10.20.193.93:0/4059262396 >> v1:10.20.193.93:6790/0 conn(0x7fbb6806e3f0 legacy=0x7fbb68070de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.491 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.483+0000 7fbb6d949640 1 -- 10.20.193.93:0/4059262396 shutdown_connections 2026-02-22T23:26:52.492 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.483+0000 7fbb6d949640 1 -- 10.20.193.93:0/4059262396 >> 10.20.193.93:0/4059262396 conn(0x7fbb6806d480 msgr2=0x7fbb6806d890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:52.492 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.483+0000 7fbb6d949640 1 -- 10.20.193.93:0/4059262396 shutdown_connections 2026-02-22T23:26:52.492 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.483+0000 7fbb6d949640 1 -- 10.20.193.93:0/4059262396 wait complete. 2026-02-22T23:26:52.492 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.484+0000 7fbb6d949640 1 Processor -- start 2026-02-22T23:26:52.492 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.484+0000 7fbb6d949640 1 -- start start 2026-02-22T23:26:52.492 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.484+0000 7fbb6d949640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb68073f60 con 0x7fbb6806e3f0 2026-02-22T23:26:52.492 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.484+0000 7fbb6d949640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb68074240 con 0x7fbb680aa8e0 2026-02-22T23:26:52.492 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.484+0000 7fbb6d949640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb681db880 con 0x7fbb6811d8b0 2026-02-22T23:26:52.492 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.484+0000 7fbb677fe640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7fbb6811d8b0 0x7fbb681e6100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:53704/0 (socket says 10.20.193.93:53704) 2026-02-22T23:26:52.492 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.484+0000 7fbb677fe640 1 -- 10.20.193.93:0/1103972828 learned_addr learned my addr 10.20.193.93:0/1103972828 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:26:52.492 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.484+0000 7fbb66ffd640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7fbb6806e3f0 0x7fbb68139ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:37062/0 (socket says 10.20.193.93:37062) 2026-02-22T23:26:52.492 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.484+0000 7fbb3ffff640 1 -- 10.20.193.93:0/1103972828 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 757427768 0 0) 0x7fbb681db880 con 0x7fbb6811d8b0 2026-02-22T23:26:52.492 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.484+0000 7fbb3ffff640 1 -- 10.20.193.93:0/1103972828 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb38003620 con 0x7fbb6811d8b0 2026-02-22T23:26:52.493 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.484+0000 7fbb3ffff640 1 -- 10.20.193.93:0/1103972828 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2249896321 0 0) 0x7fbb68073f60 con 0x7fbb6806e3f0 2026-02-22T23:26:52.493 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.484+0000 7fbb3ffff640 1 -- 10.20.193.93:0/1103972828 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb681db880 con 0x7fbb6806e3f0 2026-02-22T23:26:52.493 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.484+0000 7fbb3ffff640 1 -- 10.20.193.93:0/1103972828 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3950255185 0 0) 0x7fbb38003620 con 0x7fbb6811d8b0 2026-02-22T23:26:52.493 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.484+0000 7fbb3ffff640 1 -- 10.20.193.93:0/1103972828 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbb68073f60 con 0x7fbb6811d8b0 2026-02-22T23:26:52.493 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.484+0000 7fbb3ffff640 1 -- 10.20.193.93:0/1103972828 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fbb58003620 con 0x7fbb6811d8b0 2026-02-22T23:26:52.493 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.484+0000 7fbb3ffff640 1 -- 10.20.193.93:0/1103972828 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2638413890 0 0) 0x7fbb681db880 con 0x7fbb6806e3f0 2026-02-22T23:26:52.493 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.484+0000 7fbb3ffff640 1 -- 10.20.193.93:0/1103972828 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbb38003620 con 0x7fbb6806e3f0 2026-02-22T23:26:52.493 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.484+0000 7fbb3ffff640 1 -- 10.20.193.93:0/1103972828 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 492929448 0 0) 0x7fbb68074240 con 0x7fbb680aa8e0 2026-02-22T23:26:52.493 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.484+0000 7fbb3ffff640 1 -- 10.20.193.93:0/1103972828 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb681db880 con 0x7fbb680aa8e0 2026-02-22T23:26:52.493 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.484+0000 7fbb3ffff640 1 -- 10.20.193.93:0/1103972828 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fbb5c003140 con 0x7fbb6806e3f0 2026-02-22T23:26:52.493 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.484+0000 7fbb3ffff640 1 -- 10.20.193.93:0/1103972828 <== mon.2 v1:10.20.193.93:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 505028603 0 0) 0x7fbb68073f60 con 0x7fbb6811d8b0 2026-02-22T23:26:52.493 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.484+0000 7fbb3ffff640 1 -- 10.20.193.93:0/1103972828 >> v1:10.20.193.155:6789/0 conn(0x7fbb680aa8e0 legacy=0x7fbb681ddd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.494 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.484+0000 7fbb3ffff640 1 -- 10.20.193.93:0/1103972828 >> v1:10.20.193.93:6789/0 conn(0x7fbb6806e3f0 legacy=0x7fbb68139ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.494 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.484+0000 7fbb3ffff640 1 -- 10.20.193.93:0/1103972828 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb68074760 con 0x7fbb6811d8b0 2026-02-22T23:26:52.494 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.484+0000 7fbb6d949640 1 -- 10.20.193.93:0/1103972828 --> v1:10.20.193.93:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbb6811d570 con 0x7fbb6811d8b0 2026-02-22T23:26:52.494 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.484+0000 7fbb6d949640 1 -- 10.20.193.93:0/1103972828 --> v1:10.20.193.93:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fbb680b1450 con 0x7fbb6811d8b0 2026-02-22T23:26:52.494 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.484+0000 7fbb3ffff640 1 -- 10.20.193.93:0/1103972828 <== mon.2 v1:10.20.193.93:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbb58003af0 con 0x7fbb6811d8b0 2026-02-22T23:26:52.494 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.484+0000 7fbb3ffff640 1 -- 10.20.193.93:0/1103972828 <== mon.2 v1:10.20.193.93:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fbb58003ec0 con 0x7fbb6811d8b0 2026-02-22T23:26:52.494 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.485+0000 7fbb6d949640 1 -- 10.20.193.93:0/1103972828 --> v1:10.20.193.93:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb680008d0 con 0x7fbb6811d8b0 2026-02-22T23:26:52.494 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.485+0000 7fbb3ffff640 1 -- 10.20.193.93:0/1103972828 <== mon.2 v1:10.20.193.93:6790/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7fbb58004060 con 0x7fbb6811d8b0 2026-02-22T23:26:52.494 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.486+0000 7fbb3ffff640 1 -- 10.20.193.93:0/1103972828 <== mon.2 v1:10.20.193.93:6790/0 8 ==== osd_map(25..25 src has 1..25) ==== 4521+0+0 (unknown 3458299925 0 0) 0x7fbb580947f0 con 0x7fbb6811d8b0 2026-02-22T23:26:52.495 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.488+0000 7fbb3ffff640 1 -- 10.20.193.93:0/1103972828 <== mon.2 v1:10.20.193.93:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7fbb5805de70 con 0x7fbb6811d8b0 2026-02-22T23:26:52.575 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.571+0000 7fbb6d949640 1 -- 10.20.193.93:0/1103972828 --> v1:10.20.193.155:6800/3108481844 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fbb68141750 con 0x7fbb38078170 2026-02-22T23:26:52.575 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.572+0000 7fbb3ffff640 1 -- 10.20.193.93:0/1103972828 <== mgr.4108 v1:10.20.193.155:6800/3108481844 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (unknown 2264484800 0 0) 0x7fbb68141750 con 0x7fbb38078170 2026-02-22T23:26:52.575 INFO:teuthology.orchestra.run.trial093.stderr:instructed osd(s) 5 to deep-scrub 2026-02-22T23:26:52.576 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.573+0000 7fbb6d949640 1 -- 10.20.193.93:0/1103972828 >> v1:10.20.193.155:6800/3108481844 conn(0x7fbb38078170 legacy=0x7fbb3807a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.576 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.573+0000 7fbb6d949640 1 -- 10.20.193.93:0/1103972828 >> v1:10.20.193.93:6790/0 conn(0x7fbb6811d8b0 legacy=0x7fbb681e6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.576 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.573+0000 7fbb6d949640 1 -- 10.20.193.93:0/1103972828 shutdown_connections 2026-02-22T23:26:52.577 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.573+0000 7fbb6d949640 1 -- 10.20.193.93:0/1103972828 >> 10.20.193.93:0/1103972828 conn(0x7fbb6806d480 msgr2=0x7fbb68071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:52.577 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.573+0000 7fbb6d949640 1 -- 10.20.193.93:0/1103972828 shutdown_connections 2026-02-22T23:26:52.577 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.573+0000 7fbb6d949640 1 -- 10.20.193.93:0/1103972828 wait complete. 2026-02-22T23:26:52.583 INFO:tasks.ceph:Scrubbing osd.6 2026-02-22T23:26:52.584 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2026-02-22T23:26:52.663 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.656+0000 7f58d6a16640 1 Processor -- start 2026-02-22T23:26:52.663 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.656+0000 7f58d6a16640 1 -- start start 2026-02-22T23:26:52.664 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.656+0000 7f58d6a16640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58d00b1790 con 0x7f58d00b13b0 2026-02-22T23:26:52.664 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.656+0000 7f58d6a16640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58d00b32c0 con 0x7f58d0140e30 2026-02-22T23:26:52.664 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.656+0000 7f58d6a16640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58d0073c60 con 0x7f58d01402c0 2026-02-22T23:26:52.664 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.656+0000 7f58cffff640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7f58d00b13b0 0x7f58d013fbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:37074/0 (socket says 10.20.193.93:37074) 2026-02-22T23:26:52.664 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.656+0000 7f58cffff640 1 -- 10.20.193.93:0/1018373253 learned_addr learned my addr 10.20.193.93:0/1018373253 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:26:52.664 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.656+0000 7f58ceffd640 1 -- 10.20.193.93:0/1018373253 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 495716686 0 0) 0x7f58d0073c60 con 0x7f58d01402c0 2026-02-22T23:26:52.664 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.656+0000 7f58ceffd640 1 -- 10.20.193.93:0/1018373253 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58b4003620 con 0x7f58d01402c0 2026-02-22T23:26:52.664 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.656+0000 7f58ceffd640 1 -- 10.20.193.93:0/1018373253 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1831953984 0 0) 0x7f58d00b1790 con 0x7f58d00b13b0 2026-02-22T23:26:52.664 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.656+0000 7f58ceffd640 1 -- 10.20.193.93:0/1018373253 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58d0073c60 con 0x7f58d00b13b0 2026-02-22T23:26:52.664 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.656+0000 7f58ceffd640 1 -- 10.20.193.93:0/1018373253 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 84766711 0 0) 0x7f58b4003620 con 0x7f58d01402c0 2026-02-22T23:26:52.664 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.656+0000 7f58ceffd640 1 -- 10.20.193.93:0/1018373253 >> v1:10.20.193.155:6789/0 conn(0x7f58d0140e30 legacy=0x7f58d014c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.665 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.656+0000 7f58ceffd640 1 -- 10.20.193.93:0/1018373253 >> v1:10.20.193.93:6789/0 conn(0x7f58d00b13b0 legacy=0x7f58d013fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.665 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.656+0000 7f58ceffd640 1 -- 10.20.193.93:0/1018373253 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58d00afdb0 con 0x7f58d01402c0 2026-02-22T23:26:52.665 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.656+0000 7f58ceffd640 1 -- 10.20.193.93:0/1018373253 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f58c0002ea0 con 0x7f58d01402c0 2026-02-22T23:26:52.665 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.657+0000 7f58ceffd640 1 -- 10.20.193.93:0/1018373253 <== mon.2 v1:10.20.193.93:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f58c0003040 con 0x7f58d01402c0 2026-02-22T23:26:52.665 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.657+0000 7f58ceffd640 1 -- 10.20.193.93:0/1018373253 <== mon.2 v1:10.20.193.93:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f58c0003410 con 0x7f58d01402c0 2026-02-22T23:26:52.665 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.657+0000 7f58d6a16640 1 -- 10.20.193.93:0/1018373253 >> v1:10.20.193.93:6790/0 conn(0x7f58d01402c0 legacy=0x7f58d0140720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.665 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.657+0000 7f58d6a16640 1 -- 10.20.193.93:0/1018373253 shutdown_connections 2026-02-22T23:26:52.665 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.657+0000 7f58d6a16640 1 -- 10.20.193.93:0/1018373253 >> 10.20.193.93:0/1018373253 conn(0x7f58d00b2230 msgr2=0x7f58d00b2640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:52.665 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.657+0000 7f58d6a16640 1 -- 10.20.193.93:0/1018373253 shutdown_connections 2026-02-22T23:26:52.665 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.657+0000 7f58d6a16640 1 -- 10.20.193.93:0/1018373253 wait complete. 2026-02-22T23:26:52.665 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.657+0000 7f58d6a16640 1 Processor -- start 2026-02-22T23:26:52.665 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.657+0000 7f58d6a16640 1 -- start start 2026-02-22T23:26:52.666 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.658+0000 7f58d6a16640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58d01324f0 con 0x7f58d0132020 2026-02-22T23:26:52.666 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.658+0000 7f58d6a16640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58d0138270 con 0x7f58d00b13b0 2026-02-22T23:26:52.666 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.658+0000 7f58d6a16640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58d01dc490 con 0x7f58d0140e30 2026-02-22T23:26:52.666 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.658+0000 7f58cf7fe640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7f58d0140e30 0x7f58d0131910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:53722/0 (socket says 10.20.193.93:53722) 2026-02-22T23:26:52.666 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.658+0000 7f58cf7fe640 1 -- 10.20.193.93:0/1318102398 learned_addr learned my addr 10.20.193.93:0/1318102398 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:26:52.666 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.658+0000 7f58ccff9640 1 -- 10.20.193.93:0/1318102398 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1502535748 0 0) 0x7f58d01dc490 con 0x7f58d0140e30 2026-02-22T23:26:52.666 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.658+0000 7f58ccff9640 1 -- 10.20.193.93:0/1318102398 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58a0003620 con 0x7f58d0140e30 2026-02-22T23:26:52.666 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.658+0000 7f58ccff9640 1 -- 10.20.193.93:0/1318102398 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2396938883 0 0) 0x7f58d01324f0 con 0x7f58d0132020 2026-02-22T23:26:52.666 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.658+0000 7f58ccff9640 1 -- 10.20.193.93:0/1318102398 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58d01dc490 con 0x7f58d0132020 2026-02-22T23:26:52.666 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.658+0000 7f58ccff9640 1 -- 10.20.193.93:0/1318102398 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4206558493 0 0) 0x7f58a0003620 con 0x7f58d0140e30 2026-02-22T23:26:52.666 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.658+0000 7f58ccff9640 1 -- 10.20.193.93:0/1318102398 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f58d01324f0 con 0x7f58d0140e30 2026-02-22T23:26:52.666 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.658+0000 7f58ccff9640 1 -- 10.20.193.93:0/1318102398 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f58c0002e20 con 0x7f58d0140e30 2026-02-22T23:26:52.666 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.658+0000 7f58ccff9640 1 -- 10.20.193.93:0/1318102398 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4226608114 0 0) 0x7f58d01dc490 con 0x7f58d0132020 2026-02-22T23:26:52.667 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.658+0000 7f58ccff9640 1 -- 10.20.193.93:0/1318102398 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f58a0003620 con 0x7f58d0132020 2026-02-22T23:26:52.667 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.658+0000 7f58ccff9640 1 -- 10.20.193.93:0/1318102398 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f58c40032e0 con 0x7f58d0132020 2026-02-22T23:26:52.667 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.658+0000 7f58ccff9640 1 -- 10.20.193.93:0/1318102398 <== mon.2 v1:10.20.193.93:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4057331331 0 0) 0x7f58d01324f0 con 0x7f58d0140e30 2026-02-22T23:26:52.667 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.658+0000 7f58ccff9640 1 -- 10.20.193.93:0/1318102398 >> v1:10.20.193.155:6789/0 conn(0x7f58d00b13b0 legacy=0x7f58d0137b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.667 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.658+0000 7f58ccff9640 1 -- 10.20.193.93:0/1318102398 >> v1:10.20.193.93:6789/0 conn(0x7f58d0132020 legacy=0x7f58d01dbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.667 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.658+0000 7f58ccff9640 1 -- 10.20.193.93:0/1318102398 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58d01dc660 con 0x7f58d0140e30 2026-02-22T23:26:52.667 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.658+0000 7f58d6a16640 1 -- 10.20.193.93:0/1318102398 --> v1:10.20.193.93:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f58d0138a90 con 0x7f58d0140e30 2026-02-22T23:26:52.667 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.658+0000 7f58d6a16640 1 -- 10.20.193.93:0/1318102398 --> v1:10.20.193.93:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f58d013a9d0 con 0x7f58d0140e30 2026-02-22T23:26:52.667 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.658+0000 7f58ccff9640 1 -- 10.20.193.93:0/1318102398 <== mon.2 v1:10.20.193.93:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f58c0003980 con 0x7f58d0140e30 2026-02-22T23:26:52.667 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.658+0000 7f58ccff9640 1 -- 10.20.193.93:0/1318102398 <== mon.2 v1:10.20.193.93:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f58c0003dd0 con 0x7f58d0140e30 2026-02-22T23:26:52.667 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.659+0000 7f58d6a16640 1 -- 10.20.193.93:0/1318102398 --> v1:10.20.193.93:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f58d00008d0 con 0x7f58d0140e30 2026-02-22T23:26:52.668 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.659+0000 7f58ccff9640 1 -- 10.20.193.93:0/1318102398 <== mon.2 v1:10.20.193.93:6790/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7f58c0003f70 con 0x7f58d0140e30 2026-02-22T23:26:52.668 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.660+0000 7f58ccff9640 1 -- 10.20.193.93:0/1318102398 <== mon.2 v1:10.20.193.93:6790/0 8 ==== osd_map(25..25 src has 1..25) ==== 4521+0+0 (unknown 3458299925 0 0) 0x7f58c0094400 con 0x7f58d0140e30 2026-02-22T23:26:52.668 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.660+0000 7f58ccff9640 1 -- 10.20.193.93:0/1318102398 --> v1:10.20.193.155:6805/4020397544 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f58a0083af0 con 0x7f58a007ff20 2026-02-22T23:26:52.668 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.660+0000 7f58ccff9640 1 -- 10.20.193.93:0/1318102398 <== mon.2 v1:10.20.193.93:6790/0 9 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (unknown 2663167439 0 0) 0x7f58c00947e0 con 0x7f58d0140e30 2026-02-22T23:26:52.668 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.661+0000 7f58ccff9640 1 -- 10.20.193.93:0/1318102398 <== osd.6 v1:10.20.193.155:6805/4020397544 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7f58a0083af0 con 0x7f58a007ff20 2026-02-22T23:26:52.670 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.667+0000 7f58d6a16640 1 -- 10.20.193.93:0/1318102398 --> v1:10.20.193.155:6805/4020397544 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f58d0138e70 con 0x7f58a007ff20 2026-02-22T23:26:52.670 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.667+0000 7f58ccff9640 1 -- 10.20.193.93:0/1318102398 <== osd.6 v1:10.20.193.155:6805/4020397544 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f58d0138e70 con 0x7f58a007ff20 2026-02-22T23:26:52.671 INFO:teuthology.orchestra.run.trial093.stdout:{ 2026-02-22T23:26:52.671 INFO:teuthology.orchestra.run.trial093.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-22T23:26:52.671 INFO:teuthology.orchestra.run.trial093.stdout:} 2026-02-22T23:26:52.672 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.668+0000 7f58d6a16640 1 -- 10.20.193.93:0/1318102398 >> v1:10.20.193.155:6805/4020397544 conn(0x7f58a007ff20 legacy=0x7f58a0082340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.672 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.668+0000 7f58d6a16640 1 -- 10.20.193.93:0/1318102398 >> v1:10.20.193.155:6800/3108481844 conn(0x7f58a0078080 legacy=0x7f58a007a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.672 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.668+0000 7f58d6a16640 1 -- 10.20.193.93:0/1318102398 >> v1:10.20.193.93:6790/0 conn(0x7f58d0140e30 legacy=0x7f58d0131910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.672 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.668+0000 7f58d4f8c640 1 -- 10.20.193.93:0/1318102398 reap_dead start 2026-02-22T23:26:52.672 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.668+0000 7f58d6a16640 1 -- 10.20.193.93:0/1318102398 shutdown_connections 2026-02-22T23:26:52.672 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.668+0000 7f58d6a16640 1 -- 10.20.193.93:0/1318102398 >> 10.20.193.93:0/1318102398 conn(0x7f58d00b2230 msgr2=0x7f58d0143e30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:52.672 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.668+0000 7f58d6a16640 1 -- 10.20.193.93:0/1318102398 shutdown_connections 2026-02-22T23:26:52.673 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.668+0000 7f58d6a16640 1 -- 10.20.193.93:0/1318102398 wait complete. 2026-02-22T23:26:52.677 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2026-02-22T23:26:52.747 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.744+0000 7f8f4d038640 1 Processor -- start 2026-02-22T23:26:52.748 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.745+0000 7f8f4d038640 1 -- start start 2026-02-22T23:26:52.749 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.745+0000 7f8f4d038640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f4813bbb0 con 0x7f8f4806e3f0 2026-02-22T23:26:52.749 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.745+0000 7f8f4d038640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f480ab5e0 con 0x7f8f480714f0 2026-02-22T23:26:52.749 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.745+0000 7f8f4d038640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f480aacc0 con 0x7f8f480aa8e0 2026-02-22T23:26:52.749 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.745+0000 7f8f46d76640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7f8f480aa8e0 0x7f8f4813b4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:53732/0 (socket says 10.20.193.93:53732) 2026-02-22T23:26:52.749 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.745+0000 7f8f46d76640 1 -- 10.20.193.93:0/991977491 learned_addr learned my addr 10.20.193.93:0/991977491 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:26:52.749 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.745+0000 7f8f45d74640 1 -- 10.20.193.93:0/991977491 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1972669656 0 0) 0x7f8f480aacc0 con 0x7f8f480aa8e0 2026-02-22T23:26:52.749 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.745+0000 7f8f45d74640 1 -- 10.20.193.93:0/991977491 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f34003620 con 0x7f8f480aa8e0 2026-02-22T23:26:52.749 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.745+0000 7f8f45d74640 1 -- 10.20.193.93:0/991977491 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2090507714 0 0) 0x7f8f4813bbb0 con 0x7f8f4806e3f0 2026-02-22T23:26:52.749 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.745+0000 7f8f45d74640 1 -- 10.20.193.93:0/991977491 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f480aacc0 con 0x7f8f4806e3f0 2026-02-22T23:26:52.749 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.746+0000 7f8f45d74640 1 -- 10.20.193.93:0/991977491 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1714985209 0 0) 0x7f8f34003620 con 0x7f8f480aa8e0 2026-02-22T23:26:52.749 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.746+0000 7f8f45d74640 1 -- 10.20.193.93:0/991977491 >> v1:10.20.193.155:6789/0 conn(0x7f8f480714f0 legacy=0x7f8f4814d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.749 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.746+0000 7f8f45d74640 1 -- 10.20.193.93:0/991977491 >> v1:10.20.193.93:6789/0 conn(0x7f8f4806e3f0 legacy=0x7f8f48070de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.749 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.746+0000 7f8f45d74640 1 -- 10.20.193.93:0/991977491 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f480aae90 con 0x7f8f480aa8e0 2026-02-22T23:26:52.749 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.746+0000 7f8f45d74640 1 -- 10.20.193.93:0/991977491 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f8f3c002ea0 con 0x7f8f480aa8e0 2026-02-22T23:26:52.749 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.746+0000 7f8f45d74640 1 -- 10.20.193.93:0/991977491 <== mon.2 v1:10.20.193.93:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8f3c003040 con 0x7f8f480aa8e0 2026-02-22T23:26:52.749 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.746+0000 7f8f45d74640 1 -- 10.20.193.93:0/991977491 <== mon.2 v1:10.20.193.93:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f8f3c0034d0 con 0x7f8f480aa8e0 2026-02-22T23:26:52.749 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.746+0000 7f8f4d038640 1 -- 10.20.193.93:0/991977491 >> v1:10.20.193.93:6790/0 conn(0x7f8f480aa8e0 legacy=0x7f8f4813b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.749 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.746+0000 7f8f4d038640 1 -- 10.20.193.93:0/991977491 shutdown_connections 2026-02-22T23:26:52.749 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.746+0000 7f8f4d038640 1 -- 10.20.193.93:0/991977491 >> 10.20.193.93:0/991977491 conn(0x7f8f4806d480 msgr2=0x7f8f4806d890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:52.750 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.746+0000 7f8f4d038640 1 -- 10.20.193.93:0/991977491 shutdown_connections 2026-02-22T23:26:52.750 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.746+0000 7f8f4d038640 1 -- 10.20.193.93:0/991977491 wait complete. 2026-02-22T23:26:52.751 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.747+0000 7f8f4d038640 1 Processor -- start 2026-02-22T23:26:52.751 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.747+0000 7f8f4d038640 1 -- start start 2026-02-22T23:26:52.751 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.747+0000 7f8f4d038640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f48074820 con 0x7f8f4806e3f0 2026-02-22T23:26:52.751 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.747+0000 7f8f4d038640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f480b1a70 con 0x7f8f480aa8e0 2026-02-22T23:26:52.751 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.747+0000 7f8f4d038640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f48074440 con 0x7f8f48140550 2026-02-22T23:26:52.751 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.747+0000 7f8f46d76640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7f8f4806e3f0 0x7f8f480b1360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:37106/0 (socket says 10.20.193.93:37106) 2026-02-22T23:26:52.751 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.747+0000 7f8f46d76640 1 -- 10.20.193.93:0/351422263 learned_addr learned my addr 10.20.193.93:0/351422263 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:26:52.752 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.747+0000 7f8f277fe640 1 -- 10.20.193.93:0/351422263 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 18340402 0 0) 0x7f8f48074820 con 0x7f8f4806e3f0 2026-02-22T23:26:52.752 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.747+0000 7f8f277fe640 1 -- 10.20.193.93:0/351422263 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f14003620 con 0x7f8f4806e3f0 2026-02-22T23:26:52.752 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.747+0000 7f8f277fe640 1 -- 10.20.193.93:0/351422263 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3627603255 0 0) 0x7f8f48074440 con 0x7f8f48140550 2026-02-22T23:26:52.752 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.747+0000 7f8f277fe640 1 -- 10.20.193.93:0/351422263 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f48074820 con 0x7f8f48140550 2026-02-22T23:26:52.752 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.747+0000 7f8f277fe640 1 -- 10.20.193.93:0/351422263 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4079518913 0 0) 0x7f8f14003620 con 0x7f8f4806e3f0 2026-02-22T23:26:52.752 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.747+0000 7f8f277fe640 1 -- 10.20.193.93:0/351422263 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8f48074440 con 0x7f8f4806e3f0 2026-02-22T23:26:52.752 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.747+0000 7f8f277fe640 1 -- 10.20.193.93:0/351422263 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f8f3c0033d0 con 0x7f8f4806e3f0 2026-02-22T23:26:52.752 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.747+0000 7f8f277fe640 1 -- 10.20.193.93:0/351422263 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2711687543 0 0) 0x7f8f48074820 con 0x7f8f48140550 2026-02-22T23:26:52.752 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.747+0000 7f8f277fe640 1 -- 10.20.193.93:0/351422263 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8f14003620 con 0x7f8f48140550 2026-02-22T23:26:52.752 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.747+0000 7f8f277fe640 1 -- 10.20.193.93:0/351422263 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f8f38003440 con 0x7f8f48140550 2026-02-22T23:26:52.752 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.747+0000 7f8f277fe640 1 -- 10.20.193.93:0/351422263 <== mon.0 v1:10.20.193.93:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3767189704 0 0) 0x7f8f48074440 con 0x7f8f4806e3f0 2026-02-22T23:26:52.752 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.747+0000 7f8f277fe640 1 -- 10.20.193.93:0/351422263 >> v1:10.20.193.93:6790/0 conn(0x7f8f48140550 legacy=0x7f8f48139730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.752 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.747+0000 7f8f277fe640 1 -- 10.20.193.93:0/351422263 >> v1:10.20.193.155:6789/0 conn(0x7f8f480aa8e0 legacy=0x7f8f480ae380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.752 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.747+0000 7f8f277fe640 1 -- 10.20.193.93:0/351422263 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f480aea90 con 0x7f8f4806e3f0 2026-02-22T23:26:52.752 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.747+0000 7f8f4d038640 1 -- 10.20.193.93:0/351422263 --> v1:10.20.193.93:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8f48139e40 con 0x7f8f4806e3f0 2026-02-22T23:26:52.752 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.747+0000 7f8f277fe640 1 -- 10.20.193.93:0/351422263 <== mon.0 v1:10.20.193.93:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8f3c004cf0 con 0x7f8f4806e3f0 2026-02-22T23:26:52.752 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.747+0000 7f8f277fe640 1 -- 10.20.193.93:0/351422263 <== mon.0 v1:10.20.193.93:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f8f3c005040 con 0x7f8f4806e3f0 2026-02-22T23:26:52.752 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.747+0000 7f8f4d038640 1 -- 10.20.193.93:0/351422263 --> v1:10.20.193.93:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8f481ddee0 con 0x7f8f4806e3f0 2026-02-22T23:26:52.752 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.748+0000 7f8f4d038640 1 -- 10.20.193.93:0/351422263 --> v1:10.20.193.93:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f480b65a0 con 0x7f8f4806e3f0 2026-02-22T23:26:52.752 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.748+0000 7f8f277fe640 1 -- 10.20.193.93:0/351422263 <== mon.0 v1:10.20.193.93:6789/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7f8f3c01d890 con 0x7f8f4806e3f0 2026-02-22T23:26:52.753 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.749+0000 7f8f277fe640 1 -- 10.20.193.93:0/351422263 <== mon.0 v1:10.20.193.93:6789/0 8 ==== osd_map(25..25 src has 1..25) ==== 4521+0+0 (unknown 3458299925 0 0) 0x7f8f3c094520 con 0x7f8f4806e3f0 2026-02-22T23:26:52.753 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.750+0000 7f8f277fe640 1 -- 10.20.193.93:0/351422263 <== mon.0 v1:10.20.193.93:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f8f480b65a0 con 0x7f8f4806e3f0 2026-02-22T23:26:52.838 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.835+0000 7f8f4d038640 1 -- 10.20.193.93:0/351422263 --> v1:10.20.193.155:6800/3108481844 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f8f480ae0a0 con 0x7f8f14077f90 2026-02-22T23:26:52.839 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.835+0000 7f8f277fe640 1 -- 10.20.193.93:0/351422263 <== mgr.4108 v1:10.20.193.155:6800/3108481844 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (unknown 778718403 0 0) 0x7f8f30004d90 con 0x7f8f14077f90 2026-02-22T23:26:52.839 INFO:teuthology.orchestra.run.trial093.stderr:instructed osd(s) 6 to deep-scrub 2026-02-22T23:26:52.840 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.836+0000 7f8f4d038640 1 -- 10.20.193.93:0/351422263 >> v1:10.20.193.155:6800/3108481844 conn(0x7f8f14077f90 legacy=0x7f8f1407a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.840 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.836+0000 7f8f4d038640 1 -- 10.20.193.93:0/351422263 >> v1:10.20.193.93:6789/0 conn(0x7f8f4806e3f0 legacy=0x7f8f480b1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.840 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.836+0000 7f8f4d038640 1 -- 10.20.193.93:0/351422263 shutdown_connections 2026-02-22T23:26:52.840 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.836+0000 7f8f4d038640 1 -- 10.20.193.93:0/351422263 >> 10.20.193.93:0/351422263 conn(0x7f8f4806d480 msgr2=0x7f8f481454d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:52.840 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.836+0000 7f8f4d038640 1 -- 10.20.193.93:0/351422263 shutdown_connections 2026-02-22T23:26:52.840 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.836+0000 7f8f4d038640 1 -- 10.20.193.93:0/351422263 wait complete. 2026-02-22T23:26:52.849 INFO:tasks.ceph:Scrubbing osd.7 2026-02-22T23:26:52.849 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2026-02-22T23:26:52.924 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.916+0000 7fb28da61640 1 Processor -- start 2026-02-22T23:26:52.924 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.916+0000 7fb28da61640 1 -- start start 2026-02-22T23:26:52.924 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.917+0000 7fb28da61640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2880b1790 con 0x7fb2880b13b0 2026-02-22T23:26:52.924 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.917+0000 7fb28da61640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2880b32c0 con 0x7fb288141460 2026-02-22T23:26:52.924 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.917+0000 7fb28da61640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb288073d60 con 0x7fb2880b1b70 2026-02-22T23:26:52.925 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.917+0000 7fb286ffd640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7fb2880b13b0 0x7fb288140d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:37114/0 (socket says 10.20.193.93:37114) 2026-02-22T23:26:52.925 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.917+0000 7fb2867fc640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7fb2880b1b70 0x7fb288145340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:53746/0 (socket says 10.20.193.93:53746) 2026-02-22T23:26:52.925 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.917+0000 7fb286ffd640 1 -- 10.20.193.93:0/1219815139 learned_addr learned my addr 10.20.193.93:0/1219815139 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:26:52.925 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.917+0000 7fb285ffb640 1 -- 10.20.193.93:0/1219815139 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 913008923 0 0) 0x7fb2880b1790 con 0x7fb2880b13b0 2026-02-22T23:26:52.925 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.917+0000 7fb285ffb640 1 -- 10.20.193.93:0/1219815139 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb274003620 con 0x7fb2880b13b0 2026-02-22T23:26:52.925 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.917+0000 7fb285ffb640 1 -- 10.20.193.93:0/1219815139 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3987314817 0 0) 0x7fb288073d60 con 0x7fb2880b1b70 2026-02-22T23:26:52.925 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.917+0000 7fb285ffb640 1 -- 10.20.193.93:0/1219815139 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2880b1790 con 0x7fb2880b1b70 2026-02-22T23:26:52.925 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.917+0000 7fb285ffb640 1 -- 10.20.193.93:0/1219815139 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 653909791 0 0) 0x7fb274003620 con 0x7fb2880b13b0 2026-02-22T23:26:52.925 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.917+0000 7fb285ffb640 1 -- 10.20.193.93:0/1219815139 >> v1:10.20.193.93:6790/0 conn(0x7fb2880b1b70 legacy=0x7fb288145340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.925 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.917+0000 7fb285ffb640 1 -- 10.20.193.93:0/1219815139 >> v1:10.20.193.155:6789/0 conn(0x7fb288141460 legacy=0x7fb28814d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.925 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.917+0000 7fb285ffb640 1 -- 10.20.193.93:0/1219815139 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb288073920 con 0x7fb2880b13b0 2026-02-22T23:26:52.926 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.917+0000 7fb285ffb640 1 -- 10.20.193.93:0/1219815139 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fb27c002ea0 con 0x7fb2880b13b0 2026-02-22T23:26:52.926 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.917+0000 7fb285ffb640 1 -- 10.20.193.93:0/1219815139 <== mon.0 v1:10.20.193.93:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb27c003040 con 0x7fb2880b13b0 2026-02-22T23:26:52.926 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.917+0000 7fb285ffb640 1 -- 10.20.193.93:0/1219815139 <== mon.0 v1:10.20.193.93:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fb27c0034d0 con 0x7fb2880b13b0 2026-02-22T23:26:52.926 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.917+0000 7fb28da61640 1 -- 10.20.193.93:0/1219815139 >> v1:10.20.193.93:6789/0 conn(0x7fb2880b13b0 legacy=0x7fb288140d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.926 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.917+0000 7fb28da61640 1 -- 10.20.193.93:0/1219815139 shutdown_connections 2026-02-22T23:26:52.926 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.917+0000 7fb28da61640 1 -- 10.20.193.93:0/1219815139 >> 10.20.193.93:0/1219815139 conn(0x7fb2880b2230 msgr2=0x7fb2880b2640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:52.926 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.917+0000 7fb28da61640 1 -- 10.20.193.93:0/1219815139 shutdown_connections 2026-02-22T23:26:52.926 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.917+0000 7fb28da61640 1 -- 10.20.193.93:0/1219815139 wait complete. 2026-02-22T23:26:52.927 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.918+0000 7fb28da61640 1 Processor -- start 2026-02-22T23:26:52.927 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.918+0000 7fb28da61640 1 -- start start 2026-02-22T23:26:52.927 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.918+0000 7fb28da61640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2881391d0 con 0x7fb288141460 2026-02-22T23:26:52.927 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.918+0000 7fb28da61640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb28811da30 con 0x7fb288139450 2026-02-22T23:26:52.927 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.918+0000 7fb28da61640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2881de510 con 0x7fb2880b13b0 2026-02-22T23:26:52.927 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.918+0000 7fb286ffd640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7fb2880b13b0 0x7fb2881dde00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:53752/0 (socket says 10.20.193.93:53752) 2026-02-22T23:26:52.927 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.918+0000 7fb286ffd640 1 -- 10.20.193.93:0/3315714176 learned_addr learned my addr 10.20.193.93:0/3315714176 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:26:52.927 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.919+0000 7fb25ffff640 1 -- 10.20.193.93:0/3315714176 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1872509167 0 0) 0x7fb2881de510 con 0x7fb2880b13b0 2026-02-22T23:26:52.927 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.919+0000 7fb25ffff640 1 -- 10.20.193.93:0/3315714176 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb258003620 con 0x7fb2880b13b0 2026-02-22T23:26:52.928 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.919+0000 7fb25ffff640 1 -- 10.20.193.93:0/3315714176 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 961968668 0 0) 0x7fb2881391d0 con 0x7fb288141460 2026-02-22T23:26:52.928 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.919+0000 7fb25ffff640 1 -- 10.20.193.93:0/3315714176 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2881de510 con 0x7fb288141460 2026-02-22T23:26:52.928 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.919+0000 7fb25ffff640 1 -- 10.20.193.93:0/3315714176 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 122122746 0 0) 0x7fb258003620 con 0x7fb2880b13b0 2026-02-22T23:26:52.928 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.919+0000 7fb25ffff640 1 -- 10.20.193.93:0/3315714176 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb2881391d0 con 0x7fb2880b13b0 2026-02-22T23:26:52.928 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.919+0000 7fb25ffff640 1 -- 10.20.193.93:0/3315714176 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 704939336 0 0) 0x7fb2881de510 con 0x7fb288141460 2026-02-22T23:26:52.928 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.919+0000 7fb25ffff640 1 -- 10.20.193.93:0/3315714176 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb258003620 con 0x7fb288141460 2026-02-22T23:26:52.928 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.919+0000 7fb25ffff640 1 -- 10.20.193.93:0/3315714176 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fb27c0034d0 con 0x7fb2880b13b0 2026-02-22T23:26:52.928 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.919+0000 7fb25ffff640 1 -- 10.20.193.93:0/3315714176 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fb270002ae0 con 0x7fb288141460 2026-02-22T23:26:52.928 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.919+0000 7fb25ffff640 1 -- 10.20.193.93:0/3315714176 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1713627186 0 0) 0x7fb28811da30 con 0x7fb288139450 2026-02-22T23:26:52.928 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.919+0000 7fb25ffff640 1 -- 10.20.193.93:0/3315714176 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2881de510 con 0x7fb288139450 2026-02-22T23:26:52.928 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.919+0000 7fb25ffff640 1 -- 10.20.193.93:0/3315714176 <== mon.0 v1:10.20.193.93:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 363746671 0 0) 0x7fb258003620 con 0x7fb288141460 2026-02-22T23:26:52.928 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.919+0000 7fb25ffff640 1 -- 10.20.193.93:0/3315714176 >> v1:10.20.193.93:6790/0 conn(0x7fb2880b13b0 legacy=0x7fb2881dde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.929 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.919+0000 7fb25ffff640 1 -- 10.20.193.93:0/3315714176 >> v1:10.20.193.155:6789/0 conn(0x7fb288139450 legacy=0x7fb288138ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.929 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.919+0000 7fb25ffff640 1 -- 10.20.193.93:0/3315714176 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb288071760 con 0x7fb288141460 2026-02-22T23:26:52.929 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.919+0000 7fb28da61640 1 -- 10.20.193.93:0/3315714176 --> v1:10.20.193.93:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb288071a50 con 0x7fb288141460 2026-02-22T23:26:52.929 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.919+0000 7fb25ffff640 1 -- 10.20.193.93:0/3315714176 <== mon.0 v1:10.20.193.93:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb2700048e0 con 0x7fb288141460 2026-02-22T23:26:52.929 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.919+0000 7fb28da61640 1 -- 10.20.193.93:0/3315714176 --> v1:10.20.193.93:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb2880af520 con 0x7fb288141460 2026-02-22T23:26:52.929 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.919+0000 7fb25ffff640 1 -- 10.20.193.93:0/3315714176 <== mon.0 v1:10.20.193.93:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fb270004c30 con 0x7fb288141460 2026-02-22T23:26:52.929 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.919+0000 7fb28da61640 1 -- 10.20.193.93:0/3315714176 --> v1:10.20.193.93:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fb288071ee0 con 0x7fb288141460 2026-02-22T23:26:52.929 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.920+0000 7fb25ffff640 1 -- 10.20.193.93:0/3315714176 <== mon.0 v1:10.20.193.93:6789/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7fb27001d400 con 0x7fb288141460 2026-02-22T23:26:52.929 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.920+0000 7fb25ffff640 1 -- 10.20.193.93:0/3315714176 <== mon.0 v1:10.20.193.93:6789/0 8 ==== osd_map(25..25 src has 1..25) ==== 4521+0+0 (unknown 3458299925 0 0) 0x7fb270094320 con 0x7fb288141460 2026-02-22T23:26:52.929 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.920+0000 7fb25ffff640 1 -- 10.20.193.93:0/3315714176 --> v1:10.20.193.155:6801/2779097013 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb258083b70 con 0x7fb25807ff00 2026-02-22T23:26:52.929 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.920+0000 7fb25ffff640 1 -- 10.20.193.93:0/3315714176 <== mon.0 v1:10.20.193.93:6789/0 9 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (unknown 2663167439 0 0) 0x7fb270094760 con 0x7fb288141460 2026-02-22T23:26:52.930 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.921+0000 7fb25ffff640 1 -- 10.20.193.93:0/3315714176 <== osd.7 v1:10.20.193.155:6801/2779097013 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7fb258083b70 con 0x7fb25807ff00 2026-02-22T23:26:52.931 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.928+0000 7fb28da61640 1 -- 10.20.193.93:0/3315714176 --> v1:10.20.193.155:6801/2779097013 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb288145a50 con 0x7fb25807ff00 2026-02-22T23:26:52.931 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.928+0000 7fb25ffff640 1 -- 10.20.193.93:0/3315714176 <== osd.7 v1:10.20.193.155:6801/2779097013 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fb288145a50 con 0x7fb25807ff00 2026-02-22T23:26:52.931 INFO:teuthology.orchestra.run.trial093.stdout:{ 2026-02-22T23:26:52.932 INFO:teuthology.orchestra.run.trial093.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-22T23:26:52.932 INFO:teuthology.orchestra.run.trial093.stdout:} 2026-02-22T23:26:52.933 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.928+0000 7fb28da61640 1 -- 10.20.193.93:0/3315714176 >> v1:10.20.193.155:6801/2779097013 conn(0x7fb25807ff00 legacy=0x7fb258082320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.933 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.928+0000 7fb28da61640 1 -- 10.20.193.93:0/3315714176 >> v1:10.20.193.155:6800/3108481844 conn(0x7fb2580780f0 legacy=0x7fb25807a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.933 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.928+0000 7fb28da61640 1 -- 10.20.193.93:0/3315714176 >> v1:10.20.193.93:6789/0 conn(0x7fb288141460 legacy=0x7fb2881383b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:52.933 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.928+0000 7fb2877fe640 1 -- 10.20.193.93:0/3315714176 reap_dead start 2026-02-22T23:26:52.933 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.928+0000 7fb28da61640 1 -- 10.20.193.93:0/3315714176 shutdown_connections 2026-02-22T23:26:52.933 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.928+0000 7fb28da61640 1 -- 10.20.193.93:0/3315714176 >> 10.20.193.93:0/3315714176 conn(0x7fb2880b2230 msgr2=0x7fb28813f050 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:52.933 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.928+0000 7fb28da61640 1 -- 10.20.193.93:0/3315714176 shutdown_connections 2026-02-22T23:26:52.933 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:52.928+0000 7fb28da61640 1 -- 10.20.193.93:0/3315714176 wait complete. 2026-02-22T23:26:52.938 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2026-02-22T23:26:53.010 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.002+0000 7f16628ea640 1 Processor -- start 2026-02-22T23:26:53.011 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.003+0000 7f16628ea640 1 -- start start 2026-02-22T23:26:53.011 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.003+0000 7f16628ea640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f165c0b16f0 con 0x7f165c147940 2026-02-22T23:26:53.011 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.003+0000 7f16628ea640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f165c0b1940 con 0x7f165c0b1140 2026-02-22T23:26:53.011 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.003+0000 7f16628ea640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f165c0b5720 con 0x7f165c0b0d60 2026-02-22T23:26:53.011 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.003+0000 7f165bfff640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7f165c0b0d60 0x7f165c142f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:53762/0 (socket says 10.20.193.93:53762) 2026-02-22T23:26:53.011 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.003+0000 7f165bfff640 1 -- 10.20.193.93:0/1336910275 learned_addr learned my addr 10.20.193.93:0/1336910275 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:26:53.011 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.003+0000 7f1660e60640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7f165c147940 0x7f165c14f280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:37124/0 (socket says 10.20.193.93:37124) 2026-02-22T23:26:53.012 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.003+0000 7f165affd640 1 -- 10.20.193.93:0/1336910275 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3027198335 0 0) 0x7f165c0b16f0 con 0x7f165c147940 2026-02-22T23:26:53.012 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.003+0000 7f165affd640 1 -- 10.20.193.93:0/1336910275 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1640003620 con 0x7f165c147940 2026-02-22T23:26:53.012 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.003+0000 7f165affd640 1 -- 10.20.193.93:0/1336910275 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2303782462 0 0) 0x7f165c0b5720 con 0x7f165c0b0d60 2026-02-22T23:26:53.012 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.003+0000 7f165affd640 1 -- 10.20.193.93:0/1336910275 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f165c0b16f0 con 0x7f165c0b0d60 2026-02-22T23:26:53.012 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.003+0000 7f165affd640 1 -- 10.20.193.93:0/1336910275 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2458536937 0 0) 0x7f1640003620 con 0x7f165c147940 2026-02-22T23:26:53.012 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.003+0000 7f165affd640 1 -- 10.20.193.93:0/1336910275 >> v1:10.20.193.93:6790/0 conn(0x7f165c0b0d60 legacy=0x7f165c142f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:53.012 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.003+0000 7f165affd640 1 -- 10.20.193.93:0/1336910275 >> v1:10.20.193.155:6789/0 conn(0x7f165c0b1140 legacy=0x7f165c147230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:53.012 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.003+0000 7f165affd640 1 -- 10.20.193.93:0/1336910275 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f165c0aedf0 con 0x7f165c147940 2026-02-22T23:26:53.012 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.003+0000 7f165affd640 1 -- 10.20.193.93:0/1336910275 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f1650003220 con 0x7f165c147940 2026-02-22T23:26:53.012 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.003+0000 7f165affd640 1 -- 10.20.193.93:0/1336910275 <== mon.0 v1:10.20.193.93:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1650003440 con 0x7f165c147940 2026-02-22T23:26:53.013 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.003+0000 7f165affd640 1 -- 10.20.193.93:0/1336910275 <== mon.0 v1:10.20.193.93:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f16500038d0 con 0x7f165c147940 2026-02-22T23:26:53.013 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.004+0000 7f16628ea640 1 -- 10.20.193.93:0/1336910275 >> v1:10.20.193.93:6789/0 conn(0x7f165c147940 legacy=0x7f165c14f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:53.013 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.004+0000 7f16628ea640 1 -- 10.20.193.93:0/1336910275 shutdown_connections 2026-02-22T23:26:53.013 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.004+0000 7f16628ea640 1 -- 10.20.193.93:0/1336910275 >> 10.20.193.93:0/1336910275 conn(0x7f165c06d480 msgr2=0x7f165c06d890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:53.013 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.004+0000 7f16628ea640 1 -- 10.20.193.93:0/1336910275 shutdown_connections 2026-02-22T23:26:53.013 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.004+0000 7f16628ea640 1 -- 10.20.193.93:0/1336910275 wait complete. 2026-02-22T23:26:53.013 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.004+0000 7f16628ea640 1 Processor -- start 2026-02-22T23:26:53.013 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.004+0000 7f16628ea640 1 -- start start 2026-02-22T23:26:53.013 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.004+0000 7f16628ea640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f165c13a4c0 con 0x7f165c147940 2026-02-22T23:26:53.013 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.004+0000 7f16628ea640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f165c13c0b0 con 0x7f165c0b1140 2026-02-22T23:26:53.014 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.004+0000 7f16628ea640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f165c071fa0 con 0x7f165c0b0d60 2026-02-22T23:26:53.014 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.005+0000 7f165bfff640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7f165c0b0d60 0x7f165c139db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:53772/0 (socket says 10.20.193.93:53772) 2026-02-22T23:26:53.014 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.005+0000 7f165bfff640 1 -- 10.20.193.93:0/1665517309 learned_addr learned my addr 10.20.193.93:0/1665517309 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:26:53.014 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.005+0000 7f1658ff9640 1 -- 10.20.193.93:0/1665517309 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2244431509 0 0) 0x7f165c071fa0 con 0x7f165c0b0d60 2026-02-22T23:26:53.014 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.005+0000 7f1658ff9640 1 -- 10.20.193.93:0/1665517309 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f162c003620 con 0x7f165c0b0d60 2026-02-22T23:26:53.014 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.005+0000 7f1658ff9640 1 -- 10.20.193.93:0/1665517309 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3740447674 0 0) 0x7f165c0aedf0 con 0x7f165c147940 2026-02-22T23:26:53.014 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.005+0000 7f1658ff9640 1 -- 10.20.193.93:0/1665517309 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f165c071fa0 con 0x7f165c147940 2026-02-22T23:26:53.014 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.005+0000 7f1658ff9640 1 -- 10.20.193.93:0/1665517309 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 934815391 0 0) 0x7f162c003620 con 0x7f165c0b0d60 2026-02-22T23:26:53.014 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.005+0000 7f1658ff9640 1 -- 10.20.193.93:0/1665517309 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f165c0aedf0 con 0x7f165c0b0d60 2026-02-22T23:26:53.014 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.005+0000 7f1658ff9640 1 -- 10.20.193.93:0/1665517309 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4278721931 0 0) 0x7f165c071fa0 con 0x7f165c147940 2026-02-22T23:26:53.014 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.005+0000 7f1658ff9640 1 -- 10.20.193.93:0/1665517309 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f162c003620 con 0x7f165c147940 2026-02-22T23:26:53.015 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.005+0000 7f1658ff9640 1 -- 10.20.193.93:0/1665517309 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f16480030b0 con 0x7f165c0b0d60 2026-02-22T23:26:53.015 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.005+0000 7f1658ff9640 1 -- 10.20.193.93:0/1665517309 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f1650003790 con 0x7f165c147940 2026-02-22T23:26:53.015 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.005+0000 7f1658ff9640 1 -- 10.20.193.93:0/1665517309 <== mon.2 v1:10.20.193.93:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 412334718 0 0) 0x7f165c0aedf0 con 0x7f165c0b0d60 2026-02-22T23:26:53.015 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.005+0000 7f1658ff9640 1 -- 10.20.193.93:0/1665517309 >> v1:10.20.193.155:6789/0 conn(0x7f165c0b1140 legacy=0x7f165c1db360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:53.015 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.005+0000 7f1658ff9640 1 -- 10.20.193.93:0/1665517309 >> v1:10.20.193.93:6789/0 conn(0x7f165c147940 legacy=0x7f165c137580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:53.015 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.005+0000 7f1658ff9640 1 -- 10.20.193.93:0/1665517309 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f165c1391f0 con 0x7f165c0b0d60 2026-02-22T23:26:53.015 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.005+0000 7f16628ea640 1 -- 10.20.193.93:0/1665517309 --> v1:10.20.193.93:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f165c139500 con 0x7f165c0b0d60 2026-02-22T23:26:53.015 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.005+0000 7f16628ea640 1 -- 10.20.193.93:0/1665517309 --> v1:10.20.193.93:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f165c1dbc50 con 0x7f165c0b0d60 2026-02-22T23:26:53.016 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.005+0000 7f1658ff9640 1 -- 10.20.193.93:0/1665517309 <== mon.2 v1:10.20.193.93:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f16480048e0 con 0x7f165c0b0d60 2026-02-22T23:26:53.016 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.005+0000 7f1658ff9640 1 -- 10.20.193.93:0/1665517309 <== mon.2 v1:10.20.193.93:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f1648004bd0 con 0x7f165c0b0d60 2026-02-22T23:26:53.016 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.005+0000 7f16628ea640 1 -- 10.20.193.93:0/1665517309 --> v1:10.20.193.93:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f165c144730 con 0x7f165c0b0d60 2026-02-22T23:26:53.016 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.006+0000 7f1658ff9640 1 -- 10.20.193.93:0/1665517309 <== mon.2 v1:10.20.193.93:6790/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7f1648004d70 con 0x7f165c0b0d60 2026-02-22T23:26:53.016 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.006+0000 7f1658ff9640 1 -- 10.20.193.93:0/1665517309 <== mon.2 v1:10.20.193.93:6790/0 8 ==== osd_map(25..25 src has 1..25) ==== 4521+0+0 (unknown 3458299925 0 0) 0x7f1648094440 con 0x7f165c0b0d60 2026-02-22T23:26:53.017 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.008+0000 7f1658ff9640 1 -- 10.20.193.93:0/1665517309 <== mon.2 v1:10.20.193.93:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f165c144730 con 0x7f165c0b0d60 2026-02-22T23:26:53.093 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.091+0000 7f16628ea640 1 -- 10.20.193.93:0/1665517309 --> v1:10.20.193.155:6800/3108481844 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f165c13be60 con 0x7f162c078060 2026-02-22T23:26:53.094 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.091+0000 7f1658ff9640 1 -- 10.20.193.93:0/1665517309 <== mgr.4108 v1:10.20.193.155:6800/3108481844 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (unknown 1239724482 0 0) 0x7f165c13be60 con 0x7f162c078060 2026-02-22T23:26:53.094 INFO:teuthology.orchestra.run.trial093.stderr:instructed osd(s) 7 to deep-scrub 2026-02-22T23:26:53.095 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.092+0000 7f16628ea640 1 -- 10.20.193.93:0/1665517309 >> v1:10.20.193.155:6800/3108481844 conn(0x7f162c078060 legacy=0x7f162c07a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:53.095 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.092+0000 7f16628ea640 1 -- 10.20.193.93:0/1665517309 >> v1:10.20.193.93:6790/0 conn(0x7f165c0b0d60 legacy=0x7f165c139db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:53.095 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.092+0000 7f16628ea640 1 -- 10.20.193.93:0/1665517309 shutdown_connections 2026-02-22T23:26:53.095 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.092+0000 7f16628ea640 1 -- 10.20.193.93:0/1665517309 >> 10.20.193.93:0/1665517309 conn(0x7f165c06d480 msgr2=0x7f165c143860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:53.096 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.092+0000 7f16628ea640 1 -- 10.20.193.93:0/1665517309 shutdown_connections 2026-02-22T23:26:53.096 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.092+0000 7f16628ea640 1 -- 10.20.193.93:0/1665517309 wait complete. 2026-02-22T23:26:53.104 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T23:26:53.173 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.171+0000 7f2e4e34d640 1 Processor -- start 2026-02-22T23:26:53.173 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.171+0000 7f2e4e34d640 1 -- start start 2026-02-22T23:26:53.174 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.171+0000 7f2e4e34d640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e481424b0 con 0x7f2e48070f50 2026-02-22T23:26:53.174 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.171+0000 7f2e4e34d640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e48074d00 con 0x7f2e480aaf30 2026-02-22T23:26:53.174 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.171+0000 7f2e4e34d640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e48071380 con 0x7f2e480aab50 2026-02-22T23:26:53.174 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.171+0000 7f2e47fff640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7f2e480aab50 0x7f2e48141da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:53776/0 (socket says 10.20.193.93:53776) 2026-02-22T23:26:53.174 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.171+0000 7f2e47fff640 1 -- 10.20.193.93:0/2822011296 learned_addr learned my addr 10.20.193.93:0/2822011296 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:26:53.174 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.171+0000 7f2e46ffd640 1 -- 10.20.193.93:0/2822011296 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1148221488 0 0) 0x7f2e48071380 con 0x7f2e480aab50 2026-02-22T23:26:53.174 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.171+0000 7f2e46ffd640 1 -- 10.20.193.93:0/2822011296 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e2c003620 con 0x7f2e480aab50 2026-02-22T23:26:53.174 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.171+0000 7f2e46ffd640 1 -- 10.20.193.93:0/2822011296 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1334031336 0 0) 0x7f2e481424b0 con 0x7f2e48070f50 2026-02-22T23:26:53.174 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.171+0000 7f2e46ffd640 1 -- 10.20.193.93:0/2822011296 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e48071380 con 0x7f2e48070f50 2026-02-22T23:26:53.174 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.171+0000 7f2e46ffd640 1 -- 10.20.193.93:0/2822011296 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2676430940 0 0) 0x7f2e48071380 con 0x7f2e48070f50 2026-02-22T23:26:53.174 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.171+0000 7f2e46ffd640 1 -- 10.20.193.93:0/2822011296 >> v1:10.20.193.93:6790/0 conn(0x7f2e480aab50 legacy=0x7f2e48141da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:53.175 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.171+0000 7f2e46ffd640 1 -- 10.20.193.93:0/2822011296 >> v1:10.20.193.155:6789/0 conn(0x7f2e480aaf30 legacy=0x7f2e48140bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:53.175 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.171+0000 7f2e46ffd640 1 -- 10.20.193.93:0/2822011296 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e48142780 con 0x7f2e48070f50 2026-02-22T23:26:53.175 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.171+0000 7f2e46ffd640 1 -- 10.20.193.93:0/2822011296 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f2e3c003200 con 0x7f2e48070f50 2026-02-22T23:26:53.175 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.171+0000 7f2e46ffd640 1 -- 10.20.193.93:0/2822011296 <== mon.0 v1:10.20.193.93:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2e3c0033a0 con 0x7f2e48070f50 2026-02-22T23:26:53.175 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.172+0000 7f2e46ffd640 1 -- 10.20.193.93:0/2822011296 <== mon.0 v1:10.20.193.93:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f2e3c003830 con 0x7f2e48070f50 2026-02-22T23:26:53.175 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.172+0000 7f2e4e34d640 1 -- 10.20.193.93:0/2822011296 >> v1:10.20.193.93:6789/0 conn(0x7f2e48070f50 legacy=0x7f2e4814d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:53.175 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.172+0000 7f2e4e34d640 1 -- 10.20.193.93:0/2822011296 shutdown_connections 2026-02-22T23:26:53.175 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.172+0000 7f2e4e34d640 1 -- 10.20.193.93:0/2822011296 >> 10.20.193.93:0/2822011296 conn(0x7f2e480b20c0 msgr2=0x7f2e480b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:53.175 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.172+0000 7f2e4e34d640 1 -- 10.20.193.93:0/2822011296 shutdown_connections 2026-02-22T23:26:53.175 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.172+0000 7f2e4e34d640 1 -- 10.20.193.93:0/2822011296 wait complete. 2026-02-22T23:26:53.175 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.172+0000 7f2e4e34d640 1 Processor -- start 2026-02-22T23:26:53.175 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.172+0000 7f2e4e34d640 1 -- start start 2026-02-22T23:26:53.176 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.173+0000 7f2e4e34d640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e481455c0 con 0x7f2e480aaf30 2026-02-22T23:26:53.176 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.173+0000 7f2e4e34d640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e48145a50 con 0x7f2e480aab50 2026-02-22T23:26:53.176 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.173+0000 7f2e4e34d640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e48143a60 con 0x7f2e48070f50 2026-02-22T23:26:53.176 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.173+0000 7f2e47fff640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7f2e48070f50 0x7f2e481ddfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:53782/0 (socket says 10.20.193.93:53782) 2026-02-22T23:26:53.176 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.173+0000 7f2e4c8c3640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7f2e480aaf30 0x7f2e481e6360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:37136/0 (socket says 10.20.193.93:37136) 2026-02-22T23:26:53.176 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.173+0000 7f2e47fff640 1 -- 10.20.193.93:0/2760133496 learned_addr learned my addr 10.20.193.93:0/2760133496 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:26:53.176 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.173+0000 7f2e44ff9640 1 -- 10.20.193.93:0/2760133496 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4111986444 0 0) 0x7f2e481455c0 con 0x7f2e480aaf30 2026-02-22T23:26:53.177 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.173+0000 7f2e44ff9640 1 -- 10.20.193.93:0/2760133496 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e18003620 con 0x7f2e480aaf30 2026-02-22T23:26:53.177 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.173+0000 7f2e44ff9640 1 -- 10.20.193.93:0/2760133496 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2434089772 0 0) 0x7f2e48143a60 con 0x7f2e48070f50 2026-02-22T23:26:53.177 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.173+0000 7f2e44ff9640 1 -- 10.20.193.93:0/2760133496 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e481455c0 con 0x7f2e48070f50 2026-02-22T23:26:53.177 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.173+0000 7f2e44ff9640 1 -- 10.20.193.93:0/2760133496 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3744961054 0 0) 0x7f2e18003620 con 0x7f2e480aaf30 2026-02-22T23:26:53.177 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.173+0000 7f2e44ff9640 1 -- 10.20.193.93:0/2760133496 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2e48143a60 con 0x7f2e480aaf30 2026-02-22T23:26:53.177 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.173+0000 7f2e44ff9640 1 -- 10.20.193.93:0/2760133496 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f2e3c0036f0 con 0x7f2e480aaf30 2026-02-22T23:26:53.177 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.173+0000 7f2e44ff9640 1 -- 10.20.193.93:0/2760133496 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1318703370 0 0) 0x7f2e481455c0 con 0x7f2e48070f50 2026-02-22T23:26:53.177 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.173+0000 7f2e44ff9640 1 -- 10.20.193.93:0/2760133496 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2e18003620 con 0x7f2e48070f50 2026-02-22T23:26:53.177 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.173+0000 7f2e44ff9640 1 -- 10.20.193.93:0/2760133496 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2029720492 0 0) 0x7f2e48145a50 con 0x7f2e480aab50 2026-02-22T23:26:53.177 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.173+0000 7f2e44ff9640 1 -- 10.20.193.93:0/2760133496 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e481455c0 con 0x7f2e480aab50 2026-02-22T23:26:53.177 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.173+0000 7f2e44ff9640 1 -- 10.20.193.93:0/2760133496 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f2e34002ba0 con 0x7f2e48070f50 2026-02-22T23:26:53.177 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.173+0000 7f2e44ff9640 1 -- 10.20.193.93:0/2760133496 <== mon.0 v1:10.20.193.93:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 231535416 0 0) 0x7f2e48143a60 con 0x7f2e480aaf30 2026-02-22T23:26:53.177 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.173+0000 7f2e44ff9640 1 -- 10.20.193.93:0/2760133496 >> v1:10.20.193.93:6790/0 conn(0x7f2e48070f50 legacy=0x7f2e481ddfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:53.177 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.173+0000 7f2e44ff9640 1 -- 10.20.193.93:0/2760133496 >> v1:10.20.193.155:6789/0 conn(0x7f2e480aab50 legacy=0x7f2e48137690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:53.177 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.173+0000 7f2e44ff9640 1 -- 10.20.193.93:0/2760133496 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e481430b0 con 0x7f2e480aaf30 2026-02-22T23:26:53.177 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.173+0000 7f2e4e34d640 1 -- 10.20.193.93:0/2760133496 --> v1:10.20.193.93:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2e480b1660 con 0x7f2e480aaf30 2026-02-22T23:26:53.177 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.173+0000 7f2e4e34d640 1 -- 10.20.193.93:0/2760133496 --> v1:10.20.193.93:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2e481de8d0 con 0x7f2e480aaf30 2026-02-22T23:26:53.177 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.173+0000 7f2e44ff9640 1 -- 10.20.193.93:0/2760133496 <== mon.0 v1:10.20.193.93:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2e3c003e20 con 0x7f2e480aaf30 2026-02-22T23:26:53.177 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.173+0000 7f2e44ff9640 1 -- 10.20.193.93:0/2760133496 <== mon.0 v1:10.20.193.93:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f2e3c0042b0 con 0x7f2e480aaf30 2026-02-22T23:26:53.177 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.175+0000 7f2e4e34d640 1 -- 10.20.193.93:0/2760133496 --> v1:10.20.193.93:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e48143c30 con 0x7f2e480aaf30 2026-02-22T23:26:53.177 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.175+0000 7f2e44ff9640 1 -- 10.20.193.93:0/2760133496 <== mon.0 v1:10.20.193.93:6789/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7f2e3c004450 con 0x7f2e480aaf30 2026-02-22T23:26:53.178 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.175+0000 7f2e44ff9640 1 -- 10.20.193.93:0/2760133496 <== mon.0 v1:10.20.193.93:6789/0 8 ==== osd_map(25..25 src has 1..25) ==== 4521+0+0 (unknown 3458299925 0 0) 0x7f2e3c0945d0 con 0x7f2e480aaf30 2026-02-22T23:26:53.179 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.176+0000 7f2e44ff9640 1 -- 10.20.193.93:0/2760133496 <== mon.0 v1:10.20.193.93:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f2e3c05dcb0 con 0x7f2e480aaf30 2026-02-22T23:26:53.261 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.258+0000 7f2e4e34d640 1 -- 10.20.193.93:0/2760133496 --> v1:10.20.193.155:6800/3108481844 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2e48071eb0 con 0x7f2e180781c0 2026-02-22T23:26:53.263 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.260+0000 7f2e44ff9640 1 -- 10.20.193.93:0/2760133496 <== mgr.4108 v1:10.20.193.155:6800/3108481844 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+116629 (unknown 2965378022 0 2200284488) 0x7f2e48071eb0 con 0x7f2e180781c0 2026-02-22T23:26:53.264 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:26:53.265 INFO:teuthology.orchestra.run.trial093.stderr:dumped all 2026-02-22T23:26:53.266 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.261+0000 7f2e4e34d640 1 -- 10.20.193.93:0/2760133496 >> v1:10.20.193.155:6800/3108481844 conn(0x7f2e180781c0 legacy=0x7f2e1807a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:53.266 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.261+0000 7f2e4e34d640 1 -- 10.20.193.93:0/2760133496 >> v1:10.20.193.93:6789/0 conn(0x7f2e480aaf30 legacy=0x7f2e481e6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:26:53.266 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.261+0000 7f2e4e34d640 1 -- 10.20.193.93:0/2760133496 shutdown_connections 2026-02-22T23:26:53.266 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.261+0000 7f2e4e34d640 1 -- 10.20.193.93:0/2760133496 >> 10.20.193.93:0/2760133496 conn(0x7f2e480b20c0 msgr2=0x7f2e480707c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:26:53.266 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.261+0000 7f2e4e34d640 1 -- 10.20.193.93:0/2760133496 shutdown_connections 2026-02-22T23:26:53.266 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:26:53.261+0000 7f2e4e34d640 1 -- 10.20.193.93:0/2760133496 wait complete. 2026-02-22T23:26:53.274 INFO:teuthology.orchestra.run.trial093.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2026-02-22T23:26:53.077387+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3699561259,"num_objects":912,"num_object_clones":0,"num_object_copies":1824,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":912,"num_whiteouts":0,"num_read":2655,"num_read_kb":2658,"num_write":211104,"num_write_kb":5844199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":209928,"ondisk_log_size":209928,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":9057964,"kb_used_data":6936784,"kb_used_omap":12,"kb_used_meta":2121011,"kb_avail":745916756,"statfs":{"total":773094113280,"available":763818758144,"internally_reserved":0,"allocated":7103266816,"data_stored":7097745406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":2171915832},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8720,"num_objects":-1,"num_object_clones":0,"num_object_copies":-2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":0,"num_read":66,"num_read_kb":71,"num_write":17,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.000950"},"pg_stats":[{"pgid":"3.1f","version":"24'5669","reported_seq":5698,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:48.826567+0000","last_change":"2026-02-22T23:24:05.678004+0000","last_active":"2026-02-22T23:26:48.826567+0000","last_peered":"2026-02-22T23:26:48.826567+0000","last_clean":"2026-02-22T23:26:48.826567+0000","last_became_active":"2026-02-22T23:24:05.677831+0000","last_became_peered":"2026-02-22T23:24:05.677831+0000","last_unstale":"2026-02-22T23:26:48.826567+0000","last_undegraded":"2026-02-22T23:26:48.826567+0000","last_fullsized":"2026-02-22T23:26:48.826567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":5669,"log_dups_size":0,"ondisk_log_size":5669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":42,"num_read_kb":34,"num_write":5679,"num_write_kb":173190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"25'6645","reported_seq":6665,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:48.828913+0000","last_change":"2026-02-22T23:24:05.677818+0000","last_active":"2026-02-22T23:26:48.828913+0000","last_peered":"2026-02-22T23:26:48.828913+0000","last_clean":"2026-02-22T23:26:48.828913+0000","last_became_active":"2026-02-22T23:24:05.677553+0000","last_became_peered":"2026-02-22T23:24:05.677553+0000","last_unstale":"2026-02-22T23:26:48.828913+0000","last_undegraded":"2026-02-22T23:26:48.828913+0000","last_fullsized":"2026-02-22T23:26:48.828913+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":6645,"log_dups_size":0,"ondisk_log_size":6645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123726176,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":6626,"num_write_kb":171222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"25'10597","reported_seq":10615,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:48.853819+0000","last_change":"2026-02-22T23:24:05.699174+0000","last_active":"2026-02-22T23:26:48.853819+0000","last_peered":"2026-02-22T23:26:48.853819+0000","last_clean":"2026-02-22T23:26:48.853819+0000","last_became_active":"2026-02-22T23:24:05.698937+0000","last_became_peered":"2026-02-22T23:24:05.698937+0000","last_unstale":"2026-02-22T23:26:48.853819+0000","last_undegraded":"2026-02-22T23:26:48.853819+0000","last_fullsized":"2026-02-22T23:26:48.853819+0000","mapping_epoch":21,"log_start":"23'500","ondisk_log_start":"23'500","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":10097,"log_dups_size":0,"ondisk_log_size":10097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10572,"num_write_kb":197375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"23'4680","reported_seq":4699,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:48.846407+0000","last_change":"2026-02-22T23:24:05.699429+0000","last_active":"2026-02-22T23:26:48.846407+0000","last_peered":"2026-02-22T23:26:48.846407+0000","last_clean":"2026-02-22T23:26:48.846407+0000","last_became_active":"2026-02-22T23:24:05.699243+0000","last_became_peered":"2026-02-22T23:24:05.699243+0000","last_unstale":"2026-02-22T23:26:48.846407+0000","last_undegraded":"2026-02-22T23:26:48.846407+0000","last_fullsized":"2026-02-22T23:26:48.846407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":4680,"log_dups_size":0,"ondisk_log_size":4680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134218240,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":4685,"num_write_kb":192906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"25'6875","reported_seq":6909,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:48.832748+0000","last_change":"2026-02-22T23:24:05.676230+0000","last_active":"2026-02-22T23:26:48.832748+0000","last_peered":"2026-02-22T23:26:48.832748+0000","last_clean":"2026-02-22T23:26:48.832748+0000","last_became_active":"2026-02-22T23:24:05.675974+0000","last_became_peered":"2026-02-22T23:24:05.675974+0000","last_unstale":"2026-02-22T23:26:48.832748+0000","last_undegraded":"2026-02-22T23:26:48.832748+0000","last_fullsized":"2026-02-22T23:26:48.832748+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":6875,"log_dups_size":0,"ondisk_log_size":6875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113508352,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":67,"num_read_kb":50,"num_write":6857,"num_write_kb":185605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"25'6854","reported_seq":6881,"reported_epoch":25,"state":"active+clean+scrubbing+deep","last_fresh":"2026-02-22T23:26:52.901281+0000","last_change":"2026-02-22T23:26:52.829959+0000","last_active":"2026-02-22T23:26:52.901281+0000","last_peered":"2026-02-22T23:26:52.901281+0000","last_clean":"2026-02-22T23:26:52.901281+0000","last_became_active":"2026-02-22T23:24:05.697565+0000","last_became_peered":"2026-02-22T23:24:05.697565+0000","last_unstale":"2026-02-22T23:26:52.901281+0000","last_undegraded":"2026-02-22T23:26:52.901281+0000","last_fullsized":"2026-02-22T23:26:52.901281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":14,"log_size":6854,"log_dups_size":0,"ondisk_log_size":6854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92406800,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":18,"num_read_kb":13,"num_write":6841,"num_write_kb":183644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"25'6368","reported_seq":6391,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:48.831500+0000","last_change":"2026-02-22T23:24:05.676826+0000","last_active":"2026-02-22T23:26:48.831500+0000","last_peered":"2026-02-22T23:26:48.831500+0000","last_clean":"2026-02-22T23:26:48.831500+0000","last_became_active":"2026-02-22T23:24:05.676667+0000","last_became_peered":"2026-02-22T23:24:05.676667+0000","last_unstale":"2026-02-22T23:26:48.831500+0000","last_undegraded":"2026-02-22T23:26:48.831500+0000","last_fullsized":"2026-02-22T23:26:48.831500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":6368,"log_dups_size":0,"ondisk_log_size":6368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:06:15.433587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134218240,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":6334,"num_write_kb":211582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"24'8354","reported_seq":8372,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:48.807302+0000","last_change":"2026-02-22T23:24:05.676885+0000","last_active":"2026-02-22T23:26:48.807302+0000","last_peered":"2026-02-22T23:26:48.807302+0000","last_clean":"2026-02-22T23:26:48.807302+0000","last_became_active":"2026-02-22T23:24:05.676778+0000","last_became_peered":"2026-02-22T23:24:05.676778+0000","last_unstale":"2026-02-22T23:26:48.807302+0000","last_undegraded":"2026-02-22T23:26:48.807302+0000","last_fullsized":"2026-02-22T23:26:48.807302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":8354,"log_dups_size":0,"ondisk_log_size":8354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111804416,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8352,"num_write_kb":153987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"24'10337","reported_seq":10355,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:48.826588+0000","last_change":"2026-02-22T23:24:05.678349+0000","last_active":"2026-02-22T23:26:48.826588+0000","last_peered":"2026-02-22T23:26:48.826588+0000","last_clean":"2026-02-22T23:26:48.826588+0000","last_became_active":"2026-02-22T23:24:05.678254+0000","last_became_peered":"2026-02-22T23:24:05.678254+0000","last_unstale":"2026-02-22T23:26:48.826588+0000","last_undegraded":"2026-02-22T23:26:48.826588+0000","last_fullsized":"2026-02-22T23:26:48.826588+0000","mapping_epoch":21,"log_start":"23'300","ondisk_log_start":"23'300","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":10037,"log_dups_size":0,"ondisk_log_size":10037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10330,"num_write_kb":231303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"25'5813","reported_seq":5850,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:48.850305+0000","last_change":"2026-02-22T23:24:05.699492+0000","last_active":"2026-02-22T23:26:48.850305+0000","last_peered":"2026-02-22T23:26:48.850305+0000","last_clean":"2026-02-22T23:26:48.850305+0000","last_became_active":"2026-02-22T23:24:05.698976+0000","last_became_peered":"2026-02-22T23:24:05.698976+0000","last_unstale":"2026-02-22T23:26:48.850305+0000","last_undegraded":"2026-02-22T23:26:48.850305+0000","last_fullsized":"2026-02-22T23:26:48.850305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":5813,"log_dups_size":0,"ondisk_log_size":5813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142475792,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":73,"num_read_kb":117,"num_write":5831,"num_write_kb":192524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"24'10713","reported_seq":10746,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:48.833971+0000","last_change":"2026-02-22T23:24:05.698881+0000","last_active":"2026-02-22T23:26:48.833971+0000","last_peered":"2026-02-22T23:26:48.833971+0000","last_clean":"2026-02-22T23:26:48.833971+0000","last_became_active":"2026-02-22T23:24:05.698465+0000","last_became_peered":"2026-02-22T23:24:05.698465+0000","last_unstale":"2026-02-22T23:26:48.833971+0000","last_undegraded":"2026-02-22T23:26:48.833971+0000","last_fullsized":"2026-02-22T23:26:48.833971+0000","mapping_epoch":21,"log_start":"23'700","ondisk_log_start":"23'700","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":10013,"log_dups_size":0,"ondisk_log_size":10013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:26:04.313983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132097872,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":68,"num_read_kb":57,"num_write":10731,"num_write_kb":177027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"25'9610","reported_seq":9628,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:48.853400+0000","last_change":"2026-02-22T23:24:05.699000+0000","last_active":"2026-02-22T23:26:48.853400+0000","last_peered":"2026-02-22T23:26:48.853400+0000","last_clean":"2026-02-22T23:26:48.853400+0000","last_became_active":"2026-02-22T23:24:05.698446+0000","last_became_peered":"2026-02-22T23:24:05.698446+0000","last_unstale":"2026-02-22T23:26:48.853400+0000","last_undegraded":"2026-02-22T23:26:48.853400+0000","last_fullsized":"2026-02-22T23:26:48.853400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":9610,"log_dups_size":0,"ondisk_log_size":9610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184549376,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9557,"num_write_kb":251658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:48.846228+0000","last_change":"2026-02-22T23:24:00.993186+0000","last_active":"2026-02-22T23:26:48.846228+0000","last_peered":"2026-02-22T23:26:48.846228+0000","last_clean":"2026-02-22T23:26:48.846228+0000","last_became_active":"2026-02-22T23:23:58.958814+0000","last_became_peered":"2026-02-22T23:23:58.958814+0000","last_unstale":"2026-02-22T23:26:48.846228+0000","last_undegraded":"2026-02-22T23:26:48.846228+0000","last_fullsized":"2026-02-22T23:26:48.846228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_clean_scrub_stamp":"2026-02-22T23:23:57.931636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00022938900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"25'11034","reported_seq":11084,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:48.832440+0000","last_change":"2026-02-22T23:24:05.676485+0000","last_active":"2026-02-22T23:26:48.832440+0000","last_peered":"2026-02-22T23:26:48.832440+0000","last_clean":"2026-02-22T23:26:48.832440+0000","last_became_active":"2026-02-22T23:24:05.676228+0000","last_became_peered":"2026-02-22T23:24:05.676228+0000","last_unstale":"2026-02-22T23:26:48.832440+0000","last_undegraded":"2026-02-22T23:26:48.832440+0000","last_fullsized":"2026-02-22T23:26:48.832440+0000","mapping_epoch":21,"log_start":"23'1000","ondisk_log_start":"23'1000","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":10034,"log_dups_size":0,"ondisk_log_size":10034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137103184,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":120,"num_read_kb":161,"num_write":11063,"num_write_kb":200793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:48.826104+0000","last_change":"2026-02-22T23:24:00.946318+0000","last_active":"2026-02-22T23:26:48.826104+0000","last_peered":"2026-02-22T23:26:48.826104+0000","last_clean":"2026-02-22T23:26:48.826104+0000","last_became_active":"2026-02-22T23:23:58.938089+0000","last_became_peered":"2026-02-22T23:23:58.938089+0000","last_unstale":"2026-02-22T23:26:48.826104+0000","last_undegraded":"2026-02-22T23:26:48.826104+0000","last_fullsized":"2026-02-22T23:26:48.826104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_clean_scrub_stamp":"2026-02-22T23:23:57.931636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:57:44.956161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056227399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'3990","reported_seq":4027,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:48.829307+0000","last_change":"2026-02-22T23:24:05.678549+0000","last_active":"2026-02-22T23:26:48.829307+0000","last_peered":"2026-02-22T23:26:48.829307+0000","last_clean":"2026-02-22T23:26:48.829307+0000","last_became_active":"2026-02-22T23:24:05.678384+0000","last_became_peered":"2026-02-22T23:24:05.678384+0000","last_unstale":"2026-02-22T23:26:48.829307+0000","last_undegraded":"2026-02-22T23:26:48.829307+0000","last_fullsized":"2026-02-22T23:26:48.829307+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":3990,"log_dups_size":0,"ondisk_log_size":3990,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92275200,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":3968,"num_write_kb":148167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:48.834248+0000","last_change":"2026-02-22T23:24:01.168991+0000","last_active":"2026-02-22T23:26:48.834248+0000","last_peered":"2026-02-22T23:26:48.834248+0000","last_clean":"2026-02-22T23:26:48.834248+0000","last_became_active":"2026-02-22T23:23:59.257807+0000","last_became_peered":"2026-02-22T23:23:59.257807+0000","last_unstale":"2026-02-22T23:26:48.834248+0000","last_undegraded":"2026-02-22T23:26:48.834248+0000","last_fullsized":"2026-02-22T23:26:48.834248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_clean_scrub_stamp":"2026-02-22T23:23:57.931636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:41:56.557451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000177021,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"24'7551","reported_seq":7671,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:48.826055+0000","last_change":"2026-02-22T23:24:05.721996+0000","last_active":"2026-02-22T23:26:48.826055+0000","last_peered":"2026-02-22T23:26:48.826055+0000","last_clean":"2026-02-22T23:26:48.826055+0000","last_became_active":"2026-02-22T23:24:05.721799+0000","last_became_peered":"2026-02-22T23:24:05.721799+0000","last_unstale":"2026-02-22T23:26:48.826055+0000","last_undegraded":"2026-02-22T23:26:48.826055+0000","last_fullsized":"2026-02-22T23:26:48.826055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":7551,"log_dups_size":0,"ondisk_log_size":7551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:40.662718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121775136,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":109,"num_read_kb":107,"num_write":7564,"num_write_kb":181611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:48.826124+0000","last_change":"2026-02-22T23:24:00.946170+0000","last_active":"2026-02-22T23:26:48.826124+0000","last_peered":"2026-02-22T23:26:48.826124+0000","last_clean":"2026-02-22T23:26:48.826124+0000","last_became_active":"2026-02-22T23:23:59.237046+0000","last_became_peered":"2026-02-22T23:23:59.237046+0000","last_unstale":"2026-02-22T23:26:48.826124+0000","last_undegraded":"2026-02-22T23:26:48.826124+0000","last_fullsized":"2026-02-22T23:26:48.826124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_clean_scrub_stamp":"2026-02-22T23:23:57.931636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:24:35.277604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000445938,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"24'7209","reported_seq":7227,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:48.847721+0000","last_change":"2026-02-22T23:24:05.698370+0000","last_active":"2026-02-22T23:26:48.847721+0000","last_peered":"2026-02-22T23:26:48.847721+0000","last_clean":"2026-02-22T23:26:48.847721+0000","last_became_active":"2026-02-22T23:24:05.698126+0000","last_became_peered":"2026-02-22T23:24:05.698126+0000","last_unstale":"2026-02-22T23:26:48.847721+0000","last_undegraded":"2026-02-22T23:26:48.847721+0000","last_fullsized":"2026-02-22T23:26:48.847721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":7209,"log_dups_size":0,"ondisk_log_size":7209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145358848,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7203,"num_write_kb":211206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"24'7464","reported_seq":7482,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:48.827502+0000","last_change":"2026-02-22T23:24:05.699144+0000","last_active":"2026-02-22T23:26:48.827502+0000","last_peered":"2026-02-22T23:26:48.827502+0000","last_clean":"2026-02-22T23:26:48.827502+0000","last_became_active":"2026-02-22T23:24:05.698528+0000","last_became_peered":"2026-02-22T23:24:05.698528+0000","last_unstale":"2026-02-22T23:26:48.827502+0000","last_undegraded":"2026-02-22T23:26:48.827502+0000","last_fullsized":"2026-02-22T23:26:48.827502+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":7464,"log_dups_size":0,"ondisk_log_size":7464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86704128,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7460,"num_write_kb":164306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:48.846403+0000","last_change":"2026-02-22T23:24:00.965007+0000","last_active":"2026-02-22T23:26:48.846403+0000","last_peered":"2026-02-22T23:26:48.846403+0000","last_clean":"2026-02-22T23:26:48.846403+0000","last_became_active":"2026-02-22T23:23:58.958840+0000","last_became_peered":"2026-02-22T23:23:58.958840+0000","last_unstale":"2026-02-22T23:26:48.846403+0000","last_undegraded":"2026-02-22T23:26:48.846403+0000","last_fullsized":"2026-02-22T23:26:48.846403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_clean_scrub_stamp":"2026-02-22T23:23:57.931636+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00022545200000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"25'5356","reported_seq":5373,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:48.830771+0000","last_change":"2026-02-22T23:24:05.721947+0000","last_active":"2026-02-22T23:26:48.830771+0000","last_peered":"2026-02-22T23:26:48.830771+0000","last_clean":"2026-02-22T23:26:48.830771+0000","last_became_active":"2026-02-22T23:24:05.721787+0000","last_became_peered":"2026-02-22T23:24:05.721787+0000","last_unstale":"2026-02-22T23:26:48.830771+0000","last_undegraded":"2026-02-22T23:26:48.830771+0000","last_fullsized":"2026-02-22T23:26:48.830771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":5356,"log_dups_size":0,"ondisk_log_size":5356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:33:38.835812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5307,"num_write_kb":179763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":39,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:52.214534+0000","last_change":"2026-02-22T23:26:52.214549+0000","last_active":"2026-02-22T23:26:52.214534+0000","last_peered":"2026-02-22T23:26:52.214534+0000","last_clean":"2026-02-22T23:26:52.214534+0000","last_became_active":"2026-02-22T23:23:59.236692+0000","last_became_peered":"2026-02-22T23:23:59.236692+0000","last_unstale":"2026-02-22T23:26:52.214534+0000","last_undegraded":"2026-02-22T23:26:52.214534+0000","last_fullsized":"2026-02-22T23:26:52.214534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:26:52.214490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:26:52.214490+0000","last_clean_scrub_stamp":"2026-02-22T23:26:52.214490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:30:10.017660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017529500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"25'2809","reported_seq":2836,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:52.239920+0000","last_change":"2026-02-22T23:26:52.239934+0000","last_active":"2026-02-22T23:26:52.239920+0000","last_peered":"2026-02-22T23:26:52.239920+0000","last_clean":"2026-02-22T23:26:52.239920+0000","last_became_active":"2026-02-22T23:24:05.675717+0000","last_became_peered":"2026-02-22T23:24:05.675717+0000","last_unstale":"2026-02-22T23:26:52.239920+0000","last_undegraded":"2026-02-22T23:26:52.239920+0000","last_fullsized":"2026-02-22T23:26:52.239920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2809","last_scrub_stamp":"2026-02-22T23:26:52.239896+0000","last_deep_scrub":"25'2809","last_deep_scrub_stamp":"2026-02-22T23:26:52.239896+0000","last_clean_scrub_stamp":"2026-02-22T23:26:52.239896+0000","objects_scrubbed":19,"log_size":2809,"log_dups_size":0,"ondisk_log_size":2809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:50:08.077484+0000","scrub_duration":90,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2762,"num_write_kb":135681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:48.833896+0000","last_change":"2026-02-22T23:24:01.168995+0000","last_active":"2026-02-22T23:26:48.833896+0000","last_peered":"2026-02-22T23:26:48.833896+0000","last_clean":"2026-02-22T23:26:48.833896+0000","last_became_active":"2026-02-22T23:23:58.958969+0000","last_became_peered":"2026-02-22T23:23:58.958969+0000","last_unstale":"2026-02-22T23:26:48.833896+0000","last_undegraded":"2026-02-22T23:26:48.833896+0000","last_fullsized":"2026-02-22T23:26:48.833896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_clean_scrub_stamp":"2026-02-22T23:23:57.931636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:55:46.818746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000181831,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"24'6352","reported_seq":6394,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:48.807352+0000","last_change":"2026-02-22T23:24:05.677858+0000","last_active":"2026-02-22T23:26:48.807352+0000","last_peered":"2026-02-22T23:26:48.807352+0000","last_clean":"2026-02-22T23:26:48.807352+0000","last_became_active":"2026-02-22T23:24:05.677638+0000","last_became_peered":"2026-02-22T23:24:05.677638+0000","last_unstale":"2026-02-22T23:26:48.807352+0000","last_undegraded":"2026-02-22T23:26:48.807352+0000","last_fullsized":"2026-02-22T23:26:48.807352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":6352,"log_dups_size":0,"ondisk_log_size":6352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120522936,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":72,"num_read_kb":119,"num_write":6510,"num_write_kb":147601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:48.846434+0000","last_change":"2026-02-22T23:24:00.965025+0000","last_active":"2026-02-22T23:26:48.846434+0000","last_peered":"2026-02-22T23:26:48.846434+0000","last_clean":"2026-02-22T23:26:48.846434+0000","last_became_active":"2026-02-22T23:23:58.958830+0000","last_became_peered":"2026-02-22T23:23:58.958830+0000","last_unstale":"2026-02-22T23:26:48.846434+0000","last_undegraded":"2026-02-22T23:26:48.846434+0000","last_fullsized":"2026-02-22T23:26:48.846434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:57.931636+0000","last_clean_scrub_stamp":"2026-02-22T23:23:57.931636+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000241392,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'112","reported_seq":167,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:48.833905+0000","last_change":"2026-02-22T23:23:53.549952+0000","last_active":"2026-02-22T23:26:48.833905+0000","last_peered":"2026-02-22T23:26:48.833905+0000","last_clean":"2026-02-22T23:26:48.833905+0000","last_became_active":"2026-02-22T23:23:53.549316+0000","last_became_peered":"2026-02-22T23:23:53.549316+0000","last_unstale":"2026-02-22T23:26:48.833905+0000","last_undegraded":"2026-02-22T23:26:48.833905+0000","last_fullsized":"2026-02-22T23:26:48.833905+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:23:51.885433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:23:51.885433+0000","last_clean_scrub_stamp":"2026-02-22T23:23:51.885433+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:22:13.854378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"25'2983","reported_seq":3010,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:52.715857+0000","last_change":"2026-02-22T23:26:52.715871+0000","last_active":"2026-02-22T23:26:52.715857+0000","last_peered":"2026-02-22T23:26:52.715857+0000","last_clean":"2026-02-22T23:26:52.715857+0000","last_became_active":"2026-02-22T23:24:05.676326+0000","last_became_peered":"2026-02-22T23:24:05.676326+0000","last_unstale":"2026-02-22T23:26:52.715857+0000","last_undegraded":"2026-02-22T23:26:52.715857+0000","last_fullsized":"2026-02-22T23:26:52.715857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2983","last_scrub_stamp":"2026-02-22T23:26:52.715822+0000","last_deep_scrub":"25'2983","last_deep_scrub_stamp":"2026-02-22T23:26:52.715822+0000","last_clean_scrub_stamp":"2026-02-22T23:26:52.715822+0000","objects_scrubbed":20,"log_size":2983,"log_dups_size":0,"ondisk_log_size":2983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:53:08.542601+0000","scrub_duration":104,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2892,"num_write_kb":127875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"25'12260","reported_seq":12418,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:48.866800+0000","last_change":"2026-02-22T23:24:05.742635+0000","last_active":"2026-02-22T23:26:48.866800+0000","last_peered":"2026-02-22T23:26:48.866800+0000","last_clean":"2026-02-22T23:26:48.866800+0000","last_became_active":"2026-02-22T23:24:05.742493+0000","last_became_peered":"2026-02-22T23:24:05.742493+0000","last_unstale":"2026-02-22T23:26:48.866800+0000","last_undegraded":"2026-02-22T23:26:48.866800+0000","last_fullsized":"2026-02-22T23:26:48.866800+0000","mapping_epoch":21,"log_start":"23'2200","ondisk_log_start":"23'2200","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":434,"num_read_kb":392,"num_write":8573,"num_write_kb":186899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"25'5952","reported_seq":6275,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:48.850200+0000","last_change":"2026-02-22T23:24:05.700011+0000","last_active":"2026-02-22T23:26:48.850200+0000","last_peered":"2026-02-22T23:26:48.850200+0000","last_clean":"2026-02-22T23:26:48.850200+0000","last_became_active":"2026-02-22T23:24:05.699884+0000","last_became_peered":"2026-02-22T23:24:05.699884+0000","last_unstale":"2026-02-22T23:26:48.850200+0000","last_undegraded":"2026-02-22T23:26:48.850200+0000","last_fullsized":"2026-02-22T23:26:48.850200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":5952,"log_dups_size":0,"ondisk_log_size":5952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125960192,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":1022,"num_read_kb":916,"num_write":6136,"num_write_kb":193925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"23'3861","reported_seq":3879,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:48.807363+0000","last_change":"2026-02-22T23:24:05.677159+0000","last_active":"2026-02-22T23:26:48.807363+0000","last_peered":"2026-02-22T23:26:48.807363+0000","last_clean":"2026-02-22T23:26:48.807363+0000","last_became_active":"2026-02-22T23:24:05.676965+0000","last_became_peered":"2026-02-22T23:24:05.676965+0000","last_unstale":"2026-02-22T23:26:48.807363+0000","last_undegraded":"2026-02-22T23:26:48.807363+0000","last_fullsized":"2026-02-22T23:26:48.807363+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":3861,"log_dups_size":0,"ondisk_log_size":3861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3859,"num_write_kb":148998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"25'5909","reported_seq":5927,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:48.851884+0000","last_change":"2026-02-22T23:24:05.698233+0000","last_active":"2026-02-22T23:26:48.851884+0000","last_peered":"2026-02-22T23:26:48.851884+0000","last_clean":"2026-02-22T23:26:48.851884+0000","last_became_active":"2026-02-22T23:24:05.698018+0000","last_became_peered":"2026-02-22T23:24:05.698018+0000","last_unstale":"2026-02-22T23:26:48.851884+0000","last_undegraded":"2026-02-22T23:26:48.851884+0000","last_fullsized":"2026-02-22T23:26:48.851884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":5909,"log_dups_size":0,"ondisk_log_size":5909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131465216,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5859,"num_write_kb":186691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"25'3921","reported_seq":3954,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:48.834032+0000","last_change":"2026-02-22T23:24:05.699599+0000","last_active":"2026-02-22T23:26:48.834032+0000","last_peered":"2026-02-22T23:26:48.834032+0000","last_clean":"2026-02-22T23:26:48.834032+0000","last_became_active":"2026-02-22T23:24:05.699221+0000","last_became_peered":"2026-02-22T23:24:05.699221+0000","last_unstale":"2026-02-22T23:26:48.834032+0000","last_undegraded":"2026-02-22T23:26:48.834032+0000","last_fullsized":"2026-02-22T23:26:48.834032+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":3921,"log_dups_size":0,"ondisk_log_size":3921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:55:25.272147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":50,"num_read_kb":41,"num_write":3928,"num_write_kb":197645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"25'7437","reported_seq":7555,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:48.855618+0000","last_change":"2026-02-22T23:24:05.700990+0000","last_active":"2026-02-22T23:26:48.855618+0000","last_peered":"2026-02-22T23:26:48.855618+0000","last_clean":"2026-02-22T23:26:48.855618+0000","last_became_active":"2026-02-22T23:24:05.700853+0000","last_became_peered":"2026-02-22T23:24:05.700853+0000","last_unstale":"2026-02-22T23:26:48.855618+0000","last_undegraded":"2026-02-22T23:26:48.855618+0000","last_fullsized":"2026-02-22T23:26:48.855618+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":7437,"log_dups_size":0,"ondisk_log_size":7437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:11:05.345071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":333,"num_read_kb":324,"num_write":7701,"num_write_kb":156562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"25'6492","reported_seq":6519,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:48.849280+0000","last_change":"2026-02-22T23:24:05.700618+0000","last_active":"2026-02-22T23:26:48.849280+0000","last_peered":"2026-02-22T23:26:48.849280+0000","last_clean":"2026-02-22T23:26:48.849280+0000","last_became_active":"2026-02-22T23:24:05.700510+0000","last_became_peered":"2026-02-22T23:24:05.700510+0000","last_unstale":"2026-02-22T23:26:48.849280+0000","last_undegraded":"2026-02-22T23:26:48.849280+0000","last_fullsized":"2026-02-22T23:26:48.849280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":6492,"log_dups_size":0,"ondisk_log_size":6492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:43:14.176802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96600064,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":42,"num_read_kb":32,"num_write":6466,"num_write_kb":214278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"25'6021","reported_seq":6039,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:48.851845+0000","last_change":"2026-02-22T23:24:05.698639+0000","last_active":"2026-02-22T23:26:48.851845+0000","last_peered":"2026-02-22T23:26:48.851845+0000","last_clean":"2026-02-22T23:26:48.851845+0000","last_became_active":"2026-02-22T23:24:05.698492+0000","last_became_peered":"2026-02-22T23:24:05.698492+0000","last_unstale":"2026-02-22T23:26:48.851845+0000","last_undegraded":"2026-02-22T23:26:48.851845+0000","last_fullsized":"2026-02-22T23:26:48.851845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":6021,"log_dups_size":0,"ondisk_log_size":6021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5970,"num_write_kb":185477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"23'4568","reported_seq":4585,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:48.833923+0000","last_change":"2026-02-22T23:24:05.699724+0000","last_active":"2026-02-22T23:26:48.833923+0000","last_peered":"2026-02-22T23:26:48.833923+0000","last_clean":"2026-02-22T23:26:48.833923+0000","last_became_active":"2026-02-22T23:24:05.699288+0000","last_became_peered":"2026-02-22T23:24:05.699288+0000","last_unstale":"2026-02-22T23:26:48.833923+0000","last_undegraded":"2026-02-22T23:26:48.833923+0000","last_fullsized":"2026-02-22T23:26:48.833923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":4568,"log_dups_size":0,"ondisk_log_size":4568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:02:21.223324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4562,"num_write_kb":202117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"25'4040","reported_seq":4061,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:48.830349+0000","last_change":"2026-02-22T23:24:05.677658+0000","last_active":"2026-02-22T23:26:48.830349+0000","last_peered":"2026-02-22T23:26:48.830349+0000","last_clean":"2026-02-22T23:26:48.830349+0000","last_became_active":"2026-02-22T23:24:05.677479+0000","last_became_peered":"2026-02-22T23:24:05.677479+0000","last_unstale":"2026-02-22T23:26:48.830349+0000","last_undegraded":"2026-02-22T23:26:48.830349+0000","last_fullsized":"2026-02-22T23:26:48.830349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":4040,"log_dups_size":0,"ondisk_log_size":4040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":3995,"num_write_kb":197509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"25'6789","reported_seq":6813,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:48.833978+0000","last_change":"2026-02-22T23:24:05.700217+0000","last_active":"2026-02-22T23:26:48.833978+0000","last_peered":"2026-02-22T23:26:48.833978+0000","last_clean":"2026-02-22T23:26:48.833978+0000","last_became_active":"2026-02-22T23:24:05.700038+0000","last_became_peered":"2026-02-22T23:24:05.700038+0000","last_unstale":"2026-02-22T23:26:48.833978+0000","last_undegraded":"2026-02-22T23:26:48.833978+0000","last_fullsized":"2026-02-22T23:26:48.833978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:24:05.150806+0000","last_clean_scrub_stamp":"2026-02-22T23:24:05.150806+0000","objects_scrubbed":0,"log_size":6789,"log_dups_size":0,"ondisk_log_size":6789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:29:59.558337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":18,"num_read_kb":140,"num_write":6784,"num_write_kb":152398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3698970872,"num_objects":908,"num_object_clones":0,"num_object_copies":1816,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":908,"num_whiteouts":0,"num_read":2569,"num_read_kb":2585,"num_write":210957,"num_write_kb":5841525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7100293120,"data_stored":7096026232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":209813,"ondisk_log_size":209813,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542182,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415096,"kb_used_data":333988,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":93956744,"statfs":{"total":96636764160,"available":96211705856,"internally_reserved":0,"allocated":342003712,"data_stored":341660012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":83032519},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542183,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1389140,"kb_used_data":1061056,"kb_used_omap":1,"kb_used_meta":328062,"kb_avail":92982700,"statfs":{"total":96636764160,"available":95214284800,"internally_reserved":0,"allocated":1086521344,"data_stored":1085682243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":335935942},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542182,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1810112,"kb_used_data":1364016,"kb_used_omap":1,"kb_used_meta":446078,"kb_avail":92561728,"statfs":{"total":96636764160,"available":94783209472,"internally_reserved":0,"allocated":1396752384,"data_stored":1395766036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":456784326},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542183,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1411460,"kb_used_data":1101360,"kb_used_omap":1,"kb_used_meta":310078,"kb_avail":92960380,"statfs":{"total":96636764160,"available":95191429120,"internally_reserved":0,"allocated":1127792640,"data_stored":1126962936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":317520328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542182,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":409344,"kb_used_data":311596,"kb_used_omap":1,"kb_used_meta":97726,"kb_avail":93962496,"statfs":{"total":96636764160,"available":96217595904,"internally_reserved":0,"allocated":319074304,"data_stored":318763328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":100071878},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542183,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1350664,"kb_used_data":1004532,"kb_used_omap":1,"kb_used_meta":346110,"kb_avail":93021176,"statfs":{"total":96636764160,"available":95253684224,"internally_reserved":0,"allocated":1028640768,"data_stored":1027803732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":354417094},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1451192,"kb_used_data":1123108,"kb_used_omap":1,"kb_used_meta":328062,"kb_avail":92920648,"statfs":{"total":96636764160,"available":95150743552,"internally_reserved":0,"allocated":1150062592,"data_stored":1149143280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":335935947},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574886,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":820956,"kb_used_data":637128,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":93550884,"statfs":{"total":96636764160,"available":95796105216,"internally_reserved":0,"allocated":652419072,"data_stored":651963839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":188217798},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1027870720,"data_stored":1027192144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":652177408,"data_stored":651881160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":318836736,"data_stored":318680668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1127555072,"data_stored":1126880276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1396514816,"data_stored":1395683376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1086279680,"data_stored":1085599564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":341766144,"data_stored":341577352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1149292544,"data_stored":1148531692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T23:26:53.281 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2026-02-22T23:24:05.150806+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=24, tm_sec=5, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=26, tm_sec=50, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T23:26:53.281 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2026-02-22T23:24:05.150806+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=24, tm_sec=5, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=26, tm_sec=50, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T23:26:53.281 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2026-02-22T23:24:05.150806+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=24, tm_sec=5, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=26, tm_sec=50, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T23:26:53.282 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2026-02-22T23:24:05.150806+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=24, tm_sec=5, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=26, tm_sec=50, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T23:26:53.282 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2026-02-22T23:24:05.150806+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=24, tm_sec=5, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=26, tm_sec=50, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T23:26:53.282 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2026-02-22T23:24:05.150806+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=24, tm_sec=5, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=26, tm_sec=50, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T23:26:53.282 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2026-02-22T23:24:05.150806+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=24, tm_sec=5, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=26, tm_sec=50, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T23:26:53.282 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2026-02-22T23:24:05.150806+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=24, tm_sec=5, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=26, tm_sec=50, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T23:26:53.282 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2026-02-22T23:24:05.150806+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=24, tm_sec=5, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=26, tm_sec=50, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T23:26:53.282 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2026-02-22T23:24:05.150806+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=24, tm_sec=5, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=26, tm_sec=50, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T23:26:53.283 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2026-02-22T23:24:05.150806+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=24, tm_sec=5, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=26, tm_sec=50, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T23:26:53.283 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2026-02-22T23:24:05.150806+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=24, tm_sec=5, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=26, tm_sec=50, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T23:26:53.283 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2026-02-22T23:23:57.931636+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=23, tm_sec=57, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=26, tm_sec=50, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T23:26:53.283 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2026-02-22T23:24:05.150806+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=24, tm_sec=5, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=26, tm_sec=50, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T23:26:53.283 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2026-02-22T23:23:57.931636+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=23, tm_sec=57, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=26, tm_sec=50, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T23:26:53.283 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2026-02-22T23:24:05.150806+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=24, tm_sec=5, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=26, tm_sec=50, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T23:26:53.283 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2026-02-22T23:23:57.931636+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=23, tm_sec=57, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=26, tm_sec=50, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T23:26:53.284 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2026-02-22T23:24:05.150806+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=24, tm_sec=5, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=26, tm_sec=50, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T23:26:53.284 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2026-02-22T23:23:57.931636+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=23, tm_sec=57, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=26, tm_sec=50, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T23:26:53.284 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2026-02-22T23:24:05.150806+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=24, tm_sec=5, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=26, tm_sec=50, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T23:26:53.284 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2026-02-22T23:24:05.150806+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=24, tm_sec=5, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=26, tm_sec=50, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T23:26:53.284 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2026-02-22T23:23:57.931636+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=23, tm_sec=57, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=26, tm_sec=50, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T23:26:53.284 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2026-02-22T23:24:05.150806+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=24, tm_sec=5, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=26, tm_sec=50, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T23:26:53.284 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2026-02-22T23:23:57.931636+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=23, tm_sec=57, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=26, tm_sec=50, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T23:26:53.285 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2026-02-22T23:24:05.150806+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=24, tm_sec=5, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=26, tm_sec=50, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T23:26:53.285 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2026-02-22T23:23:57.931636+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=23, tm_sec=57, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=26, tm_sec=50, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T23:26:53.285 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2026-02-22T23:23:51.885433+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=23, tm_sec=51, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=26, tm_sec=50, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T23:26:53.285 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2026-02-22T23:24:05.150806+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=24, tm_sec=5, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=26, tm_sec=50, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T23:26:53.285 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2026-02-22T23:24:05.150806+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=24, tm_sec=5, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=26, tm_sec=50, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T23:26:53.285 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2026-02-22T23:24:05.150806+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=24, tm_sec=5, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=26, tm_sec=50, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T23:26:53.286 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2026-02-22T23:24:05.150806+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=24, tm_sec=5, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=26, tm_sec=50, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T23:26:53.286 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2026-02-22T23:24:05.150806+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=24, tm_sec=5, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=26, tm_sec=50, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T23:26:53.286 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2026-02-22T23:24:05.150806+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=24, tm_sec=5, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=26, tm_sec=50, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T23:26:53.286 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2026-02-22T23:24:05.150806+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=24, tm_sec=5, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=26, tm_sec=50, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T23:26:53.286 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2026-02-22T23:24:05.150806+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=24, tm_sec=5, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=26, tm_sec=50, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T23:26:53.286 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2026-02-22T23:24:05.150806+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=24, tm_sec=5, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=26, tm_sec=50, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T23:26:53.286 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2026-02-22T23:24:05.150806+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=24, tm_sec=5, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=26, tm_sec=50, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T23:26:53.287 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2026-02-22T23:24:05.150806+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=24, tm_sec=5, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=23, tm_min=26, tm_sec=50, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T23:26:53.287 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-22T23:27:13.288 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T23:27:13.360 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.357+0000 7fdb02805640 1 Processor -- start 2026-02-22T23:27:13.361 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.357+0000 7fdb02805640 1 -- start start 2026-02-22T23:27:13.365 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.358+0000 7fdb02805640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdafc1424b0 con 0x7fdafc0aaf30 2026-02-22T23:27:13.365 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.358+0000 7fdb02805640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdafc074d00 con 0x7fdafc0aab50 2026-02-22T23:27:13.365 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.358+0000 7fdb02805640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdafc071380 con 0x7fdafc070f50 2026-02-22T23:27:13.365 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.358+0000 7fdafb7fe640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7fdafc0aaf30 0x7fdafc140bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:60828/0 (socket says 10.20.193.93:60828) 2026-02-22T23:27:13.366 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.358+0000 7fdb00d7b640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7fdafc070f50 0x7fdafc14d000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:41470/0 (socket says 10.20.193.93:41470) 2026-02-22T23:27:13.366 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.358+0000 7fdafb7fe640 1 -- 10.20.193.93:0/1849296019 learned_addr learned my addr 10.20.193.93:0/1849296019 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:27:13.366 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.358+0000 7fdafaffd640 1 -- 10.20.193.93:0/1849296019 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 953963486 0 0) 0x7fdafc1424b0 con 0x7fdafc0aaf30 2026-02-22T23:27:13.366 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.358+0000 7fdafaffd640 1 -- 10.20.193.93:0/1849296019 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdae0003620 con 0x7fdafc0aaf30 2026-02-22T23:27:13.366 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.358+0000 7fdafaffd640 1 -- 10.20.193.93:0/1849296019 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4166736098 0 0) 0x7fdafc071380 con 0x7fdafc070f50 2026-02-22T23:27:13.366 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.358+0000 7fdafaffd640 1 -- 10.20.193.93:0/1849296019 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdafc1424b0 con 0x7fdafc070f50 2026-02-22T23:27:13.366 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.358+0000 7fdafaffd640 1 -- 10.20.193.93:0/1849296019 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 18642918 0 0) 0x7fdafc074d00 con 0x7fdafc0aab50 2026-02-22T23:27:13.366 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.358+0000 7fdafaffd640 1 -- 10.20.193.93:0/1849296019 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdafc071380 con 0x7fdafc0aab50 2026-02-22T23:27:13.366 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.358+0000 7fdafaffd640 1 -- 10.20.193.93:0/1849296019 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2605245357 0 0) 0x7fdae0003620 con 0x7fdafc0aaf30 2026-02-22T23:27:13.366 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.358+0000 7fdafaffd640 1 -- 10.20.193.93:0/1849296019 >> v1:10.20.193.93:6790/0 conn(0x7fdafc070f50 legacy=0x7fdafc14d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:27:13.366 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.358+0000 7fdafaffd640 1 -- 10.20.193.93:0/1849296019 >> v1:10.20.193.155:6789/0 conn(0x7fdafc0aab50 legacy=0x7fdafc141da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:27:13.366 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.358+0000 7fdafaffd640 1 -- 10.20.193.93:0/1849296019 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdafc142780 con 0x7fdafc0aaf30 2026-02-22T23:27:13.367 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.358+0000 7fdafaffd640 1 -- 10.20.193.93:0/1849296019 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fdaec002ea0 con 0x7fdafc0aaf30 2026-02-22T23:27:13.367 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.358+0000 7fdafaffd640 1 -- 10.20.193.93:0/1849296019 <== mon.0 v1:10.20.193.93:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdaec003040 con 0x7fdafc0aaf30 2026-02-22T23:27:13.367 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.358+0000 7fdafaffd640 1 -- 10.20.193.93:0/1849296019 <== mon.0 v1:10.20.193.93:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fdaec0034d0 con 0x7fdafc0aaf30 2026-02-22T23:27:13.367 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.359+0000 7fdb02805640 1 -- 10.20.193.93:0/1849296019 >> v1:10.20.193.93:6789/0 conn(0x7fdafc0aaf30 legacy=0x7fdafc140bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:27:13.367 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.359+0000 7fdb02805640 1 -- 10.20.193.93:0/1849296019 shutdown_connections 2026-02-22T23:27:13.367 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.359+0000 7fdb02805640 1 -- 10.20.193.93:0/1849296019 >> 10.20.193.93:0/1849296019 conn(0x7fdafc0b20c0 msgr2=0x7fdafc0b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:27:13.367 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.359+0000 7fdb02805640 1 -- 10.20.193.93:0/1849296019 shutdown_connections 2026-02-22T23:27:13.367 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.359+0000 7fdb02805640 1 -- 10.20.193.93:0/1849296019 wait complete. 2026-02-22T23:27:13.367 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.359+0000 7fdb02805640 1 Processor -- start 2026-02-22T23:27:13.367 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.359+0000 7fdb02805640 1 -- start start 2026-02-22T23:27:13.367 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.360+0000 7fdb02805640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdafc1361b0 con 0x7fdafc0aaf30 2026-02-22T23:27:13.367 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.360+0000 7fdb02805640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdafc1cd270 con 0x7fdafc070f50 2026-02-22T23:27:13.368 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.360+0000 7fdb02805640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdafc073a40 con 0x7fdafc0aab50 2026-02-22T23:27:13.368 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.360+0000 7fdafb7fe640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7fdafc0aab50 0x7fdafc135390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:41482/0 (socket says 10.20.193.93:41482) 2026-02-22T23:27:13.368 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.360+0000 7fdafb7fe640 1 -- 10.20.193.93:0/2059069060 learned_addr learned my addr 10.20.193.93:0/2059069060 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:27:13.368 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.360+0000 7fdaf8ff9640 1 -- 10.20.193.93:0/2059069060 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2527753187 0 0) 0x7fdafc073a40 con 0x7fdafc0aab50 2026-02-22T23:27:13.368 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.360+0000 7fdaf8ff9640 1 -- 10.20.193.93:0/2059069060 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdacc003620 con 0x7fdafc0aab50 2026-02-22T23:27:13.368 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.360+0000 7fdaf8ff9640 1 -- 10.20.193.93:0/2059069060 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2304259625 0 0) 0x7fdafc1361b0 con 0x7fdafc0aaf30 2026-02-22T23:27:13.368 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.360+0000 7fdaf8ff9640 1 -- 10.20.193.93:0/2059069060 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdafc073a40 con 0x7fdafc0aaf30 2026-02-22T23:27:13.368 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.360+0000 7fdaf8ff9640 1 -- 10.20.193.93:0/2059069060 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1013156238 0 0) 0x7fdacc003620 con 0x7fdafc0aab50 2026-02-22T23:27:13.368 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.360+0000 7fdaf8ff9640 1 -- 10.20.193.93:0/2059069060 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdafc1361b0 con 0x7fdafc0aab50 2026-02-22T23:27:13.368 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.360+0000 7fdaf8ff9640 1 -- 10.20.193.93:0/2059069060 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fdaec003450 con 0x7fdafc0aab50 2026-02-22T23:27:13.369 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.360+0000 7fdaf8ff9640 1 -- 10.20.193.93:0/2059069060 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3780754526 0 0) 0x7fdafc073a40 con 0x7fdafc0aaf30 2026-02-22T23:27:13.369 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.360+0000 7fdaf8ff9640 1 -- 10.20.193.93:0/2059069060 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdacc003620 con 0x7fdafc0aaf30 2026-02-22T23:27:13.369 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.360+0000 7fdaf8ff9640 1 -- 10.20.193.93:0/2059069060 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fdaf0003550 con 0x7fdafc0aaf30 2026-02-22T23:27:13.369 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.360+0000 7fdaf8ff9640 1 -- 10.20.193.93:0/2059069060 <== mon.2 v1:10.20.193.93:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 824468304 0 0) 0x7fdafc1361b0 con 0x7fdafc0aab50 2026-02-22T23:27:13.369 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.360+0000 7fdaf8ff9640 1 -- 10.20.193.93:0/2059069060 >> v1:10.20.193.155:6789/0 conn(0x7fdafc070f50 legacy=0x7fdafc1dde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:27:13.369 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.360+0000 7fdaf8ff9640 1 -- 10.20.193.93:0/2059069060 >> v1:10.20.193.93:6789/0 conn(0x7fdafc0aaf30 legacy=0x7fdafc135aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:27:13.369 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.360+0000 7fdaf8ff9640 1 -- 10.20.193.93:0/2059069060 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdafc1363c0 con 0x7fdafc0aab50 2026-02-22T23:27:13.369 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.360+0000 7fdb02805640 1 -- 10.20.193.93:0/2059069060 --> v1:10.20.193.93:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdafc073f60 con 0x7fdafc0aab50 2026-02-22T23:27:13.369 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.360+0000 7fdaf8ff9640 1 -- 10.20.193.93:0/2059069060 <== mon.2 v1:10.20.193.93:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdaec004b90 con 0x7fdafc0aab50 2026-02-22T23:27:13.369 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.360+0000 7fdb02805640 1 -- 10.20.193.93:0/2059069060 --> v1:10.20.193.93:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fdafc1de6f0 con 0x7fdafc0aab50 2026-02-22T23:27:13.369 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.360+0000 7fdaf8ff9640 1 -- 10.20.193.93:0/2059069060 <== mon.2 v1:10.20.193.93:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7fdaec004ee0 con 0x7fdafc0aab50 2026-02-22T23:27:13.370 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.361+0000 7fdb02805640 1 -- 10.20.193.93:0/2059069060 --> v1:10.20.193.93:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdafc0008d0 con 0x7fdafc0aab50 2026-02-22T23:27:13.370 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.361+0000 7fdaf8ff9640 1 -- 10.20.193.93:0/2059069060 <== mon.2 v1:10.20.193.93:6790/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7fdaec005100 con 0x7fdafc0aab50 2026-02-22T23:27:13.370 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.362+0000 7fdaf8ff9640 1 -- 10.20.193.93:0/2059069060 <== mon.2 v1:10.20.193.93:6790/0 8 ==== osd_map(25..25 src has 1..25) ==== 4521+0+0 (unknown 3458299925 0 0) 0x7fdaec094440 con 0x7fdafc0aab50 2026-02-22T23:27:13.370 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.364+0000 7fdaf8ff9640 1 -- 10.20.193.93:0/2059069060 <== mon.2 v1:10.20.193.93:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7fdaec05dac0 con 0x7fdafc0aab50 2026-02-22T23:27:13.449 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.446+0000 7fdb02805640 1 -- 10.20.193.93:0/2059069060 --> v1:10.20.193.155:6800/3108481844 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdafc0b1420 con 0x7fdacc078030 2026-02-22T23:27:13.452 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.449+0000 7fdaf8ff9640 1 -- 10.20.193.93:0/2059069060 <== mgr.4108 v1:10.20.193.155:6800/3108481844 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+117840 (unknown 2965378022 0 2820522353) 0x7fdafc0b1420 con 0x7fdacc078030 2026-02-22T23:27:13.453 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-22T23:27:13.454 INFO:teuthology.orchestra.run.trial093.stderr:dumped all 2026-02-22T23:27:13.455 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.450+0000 7fdb02805640 1 -- 10.20.193.93:0/2059069060 >> v1:10.20.193.155:6800/3108481844 conn(0x7fdacc078030 legacy=0x7fdacc07a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:27:13.455 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.450+0000 7fdb02805640 1 -- 10.20.193.93:0/2059069060 >> v1:10.20.193.93:6790/0 conn(0x7fdafc0aab50 legacy=0x7fdafc135390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:27:13.455 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.450+0000 7fdb02805640 1 -- 10.20.193.93:0/2059069060 shutdown_connections 2026-02-22T23:27:13.455 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.450+0000 7fdb02805640 1 -- 10.20.193.93:0/2059069060 >> 10.20.193.93:0/2059069060 conn(0x7fdafc0b20c0 msgr2=0x7fdafc071e80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:27:13.455 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.450+0000 7fdb02805640 1 -- 10.20.193.93:0/2059069060 shutdown_connections 2026-02-22T23:27:13.455 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.450+0000 7fdb02805640 1 -- 10.20.193.93:0/2059069060 wait complete. 2026-02-22T23:27:13.460 INFO:teuthology.orchestra.run.trial093.stdout:{"pg_ready":true,"pg_map":{"version":120,"stamp":"2026-02-22T23:27:13.079599+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3699561259,"num_objects":912,"num_object_clones":0,"num_object_copies":1824,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":912,"num_whiteouts":0,"num_read":2655,"num_read_kb":2658,"num_write":211104,"num_write_kb":5844199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":210685,"ondisk_log_size":210685,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":9049616,"kb_used_data":6936784,"kb_used_omap":12,"kb_used_meta":2112691,"kb_avail":745925104,"statfs":{"total":773094113280,"available":763827306496,"internally_reserved":0,"allocated":7103266816,"data_stored":7097745406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":2163396152},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001235"},"pg_stats":[{"pgid":"3.1f","version":"25'5693","reported_seq":5731,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:56.231260+0000","last_change":"2026-02-22T23:26:56.231284+0000","last_active":"2026-02-22T23:26:56.231260+0000","last_peered":"2026-02-22T23:26:56.231260+0000","last_clean":"2026-02-22T23:26:56.231260+0000","last_became_active":"2026-02-22T23:24:05.677831+0000","last_became_peered":"2026-02-22T23:24:05.677831+0000","last_unstale":"2026-02-22T23:26:56.231260+0000","last_undegraded":"2026-02-22T23:26:56.231260+0000","last_fullsized":"2026-02-22T23:26:56.231260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5693","last_scrub_stamp":"2026-02-22T23:26:56.231221+0000","last_deep_scrub":"25'5693","last_deep_scrub_stamp":"2026-02-22T23:26:56.231221+0000","last_clean_scrub_stamp":"2026-02-22T23:26:56.231221+0000","objects_scrubbed":24,"log_size":5693,"log_dups_size":0,"ondisk_log_size":5693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:55:55.930816+0000","scrub_duration":129,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":42,"num_read_kb":34,"num_write":5679,"num_write_kb":173190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"25'6675","reported_seq":6705,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:55.857305+0000","last_change":"2026-02-22T23:26:55.857315+0000","last_active":"2026-02-22T23:26:55.857305+0000","last_peered":"2026-02-22T23:26:55.857305+0000","last_clean":"2026-02-22T23:26:55.857305+0000","last_became_active":"2026-02-22T23:24:05.677553+0000","last_became_peered":"2026-02-22T23:24:05.677553+0000","last_unstale":"2026-02-22T23:26:55.857305+0000","last_undegraded":"2026-02-22T23:26:55.857305+0000","last_fullsized":"2026-02-22T23:26:55.857305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6675","last_scrub_stamp":"2026-02-22T23:26:55.857280+0000","last_deep_scrub":"25'6675","last_deep_scrub_stamp":"2026-02-22T23:26:55.857280+0000","last_clean_scrub_stamp":"2026-02-22T23:26:55.857280+0000","objects_scrubbed":31,"log_size":6675,"log_dups_size":0,"ondisk_log_size":6675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:24:31.697429+0000","scrub_duration":171,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123726176,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":6626,"num_write_kb":171222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"25'10623","reported_seq":10650,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:57.264790+0000","last_change":"2026-02-22T23:26:57.264833+0000","last_active":"2026-02-22T23:26:57.264790+0000","last_peered":"2026-02-22T23:26:57.264790+0000","last_clean":"2026-02-22T23:26:57.264790+0000","last_became_active":"2026-02-22T23:24:05.698937+0000","last_became_peered":"2026-02-22T23:24:05.698937+0000","last_unstale":"2026-02-22T23:26:57.264790+0000","last_undegraded":"2026-02-22T23:26:57.264790+0000","last_fullsized":"2026-02-22T23:26:57.264790+0000","mapping_epoch":21,"log_start":"23'600","ondisk_log_start":"23'600","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'10623","last_scrub_stamp":"2026-02-22T23:26:57.264731+0000","last_deep_scrub":"25'10623","last_deep_scrub_stamp":"2026-02-22T23:26:57.264731+0000","last_clean_scrub_stamp":"2026-02-22T23:26:57.264731+0000","objects_scrubbed":26,"log_size":10023,"log_dups_size":0,"ondisk_log_size":10023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:05:56.019977+0000","scrub_duration":165,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10572,"num_write_kb":197375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"25'4713","reported_seq":4742,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:58.253336+0000","last_change":"2026-02-22T23:26:58.253349+0000","last_active":"2026-02-22T23:26:58.253336+0000","last_peered":"2026-02-22T23:26:58.253336+0000","last_clean":"2026-02-22T23:26:58.253336+0000","last_became_active":"2026-02-22T23:24:05.699243+0000","last_became_peered":"2026-02-22T23:24:05.699243+0000","last_unstale":"2026-02-22T23:26:58.253336+0000","last_undegraded":"2026-02-22T23:26:58.253336+0000","last_fullsized":"2026-02-22T23:26:58.253336+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4713","last_scrub_stamp":"2026-02-22T23:26:58.253310+0000","last_deep_scrub":"25'4713","last_deep_scrub_stamp":"2026-02-22T23:26:58.253310+0000","last_clean_scrub_stamp":"2026-02-22T23:26:58.253310+0000","objects_scrubbed":33,"log_size":4713,"log_dups_size":0,"ondisk_log_size":4713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:40:19.431930+0000","scrub_duration":161,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134218240,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":4685,"num_write_kb":192906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"25'6905","reported_seq":6949,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:53.273988+0000","last_change":"2026-02-22T23:26:53.273999+0000","last_active":"2026-02-22T23:26:53.273988+0000","last_peered":"2026-02-22T23:26:53.273988+0000","last_clean":"2026-02-22T23:26:53.273988+0000","last_became_active":"2026-02-22T23:24:05.675974+0000","last_became_peered":"2026-02-22T23:24:05.675974+0000","last_unstale":"2026-02-22T23:26:53.273988+0000","last_undegraded":"2026-02-22T23:26:53.273988+0000","last_fullsized":"2026-02-22T23:26:53.273988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6905","last_scrub_stamp":"2026-02-22T23:26:53.273963+0000","last_deep_scrub":"25'6905","last_deep_scrub_stamp":"2026-02-22T23:26:53.273963+0000","last_clean_scrub_stamp":"2026-02-22T23:26:53.273963+0000","objects_scrubbed":30,"log_size":6905,"log_dups_size":0,"ondisk_log_size":6905,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:39:27.528878+0000","scrub_duration":145,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113508352,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":67,"num_read_kb":50,"num_write":6857,"num_write_kb":185605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"25'6864","reported_seq":6896,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:52.953929+0000","last_change":"2026-02-22T23:26:52.953943+0000","last_active":"2026-02-22T23:26:52.953929+0000","last_peered":"2026-02-22T23:26:52.953929+0000","last_clean":"2026-02-22T23:26:52.953929+0000","last_became_active":"2026-02-22T23:24:05.697565+0000","last_became_peered":"2026-02-22T23:24:05.697565+0000","last_unstale":"2026-02-22T23:26:52.953929+0000","last_undegraded":"2026-02-22T23:26:52.953929+0000","last_fullsized":"2026-02-22T23:26:52.953929+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6864","last_scrub_stamp":"2026-02-22T23:26:52.953906+0000","last_deep_scrub":"25'6864","last_deep_scrub_stamp":"2026-02-22T23:26:52.953906+0000","last_clean_scrub_stamp":"2026-02-22T23:26:52.953906+0000","objects_scrubbed":24,"log_size":6864,"log_dups_size":0,"ondisk_log_size":6864,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:01:00.232241+0000","scrub_duration":122,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92406800,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":18,"num_read_kb":13,"num_write":6841,"num_write_kb":183644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"25'6401","reported_seq":6435,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:54.189978+0000","last_change":"2026-02-22T23:26:54.190008+0000","last_active":"2026-02-22T23:26:54.189978+0000","last_peered":"2026-02-22T23:26:54.189978+0000","last_clean":"2026-02-22T23:26:54.189978+0000","last_became_active":"2026-02-22T23:24:05.676667+0000","last_became_peered":"2026-02-22T23:24:05.676667+0000","last_unstale":"2026-02-22T23:26:54.189978+0000","last_undegraded":"2026-02-22T23:26:54.189978+0000","last_fullsized":"2026-02-22T23:26:54.189978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6401","last_scrub_stamp":"2026-02-22T23:26:54.189920+0000","last_deep_scrub":"25'6401","last_deep_scrub_stamp":"2026-02-22T23:26:54.189920+0000","last_clean_scrub_stamp":"2026-02-22T23:26:54.189920+0000","objects_scrubbed":33,"log_size":6401,"log_dups_size":0,"ondisk_log_size":6401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:08:29.985971+0000","scrub_duration":185,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134218240,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":6334,"num_write_kb":211582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"25'8381","reported_seq":8408,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:53.802221+0000","last_change":"2026-02-22T23:26:53.802243+0000","last_active":"2026-02-22T23:26:53.802221+0000","last_peered":"2026-02-22T23:26:53.802221+0000","last_clean":"2026-02-22T23:26:53.802221+0000","last_became_active":"2026-02-22T23:24:05.676778+0000","last_became_peered":"2026-02-22T23:24:05.676778+0000","last_unstale":"2026-02-22T23:26:53.802221+0000","last_undegraded":"2026-02-22T23:26:53.802221+0000","last_fullsized":"2026-02-22T23:26:53.802221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8381","last_scrub_stamp":"2026-02-22T23:26:53.802186+0000","last_deep_scrub":"25'8381","last_deep_scrub_stamp":"2026-02-22T23:26:53.802186+0000","last_clean_scrub_stamp":"2026-02-22T23:26:53.802186+0000","objects_scrubbed":27,"log_size":8381,"log_dups_size":0,"ondisk_log_size":8381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:06:36.490004+0000","scrub_duration":143,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111804416,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8352,"num_write_kb":153987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"25'10368","reported_seq":10396,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:57.267204+0000","last_change":"2026-02-22T23:26:57.267223+0000","last_active":"2026-02-22T23:26:57.267204+0000","last_peered":"2026-02-22T23:26:57.267204+0000","last_clean":"2026-02-22T23:26:57.267204+0000","last_became_active":"2026-02-22T23:24:05.678254+0000","last_became_peered":"2026-02-22T23:24:05.678254+0000","last_unstale":"2026-02-22T23:26:57.267204+0000","last_undegraded":"2026-02-22T23:26:57.267204+0000","last_fullsized":"2026-02-22T23:26:57.267204+0000","mapping_epoch":21,"log_start":"23'300","ondisk_log_start":"23'300","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'10368","last_scrub_stamp":"2026-02-22T23:26:57.267168+0000","last_deep_scrub":"25'10368","last_deep_scrub_stamp":"2026-02-22T23:26:57.267168+0000","last_clean_scrub_stamp":"2026-02-22T23:26:57.267168+0000","objects_scrubbed":31,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:40:45.761199+0000","scrub_duration":195,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10330,"num_write_kb":231303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"25'5851","reported_seq":5898,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:59.303580+0000","last_change":"2026-02-22T23:26:59.303603+0000","last_active":"2026-02-22T23:26:59.303580+0000","last_peered":"2026-02-22T23:26:59.303580+0000","last_clean":"2026-02-22T23:26:59.303580+0000","last_became_active":"2026-02-22T23:24:05.698976+0000","last_became_peered":"2026-02-22T23:24:05.698976+0000","last_unstale":"2026-02-22T23:26:59.303580+0000","last_undegraded":"2026-02-22T23:26:59.303580+0000","last_fullsized":"2026-02-22T23:26:59.303580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5851","last_scrub_stamp":"2026-02-22T23:26:59.303544+0000","last_deep_scrub":"25'5851","last_deep_scrub_stamp":"2026-02-22T23:26:59.303544+0000","last_clean_scrub_stamp":"2026-02-22T23:26:59.303544+0000","objects_scrubbed":38,"log_size":5851,"log_dups_size":0,"ondisk_log_size":5851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:54:56.531801+0000","scrub_duration":192,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142475792,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":73,"num_read_kb":117,"num_write":5831,"num_write_kb":192524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"25'10745","reported_seq":10789,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:56.567947+0000","last_change":"2026-02-22T23:26:56.567959+0000","last_active":"2026-02-22T23:26:56.567947+0000","last_peered":"2026-02-22T23:26:56.567947+0000","last_clean":"2026-02-22T23:26:56.567947+0000","last_became_active":"2026-02-22T23:24:05.698465+0000","last_became_peered":"2026-02-22T23:24:05.698465+0000","last_unstale":"2026-02-22T23:26:56.567947+0000","last_undegraded":"2026-02-22T23:26:56.567947+0000","last_fullsized":"2026-02-22T23:26:56.567947+0000","mapping_epoch":21,"log_start":"23'700","ondisk_log_start":"23'700","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'10745","last_scrub_stamp":"2026-02-22T23:26:56.567924+0000","last_deep_scrub":"25'10745","last_deep_scrub_stamp":"2026-02-22T23:26:56.567924+0000","last_clean_scrub_stamp":"2026-02-22T23:26:56.567924+0000","objects_scrubbed":32,"log_size":10045,"log_dups_size":0,"ondisk_log_size":10045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:00:36.453676+0000","scrub_duration":171,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132097872,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":68,"num_read_kb":57,"num_write":10731,"num_write_kb":177027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"25'9654","reported_seq":9682,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:54.036674+0000","last_change":"2026-02-22T23:26:54.036698+0000","last_active":"2026-02-22T23:26:54.036674+0000","last_peered":"2026-02-22T23:26:54.036674+0000","last_clean":"2026-02-22T23:26:54.036674+0000","last_became_active":"2026-02-22T23:24:05.698446+0000","last_became_peered":"2026-02-22T23:24:05.698446+0000","last_unstale":"2026-02-22T23:26:54.036674+0000","last_undegraded":"2026-02-22T23:26:54.036674+0000","last_fullsized":"2026-02-22T23:26:54.036674+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'9654","last_scrub_stamp":"2026-02-22T23:26:54.036645+0000","last_deep_scrub":"25'9654","last_deep_scrub_stamp":"2026-02-22T23:26:54.036645+0000","last_clean_scrub_stamp":"2026-02-22T23:26:54.036645+0000","objects_scrubbed":44,"log_size":9654,"log_dups_size":0,"ondisk_log_size":9654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:56:16.605751+0000","scrub_duration":253,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184549376,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9557,"num_write_kb":251658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":39,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:53.023527+0000","last_change":"2026-02-22T23:26:53.023544+0000","last_active":"2026-02-22T23:26:53.023527+0000","last_peered":"2026-02-22T23:26:53.023527+0000","last_clean":"2026-02-22T23:26:53.023527+0000","last_became_active":"2026-02-22T23:23:58.958814+0000","last_became_peered":"2026-02-22T23:23:58.958814+0000","last_unstale":"2026-02-22T23:26:53.023527+0000","last_undegraded":"2026-02-22T23:26:53.023527+0000","last_fullsized":"2026-02-22T23:26:53.023527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:26:53.023470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:26:53.023470+0000","last_clean_scrub_stamp":"2026-02-22T23:26:53.023470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:19:05.099600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00022938900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"25'11069","reported_seq":11129,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:54.358770+0000","last_change":"2026-02-22T23:26:54.358791+0000","last_active":"2026-02-22T23:26:54.358770+0000","last_peered":"2026-02-22T23:26:54.358770+0000","last_clean":"2026-02-22T23:26:54.358770+0000","last_became_active":"2026-02-22T23:24:05.676228+0000","last_became_peered":"2026-02-22T23:24:05.676228+0000","last_unstale":"2026-02-22T23:26:54.358770+0000","last_undegraded":"2026-02-22T23:26:54.358770+0000","last_fullsized":"2026-02-22T23:26:54.358770+0000","mapping_epoch":21,"log_start":"23'1000","ondisk_log_start":"23'1000","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'11069","last_scrub_stamp":"2026-02-22T23:26:54.358731+0000","last_deep_scrub":"25'11069","last_deep_scrub_stamp":"2026-02-22T23:26:54.358731+0000","last_clean_scrub_stamp":"2026-02-22T23:26:54.358731+0000","objects_scrubbed":35,"log_size":10069,"log_dups_size":0,"ondisk_log_size":10069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:34:29.373866+0000","scrub_duration":195,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137103184,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":120,"num_read_kb":161,"num_write":11063,"num_write_kb":200793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":39,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:52.014187+0000","last_change":"2026-02-22T23:26:52.014200+0000","last_active":"2026-02-22T23:26:52.014187+0000","last_peered":"2026-02-22T23:26:52.014187+0000","last_clean":"2026-02-22T23:26:52.014187+0000","last_became_active":"2026-02-22T23:23:58.938089+0000","last_became_peered":"2026-02-22T23:23:58.938089+0000","last_unstale":"2026-02-22T23:26:52.014187+0000","last_undegraded":"2026-02-22T23:26:52.014187+0000","last_fullsized":"2026-02-22T23:26:52.014187+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:26:52.014135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:26:52.014135+0000","last_clean_scrub_stamp":"2026-02-22T23:26:52.014135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:45:52.167482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056227399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'4013","reported_seq":4059,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:57.794299+0000","last_change":"2026-02-22T23:26:57.794313+0000","last_active":"2026-02-22T23:26:57.794299+0000","last_peered":"2026-02-22T23:26:57.794299+0000","last_clean":"2026-02-22T23:26:57.794299+0000","last_became_active":"2026-02-22T23:24:05.678384+0000","last_became_peered":"2026-02-22T23:24:05.678384+0000","last_unstale":"2026-02-22T23:26:57.794299+0000","last_undegraded":"2026-02-22T23:26:57.794299+0000","last_fullsized":"2026-02-22T23:26:57.794299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4013","last_scrub_stamp":"2026-02-22T23:26:57.794275+0000","last_deep_scrub":"25'4013","last_deep_scrub_stamp":"2026-02-22T23:26:57.794275+0000","last_clean_scrub_stamp":"2026-02-22T23:26:57.794275+0000","objects_scrubbed":23,"log_size":4013,"log_dups_size":0,"ondisk_log_size":4013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:26:10.156296+0000","scrub_duration":113,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92275200,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":3968,"num_write_kb":148167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":39,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:55.427621+0000","last_change":"2026-02-22T23:26:55.427633+0000","last_active":"2026-02-22T23:26:55.427621+0000","last_peered":"2026-02-22T23:26:55.427621+0000","last_clean":"2026-02-22T23:26:55.427621+0000","last_became_active":"2026-02-22T23:23:59.257807+0000","last_became_peered":"2026-02-22T23:23:59.257807+0000","last_unstale":"2026-02-22T23:26:55.427621+0000","last_undegraded":"2026-02-22T23:26:55.427621+0000","last_fullsized":"2026-02-22T23:26:55.427621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:26:55.427582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:26:55.427582+0000","last_clean_scrub_stamp":"2026-02-22T23:26:55.427582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:40:33.649995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000177021,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"25'7582","reported_seq":7713,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:56.168569+0000","last_change":"2026-02-22T23:26:56.168589+0000","last_active":"2026-02-22T23:26:56.168569+0000","last_peered":"2026-02-22T23:26:56.168569+0000","last_clean":"2026-02-22T23:26:56.168569+0000","last_became_active":"2026-02-22T23:24:05.721799+0000","last_became_peered":"2026-02-22T23:24:05.721799+0000","last_unstale":"2026-02-22T23:26:56.168569+0000","last_undegraded":"2026-02-22T23:26:56.168569+0000","last_fullsized":"2026-02-22T23:26:56.168569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7582","last_scrub_stamp":"2026-02-22T23:26:56.168523+0000","last_deep_scrub":"25'7582","last_deep_scrub_stamp":"2026-02-22T23:26:56.168523+0000","last_clean_scrub_stamp":"2026-02-22T23:26:56.168523+0000","objects_scrubbed":31,"log_size":7582,"log_dups_size":0,"ondisk_log_size":7582,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:27:34.090628+0000","scrub_duration":160,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121775136,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":109,"num_read_kb":107,"num_write":7564,"num_write_kb":181611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:52.994752+0000","last_change":"2026-02-22T23:26:52.994764+0000","last_active":"2026-02-22T23:26:52.994752+0000","last_peered":"2026-02-22T23:26:52.994752+0000","last_clean":"2026-02-22T23:26:52.994752+0000","last_became_active":"2026-02-22T23:23:59.237046+0000","last_became_peered":"2026-02-22T23:23:59.237046+0000","last_unstale":"2026-02-22T23:26:52.994752+0000","last_undegraded":"2026-02-22T23:26:52.994752+0000","last_fullsized":"2026-02-22T23:26:52.994752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:26:52.994713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:26:52.994713+0000","last_clean_scrub_stamp":"2026-02-22T23:26:52.994713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:11:58.054499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000445938,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'7244","reported_seq":7272,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:56.262346+0000","last_change":"2026-02-22T23:26:56.262362+0000","last_active":"2026-02-22T23:26:56.262346+0000","last_peered":"2026-02-22T23:26:56.262346+0000","last_clean":"2026-02-22T23:26:56.262346+0000","last_became_active":"2026-02-22T23:24:05.698126+0000","last_became_peered":"2026-02-22T23:24:05.698126+0000","last_unstale":"2026-02-22T23:26:56.262346+0000","last_undegraded":"2026-02-22T23:26:56.262346+0000","last_fullsized":"2026-02-22T23:26:56.262346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7244","last_scrub_stamp":"2026-02-22T23:26:56.262317+0000","last_deep_scrub":"25'7244","last_deep_scrub_stamp":"2026-02-22T23:26:56.262317+0000","last_clean_scrub_stamp":"2026-02-22T23:26:56.262317+0000","objects_scrubbed":35,"log_size":7244,"log_dups_size":0,"ondisk_log_size":7244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:30:13.141979+0000","scrub_duration":190,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145358848,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7203,"num_write_kb":211206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"25'7485","reported_seq":7512,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:54.891223+0000","last_change":"2026-02-22T23:26:54.891239+0000","last_active":"2026-02-22T23:26:54.891223+0000","last_peered":"2026-02-22T23:26:54.891223+0000","last_clean":"2026-02-22T23:26:54.891223+0000","last_became_active":"2026-02-22T23:24:05.698528+0000","last_became_peered":"2026-02-22T23:24:05.698528+0000","last_unstale":"2026-02-22T23:26:54.891223+0000","last_undegraded":"2026-02-22T23:26:54.891223+0000","last_fullsized":"2026-02-22T23:26:54.891223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7485","last_scrub_stamp":"2026-02-22T23:26:54.891191+0000","last_deep_scrub":"25'7485","last_deep_scrub_stamp":"2026-02-22T23:26:54.891191+0000","last_clean_scrub_stamp":"2026-02-22T23:26:54.891191+0000","objects_scrubbed":21,"log_size":7485,"log_dups_size":0,"ondisk_log_size":7485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T05:39:06.395079+0000","scrub_duration":114,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86704128,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7460,"num_write_kb":164306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"25'3","reported_seq":42,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:53.120489+0000","last_change":"2026-02-22T23:26:53.120500+0000","last_active":"2026-02-22T23:26:53.120489+0000","last_peered":"2026-02-22T23:26:53.120489+0000","last_clean":"2026-02-22T23:26:53.120489+0000","last_became_active":"2026-02-22T23:23:58.958840+0000","last_became_peered":"2026-02-22T23:23:58.958840+0000","last_unstale":"2026-02-22T23:26:53.120489+0000","last_undegraded":"2026-02-22T23:26:53.120489+0000","last_fullsized":"2026-02-22T23:26:53.120489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'3","last_scrub_stamp":"2026-02-22T23:26:53.120467+0000","last_deep_scrub":"25'3","last_deep_scrub_stamp":"2026-02-22T23:26:53.120467+0000","last_clean_scrub_stamp":"2026-02-22T23:26:53.120467+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:48:33.945706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00022545200000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"25'5382","reported_seq":5409,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:55.172162+0000","last_change":"2026-02-22T23:26:55.172185+0000","last_active":"2026-02-22T23:26:55.172162+0000","last_peered":"2026-02-22T23:26:55.172162+0000","last_clean":"2026-02-22T23:26:55.172162+0000","last_became_active":"2026-02-22T23:24:05.721787+0000","last_became_peered":"2026-02-22T23:24:05.721787+0000","last_unstale":"2026-02-22T23:26:55.172162+0000","last_undegraded":"2026-02-22T23:26:55.172162+0000","last_fullsized":"2026-02-22T23:26:55.172162+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5382","last_scrub_stamp":"2026-02-22T23:26:55.172114+0000","last_deep_scrub":"25'5382","last_deep_scrub_stamp":"2026-02-22T23:26:55.172114+0000","last_clean_scrub_stamp":"2026-02-22T23:26:55.172114+0000","objects_scrubbed":26,"log_size":5382,"log_dups_size":0,"ondisk_log_size":5382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:21:22.420608+0000","scrub_duration":138,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5307,"num_write_kb":179763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":39,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:52.214534+0000","last_change":"2026-02-22T23:26:52.214549+0000","last_active":"2026-02-22T23:26:52.214534+0000","last_peered":"2026-02-22T23:26:52.214534+0000","last_clean":"2026-02-22T23:26:52.214534+0000","last_became_active":"2026-02-22T23:23:59.236692+0000","last_became_peered":"2026-02-22T23:23:59.236692+0000","last_unstale":"2026-02-22T23:26:52.214534+0000","last_undegraded":"2026-02-22T23:26:52.214534+0000","last_fullsized":"2026-02-22T23:26:52.214534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:26:52.214490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:26:52.214490+0000","last_clean_scrub_stamp":"2026-02-22T23:26:52.214490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:30:10.017660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017529500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"25'2809","reported_seq":2836,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:52.239920+0000","last_change":"2026-02-22T23:26:52.239934+0000","last_active":"2026-02-22T23:26:52.239920+0000","last_peered":"2026-02-22T23:26:52.239920+0000","last_clean":"2026-02-22T23:26:52.239920+0000","last_became_active":"2026-02-22T23:24:05.675717+0000","last_became_peered":"2026-02-22T23:24:05.675717+0000","last_unstale":"2026-02-22T23:26:52.239920+0000","last_undegraded":"2026-02-22T23:26:52.239920+0000","last_fullsized":"2026-02-22T23:26:52.239920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2809","last_scrub_stamp":"2026-02-22T23:26:52.239896+0000","last_deep_scrub":"25'2809","last_deep_scrub_stamp":"2026-02-22T23:26:52.239896+0000","last_clean_scrub_stamp":"2026-02-22T23:26:52.239896+0000","objects_scrubbed":19,"log_size":2809,"log_dups_size":0,"ondisk_log_size":2809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:50:08.077484+0000","scrub_duration":90,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2762,"num_write_kb":135681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":39,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:54.393586+0000","last_change":"2026-02-22T23:26:54.393594+0000","last_active":"2026-02-22T23:26:54.393586+0000","last_peered":"2026-02-22T23:26:54.393586+0000","last_clean":"2026-02-22T23:26:54.393586+0000","last_became_active":"2026-02-22T23:23:58.958969+0000","last_became_peered":"2026-02-22T23:23:58.958969+0000","last_unstale":"2026-02-22T23:26:54.393586+0000","last_undegraded":"2026-02-22T23:26:54.393586+0000","last_fullsized":"2026-02-22T23:26:54.393586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T23:26:54.393560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T23:26:54.393560+0000","last_clean_scrub_stamp":"2026-02-22T23:26:54.393560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:56:29.666096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000181831,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"25'6384","reported_seq":6436,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:56.835907+0000","last_change":"2026-02-22T23:26:56.835920+0000","last_active":"2026-02-22T23:26:56.835907+0000","last_peered":"2026-02-22T23:26:56.835907+0000","last_clean":"2026-02-22T23:26:56.835907+0000","last_became_active":"2026-02-22T23:24:05.677638+0000","last_became_peered":"2026-02-22T23:24:05.677638+0000","last_unstale":"2026-02-22T23:26:56.835907+0000","last_undegraded":"2026-02-22T23:26:56.835907+0000","last_fullsized":"2026-02-22T23:26:56.835907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6384","last_scrub_stamp":"2026-02-22T23:26:56.835882+0000","last_deep_scrub":"25'6384","last_deep_scrub_stamp":"2026-02-22T23:26:56.835882+0000","last_clean_scrub_stamp":"2026-02-22T23:26:56.835882+0000","objects_scrubbed":32,"log_size":6384,"log_dups_size":0,"ondisk_log_size":6384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:36:34.425882+0000","scrub_duration":155,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120522936,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":72,"num_read_kb":119,"num_write":6510,"num_write_kb":147601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"25'2","reported_seq":41,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:54.100609+0000","last_change":"2026-02-22T23:26:54.100623+0000","last_active":"2026-02-22T23:26:54.100609+0000","last_peered":"2026-02-22T23:26:54.100609+0000","last_clean":"2026-02-22T23:26:54.100609+0000","last_became_active":"2026-02-22T23:23:58.958830+0000","last_became_peered":"2026-02-22T23:23:58.958830+0000","last_unstale":"2026-02-22T23:26:54.100609+0000","last_undegraded":"2026-02-22T23:26:54.100609+0000","last_fullsized":"2026-02-22T23:26:54.100609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2026-02-22T23:26:54.100581+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2026-02-22T23:26:54.100581+0000","last_clean_scrub_stamp":"2026-02-22T23:26:54.100581+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:54:38.837847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000241392,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"25'114","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:53.439429+0000","last_change":"2026-02-22T23:26:53.439445+0000","last_active":"2026-02-22T23:26:53.439429+0000","last_peered":"2026-02-22T23:26:53.439429+0000","last_clean":"2026-02-22T23:26:53.439429+0000","last_became_active":"2026-02-22T23:23:53.549316+0000","last_became_peered":"2026-02-22T23:23:53.549316+0000","last_unstale":"2026-02-22T23:26:53.439429+0000","last_undegraded":"2026-02-22T23:26:53.439429+0000","last_fullsized":"2026-02-22T23:26:53.439429+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'114","last_scrub_stamp":"2026-02-22T23:26:53.439396+0000","last_deep_scrub":"25'114","last_deep_scrub_stamp":"2026-02-22T23:26:53.439396+0000","last_clean_scrub_stamp":"2026-02-22T23:26:53.439396+0000","objects_scrubbed":2,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:36:15.090943+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"25'2983","reported_seq":3010,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:52.715857+0000","last_change":"2026-02-22T23:26:52.715871+0000","last_active":"2026-02-22T23:26:52.715857+0000","last_peered":"2026-02-22T23:26:52.715857+0000","last_clean":"2026-02-22T23:26:52.715857+0000","last_became_active":"2026-02-22T23:24:05.676326+0000","last_became_peered":"2026-02-22T23:24:05.676326+0000","last_unstale":"2026-02-22T23:26:52.715857+0000","last_undegraded":"2026-02-22T23:26:52.715857+0000","last_fullsized":"2026-02-22T23:26:52.715857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2983","last_scrub_stamp":"2026-02-22T23:26:52.715822+0000","last_deep_scrub":"25'2983","last_deep_scrub_stamp":"2026-02-22T23:26:52.715822+0000","last_clean_scrub_stamp":"2026-02-22T23:26:52.715822+0000","objects_scrubbed":20,"log_size":2983,"log_dups_size":0,"ondisk_log_size":2983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:53:08.542601+0000","scrub_duration":104,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2892,"num_write_kb":127875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"25'12283","reported_seq":12450,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:55.892179+0000","last_change":"2026-02-22T23:26:55.892195+0000","last_active":"2026-02-22T23:26:55.892179+0000","last_peered":"2026-02-22T23:26:55.892179+0000","last_clean":"2026-02-22T23:26:55.892179+0000","last_became_active":"2026-02-22T23:24:05.742493+0000","last_became_peered":"2026-02-22T23:24:05.742493+0000","last_unstale":"2026-02-22T23:26:55.892179+0000","last_undegraded":"2026-02-22T23:26:55.892179+0000","last_fullsized":"2026-02-22T23:26:55.892179+0000","mapping_epoch":21,"log_start":"23'2200","ondisk_log_start":"23'2200","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'12283","last_scrub_stamp":"2026-02-22T23:26:55.892153+0000","last_deep_scrub":"25'12283","last_deep_scrub_stamp":"2026-02-22T23:26:55.892153+0000","last_clean_scrub_stamp":"2026-02-22T23:26:55.892153+0000","objects_scrubbed":24,"log_size":10083,"log_dups_size":0,"ondisk_log_size":10083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:01:40.589175+0000","scrub_duration":151,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":434,"num_read_kb":392,"num_write":8573,"num_write_kb":186899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"25'5983","reported_seq":6316,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:55.211324+0000","last_change":"2026-02-22T23:26:55.211335+0000","last_active":"2026-02-22T23:26:55.211324+0000","last_peered":"2026-02-22T23:26:55.211324+0000","last_clean":"2026-02-22T23:26:55.211324+0000","last_became_active":"2026-02-22T23:24:05.699884+0000","last_became_peered":"2026-02-22T23:24:05.699884+0000","last_unstale":"2026-02-22T23:26:55.211324+0000","last_undegraded":"2026-02-22T23:26:55.211324+0000","last_fullsized":"2026-02-22T23:26:55.211324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5983","last_scrub_stamp":"2026-02-22T23:26:55.211299+0000","last_deep_scrub":"25'5983","last_deep_scrub_stamp":"2026-02-22T23:26:55.211299+0000","last_clean_scrub_stamp":"2026-02-22T23:26:55.211299+0000","objects_scrubbed":31,"log_size":5983,"log_dups_size":0,"ondisk_log_size":5983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T05:17:21.231582+0000","scrub_duration":157,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125960192,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":1022,"num_read_kb":916,"num_write":6136,"num_write_kb":193925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"25'3883","reported_seq":3910,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:54.795004+0000","last_change":"2026-02-22T23:26:54.795021+0000","last_active":"2026-02-22T23:26:54.795004+0000","last_peered":"2026-02-22T23:26:54.795004+0000","last_clean":"2026-02-22T23:26:54.795004+0000","last_became_active":"2026-02-22T23:24:05.676965+0000","last_became_peered":"2026-02-22T23:24:05.676965+0000","last_unstale":"2026-02-22T23:26:54.795004+0000","last_undegraded":"2026-02-22T23:26:54.795004+0000","last_fullsized":"2026-02-22T23:26:54.795004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'3883","last_scrub_stamp":"2026-02-22T23:26:54.794973+0000","last_deep_scrub":"25'3883","last_deep_scrub_stamp":"2026-02-22T23:26:54.794973+0000","last_clean_scrub_stamp":"2026-02-22T23:26:54.794973+0000","objects_scrubbed":22,"log_size":3883,"log_dups_size":0,"ondisk_log_size":3883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T05:12:36.945985+0000","scrub_duration":129,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3859,"num_write_kb":148998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"25'5941","reported_seq":5969,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:55.287265+0000","last_change":"2026-02-22T23:26:55.287277+0000","last_active":"2026-02-22T23:26:55.287265+0000","last_peered":"2026-02-22T23:26:55.287265+0000","last_clean":"2026-02-22T23:26:55.287265+0000","last_became_active":"2026-02-22T23:24:05.698018+0000","last_became_peered":"2026-02-22T23:24:05.698018+0000","last_unstale":"2026-02-22T23:26:55.287265+0000","last_undegraded":"2026-02-22T23:26:55.287265+0000","last_fullsized":"2026-02-22T23:26:55.287265+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5941","last_scrub_stamp":"2026-02-22T23:26:55.287228+0000","last_deep_scrub":"25'5941","last_deep_scrub_stamp":"2026-02-22T23:26:55.287228+0000","last_clean_scrub_stamp":"2026-02-22T23:26:55.287228+0000","objects_scrubbed":32,"log_size":5941,"log_dups_size":0,"ondisk_log_size":5941,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:09:41.785827+0000","scrub_duration":170,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131465216,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5859,"num_write_kb":186691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"25'3948","reported_seq":3991,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:57.527466+0000","last_change":"2026-02-22T23:26:57.527484+0000","last_active":"2026-02-22T23:26:57.527466+0000","last_peered":"2026-02-22T23:26:57.527466+0000","last_clean":"2026-02-22T23:26:57.527466+0000","last_became_active":"2026-02-22T23:24:05.699221+0000","last_became_peered":"2026-02-22T23:24:05.699221+0000","last_unstale":"2026-02-22T23:26:57.527466+0000","last_undegraded":"2026-02-22T23:26:57.527466+0000","last_fullsized":"2026-02-22T23:26:57.527466+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'3948","last_scrub_stamp":"2026-02-22T23:26:57.527429+0000","last_deep_scrub":"25'3948","last_deep_scrub_stamp":"2026-02-22T23:26:57.527429+0000","last_clean_scrub_stamp":"2026-02-22T23:26:57.527429+0000","objects_scrubbed":27,"log_size":3948,"log_dups_size":0,"ondisk_log_size":3948,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:52:41.962188+0000","scrub_duration":128,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":50,"num_read_kb":41,"num_write":3928,"num_write_kb":197645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"25'7461","reported_seq":7589,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:27:01.537914+0000","last_change":"2026-02-22T23:27:01.537940+0000","last_active":"2026-02-22T23:27:01.537914+0000","last_peered":"2026-02-22T23:27:01.537914+0000","last_clean":"2026-02-22T23:27:01.537914+0000","last_became_active":"2026-02-22T23:24:05.700853+0000","last_became_peered":"2026-02-22T23:24:05.700853+0000","last_unstale":"2026-02-22T23:27:01.537914+0000","last_undegraded":"2026-02-22T23:27:01.537914+0000","last_fullsized":"2026-02-22T23:27:01.537914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7461","last_scrub_stamp":"2026-02-22T23:27:01.537870+0000","last_deep_scrub":"25'7461","last_deep_scrub_stamp":"2026-02-22T23:27:01.537870+0000","last_clean_scrub_stamp":"2026-02-22T23:27:01.537870+0000","objects_scrubbed":24,"log_size":7461,"log_dups_size":0,"ondisk_log_size":7461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:22:24.241459+0000","scrub_duration":134,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":333,"num_read_kb":324,"num_write":7701,"num_write_kb":156562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"25'6516","reported_seq":6553,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:27:00.558578+0000","last_change":"2026-02-22T23:27:00.558605+0000","last_active":"2026-02-22T23:27:00.558578+0000","last_peered":"2026-02-22T23:27:00.558578+0000","last_clean":"2026-02-22T23:27:00.558578+0000","last_became_active":"2026-02-22T23:24:05.700510+0000","last_became_peered":"2026-02-22T23:24:05.700510+0000","last_unstale":"2026-02-22T23:27:00.558578+0000","last_undegraded":"2026-02-22T23:27:00.558578+0000","last_fullsized":"2026-02-22T23:27:00.558578+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6516","last_scrub_stamp":"2026-02-22T23:27:00.558535+0000","last_deep_scrub":"25'6516","last_deep_scrub_stamp":"2026-02-22T23:27:00.558535+0000","last_clean_scrub_stamp":"2026-02-22T23:27:00.558535+0000","objects_scrubbed":24,"log_size":6516,"log_dups_size":0,"ondisk_log_size":6516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:54:24.537669+0000","scrub_duration":129,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96600064,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":42,"num_read_kb":32,"num_write":6466,"num_write_kb":214278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"25'6047","reported_seq":6074,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:54.189242+0000","last_change":"2026-02-22T23:26:54.189266+0000","last_active":"2026-02-22T23:26:54.189242+0000","last_peered":"2026-02-22T23:26:54.189242+0000","last_clean":"2026-02-22T23:26:54.189242+0000","last_became_active":"2026-02-22T23:24:05.698492+0000","last_became_peered":"2026-02-22T23:24:05.698492+0000","last_unstale":"2026-02-22T23:26:54.189242+0000","last_undegraded":"2026-02-22T23:26:54.189242+0000","last_fullsized":"2026-02-22T23:26:54.189242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6047","last_scrub_stamp":"2026-02-22T23:26:54.189201+0000","last_deep_scrub":"25'6047","last_deep_scrub_stamp":"2026-02-22T23:26:54.189201+0000","last_clean_scrub_stamp":"2026-02-22T23:26:54.189201+0000","objects_scrubbed":26,"log_size":6047,"log_dups_size":0,"ondisk_log_size":6047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T05:20:08.169445+0000","scrub_duration":142,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5970,"num_write_kb":185477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"25'4601","reported_seq":4629,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:58.548636+0000","last_change":"2026-02-22T23:26:58.548649+0000","last_active":"2026-02-22T23:26:58.548636+0000","last_peered":"2026-02-22T23:26:58.548636+0000","last_clean":"2026-02-22T23:26:58.548636+0000","last_became_active":"2026-02-22T23:24:05.699288+0000","last_became_peered":"2026-02-22T23:24:05.699288+0000","last_unstale":"2026-02-22T23:26:58.548636+0000","last_undegraded":"2026-02-22T23:26:58.548636+0000","last_fullsized":"2026-02-22T23:26:58.548636+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4601","last_scrub_stamp":"2026-02-22T23:26:58.548606+0000","last_deep_scrub":"25'4601","last_deep_scrub_stamp":"2026-02-22T23:26:58.548606+0000","last_clean_scrub_stamp":"2026-02-22T23:26:58.548606+0000","objects_scrubbed":33,"log_size":4601,"log_dups_size":0,"ondisk_log_size":4601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:43:43.628401+0000","scrub_duration":167,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4562,"num_write_kb":202117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"25'4068","reported_seq":4098,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:55.243560+0000","last_change":"2026-02-22T23:26:55.243581+0000","last_active":"2026-02-22T23:26:55.243560+0000","last_peered":"2026-02-22T23:26:55.243560+0000","last_clean":"2026-02-22T23:26:55.243560+0000","last_became_active":"2026-02-22T23:24:05.677479+0000","last_became_peered":"2026-02-22T23:24:05.677479+0000","last_unstale":"2026-02-22T23:26:55.243560+0000","last_undegraded":"2026-02-22T23:26:55.243560+0000","last_fullsized":"2026-02-22T23:26:55.243560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4068","last_scrub_stamp":"2026-02-22T23:26:55.243511+0000","last_deep_scrub":"25'4068","last_deep_scrub_stamp":"2026-02-22T23:26:55.243511+0000","last_clean_scrub_stamp":"2026-02-22T23:26:55.243511+0000","objects_scrubbed":28,"log_size":4068,"log_dups_size":0,"ondisk_log_size":4068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:14:06.687069+0000","scrub_duration":128,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":3995,"num_write_kb":197509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"25'6811","reported_seq":6845,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-22T23:26:59.508119+0000","last_change":"2026-02-22T23:26:59.508135+0000","last_active":"2026-02-22T23:26:59.508119+0000","last_peered":"2026-02-22T23:26:59.508119+0000","last_clean":"2026-02-22T23:26:59.508119+0000","last_became_active":"2026-02-22T23:24:05.700038+0000","last_became_peered":"2026-02-22T23:24:05.700038+0000","last_unstale":"2026-02-22T23:26:59.508119+0000","last_undegraded":"2026-02-22T23:26:59.508119+0000","last_fullsized":"2026-02-22T23:26:59.508119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6811","last_scrub_stamp":"2026-02-22T23:26:59.508083+0000","last_deep_scrub":"25'6811","last_deep_scrub_stamp":"2026-02-22T23:26:59.508083+0000","last_clean_scrub_stamp":"2026-02-22T23:26:59.508083+0000","objects_scrubbed":22,"log_size":6811,"log_dups_size":0,"ondisk_log_size":6811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:07:12.199081+0000","scrub_duration":114,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":18,"num_read_kb":140,"num_write":6784,"num_write_kb":152398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3698970872,"num_objects":908,"num_object_clones":0,"num_object_copies":1816,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":908,"num_whiteouts":0,"num_read":2569,"num_read_kb":2585,"num_write":210957,"num_write_kb":5841525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7100293120,"data_stored":7096026232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":210566,"ondisk_log_size":210566,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542186,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":419252,"kb_used_data":333988,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":93952588,"statfs":{"total":96636764160,"available":96207450112,"internally_reserved":0,"allocated":342003712,"data_stored":341660012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":87292359},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542187,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1389136,"kb_used_data":1061056,"kb_used_omap":1,"kb_used_meta":328062,"kb_avail":92982704,"statfs":{"total":96636764160,"available":95214288896,"internally_reserved":0,"allocated":1086521344,"data_stored":1085682243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":335935942},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542186,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1810112,"kb_used_data":1364016,"kb_used_omap":1,"kb_used_meta":446078,"kb_avail":92561728,"statfs":{"total":96636764160,"available":94783209472,"internally_reserved":0,"allocated":1396752384,"data_stored":1395766036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":456784326},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542187,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1411456,"kb_used_data":1101360,"kb_used_omap":1,"kb_used_meta":310078,"kb_avail":92960384,"statfs":{"total":96636764160,"available":95191433216,"internally_reserved":0,"allocated":1127792640,"data_stored":1126962936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":317520328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542186,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":392700,"kb_used_data":311596,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":93979140,"statfs":{"total":96636764160,"available":96234639360,"internally_reserved":0,"allocated":319074304,"data_stored":318763328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":83032518},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542187,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1350660,"kb_used_data":1004532,"kb_used_omap":1,"kb_used_meta":346110,"kb_avail":93021180,"statfs":{"total":96636764160,"available":95253688320,"internally_reserved":0,"allocated":1028640768,"data_stored":1027803732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":354417094},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574890,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1451188,"kb_used_data":1123108,"kb_used_omap":1,"kb_used_meta":328062,"kb_avail":92920652,"statfs":{"total":96636764160,"available":95150747648,"internally_reserved":0,"allocated":1150062592,"data_stored":1149143280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":335935947},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574890,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":825112,"kb_used_data":637128,"kb_used_omap":1,"kb_used_meta":187966,"kb_avail":93546728,"statfs":{"total":96636764160,"available":95791849472,"internally_reserved":0,"allocated":652419072,"data_stored":651963839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":192477638},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1027870720,"data_stored":1027192144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":652177408,"data_stored":651881160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":318836736,"data_stored":318680668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1127555072,"data_stored":1126880276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1396514816,"data_stored":1395683376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1086279680,"data_stored":1085599564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":341766144,"data_stored":341577352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1149292544,"data_stored":1148531692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T23:27:13.466 DEBUG:teuthology.orchestra.run.trial093:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-22T23:27:13.532 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.529+0000 7f36e1af1640 1 Processor -- start 2026-02-22T23:27:13.532 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.529+0000 7f36e1af1640 1 -- start start 2026-02-22T23:27:13.537 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.529+0000 7f36e1af1640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36dc06e3c0 con 0x7f36dc149170 2026-02-22T23:27:13.537 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.529+0000 7f36e1af1640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36dc072d50 con 0x7f36dc0744d0 2026-02-22T23:27:13.537 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.529+0000 7f36e1af1640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36dc0ab320 con 0x7f36dc06dfe0 2026-02-22T23:27:13.537 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.529+0000 7f36db7fe640 1 --1- >> v1:10.20.193.93:6790/0 conn(0x7f36dc06dfe0 0x7f36dc071f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.93:6790/0 says I am v1:10.20.193.93:41492/0 (socket says 10.20.193.93:41492) 2026-02-22T23:27:13.537 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.529+0000 7f36db7fe640 1 -- 10.20.193.93:0/4109962077 learned_addr learned my addr 10.20.193.93:0/4109962077 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:27:13.538 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.530+0000 7f36da7fc640 1 -- 10.20.193.93:0/4109962077 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1654375354 0 0) 0x7f36dc0ab320 con 0x7f36dc06dfe0 2026-02-22T23:27:13.538 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.530+0000 7f36da7fc640 1 -- 10.20.193.93:0/4109962077 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36c0003620 con 0x7f36dc06dfe0 2026-02-22T23:27:13.538 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.530+0000 7f36da7fc640 1 -- 10.20.193.93:0/4109962077 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1792687267 0 0) 0x7f36dc06e3c0 con 0x7f36dc149170 2026-02-22T23:27:13.538 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.530+0000 7f36da7fc640 1 -- 10.20.193.93:0/4109962077 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36dc0ab320 con 0x7f36dc149170 2026-02-22T23:27:13.538 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.530+0000 7f36da7fc640 1 -- 10.20.193.93:0/4109962077 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1307303972 0 0) 0x7f36dc0ab320 con 0x7f36dc149170 2026-02-22T23:27:13.538 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.530+0000 7f36da7fc640 1 -- 10.20.193.93:0/4109962077 >> v1:10.20.193.93:6790/0 conn(0x7f36dc06dfe0 legacy=0x7f36dc071f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:27:13.538 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.530+0000 7f36da7fc640 1 -- 10.20.193.93:0/4109962077 >> v1:10.20.193.155:6789/0 conn(0x7f36dc0744d0 legacy=0x7f36dc072640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:27:13.538 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.530+0000 7f36da7fc640 1 -- 10.20.193.93:0/4109962077 --> v1:10.20.193.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36dc0ab600 con 0x7f36dc149170 2026-02-22T23:27:13.538 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.530+0000 7f36da7fc640 1 -- 10.20.193.93:0/4109962077 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f36d0003200 con 0x7f36dc149170 2026-02-22T23:27:13.538 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.530+0000 7f36da7fc640 1 -- 10.20.193.93:0/4109962077 <== mon.0 v1:10.20.193.93:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f36d00033a0 con 0x7f36dc149170 2026-02-22T23:27:13.538 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.530+0000 7f36da7fc640 1 -- 10.20.193.93:0/4109962077 <== mon.0 v1:10.20.193.93:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f36d00037b0 con 0x7f36dc149170 2026-02-22T23:27:13.539 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.530+0000 7f36e1af1640 1 -- 10.20.193.93:0/4109962077 >> v1:10.20.193.93:6789/0 conn(0x7f36dc149170 legacy=0x7f36dc14b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:27:13.539 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.530+0000 7f36e1af1640 1 -- 10.20.193.93:0/4109962077 shutdown_connections 2026-02-22T23:27:13.539 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.530+0000 7f36e1af1640 1 -- 10.20.193.93:0/4109962077 >> 10.20.193.93:0/4109962077 conn(0x7f36dc0b2e70 msgr2=0x7f36dc06d480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:27:13.539 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.530+0000 7f36e1af1640 1 -- 10.20.193.93:0/4109962077 shutdown_connections 2026-02-22T23:27:13.539 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.530+0000 7f36e1af1640 1 -- 10.20.193.93:0/4109962077 wait complete. 2026-02-22T23:27:13.539 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.531+0000 7f36e1af1640 1 Processor -- start 2026-02-22T23:27:13.539 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.531+0000 7f36e1af1640 1 -- start start 2026-02-22T23:27:13.539 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.531+0000 7f36e1af1640 1 -- --> v1:10.20.193.93:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36dc1391d0 con 0x7f36dc06dfe0 2026-02-22T23:27:13.539 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.531+0000 7f36e1af1640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36dc1378f0 con 0x7f36dc149170 2026-02-22T23:27:13.539 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.531+0000 7f36e1af1640 1 -- --> v1:10.20.193.93:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36dc137bd0 con 0x7f36dc0744d0 2026-02-22T23:27:13.539 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.531+0000 7f36db7fe640 1 --1- >> v1:10.20.193.93:6789/0 conn(0x7f36dc06dfe0 0x7f36dc14bf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.93:6789/0 says I am v1:10.20.193.93:60838/0 (socket says 10.20.193.93:60838) 2026-02-22T23:27:13.539 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.531+0000 7f36db7fe640 1 -- 10.20.193.93:0/3523081271 learned_addr learned my addr 10.20.193.93:0/3523081271 (peer_addr_for_me v1:10.20.193.93:0/0) 2026-02-22T23:27:13.540 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.531+0000 7f36b7fff640 1 -- 10.20.193.93:0/3523081271 <== mon.2 v1:10.20.193.93:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4165468506 0 0) 0x7f36dc137bd0 con 0x7f36dc0744d0 2026-02-22T23:27:13.540 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.531+0000 7f36b7fff640 1 -- 10.20.193.93:0/3523081271 --> v1:10.20.193.93:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36ac003620 con 0x7f36dc0744d0 2026-02-22T23:27:13.540 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.531+0000 7f36b7fff640 1 -- 10.20.193.93:0/3523081271 <== mon.0 v1:10.20.193.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2812233565 0 0) 0x7f36dc1391d0 con 0x7f36dc06dfe0 2026-02-22T23:27:13.540 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.531+0000 7f36b7fff640 1 -- 10.20.193.93:0/3523081271 --> v1:10.20.193.93:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36dc137bd0 con 0x7f36dc06dfe0 2026-02-22T23:27:13.540 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.531+0000 7f36b7fff640 1 -- 10.20.193.93:0/3523081271 <== mon.2 v1:10.20.193.93:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1795393008 0 0) 0x7f36ac003620 con 0x7f36dc0744d0 2026-02-22T23:27:13.540 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.531+0000 7f36b7fff640 1 -- 10.20.193.93:0/3523081271 --> v1:10.20.193.93:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f36dc1391d0 con 0x7f36dc0744d0 2026-02-22T23:27:13.540 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.531+0000 7f36b7fff640 1 -- 10.20.193.93:0/3523081271 <== mon.2 v1:10.20.193.93:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f36cc003140 con 0x7f36dc0744d0 2026-02-22T23:27:13.540 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.531+0000 7f36b7fff640 1 -- 10.20.193.93:0/3523081271 <== mon.0 v1:10.20.193.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4025707906 0 0) 0x7f36dc137bd0 con 0x7f36dc06dfe0 2026-02-22T23:27:13.540 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.531+0000 7f36b7fff640 1 -- 10.20.193.93:0/3523081271 --> v1:10.20.193.93:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f36ac003620 con 0x7f36dc06dfe0 2026-02-22T23:27:13.540 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.531+0000 7f36b7fff640 1 -- 10.20.193.93:0/3523081271 <== mon.0 v1:10.20.193.93:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f36c8002b20 con 0x7f36dc06dfe0 2026-02-22T23:27:13.540 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.531+0000 7f36b7fff640 1 -- 10.20.193.93:0/3523081271 <== mon.2 v1:10.20.193.93:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1073961927 0 0) 0x7f36dc1391d0 con 0x7f36dc0744d0 2026-02-22T23:27:13.540 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.531+0000 7f36b7fff640 1 -- 10.20.193.93:0/3523081271 >> v1:10.20.193.155:6789/0 conn(0x7f36dc149170 legacy=0x7f36dc138ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:27:13.541 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.531+0000 7f36b7fff640 1 -- 10.20.193.93:0/3523081271 >> v1:10.20.193.93:6789/0 conn(0x7f36dc06dfe0 legacy=0x7f36dc14bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:27:13.541 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.531+0000 7f36b7fff640 1 -- 10.20.193.93:0/3523081271 --> v1:10.20.193.93:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36dc135290 con 0x7f36dc0744d0 2026-02-22T23:27:13.541 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.532+0000 7f36e1af1640 1 -- 10.20.193.93:0/3523081271 --> v1:10.20.193.93:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f36dc14bb60 con 0x7f36dc0744d0 2026-02-22T23:27:13.541 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.532+0000 7f36e1af1640 1 -- 10.20.193.93:0/3523081271 --> v1:10.20.193.93:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f36dc135ad0 con 0x7f36dc0744d0 2026-02-22T23:27:13.541 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.532+0000 7f36b7fff640 1 -- 10.20.193.93:0/3523081271 <== mon.2 v1:10.20.193.93:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f36cc003360 con 0x7f36dc0744d0 2026-02-22T23:27:13.541 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.532+0000 7f36b7fff640 1 -- 10.20.193.93:0/3523081271 <== mon.2 v1:10.20.193.93:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 615438498 0 0) 0x7f36cc003770 con 0x7f36dc0744d0 2026-02-22T23:27:13.541 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.532+0000 7f36e1af1640 1 -- 10.20.193.93:0/3523081271 --> v1:10.20.193.93:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36dc135520 con 0x7f36dc0744d0 2026-02-22T23:27:13.541 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.533+0000 7f36b7fff640 1 -- 10.20.193.93:0/3523081271 <== mon.2 v1:10.20.193.93:6790/0 7 ==== mgrmap(e 5) ==== 99866+0+0 (unknown 3760389810 0 0) 0x7f36cc003990 con 0x7f36dc0744d0 2026-02-22T23:27:13.541 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.533+0000 7f36b7fff640 1 -- 10.20.193.93:0/3523081271 <== mon.2 v1:10.20.193.93:6790/0 8 ==== osd_map(25..25 src has 1..25) ==== 4521+0+0 (unknown 3458299925 0 0) 0x7f36cc0932d0 con 0x7f36dc0744d0 2026-02-22T23:27:13.542 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.535+0000 7f36b7fff640 1 -- 10.20.193.93:0/3523081271 <== mon.2 v1:10.20.193.93:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (unknown 1092875540 0 2568732696) 0x7f36cc05c950 con 0x7f36dc0744d0 2026-02-22T23:27:13.620 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.617+0000 7f36e1af1640 1 -- 10.20.193.93:0/3523081271 --> v1:10.20.193.93:6790/0 -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f36dc069810 con 0x7f36dc0744d0 2026-02-22T23:27:13.623 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.620+0000 7f36b7fff640 1 -- 10.20.193.93:0/3523081271 <== mon.2 v1:10.20.193.93:6790/0 10 ==== config(1 keys) ==== 35+0+0 (unknown 2555425225 0 0) 0x7f36cc05c250 con 0x7f36dc0744d0 2026-02-22T23:27:13.623 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.620+0000 7f36b7fff640 1 -- 10.20.193.93:0/3523081271 <== mon.2 v1:10.20.193.93:6790/0 11 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v2)=0 v2) ==== 123+0+0 (unknown 691139944 0 0) 0x7f36cc060600 con 0x7f36dc0744d0 2026-02-22T23:27:13.624 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.621+0000 7f36e1af1640 1 -- 10.20.193.93:0/3523081271 >> v1:10.20.193.155:6800/3108481844 conn(0x7f36ac078030 legacy=0x7f36ac07a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:27:13.625 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.621+0000 7f36e1af1640 1 -- 10.20.193.93:0/3523081271 >> v1:10.20.193.93:6790/0 conn(0x7f36dc0744d0 legacy=0x7f36dc1383b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T23:27:13.625 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.621+0000 7f36e1af1640 1 -- 10.20.193.93:0/3523081271 shutdown_connections 2026-02-22T23:27:13.625 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.621+0000 7f36e1af1640 1 -- 10.20.193.93:0/3523081271 >> 10.20.193.93:0/3523081271 conn(0x7f36dc0b2e70 msgr2=0x7f36dc0b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T23:27:13.625 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.621+0000 7f36e1af1640 1 -- 10.20.193.93:0/3523081271 shutdown_connections 2026-02-22T23:27:13.625 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-22T23:27:13.621+0000 7f36e1af1640 1 -- 10.20.193.93:0/3523081271 wait complete. 2026-02-22T23:27:13.632 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-22T23:27:13.632 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-22T23:27:13.633 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-22T23:27:13.633 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T23:27:13.685 INFO:tasks.ceph.osd.0:Stopped 2026-02-22T23:27:13.685 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-22T23:27:13.685 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T23:27:13.736 INFO:tasks.ceph.osd.1:Stopped 2026-02-22T23:27:13.737 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-22T23:27:13.737 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T23:27:13.779 INFO:tasks.ceph.osd.2:Stopped 2026-02-22T23:27:13.779 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-22T23:27:13.779 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T23:27:13.824 INFO:tasks.ceph.osd.3:Stopped 2026-02-22T23:27:13.825 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2026-02-22T23:27:13.825 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T23:27:13.894 INFO:tasks.ceph.osd.4:Stopped 2026-02-22T23:27:13.894 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2026-02-22T23:27:13.894 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T23:27:13.956 INFO:tasks.ceph.osd.5:Stopped 2026-02-22T23:27:13.957 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2026-02-22T23:27:13.957 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T23:27:14.000 INFO:tasks.ceph.osd.6:Stopped 2026-02-22T23:27:14.001 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2026-02-22T23:27:14.001 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T23:27:14.052 INFO:tasks.ceph.osd.7:Stopped 2026-02-22T23:27:14.053 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-22T23:27:14.053 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2026-02-22T23:27:14.053 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T23:27:14.082 INFO:tasks.ceph.mgr.y:Stopped 2026-02-22T23:27:14.082 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-22T23:27:14.082 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T23:27:14.113 INFO:tasks.ceph.mgr.x:Stopped 2026-02-22T23:27:14.113 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-22T23:27:14.113 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-22T23:27:14.113 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T23:27:14.131 INFO:tasks.ceph.mon.a:Stopped 2026-02-22T23:27:14.132 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-22T23:27:14.132 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T23:27:14.181 INFO:tasks.ceph.mon.c:Stopped 2026-02-22T23:27:14.181 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-22T23:27:14.181 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T23:27:14.190 INFO:tasks.ceph.mon.b:Stopped 2026-02-22T23:27:14.191 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-22T23:27:14.191 DEBUG:teuthology.orchestra.run.trial093:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | head -n 1 2026-02-22T23:27:14.249 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial093.front.sepia.ceph.com 2026-02-22T23:27:14.249 DEBUG:teuthology.orchestra.run.trial093:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-22T23:27:14.334 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial093.front.sepia.ceph.com 2026-02-22T23:27:14.334 DEBUG:teuthology.orchestra.run.trial093:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-22T23:27:14.371 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial093.front.sepia.ceph.com 2026-02-22T23:27:14.371 DEBUG:teuthology.orchestra.run.trial093:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-22T23:27:14.443 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@trial093.front.sepia.ceph.com 2026-02-22T23:27:14.444 DEBUG:teuthology.orchestra.run.trial093:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2026-02-22T23:27:14.528 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@trial155.front.sepia.ceph.com 2026-02-22T23:27:14.528 DEBUG:teuthology.orchestra.run.trial155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2026-02-22T23:27:14.583 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@trial155.front.sepia.ceph.com 2026-02-22T23:27:14.584 DEBUG:teuthology.orchestra.run.trial155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2026-02-22T23:27:14.627 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@trial155.front.sepia.ceph.com 2026-02-22T23:27:14.627 DEBUG:teuthology.orchestra.run.trial155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2026-02-22T23:27:14.699 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@trial155.front.sepia.ceph.com 2026-02-22T23:27:14.699 DEBUG:teuthology.orchestra.run.trial155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2026-02-22T23:27:14.782 INFO:tasks.ceph:Archiving mon data... 2026-02-22T23:27:14.784 DEBUG:teuthology.misc:Transferring archived files from trial093:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64383/data/mon.a.tgz 2026-02-22T23:27:14.784 DEBUG:teuthology.orchestra.run.trial093:> mktemp 2026-02-22T23:27:14.801 INFO:teuthology.orchestra.run.trial093.stdout:/tmp/tmp.BrRwUmcJAT 2026-02-22T23:27:14.801 DEBUG:teuthology.orchestra.run.trial093:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.BrRwUmcJAT 2026-02-22T23:27:14.897 DEBUG:teuthology.orchestra.run.trial093:> sudo chmod 0666 /tmp/tmp.BrRwUmcJAT 2026-02-22T23:27:14.978 DEBUG:teuthology.orchestra.remote:trial093:/tmp/tmp.BrRwUmcJAT is 278KB 2026-02-22T23:27:15.044 DEBUG:teuthology.orchestra.run.trial093:> rm -fr /tmp/tmp.BrRwUmcJAT 2026-02-22T23:27:15.060 DEBUG:teuthology.misc:Transferring archived files from trial093:/var/lib/ceph/mon/ceph-c to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64383/data/mon.c.tgz 2026-02-22T23:27:15.060 DEBUG:teuthology.orchestra.run.trial093:> mktemp 2026-02-22T23:27:15.117 INFO:teuthology.orchestra.run.trial093.stdout:/tmp/tmp.kGtmVRhy7b 2026-02-22T23:27:15.117 DEBUG:teuthology.orchestra.run.trial093:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.kGtmVRhy7b 2026-02-22T23:27:15.210 DEBUG:teuthology.orchestra.run.trial093:> sudo chmod 0666 /tmp/tmp.kGtmVRhy7b 2026-02-22T23:27:15.289 DEBUG:teuthology.orchestra.remote:trial093:/tmp/tmp.kGtmVRhy7b is 278KB 2026-02-22T23:27:15.354 DEBUG:teuthology.orchestra.run.trial093:> rm -fr /tmp/tmp.kGtmVRhy7b 2026-02-22T23:27:15.371 DEBUG:teuthology.misc:Transferring archived files from trial155:/var/lib/ceph/mon/ceph-b to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64383/data/mon.b.tgz 2026-02-22T23:27:15.372 DEBUG:teuthology.orchestra.run.trial155:> mktemp 2026-02-22T23:27:15.390 INFO:teuthology.orchestra.run.trial155.stdout:/tmp/tmp.6yFU9ESi2O 2026-02-22T23:27:15.390 DEBUG:teuthology.orchestra.run.trial155:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.6yFU9ESi2O 2026-02-22T23:27:15.486 DEBUG:teuthology.orchestra.run.trial155:> sudo chmod 0666 /tmp/tmp.6yFU9ESi2O 2026-02-22T23:27:15.569 DEBUG:teuthology.orchestra.remote:trial155:/tmp/tmp.6yFU9ESi2O is 278KB 2026-02-22T23:27:15.662 DEBUG:teuthology.orchestra.run.trial155:> rm -fr /tmp/tmp.6yFU9ESi2O 2026-02-22T23:27:15.679 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-22T23:27:15.680 DEBUG:teuthology.orchestra.run.trial093:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-22T23:27:15.682 DEBUG:teuthology.orchestra.run.trial155:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-22T23:27:15.762 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-22T23:27:15.799 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-22T23:27:15.800 INFO:tasks.ceph:Archiving crash dumps... 2026-02-22T23:27:15.802 DEBUG:teuthology.misc:Transferring archived files from trial093:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64383/remote/trial093/crash 2026-02-22T23:27:15.802 DEBUG:teuthology.orchestra.run.trial093:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-22T23:27:15.829 DEBUG:teuthology.misc:Transferring archived files from trial155:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64383/remote/trial155/crash 2026-02-22T23:27:15.830 DEBUG:teuthology.orchestra.run.trial155:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-22T23:27:15.863 INFO:tasks.ceph:Compressing logs... 2026-02-22T23:27:15.864 DEBUG:teuthology.orchestra.run.trial093:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-22T23:27:15.874 DEBUG:teuthology.orchestra.run.trial155:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-22T23:27:15.895 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-22T23:27:15.904 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49496.log 2026-02-22T23:27:15.905 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephsqlite.48541.log 2026-02-22T23:27:15.905 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.49496.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-22T23:27:15.905 INFO:teuthology.orchestra.run.trial093.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.49496.log.gz 2026-02-22T23:27:15.905 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46201.log 2026-02-22T23:27:15.905 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.libcephsqlite.48541.log: /var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47590.log 2026-02-22T23:27:15.905 INFO:teuthology.orchestra.run.trial093.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.libcephsqlite.48541.log.gz 2026-02-22T23:27:15.905 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.46201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephsqlite.48421.log 2026-02-22T23:27:15.905 INFO:teuthology.orchestra.run.trial093.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.46201.log.gz 2026-02-22T23:27:15.905 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.47590.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-22T23:27:15.905 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.libcephsqlite.48421.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.47590.log.gz 2026-02-22T23:27:15.905 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46601.log 2026-02-22T23:27:15.905 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47688.log 2026-02-22T23:27:15.905 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.46601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephsqlite.48522.log 2026-02-22T23:27:15.905 INFO:teuthology.orchestra.run.trial093.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.46601.log.gz 2026-02-22T23:27:15.905 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.47688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49055.log 2026-02-22T23:27:15.905 INFO:teuthology.orchestra.run.trial093.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.47688.log.gz 2026-02-22T23:27:15.905 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.libcephsqlite.48522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42248.log 2026-02-22T23:27:15.905 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.49055.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2026-02-22T23:27:15.905 INFO:teuthology.orchestra.run.trial093.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.49055.log.gz 2026-02-22T23:27:15.905 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.42248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49153.log 2026-02-22T23:27:15.905 INFO:teuthology.orchestra.run.trial093.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.42248.log.gz 2026-02-22T23:27:15.905 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47389.log 2026-02-22T23:27:15.905 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.49153.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2026-02-22T23:27:15.905 INFO:teuthology.orchestra.run.trial093.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.49153.log.gz 2026-02-22T23:27:15.905 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.47389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46600.log 2026-02-22T23:27:15.905 INFO:teuthology.orchestra.run.trial093.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.47389.log.gz 2026-02-22T23:27:15.905 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48810.log 2026-02-22T23:27:15.905 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.46600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47251.log 2026-02-22T23:27:15.905 INFO:teuthology.orchestra.run.trial093.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.46600.log.gz 2026-02-22T23:27:15.905 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.48810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephsqlite.48564.log 2026-02-22T23:27:15.905 INFO:teuthology.orchestra.run.trial093.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.48810.log.gz 2026-02-22T23:27:15.906 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.47251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45973.log 2026-02-22T23:27:15.906 INFO:teuthology.orchestra.run.trial093.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.47251.log.gz 2026-02-22T23:27:15.906 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.libcephsqlite.48564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49447.log 2026-02-22T23:27:15.906 INFO:teuthology.orchestra.run.trial093.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.libcephsqlite.48421.log.gz 2026-02-22T23:27:15.906 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.45973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45924.log 2026-02-22T23:27:15.906 INFO:teuthology.orchestra.run.trial093.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.45973.log.gz 2026-02-22T23:27:15.906 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42149.log 2026-02-22T23:27:15.906 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.49447.log: 92.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2026-02-22T23:27:15.906 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.45924.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.49447.log.gz 2026-02-22T23:27:15.906 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46886.log 2026-02-22T23:27:15.906 INFO:teuthology.orchestra.run.trial093.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.45924.log.gz 2026-02-22T23:27:15.906 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.42149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48761.log 2026-02-22T23:27:15.906 INFO:teuthology.orchestra.run.trial093.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.42149.log.gz 2026-02-22T23:27:15.906 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.46886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephsqlite.47832.log 2026-02-22T23:27:15.906 INFO:teuthology.orchestra.run.trial093.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.46886.log.gz 2026-02-22T23:27:15.906 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2026-02-22T23:27:15.906 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.48761.log: /var/log/ceph/ceph-client.libcephsqlite.47832.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.48761.log.gz 2026-02-22T23:27:15.906 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46887.log 2026-02-22T23:27:15.906 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48859.log 2026-02-22T23:27:15.906 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.46887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49594.log 2026-02-22T23:27:15.906 INFO:teuthology.orchestra.run.trial093.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46887.log.gz 2026-02-22T23:27:15.906 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.48859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45810.log 2026-02-22T23:27:15.906 INFO:teuthology.orchestra.run.trial093.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.48859.log.gz 2026-02-22T23:27:15.906 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.49594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49006.log 2026-02-22T23:27:15.906 INFO:teuthology.orchestra.run.trial093.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.49594.log.gz 2026-02-22T23:27:15.906 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.45810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47396.log 2026-02-22T23:27:15.906 INFO:teuthology.orchestra.run.trial093.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.45810.log.gz 2026-02-22T23:27:15.906 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.49006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48957.log 2026-02-22T23:27:15.906 INFO:teuthology.orchestra.run.trial093.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.49006.log.gz 2026-02-22T23:27:15.906 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.47396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephsqlite.48618.log 2026-02-22T23:27:15.906 INFO:teuthology.orchestra.run.trial093.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.47396.log.gz 2026-02-22T23:27:15.908 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.48957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49251.log 2026-02-22T23:27:15.908 INFO:teuthology.orchestra.run.trial093.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.48957.log.gz 2026-02-22T23:27:15.908 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.libcephsqlite.48618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46210.log 2026-02-22T23:27:15.908 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.49251.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.35454.log 2026-02-22T23:27:15.908 INFO:teuthology.orchestra.run.trial093.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.49251.log.gz 2026-02-22T23:27:15.908 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.46210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46603.log 2026-02-22T23:27:15.908 INFO:teuthology.orchestra.run.trial093.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.libcephsqlite.48618.log.gz 2026-02-22T23:27:15.908 INFO:teuthology.orchestra.run.trial093.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.46210.log.gz 2026-02-22T23:27:15.908 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph.tmp-client.admin.35454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48908.log 2026-02-22T23:27:15.908 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.35454.log.gz 2026-02-22T23:27:15.908 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.46603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47041.log 2026-02-22T23:27:15.908 INFO:teuthology.orchestra.run.trial093.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.46603.log.gz 2026-02-22T23:27:15.908 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.48908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46884.log 2026-02-22T23:27:15.908 INFO:teuthology.orchestra.run.trial093.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.48908.log.gz 2026-02-22T23:27:15.908 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.47041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46208.log 2026-02-22T23:27:15.908 INFO:teuthology.orchestra.run.trial093.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.47041.log.gz 2026-02-22T23:27:15.908 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.46884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46199.log 2026-02-22T23:27:15.908 INFO:teuthology.orchestra.run.trial093.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.46884.log.gz 2026-02-22T23:27:15.908 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.46208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47362.log 2026-02-22T23:27:15.908 INFO:teuthology.orchestra.run.trial093.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.46208.log.gz 2026-02-22T23:27:15.908 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.46199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49202.log 2026-02-22T23:27:15.908 INFO:teuthology.orchestra.run.trial093.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.46199.log.gz 2026-02-22T23:27:15.908 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.47362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47075.log 2026-02-22T23:27:15.908 INFO:teuthology.orchestra.run.trial093.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.47362.log.gz 2026-02-22T23:27:15.908 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.49202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49104.log 2026-02-22T23:27:15.909 INFO:teuthology.orchestra.run.trial093.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.49202.log.gz 2026-02-22T23:27:15.910 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.47075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47252.log 2026-02-22T23:27:15.910 INFO:teuthology.orchestra.run.trial093.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.47075.log.gz 2026-02-22T23:27:15.910 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.49104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45618.log 2026-02-22T23:27:15.910 INFO:teuthology.orchestra.run.trial093.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.49104.log.gz 2026-02-22T23:27:15.910 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.47252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47735.log 2026-02-22T23:27:15.910 INFO:teuthology.orchestra.run.trial093.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.47252.log.gz 2026-02-22T23:27:15.910 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.45618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephsqlite.48453.log 2026-02-22T23:27:15.910 INFO:teuthology.orchestra.run.trial093.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.45618.log.gz 2026-02-22T23:27:15.910 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.47735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41861.log 2026-02-22T23:27:15.910 INFO:teuthology.orchestra.run.trial093.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.47735.log.gz 2026-02-22T23:27:15.910 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.libcephsqlite.48453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46596.log 2026-02-22T23:27:15.910 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.41861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49790.log 2026-02-22T23:27:15.910 INFO:teuthology.orchestra.run.trial093.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.41861.log.gz 2026-02-22T23:27:15.910 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.46596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47423.log 2026-02-22T23:27:15.910 INFO:teuthology.orchestra.run.trial093.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.46596.log.gz 2026-02-22T23:27:15.910 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.49790.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-22T23:27:15.911 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.47423.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.49790.log.gz 2026-02-22T23:27:15.911 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47034.log 2026-02-22T23:27:15.911 INFO:teuthology.orchestra.run.trial093.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.47423.log.gz 2026-02-22T23:27:15.911 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46602.log 2026-02-22T23:27:15.911 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.47034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephsqlite.48356.log 2026-02-22T23:27:15.911 INFO:teuthology.orchestra.run.trial093.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.47034.log.gz 2026-02-22T23:27:15.911 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.46602.log: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-22T23:27:15.911 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46881.log 2026-02-22T23:27:15.911 INFO:teuthology.orchestra.run.trial093.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.46602.log.gz 2026-02-22T23:27:15.912 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.libcephsqlite.48356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49398.log 2026-02-22T23:27:15.912 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.46881.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-22T23:27:15.912 INFO:teuthology.orchestra.run.trial093.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.46881.log.gz 2026-02-22T23:27:15.912 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.49398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45785.log 2026-02-22T23:27:15.912 INFO:teuthology.orchestra.run.trial093.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.49398.log.gz 2026-02-22T23:27:15.912 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46207.log 2026-02-22T23:27:15.913 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.45785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47250.log 2026-02-22T23:27:15.913 INFO:teuthology.orchestra.run.trial093.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.libcephsqlite.48356.log.gz 2026-02-22T23:27:15.913 INFO:teuthology.orchestra.run.trial093.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.45785.log.gz 2026-02-22T23:27:15.913 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.46207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49643.log 2026-02-22T23:27:15.913 INFO:teuthology.orchestra.run.trial093.stderr: 95.4% -- replaced with /var/log/ceph/ceph-client.libcephsqlite.48522.log.gz 2026-02-22T23:27:15.913 INFO:teuthology.orchestra.run.trial093.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.46207.log.gz 2026-02-22T23:27:15.913 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.47250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46209.log 2026-02-22T23:27:15.913 INFO:teuthology.orchestra.run.trial093.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.47250.log.gz 2026-02-22T23:27:15.913 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.49643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephsqlite.48473.log 2026-02-22T23:27:15.913 INFO:teuthology.orchestra.run.trial093.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.49643.log.gz 2026-02-22T23:27:15.914 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.46209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46591.log 2026-02-22T23:27:15.914 INFO:teuthology.orchestra.run.trial093.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.46209.log.gz 2026-02-22T23:27:15.914 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.libcephsqlite.48473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephsqlite.48334.log 2026-02-22T23:27:15.914 INFO:teuthology.orchestra.run.trial093.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.libcephsqlite.48473.log.gz 2026-02-22T23:27:15.914 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.46591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47785.log 2026-02-22T23:27:15.914 INFO:teuthology.orchestra.run.trial093.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.46591.log.gz 2026-02-22T23:27:15.914 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.libcephsqlite.48334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46594.log 2026-02-22T23:27:15.915 INFO:teuthology.orchestra.run.trial093.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.libcephsqlite.48334.log.gz 2026-02-22T23:27:15.915 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.47785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45715.log 2026-02-22T23:27:15.915 INFO:teuthology.orchestra.run.trial093.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.47785.log.gz 2026-02-22T23:27:15.915 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.46594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephsqlite.48398.log 2026-02-22T23:27:15.915 INFO:teuthology.orchestra.run.trial093.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.46594.log.gz 2026-02-22T23:27:15.915 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.45715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49300.log 2026-02-22T23:27:15.915 INFO:teuthology.orchestra.run.trial093.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.45715.log.gz 2026-02-22T23:27:15.916 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.libcephsqlite.48398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephsqlite.48377.log 2026-02-22T23:27:15.916 INFO:teuthology.orchestra.run.trial093.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.libcephsqlite.48398.log.gz 2026-02-22T23:27:15.916 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.49300.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-22T23:27:15.916 INFO:teuthology.orchestra.run.trial093.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.49300.log.gz 2026-02-22T23:27:15.916 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.libcephsqlite.48377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephsqlite.48496.log 2026-02-22T23:27:15.916 INFO:teuthology.orchestra.run.trial093.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.libcephsqlite.48377.log.gz 2026-02-22T23:27:15.916 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47447.log 2026-02-22T23:27:15.917 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.libcephsqlite.48496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47038.log 2026-02-22T23:27:15.917 INFO:teuthology.orchestra.run.trial093.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.libcephsqlite.48453.log.gz 2026-02-22T23:27:15.917 INFO:teuthology.orchestra.run.trial093.stderr: 92.5% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-22T23:27:15.917 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.47447.log: 86.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.47447.log.gz 2026-02-22T23:27:15.917 INFO:teuthology.orchestra.run.trial093.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49837.log 2026-02-22T23:27:15.917 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46202.log 2026-02-22T23:27:15.918 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.47038.log: /var/log/ceph/ceph-client.admin.49837.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.47038.log.gz 2026-02-22T23:27:15.918 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47639.log 2026-02-22T23:27:15.918 INFO:teuthology.orchestra.run.trial093.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.49837.log.gz 2026-02-22T23:27:15.918 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.46202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49741.log 2026-02-22T23:27:15.918 INFO:teuthology.orchestra.run.trial093.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.46202.log.gz 2026-02-22T23:27:15.918 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.47639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49349.log 2026-02-22T23:27:15.918 INFO:teuthology.orchestra.run.trial093.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.47639.log.gz 2026-02-22T23:27:15.918 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.49741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49545.log 2026-02-22T23:27:15.918 INFO:teuthology.orchestra.run.trial093.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.49741.log.gz 2026-02-22T23:27:15.919 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.49349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46592.log 2026-02-22T23:27:15.919 INFO:teuthology.orchestra.run.trial093.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.49349.log.gz 2026-02-22T23:27:15.919 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.49545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45875.log 2026-02-22T23:27:15.919 INFO:teuthology.orchestra.run.trial093.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.49545.log.gz 2026-02-22T23:27:15.919 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.46592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46211.log 2026-02-22T23:27:15.919 INFO:teuthology.orchestra.run.trial093.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.46592.log.gz 2026-02-22T23:27:15.920 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.45875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49692.log 2026-02-22T23:27:15.920 INFO:teuthology.orchestra.run.trial093.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.45875.log.gz 2026-02-22T23:27:15.920 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.46211.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.46211.log.gz 2026-02-22T23:27:15.920 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.49692.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.49692.log.gz 2026-02-22T23:27:15.930 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41876.log 2026-02-22T23:27:15.930 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2026-02-22T23:27:15.931 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.41876.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2026-02-22T23:27:15.931 INFO:teuthology.orchestra.run.trial155.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.41876.log.gz 2026-02-22T23:27:15.931 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41829.log 2026-02-22T23:27:15.931 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41924.log 2026-02-22T23:27:15.931 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-osd.7.log: /var/log/ceph/ceph-client.admin.41829.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2026-02-22T23:27:15.931 INFO:teuthology.orchestra.run.trial155.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.41829.log.gz 2026-02-22T23:27:15.932 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.41924.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-22T23:27:15.932 INFO:teuthology.orchestra.run.trial155.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.41924.log.gz 2026-02-22T23:27:15.932 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41735.log 2026-02-22T23:27:15.932 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2026-02-22T23:27:15.933 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.41735.log: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-22T23:27:15.933 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2026-02-22T23:27:15.933 INFO:teuthology.orchestra.run.trial155.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.41735.log.gz 2026-02-22T23:27:15.933 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41641.log 2026-02-22T23:27:15.933 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-22T23:27:15.933 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.41641.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.41641.log.gz 2026-02-22T23:27:15.934 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41688.log 2026-02-22T23:27:15.934 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41782.log 2026-02-22T23:27:15.934 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.41688.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.41688.log.gz 2026-02-22T23:27:15.934 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-22T23:27:15.934 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.41782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41594.log 2026-02-22T23:27:15.934 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.41782.log.gz 2026-02-22T23:27:15.935 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.41594.log: 86.4% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-22T23:27:15.935 INFO:teuthology.orchestra.run.trial155.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.41594.log.gz 2026-02-22T23:27:15.952 INFO:teuthology.orchestra.run.trial093.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2026-02-22T23:27:15.955 INFO:teuthology.orchestra.run.trial155.stderr: 90.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-22T23:27:15.993 INFO:teuthology.orchestra.run.trial155.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2026-02-22T23:27:15.998 INFO:teuthology.orchestra.run.trial093.stderr: 89.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-22T23:27:16.785 INFO:teuthology.orchestra.run.trial093.stderr: 95.7% -- replaced with /var/log/ceph/ceph-client.libcephsqlite.48496.log.gz 2026-02-22T23:27:17.157 INFO:teuthology.orchestra.run.trial093.stderr: 95.7% -- replaced with /var/log/ceph/ceph-client.libcephsqlite.48564.log.gz 2026-02-22T23:27:17.521 INFO:teuthology.orchestra.run.trial093.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.libcephsqlite.47832.log.gz 2026-02-22T23:27:18.590 INFO:teuthology.orchestra.run.trial093.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-22T23:27:20.000 INFO:teuthology.orchestra.run.trial155.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2026-02-22T23:27:23.841 INFO:teuthology.orchestra.run.trial093.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-22T23:27:28.790 INFO:teuthology.orchestra.run.trial093.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2026-02-22T23:27:29.429 INFO:teuthology.orchestra.run.trial155.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2026-02-22T23:27:30.695 INFO:teuthology.orchestra.run.trial155.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2026-02-22T23:27:31.099 INFO:teuthology.orchestra.run.trial093.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-22T23:27:31.102 INFO:teuthology.orchestra.run.trial093.stderr: 2026-02-22T23:27:31.102 INFO:teuthology.orchestra.run.trial093.stderr:real 0m15.214s 2026-02-22T23:27:31.102 INFO:teuthology.orchestra.run.trial093.stderr:user 0m40.878s 2026-02-22T23:27:31.102 INFO:teuthology.orchestra.run.trial093.stderr:sys 0m1.747s 2026-02-22T23:27:33.061 INFO:teuthology.orchestra.run.trial155.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2026-02-22T23:27:33.063 INFO:teuthology.orchestra.run.trial155.stderr: 2026-02-22T23:27:33.063 INFO:teuthology.orchestra.run.trial155.stderr:real 0m17.142s 2026-02-22T23:27:33.063 INFO:teuthology.orchestra.run.trial155.stderr:user 0m47.603s 2026-02-22T23:27:33.063 INFO:teuthology.orchestra.run.trial155.stderr:sys 0m1.867s 2026-02-22T23:27:33.063 INFO:tasks.ceph:Archiving logs... 2026-02-22T23:27:33.064 DEBUG:teuthology.misc:Transferring archived files from trial093:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64383/remote/trial093/log 2026-02-22T23:27:33.065 DEBUG:teuthology.orchestra.run.trial093:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-22T23:27:36.478 DEBUG:teuthology.misc:Transferring archived files from trial155:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64383/remote/trial155/log 2026-02-22T23:27:36.478 DEBUG:teuthology.orchestra.run.trial155:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-22T23:27:40.472 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-22T23:27:40.484 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-22T23:27:40.484 DEBUG:teuthology.orchestra.run.trial093:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-22T23:27:40.486 DEBUG:teuthology.orchestra.run.trial155:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-22T23:27:40.646 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-22T23:27:40.658 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-22T23:27:40.658 DEBUG:teuthology.orchestra.run.trial093:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-22T23:27:40.660 DEBUG:teuthology.orchestra.run.trial155:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-22T23:27:40.674 INFO:teuthology.orchestra.run.trial093.stderr:bash: line 1: ntpq: command not found 2026-02-22T23:27:40.675 INFO:teuthology.orchestra.run.trial155.stderr:bash: line 1: ntpq: command not found 2026-02-22T23:27:40.695 INFO:teuthology.orchestra.run.trial093.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-22T23:27:40.695 INFO:teuthology.orchestra.run.trial093.stdout:=============================================================================== 2026-02-22T23:27:40.695 INFO:teuthology.orchestra.run.trial093.stdout:^+ 73.185.182.209 2 6 377 64 +304us[ +304us] +/- 74ms 2026-02-22T23:27:40.695 INFO:teuthology.orchestra.run.trial093.stdout:^+ 198-23-133-146-host.colo> 3 6 377 64 -1962us[-1958us] +/- 55ms 2026-02-22T23:27:40.695 INFO:teuthology.orchestra.run.trial093.stdout:^+ 149.28.200.179.vultruser> 2 6 377 0 -1556us[-1556us] +/- 42ms 2026-02-22T23:27:40.695 INFO:teuthology.orchestra.run.trial093.stdout:^* 216.82.35.115 2 6 377 64 +1829us[+1833us] +/- 31ms 2026-02-22T23:27:40.871 INFO:teuthology.orchestra.run.trial155.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-22T23:27:40.871 INFO:teuthology.orchestra.run.trial155.stdout:=============================================================================== 2026-02-22T23:27:40.871 INFO:teuthology.orchestra.run.trial155.stdout:^+ gopher.fart.website 3 6 377 65 +21ms[ +19ms] +/- 101ms 2026-02-22T23:27:40.871 INFO:teuthology.orchestra.run.trial155.stdout:^+ ntp2.zeus.frumentum.media 2 6 377 63 -86ms[ -87ms] +/- 128ms 2026-02-22T23:27:40.871 INFO:teuthology.orchestra.run.trial155.stdout:^+ 172-233-157-223.ip.linod> 2 6 377 64 +13ms[ +12ms] +/- 126ms 2026-02-22T23:27:40.871 INFO:teuthology.orchestra.run.trial155.stdout:^* 172-234-44-141.ip.linode> 2 6 377 0 +33ms[ +32ms] +/- 96ms 2026-02-22T23:27:40.872 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-22T23:27:40.883 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-22T23:27:40.884 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-22T23:27:40.897 DEBUG:teuthology.orchestra.run.trial093:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-22T23:27:40.951 DEBUG:teuthology.orchestra.run.trial155:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-22T23:27:41.004 DEBUG:teuthology.orchestra.run.trial093:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-22T23:27:41.032 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T23:27:41.033 DEBUG:teuthology.orchestra.run.trial155:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-22T23:27:41.058 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T23:27:41.059 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-22T23:27:41.074 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-22T23:27:41.099 INFO:teuthology.task.internal:Duration was 502.392748 seconds 2026-02-22T23:27:41.099 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-22T23:27:41.120 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-22T23:27:41.121 DEBUG:teuthology.orchestra.run.trial093:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-22T23:27:41.123 DEBUG:teuthology.orchestra.run.trial155:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-22T23:27:41.158 INFO:teuthology.orchestra.run.trial093.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-22T23:27:41.159 INFO:teuthology.orchestra.run.trial155.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-22T23:27:41.429 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-22T23:27:41.430 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial093.front.sepia.ceph.com 2026-02-22T23:27:41.430 DEBUG:teuthology.orchestra.run.trial093:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-22T23:27:41.488 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial155.front.sepia.ceph.com 2026-02-22T23:27:41.489 DEBUG:teuthology.orchestra.run.trial155:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-22T23:27:41.508 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-22T23:27:41.508 DEBUG:teuthology.orchestra.run.trial093:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-22T23:27:41.531 DEBUG:teuthology.orchestra.run.trial155:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-22T23:27:41.606 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-22T23:27:41.606 DEBUG:teuthology.orchestra.run.trial093:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-22T23:27:41.608 DEBUG:teuthology.orchestra.run.trial155:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-22T23:27:41.629 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-22T23:27:41.629 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-22T23:27:41.629 INFO:teuthology.orchestra.run.trial093.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-22T23:27:41.629 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-22T23:27:41.629 INFO:teuthology.orchestra.run.trial093.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-22T23:27:41.630 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-22T23:27:41.630 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-22T23:27:41.631 INFO:teuthology.orchestra.run.trial155.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-22T23:27:41.631 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-22T23:27:41.631 INFO:teuthology.orchestra.run.trial155.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-22T23:27:41.640 INFO:teuthology.orchestra.run.trial093.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 81.8% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-22T23:27:41.641 INFO:teuthology.orchestra.run.trial155.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 81.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-22T23:27:41.643 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-22T23:27:41.660 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-22T23:27:41.660 DEBUG:teuthology.orchestra.run.trial093:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-22T23:27:41.707 DEBUG:teuthology.orchestra.run.trial155:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-22T23:27:41.732 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-22T23:27:41.749 DEBUG:teuthology.orchestra.run.trial093:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-22T23:27:41.752 DEBUG:teuthology.orchestra.run.trial155:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-22T23:27:41.776 INFO:teuthology.orchestra.run.trial093.stdout:kernel.core_pattern = core 2026-02-22T23:27:41.796 INFO:teuthology.orchestra.run.trial155.stdout:kernel.core_pattern = core 2026-02-22T23:27:41.812 DEBUG:teuthology.orchestra.run.trial093:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-22T23:27:41.848 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T23:27:41.849 DEBUG:teuthology.orchestra.run.trial155:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-22T23:27:41.868 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T23:27:41.869 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-22T23:27:41.885 INFO:teuthology.task.internal:Transferring archived files... 2026-02-22T23:27:41.886 DEBUG:teuthology.misc:Transferring archived files from trial093:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64383/remote/trial093 2026-02-22T23:27:41.887 DEBUG:teuthology.orchestra.run.trial093:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-22T23:27:41.926 DEBUG:teuthology.misc:Transferring archived files from trial155:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64383/remote/trial155 2026-02-22T23:27:41.926 DEBUG:teuthology.orchestra.run.trial155:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-22T23:27:41.961 INFO:teuthology.task.internal:Removing archive directory... 2026-02-22T23:27:41.961 DEBUG:teuthology.orchestra.run.trial093:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-22T23:27:41.964 DEBUG:teuthology.orchestra.run.trial155:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-22T23:27:42.010 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-22T23:27:42.028 INFO:teuthology.task.internal:Not uploading archives. 2026-02-22T23:27:42.028 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-22T23:27:42.044 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-22T23:27:42.045 DEBUG:teuthology.orchestra.run.trial093:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-22T23:27:42.047 DEBUG:teuthology.orchestra.run.trial155:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-22T23:27:42.062 INFO:teuthology.orchestra.run.trial093.stdout: 917572 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 22 23:27 /home/ubuntu/cephtest 2026-02-22T23:27:42.066 INFO:teuthology.orchestra.run.trial155.stdout: 917572 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 22 23:27 /home/ubuntu/cephtest 2026-02-22T23:27:42.067 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-22T23:27:42.090 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-22T23:27:42.140 INFO:teuthology.run:Summary data: description: rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} tasks/libcephsqlite} duration: 502.3927481174469 flavor: default owner: scheduled_yuriw@soko04.front.sepia.ceph.com success: true 2026-02-22T23:27:42.141 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-22T23:27:42.251 INFO:teuthology.run:pass